2024-04-19T02:02:51.557 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T02:02:51.557 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849 --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --name teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi --verbose -- /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/orig.config.yaml 2024-04-19T02:02:51.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T02:02:51.674 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662849' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 2879 sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwcwfecSzyGC5hPGahacQVnax+wnplrjmtRlmw7DSXfj7T6yz+DnwdMMf6G0ZQie6+hPU5Je3l+Jz+f0dtBxdA= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLG9zUGTA8hT9+tCZ3q3RrVHobxb9BjrLvTSGeMVSfkooSCHOtdgOJRjG828VA8xF0X6bryR6d9eItGmwqCYq3w= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuhBw/EdpIy2B3Nfk17PzhA9OJsVDFG+dLfXsBkkvytCpMxUGGPurSl0/eiVLIKsp2jivdHi9HBbdbJMl/CBE4= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNXW0Xmx78FVWO+2ORX21NUVzfA5eLC5aXxrZ/UqiRJBOMGTElHwsqdVgfpngYi1ABH9+F1Ul31mS5d+VLZ2JX8= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-19T02:02:51.674 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-19T02:02:51.675 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-19T02:02:51.675 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-19T02:02:51.676 INFO:teuthology.task.internal:Checking packages... 2024-04-19T02:02:51.700 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '646b8c7d293d8ec31a40c69f7b3237b19c1be24d' 2024-04-19T02:02:51.700 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-19T02:02:51.700 INFO:teuthology.packaging:ref: None 2024-04-19T02:02:51.700 INFO:teuthology.packaging:tag: None 2024-04-19T02:02:51.700 INFO:teuthology.packaging:branch: reef 2024-04-19T02:02:51.700 INFO:teuthology.packaging:sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:02:51.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-04-19T02:02:51.950 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:02:51.952 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-19T02:02:51.959 INFO:teuthology.task.internal:no buildpackages task found 2024-04-19T02:02:51.959 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-19T02:02:52.004 INFO:teuthology.task.internal:Saving configuration 2024-04-19T02:02:52.016 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-19T02:02:52.029 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T02:02:52.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:07.147833', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKYj8fZ09KoXvf3snr1R6o0ZBvIPP5zI2UlhXQUgNe9n'} 2024-04-19T02:02:52.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:07.146339', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOJOCKHklka9D78zLpJ3CTISdzrrNa1ObiWlAtiENfYS'} 2024-04-19T02:02:52.099 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:07.145028', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDfmLWcnh/Y3TvQTGxEqvdQTr2Lc6WCIss/rOWRkgRvt'} 2024-04-19T02:02:52.117 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:07.143620', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGGb8HzF1ug0fZ4StLqHyo2JCqFs2UEH/Ak75Y0erLM6'} 2024-04-19T02:02:52.118 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-19T02:02:52.124 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-19T02:02:52.124 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['osd.0'] 2024-04-19T02:02:52.124 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['osd.1'] 2024-04-19T02:02:52.124 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['osd.2'] 2024-04-19T02:02:52.124 INFO:teuthology.run_tasks:Running task console_log... 2024-04-19T02:02:52.258 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f392b9f0280>, signals=[15]) 2024-04-19T02:02:52.258 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-19T02:02:52.265 INFO:teuthology.task.internal:Opening connections... 2024-04-19T02:02:52.265 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-04-19T02:02:52.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:02:52.350 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-04-19T02:02:52.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:02:52.429 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:02:52.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:02:52.506 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-04-19T02:02:52.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:02:52.586 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-19T02:02:52.592 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-04-19T02:02:52.598 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-04-19T02:02:52.599 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:02:52.646 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:02:52.647 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:02:52.647 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2024-04-19T02:02:52.647 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-19T02:02:52.667 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-04-19T02:02:52.672 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-04-19T02:02:52.673 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-04-19T02:02:52.718 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T02:02:52.718 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04" 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:02:52.719 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy 2024-04-19T02:02:52.719 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-04-19T02:02:52.741 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-04-19T02:02:52.747 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-04-19T02:02:52.747 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:02:52.795 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy 2024-04-19T02:02:52.796 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-19T02:02:52.816 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-04-19T02:02:52.822 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-04-19T02:02:52.822 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:02:52.868 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:02:52.869 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:02:52.869 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-04-19T02:02:52.869 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-19T02:02:52.912 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-19T02:02:52.922 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-19T02:02:52.969 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-19T02:02:52.970 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:02:52.972 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:02:52.975 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:02:52.977 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:02:52.982 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-19T02:02:52.996 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-19T02:02:52.996 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:02:53.019 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:02:53.021 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:02:53.024 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:02:53.125 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-19T02:02:53.212 INFO:teuthology.run_tasks:Running task kernel... 2024-04-19T02:02:53.225 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-19T02:02:53.225 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-19T02:02:53.226 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:02:53.227 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:02:53.227 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:02:53.228 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:02:53.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:02:53.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:02:53.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:02:53.235 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-19T02:02:53.235 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-19T02:02:53.235 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-04-19T02:02:53.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:02:53.236 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-19T02:02:53.279 INFO:teuthology.orchestra.run.smithi116.stdout:5.15.0-56-generic 2024-04-19T02:02:53.280 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.15.0-56-generic 2024-04-19T02:02:53.280 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get clean 2024-04-19T02:02:53.282 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2024-04-19T02:02:53.282 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.15.0-56-generic 2024-04-19T02:02:53.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-04-19T02:02:53.283 INFO:teuthology.orchestra.run.smithi136.stdout:5.15.0-56-generic 2024-04-19T02:02:53.284 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.15.0-56-generic 2024-04-19T02:02:53.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2024-04-19T02:02:53.285 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-56-generic 2024-04-19T02:02:53.285 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.15.0-56-generic 2024-04-19T02:02:53.285 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-04-19T02:02:53.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-19T02:02:53.414 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-04-19T02:02:53.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-19T02:02:53.445 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-04-19T02:02:53.584 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-19T02:02:53.591 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-19T02:02:53.601 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-19T02:02:53.688 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:02:53.769 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-19T02:02:53.806 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-19T02:02:53.817 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,351 kB] 2024-04-19T02:02:53.817 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-19T02:02:53.929 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,351 kB] 2024-04-19T02:02:53.938 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,351 kB] 2024-04-19T02:02:54.027 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-19T02:02:54.041 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [238 kB] 2024-04-19T02:02:54.048 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-19T02:02:54.049 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-19T02:02:54.050 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,680 kB] 2024-04-19T02:02:54.070 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [238 kB] 2024-04-19T02:02:54.077 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [238 kB] 2024-04-19T02:02:54.101 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-19T02:02:54.102 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,680 kB] 2024-04-19T02:02:54.125 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:02:54.130 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-19T02:02:54.131 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-19T02:02:54.131 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,680 kB] 2024-04-19T02:02:54.132 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-19T02:02:54.139 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [281 kB] 2024-04-19T02:02:54.146 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:54.146 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-19T02:02:54.156 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:02:54.157 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-19T02:02:54.166 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-19T02:02:54.171 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-19T02:02:54.171 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:11 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:02:54.186 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-19T02:02:54.199 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-19T02:02:54.203 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-19T02:02:54.213 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [281 kB] 2024-04-19T02:02:54.217 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:54.217 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-19T02:02:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-19T02:02:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-19T02:02:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-19T02:02:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-19T02:02:54.231 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-19T02:02:54.232 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [281 kB] 2024-04-19T02:02:54.246 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:54.246 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-19T02:02:54.253 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-19T02:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-19T02:02:54.264 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-19T02:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-19T02:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-19T02:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-19T02:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-19T02:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-19T02:02:54.275 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-19T02:02:54.289 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-19T02:02:54.314 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-19T02:02:54.317 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-19T02:02:54.328 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-19T02:02:54.337 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-19T02:02:54.338 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-19T02:02:54.338 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-19T02:02:54.340 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-19T02:02:54.342 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-19T02:02:54.384 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-19T02:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-19T02:02:54.462 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-19T02:02:54.471 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-19T02:02:54.531 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,351 kB] 2024-04-19T02:02:54.549 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-19T02:02:54.568 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-19T02:02:54.576 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-19T02:02:54.576 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-19T02:02:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-19T02:02:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-19T02:02:54.620 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-19T02:02:54.627 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-19T02:02:54.635 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-19T02:02:54.637 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-19T02:02:54.697 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-19T02:02:54.699 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-19T02:02:54.706 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:54.706 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-19T02:02:54.720 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:54.720 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-19T02:02:54.732 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-19T02:02:54.750 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-19T02:02:54.754 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-19T02:02:54.755 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-19T02:02:54.755 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-19T02:02:54.756 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-19T02:02:54.757 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-19T02:02:54.763 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [238 kB] 2024-04-19T02:02:54.768 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-19T02:02:54.768 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,680 kB] 2024-04-19T02:02:54.781 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-19T02:02:54.790 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-19T02:02:54.791 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-19T02:02:54.793 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-19T02:02:54.793 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-19T02:02:54.793 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-19T02:02:54.794 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-19T02:02:54.795 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-19T02:02:54.798 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-19T02:02:54.834 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-19T02:02:54.835 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-19T02:02:54.835 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-19T02:02:54.842 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-19T02:02:54.871 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-19T02:02:54.998 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-19T02:02:55.003 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-19T02:02:55.009 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [281 kB] 2024-04-19T02:02:55.019 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:55.020 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-19T02:02:55.022 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:55.023 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-19T02:02:55.035 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-19T02:02:55.051 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-19T02:02:55.075 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-19T02:02:55.076 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-19T02:02:55.081 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-19T02:02:55.081 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-19T02:02:55.082 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-19T02:02:55.084 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-19T02:02:55.084 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-19T02:02:55.093 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-19T02:02:55.095 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-19T02:02:55.096 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-19T02:02:55.135 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-19T02:02:55.136 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-19T02:02:55.136 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-19T02:02:55.137 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-19T02:02:55.138 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-19T02:02:55.138 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-19T02:02:55.138 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-19T02:02:55.138 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-19T02:02:55.139 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-19T02:02:55.140 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-19T02:02:55.456 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-19T02:02:55.567 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-19T02:02:55.588 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-19T02:02:55.589 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-19T02:02:55.589 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-19T02:02:55.593 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-19T02:02:55.593 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-19T02:02:55.594 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-19T02:02:55.597 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-19T02:02:55.602 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-19T02:02:55.767 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-19T02:02:55.849 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-19T02:02:55.957 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-19T02:02:56.015 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-19T02:02:56.049 INFO:teuthology.orchestra.run.smithi116.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-19T02:02:56.077 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-19T02:02:56.273 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-19T02:02:56.350 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-19T02:02:56.353 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-19T02:02:56.362 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-19T02:02:56.678 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-19T02:02:56.717 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T02:02:56.883 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-19T02:02:58.073 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-19T02:02:58.853 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-19T02:02:58.975 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-19T02:02:58.985 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-19T02:02:59.004 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-19T02:02:59.006 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-19T02:02:59.010 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-19T02:02:59.011 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-19T02:02:59.036 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-19T02:02:59.063 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-19T02:02:59.232 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-19T02:02:59.315 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-19T02:02:59.397 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-19T02:02:59.478 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-19T02:02:59.508 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-19T02:02:59.743 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 13.0 MB in 2s (6,560 kB/s) 2024-04-19T02:03:00.440 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 13.0 MB in 3s (5,122 kB/s) 2024-04-19T02:03:00.450 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 13.0 MB in 3s (5,009 kB/s) 2024-04-19T02:03:01.169 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-19T02:03:01.185 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:03:01.237 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-19T02:03:01.414 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-19T02:03:01.415 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-19T02:03:01.570 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:03:01.570 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:03:01.570 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:03:01.570 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:03:01.570 INFO:teuthology.orchestra.run.smithi169.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-19T02:03:01.571 INFO:teuthology.orchestra.run.smithi169.stdout: python2.7-minimal 2024-04-19T02:03:01.571 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:03:01.571 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-19T02:03:01.571 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:01.572 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-19T02:03:01.572 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:01.573 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-19T02:03:01.573 INFO:teuthology.orchestra.run.smithi169.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-19T02:03:01.573 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-04-19T02:03:01.573 INFO:teuthology.orchestra.run.smithi169.stdout: thermald 2024-04-19T02:03:01.616 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-19T02:03:01.616 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:01.616 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-19T02:03:01.616 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:01.617 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-04-19T02:03:01.618 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:03:01.797 INFO:teuthology.orchestra.run.smithi169.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:03:01.797 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 113 MB of archives. 2024-04-19T02:03:01.798 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-19T02:03:01.798 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-19T02:03:01.811 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-19T02:03:01.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:03:01.857 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-19T02:03:01.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:03:01.888 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-19T02:03:01.937 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-19T02:03:02.089 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-19T02:03:02.089 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-19T02:03:02.115 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-04-19T02:03:02.115 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-04-19T02:03:02.264 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:03:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:03:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:03:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:03:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-19T02:03:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: python2.7-minimal 2024-04-19T02:03:02.265 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:03:02.266 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-04-19T02:03:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-19T02:03:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:02.268 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-04-19T02:03:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-19T02:03:02.268 INFO:teuthology.orchestra.run.smithi116.stdout:Recommended packages: 2024-04-19T02:03:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: thermald 2024-04-19T02:03:02.270 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:03:02.270 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:03:02.270 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:03:02.271 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:03:02.271 INFO:teuthology.orchestra.run.smithi136.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-19T02:03:02.271 INFO:teuthology.orchestra.run.smithi136.stdout: python2.7-minimal 2024-04-19T02:03:02.271 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:03:02.272 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2024-04-19T02:03:02.272 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:02.272 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-19T02:03:02.273 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:02.274 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2024-04-19T02:03:02.274 INFO:teuthology.orchestra.run.smithi136.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-19T02:03:02.274 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2024-04-19T02:03:02.274 INFO:teuthology.orchestra.run.smithi136.stdout: thermald 2024-04-19T02:03:02.308 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-19T02:03:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-19T02:03:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:02.310 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages will be upgraded: 2024-04-19T02:03:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:03:02.326 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2024-04-19T02:03:02.326 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:02.326 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-19T02:03:02.326 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:02.326 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2024-04-19T02:03:02.326 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:03:02.505 INFO:teuthology.orchestra.run.smithi136.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:03:02.505 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 113 MB of archives. 2024-04-19T02:03:02.505 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-19T02:03:02.505 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-19T02:03:03.773 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 13.0 MB in 6s (2,163 kB/s) 2024-04-19T02:03:04.689 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-19T02:03:05.129 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-19T02:03:05.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:03:05.205 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-19T02:03:05.406 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-19T02:03:05.406 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-19T02:03:05.580 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:03:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:03:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:03:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:03:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-19T02:03:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: python2.7-minimal 2024-04-19T02:03:05.581 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:03:05.582 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-19T02:03:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-19T02:03:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:05.583 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-19T02:03:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-19T02:03:05.584 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-04-19T02:03:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2024-04-19T02:03:05.634 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-19T02:03:05.634 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T02:03:05.634 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-19T02:03:05.634 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-19T02:03:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-04-19T02:03:05.636 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:03:05.838 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:03:05.838 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 113 MB of archives. 2024-04-19T02:03:05.838 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-19T02:03:05.838 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-19T02:03:07.253 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-19T02:03:07.609 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-19T02:03:08.270 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-19T02:03:08.939 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-19T02:03:09.852 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-19T02:03:09.852 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-19T02:03:09.852 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-19T02:03:10.135 INFO:teuthology.orchestra.run.smithi116.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:03:10.135 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 113 MB of archives. 2024-04-19T02:03:10.135 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-19T02:03:10.135 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-19T02:03:10.777 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-19T02:03:10.837 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-19T02:03:10.847 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-19T02:03:10.847 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-19T02:03:10.847 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-19T02:03:10.857 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-19T02:03:11.094 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-19T02:03:11.258 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 113 MB in 5s (21.7 MB/s) 2024-04-19T02:03:11.412 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-19T02:03:11.788 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-19T02:03:11.878 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-19T02:03:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-19T02:03:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-19T02:03:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-19T02:03:12.295 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 113 MB in 10s (11.9 MB/s) 2024-04-19T02:03:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-19T02:03:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-19T02:03:12.490 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-19T02:03:12.826 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 113 MB in 10s (11.2 MB/s) 2024-04-19T02:03:12.994 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-19T02:03:13.192 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-19T02:03:13.415 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-19T02:03:13.419 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:13.494 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:14.497 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-19T02:03:14.502 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:14.656 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:14.955 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-19T02:03:14.959 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:15.015 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:15.946 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-19T02:03:15.967 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:16.065 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-19T02:03:16.065 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-19T02:03:16.066 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:16.066 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-19T02:03:16.491 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-19T02:03:16.511 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:16.549 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:16.966 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-19T02:03:16.979 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:17.049 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-19T02:03:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:17.091 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:17.355 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:17.595 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-19T02:03:17.615 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:17.645 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:17.936 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-19T02:03:17.956 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:18.553 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-19T02:03:18.702 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-19T02:03:19.102 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 113 MB in 17s (6,634 kB/s) 2024-04-19T02:03:19.303 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-19T02:03:21.333 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-19T02:03:21.337 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:21.436 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:23.097 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:23.204 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:23.520 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:23.641 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:23.721 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-19T02:03:23.742 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:23.905 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:23.978 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-19T02:03:24.000 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-19T02:03:24.044 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:24.059 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:24.177 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:24.510 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:24.541 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-19T02:03:24.562 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:24.590 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:24.639 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:24.891 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-19T02:03:24.914 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-19T02:03:24.958 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:25.009 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:25.109 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:25.449 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:25.604 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:25.940 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-19T02:03:25.962 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-19T02:03:26.007 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:30.689 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-19T02:03:30.726 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:30.764 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:31.378 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-19T02:03:31.415 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:31.453 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:32.042 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:32.183 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:32.507 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:32.612 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:32.898 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-19T02:03:32.921 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-19T02:03:32.964 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:33.123 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-19T02:03:33.159 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:33.222 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:33.375 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:33.518 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:33.868 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:33.964 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:34.022 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:34.090 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-19T02:03:34.146 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:34.218 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:34.504 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:34.625 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:35.468 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-19T02:03:35.534 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:35.534 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:35.534 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:35.534 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:35.580 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:35.687 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:36.891 INFO:teuthology.orchestra.run.smithi116.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:36.891 INFO:teuthology.orchestra.run.smithi116.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:36.891 INFO:teuthology.orchestra.run.smithi116.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:36.891 INFO:teuthology.orchestra.run.smithi116.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:36.894 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:37.045 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:37.048 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:37.106 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:37.453 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:37.608 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:37.743 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-19T02:03:37.904 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:38.434 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:38.482 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-19T02:03:38.608 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-19T02:03:38.734 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:38.795 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:03:38.795 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:39.236 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:39.236 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:39.237 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:39.237 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:39.409 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:39.792 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-19T02:03:39.893 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-19T02:03:39.991 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-19T02:03:40.003 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:40.029 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T02:03:40.074 INFO:teuthology.orchestra.run.smithi116.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:03:40.074 INFO:teuthology.orchestra.run.smithi116.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:40.107 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:40.819 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:42.228 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-19T02:03:42.354 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-19T02:03:42.505 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:42.566 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:03:42.566 INFO:teuthology.orchestra.run.smithi136.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:42.858 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T02:03:42.987 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T02:03:43.353 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T02:03:43.467 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:43.584 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-19T02:03:43.738 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:45.063 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:45.063 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:45.063 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:45.063 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:45.207 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:46.618 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:48.043 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-19T02:03:48.169 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-19T02:03:48.287 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T02:03:48.351 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:03:48.351 INFO:teuthology.orchestra.run.smithi169.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:52.886 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:03:52.886 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:03:52.893 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:03:52.915 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2024-04-19T02:03:53.230 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:53.252 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:53.607 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:53.613 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:53.683 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:03:53.689 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:03:53.842 INFO:teuthology.orchestra.run.smithi073.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:03:53.843 INFO:teuthology.orchestra.run.smithi073.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:03:53.843 INFO:teuthology.orchestra.run.smithi073.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:03:53.895 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-04-19T02:03:54.091 INFO:teuthology.orchestra.run.smithi116.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:03:54.091 INFO:teuthology.orchestra.run.smithi116.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:03:54.102 INFO:teuthology.orchestra.run.smithi116.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:03:54.115 INFO:teuthology.orchestra.run.smithi116.stdout:Generating grub configuration file ... 2024-04-19T02:03:54.386 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-04-19T02:03:54.403 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-04-19T02:03:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.105.102 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:03:54.405 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-04-19T02:03:54.406 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-19T02:03:54.406 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:03:54.406 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:03:54.406 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-19T02:03:54.406 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:03:54.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-04-19T02:03:54.427 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:54.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-19T02:03:54.728 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:54.734 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:54.804 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:03:54.809 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:03:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:03:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:03:54.902 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:03:54.959 INFO:teuthology.orchestra.run.smithi116.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:03:54.959 INFO:teuthology.orchestra.run.smithi116.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:03:54.959 INFO:teuthology.orchestra.run.smithi116.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:03:54.984 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:03:55.035 INFO:teuthology.orchestra.run.smithi116.stdout:done 2024-04-19T02:03:55.505 DEBUG:teuthology.orchestra.run.smithi116:> dpkg -s linux-image-generic 2024-04-19T02:03:55.523 INFO:teuthology.orchestra.run.smithi116.stdout:Package: linux-image-generic 2024-04-19T02:03:55.523 INFO:teuthology.orchestra.run.smithi116.stdout:Status: install ok installed 2024-04-19T02:03:55.523 INFO:teuthology.orchestra.run.smithi116.stdout:Priority: optional 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Section: kernel 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Installed-Size: 21 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: amd64 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Source: linux-meta 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Version: 5.15.0.105.102 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Recommends: thermald 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout:Description: Generic Linux kernel image 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:03:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: available. 2024-04-19T02:03:55.525 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-19T02:03:55.525 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:03:55.525 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:03:55.525 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-19T02:03:55.525 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:03:55.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get clean 2024-04-19T02:03:55.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-04-19T02:03:55.787 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:03:55.800 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:03:55.821 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:03:55.901 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:03:56.204 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-19T02:03:56.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:03:56.276 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-19T02:03:56.469 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-19T02:03:56.470 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-19T02:03:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-19T02:03:56.629 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:03:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:03:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:03:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:03:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:03:56.630 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:03:56.630 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:03:56.668 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:03:56.670 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-04-19T02:03:56.727 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-04-19T02:03:56.728 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.105.102 2024-04-19T02:03:56.729 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:03:56.729 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:03:56.729 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-04-19T02:03:56.729 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-04-19T02:03:56.729 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:03:56.729 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-04-19T02:03:56.730 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-19T02:03:56.772 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.6MJfmGB4Th 2024-04-19T02:03:56.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6MJfmGB4Th 2024-04-19T02:03:56.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.6MJfmGB4Th 2024-04-19T02:03:56.965 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.6MJfmGB4Th is 10KB 2024-04-19T02:03:56.979 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.6MJfmGB4Th 2024-04-19T02:03:56.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:03:56.985 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:03:56.985 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:03:57.004 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:03:57.026 INFO:teuthology.orchestra.run.smithi136.stdout:Generating grub configuration file ... 2024-04-19T02:03:57.040 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:03:57.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:03:57.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:03:57.107 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-19T02:03:57.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2024-04-19T02:03:57.132 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-19T02:03:57.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:03:57.210 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-19T02:03:57.413 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-19T02:03:57.414 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:57.414 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-19T02:03:57.450 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-19T02:03:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:03:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:03:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:03:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:03:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:03:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:03:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:03:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:03:57.632 DEBUG:teuthology.orchestra.run.smithi116:> dpkg -s linux-image-generic 2024-04-19T02:03:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:Package: linux-image-generic 2024-04-19T02:03:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:Status: install ok installed 2024-04-19T02:03:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:Priority: optional 2024-04-19T02:03:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:Section: kernel 2024-04-19T02:03:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:Installed-Size: 21 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: amd64 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Source: linux-meta 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Version: 5.15.0.105.102 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Recommends: thermald 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:Description: Generic Linux kernel image 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:03:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: available. 2024-04-19T02:03:57.647 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-04-19T02:03:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.FGCO4GCigV 2024-04-19T02:03:57.694 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub/grub.cfg /tmp/tmp.FGCO4GCigV 2024-04-19T02:03:57.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.FGCO4GCigV 2024-04-19T02:03:57.778 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:57.784 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:57.849 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:03:57.856 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:03:57.870 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.FGCO4GCigV is 10KB 2024-04-19T02:03:57.883 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.FGCO4GCigV 2024-04-19T02:03:57.888 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:03:57.941 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:03:57.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:03:57.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:03:58.009 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-19T02:03:58.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo update-grub 2024-04-19T02:03:58.039 INFO:teuthology.orchestra.run.smithi136.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:03:58.039 INFO:teuthology.orchestra.run.smithi136.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:03:58.039 INFO:teuthology.orchestra.run.smithi136.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:03:58.091 INFO:teuthology.orchestra.run.smithi136.stdout:done 2024-04-19T02:03:58.317 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:03:58.317 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:03:58.319 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-04-19T02:03:58.547 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:58.554 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:58.603 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2024-04-19T02:03:58.626 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2024-04-19T02:03:58.626 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2024-04-19T02:03:58.626 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2024-04-19T02:03:58.626 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2024-04-19T02:03:58.626 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 21 2024-04-19T02:03:58.626 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.15.0.105.102 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:03:58.627 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2024-04-19T02:03:58.627 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-19T02:03:58.627 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:03:58.628 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:03:58.628 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-19T02:03:58.628 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:03:58.628 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2024-04-19T02:03:58.828 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:58.844 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-04-19T02:03:58.877 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:03:58.882 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:03:58.974 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:03:58.974 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:03:58.986 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:03:59.007 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:03:59.027 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:03:59.027 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:03:59.027 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:03:59.042 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-04-19T02:03:59.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-04-19T02:03:59.152 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:03:59.153 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:03:59.156 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-04-19T02:03:59.351 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:03:59.357 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:03:59.587 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:03:59.593 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:03:59.632 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:03:59.637 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:03:59.766 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:03:59.767 INFO:teuthology.orchestra.run.smithi116.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:03:59.767 INFO:teuthology.orchestra.run.smithi116.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:03:59.782 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-04-19T02:03:59.791 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-04-19T02:04:00.296 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-19T02:04:00.313 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:04:00.377 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-19T02:04:00.583 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-04-19T02:04:00.584 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-04-19T02:04:00.760 INFO:teuthology.orchestra.run.smithi136.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-19T02:04:00.760 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:04:00.760 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:04:00.760 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:04:00.760 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:04:00.760 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:04:00.761 INFO:teuthology.orchestra.run.smithi136.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:04:00.761 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:04:00.803 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:04:00.805 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2024-04-19T02:04:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2024-04-19T02:04:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2024-04-19T02:04:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2024-04-19T02:04:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2024-04-19T02:04:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 21 2024-04-19T02:04:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:04:00.818 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.15.0.105.102 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:04:00.819 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2024-04-19T02:04:00.819 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-04-19T02:04:00.865 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.IN0PpLBAjZ 2024-04-19T02:04:00.865 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub/grub.cfg /tmp/tmp.IN0PpLBAjZ 2024-04-19T02:04:00.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.IN0PpLBAjZ 2024-04-19T02:04:01.034 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.IN0PpLBAjZ is 10KB 2024-04-19T02:04:01.045 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.IN0PpLBAjZ 2024-04-19T02:04:01.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:04:01.105 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:04:01.105 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:04:01.105 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:04:01.167 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-19T02:04:01.168 DEBUG:teuthology.orchestra.run.smithi136:> sudo update-grub 2024-04-19T02:04:02.398 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:04:02.398 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:04:02.429 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:04:02.448 INFO:teuthology.orchestra.run.smithi169.stdout:Generating grub configuration file ... 2024-04-19T02:04:02.557 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:04:02.558 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:04:02.562 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-04-19T02:04:02.744 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:04:02.751 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:04:02.757 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:04:02.764 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:04:03.006 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:04:03.011 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:04:03.053 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:04:03.058 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:04:03.078 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:04:03.084 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:04:03.158 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:04:03.164 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:04:03.171 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:04:03.171 INFO:teuthology.orchestra.run.smithi136.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:04:03.171 INFO:teuthology.orchestra.run.smithi136.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:04:03.194 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-04-19T02:04:03.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-04-19T02:04:03.351 INFO:teuthology.orchestra.run.smithi169.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:04:03.352 INFO:teuthology.orchestra.run.smithi169.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:04:03.352 INFO:teuthology.orchestra.run.smithi169.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:04:03.401 INFO:teuthology.orchestra.run.smithi169.stdout:done 2024-04-19T02:04:03.873 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-04-19T02:04:03.893 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-04-19T02:04:03.893 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-04-19T02:04:03.893 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-04-19T02:04:03.893 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-04-19T02:04:03.893 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-04-19T02:04:03.893 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.105.102 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:04:03.894 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-04-19T02:04:03.895 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-19T02:04:03.895 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:04:03.895 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:04:03.895 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-19T02:04:03.895 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:04:03.895 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-04-19T02:04:04.046 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-19T02:04:04.176 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:04:04.189 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:04:04.210 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:04:04.291 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:04:05.551 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-19T02:04:05.569 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:04:05.619 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-19T02:04:05.797 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-19T02:04:05.798 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-19T02:04:05.953 INFO:teuthology.orchestra.run.smithi169.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-19T02:04:05.953 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:04:05.953 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:04:05.953 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:04:05.953 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:04:05.953 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:04:05.954 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:04:05.954 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:04:05.992 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T02:04:05.994 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-04-19T02:04:06.049 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-04-19T02:04:06.049 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-04-19T02:04:06.049 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.105.102 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:04:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-04-19T02:04:06.051 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-19T02:04:06.095 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.vtyO8fAU2F 2024-04-19T02:04:06.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vtyO8fAU2F 2024-04-19T02:04:06.150 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.vtyO8fAU2F 2024-04-19T02:04:06.265 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.vtyO8fAU2F is 10KB 2024-04-19T02:04:06.278 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.vtyO8fAU2F 2024-04-19T02:04:06.286 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:04:06.338 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:04:06.338 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:04:06.338 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:04:06.404 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-19T02:04:06.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo update-grub 2024-04-19T02:04:07.581 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:04:07.582 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:04:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-04-19T02:04:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T02:04:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T02:04:08.070 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T02:04:08.075 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T02:04:08.114 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T02:04:08.119 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T02:04:08.245 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T02:04:08.245 INFO:teuthology.orchestra.run.smithi169.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T02:04:08.246 INFO:teuthology.orchestra.run.smithi169.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T02:04:08.277 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-04-19T02:04:08.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-04-19T02:04:29.075 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-19T02:04:29.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-19T02:04:29.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:04:29.794 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-19T02:04:29.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-19T02:04:29.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:04:33.211 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-19T02:04:33.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:04:33.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:04:38.294 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-19T02:04:38.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-19T02:04:38.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:04.419 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-19T02:05:12.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-19T02:05:13.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-19T02:05:13.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:21.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-19T02:05:21.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:29.086 DEBUG:teuthology.orchestra.remote:timed out 2024-04-19T02:05:31.808 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-19T02:05:33.216 DEBUG:teuthology.orchestra.remote:timed out 2024-04-19T02:05:38.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-19T02:05:38.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:38.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-19T02:05:42.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:05:42.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:42.220 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-19T02:05:43.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-19T02:05:43.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:43.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-19T02:05:50.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-19T02:05:50.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:50.378 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-19T02:05:50.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-19T02:05:50.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-19T02:05:50.904 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-19T02:05:50.948 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-105-generic 2024-04-19T02:05:50.949 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-19T02:05:50.949 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:05:50.949 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:05:51.949 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-19T02:05:51.949 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:05:52.022 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-04-19T02:05:52.046 DEBUG:teuthology.parallel:result is None 2024-04-19T02:05:53.315 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-19T02:05:54.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:05:54.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:54.735 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-19T02:05:55.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:05:55.322 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-105-generic"... 2024-04-19T02:05:55.322 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-19T02:05:55.368 INFO:teuthology.orchestra.run.smithi136.stdout:5.15.0-105-generic 2024-04-19T02:05:55.368 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-19T02:05:55.368 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:05:55.368 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:05:56.369 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-19T02:05:56.369 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:05:56.744 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-04-19T02:05:56.778 DEBUG:teuthology.parallel:result is None 2024-04-19T02:05:58.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-19T02:05:58.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:59.155 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-04-19T02:05:59.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-19T02:05:59.605 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-105-generic"... 2024-04-19T02:05:59.605 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-04-19T02:05:59.651 INFO:teuthology.orchestra.run.smithi116.stdout:5.15.0-105-generic 2024-04-19T02:05:59.651 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-19T02:05:59.651 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:05:59.651 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:06:00.652 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-19T02:06:00.652 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:06:00.998 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-04-19T02:06:01.013 DEBUG:teuthology.parallel:result is None 2024-04-19T02:06:05.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-19T02:06:05.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:06:05.571 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-19T02:06:06.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-19T02:06:06.139 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-105-generic"... 2024-04-19T02:06:06.140 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-19T02:06:06.188 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-105-generic 2024-04-19T02:06:06.188 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-19T02:06:06.188 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:06:06.188 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:06:07.189 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-19T02:06:07.189 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:06:07.249 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-04-19T02:06:07.285 DEBUG:teuthology.parallel:result is None 2024-04-19T02:06:07.286 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-19T02:06:07.298 INFO:teuthology.task.internal:Creating test directory... 2024-04-19T02:06:07.298 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:07.301 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:07.303 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:07.307 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:07.312 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-19T02:06:07.339 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-19T02:06:07.373 INFO:teuthology.task.internal:Creating archive directory... 2024-04-19T02:06:07.373 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:07.376 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:07.378 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:07.381 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:07.483 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-19T02:06:07.490 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-19T02:06:07.490 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:07.493 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:07.497 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:07.499 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:07.513 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.518 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.519 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.521 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.521 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.526 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.527 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.529 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:07.531 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-19T02:06:07.538 INFO:teuthology.task.internal:Configuring sudo... 2024-04-19T02:06:07.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:07.573 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:07.577 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:07.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:07.602 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-19T02:06:07.612 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-19T02:06:07.612 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:07.633 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:07.635 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:07.638 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:07.651 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:07.684 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:07.735 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:06:07.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:07.834 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:07.840 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:07.888 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:06:07.888 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:07.960 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:07.965 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:08.012 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:06:08.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:08.083 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:08.088 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:08.136 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:06:08.136 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:08.200 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-04-19T02:06:08.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-04-19T02:06:08.205 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-04-19T02:06:08.207 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-04-19T02:06:08.271 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-19T02:06:08.299 INFO:teuthology.task.internal:Starting timer... 2024-04-19T02:06:08.299 INFO:teuthology.run_tasks:Running task pcp... 2024-04-19T02:06:08.336 INFO:teuthology.run_tasks:Running task selinux... 2024-04-19T02:06:08.366 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-04-19T02:06:08.367 DEBUG:teuthology.task.selinux:Excluding smithi116: OS 'ubuntu' does not support SELinux 2024-04-19T02:06:08.367 DEBUG:teuthology.task.selinux:Excluding smithi136: OS 'ubuntu' does not support SELinux 2024-04-19T02:06:08.367 DEBUG:teuthology.task.selinux:Excluding smithi169: OS 'ubuntu' does not support SELinux 2024-04-19T02:06:08.367 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-19T02:06:08.367 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-19T02:06:08.367 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-19T02:06:08.367 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-19T02:06:08.400 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-19T02:06:08.418 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-19T02:06:08.420 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi116.front.sepia.ceph.com,smithi136.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-19T02:13:21.700 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-04-19T02:13:21.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-19T02:13:21.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:13:21.785 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-19T02:13:21.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-19T02:13:21.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-19T02:13:21.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:13:21.945 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-04-19T02:13:22.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-19T02:13:22.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:13:22.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:13:22.097 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-19T02:13:22.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:13:22.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-19T02:13:22.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:13:22.257 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-19T02:13:22.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-19T02:13:22.335 INFO:teuthology.run_tasks:Running task clock... 2024-04-19T02:13:22.347 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-19T02:13:22.347 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:13:22.347 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:13:22.350 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:13:22.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:13:22.352 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:13:22.352 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:13:22.354 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:13:22.355 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:13:22.376 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-19T02:13:22.376 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Command line: ntpd -gq 2024-04-19T02:13:22.376 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: ---------------------------------------------------- 2024-04-19T02:13:22.376 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: ntp-4 is maintained by Network Time Foundation, 2024-04-19T02:13:22.377 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-19T02:13:22.377 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: corporation. Support and training for ntp-4 are 2024-04-19T02:13:22.377 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: available at https://www.nwtime.org/support 2024-04-19T02:13:22.377 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: ---------------------------------------------------- 2024-04-19T02:13:22.378 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: proto: precision = 0.063 usec (-24) 2024-04-19T02:13:22.378 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: basedate set to 2022-02-04 2024-04-19T02:13:22.378 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: gps base set to 2022-02-06 (week 2196) 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Command line: ntpd -gq 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: ---------------------------------------------------- 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: ntp-4 is maintained by Network Time Foundation, 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: corporation. Support and training for ntp-4 are 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: available at https://www.nwtime.org/support 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: ---------------------------------------------------- 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: proto: precision = 0.045 usec (-24) 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: basedate set to 2022-02-04 2024-04-19T02:13:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: gps base set to 2022-02-06 (week 2196) 2024-04-19T02:13:22.380 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.380 INFO:teuthology.orchestra.run.smithi116.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.380 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.380 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.381 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.381 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.381 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.381 INFO:teuthology.orchestra.run.smithi116.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Listen normally on 4 lo [::1]:123 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:22 ntpd[17192]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:13:22.383 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:13:22.384 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:13:22.384 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Listen normally on 3 enp3s0f1 172.21.15.116:123 2024-04-19T02:13:22.384 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Listen normally on 4 lo [::1]:123 2024-04-19T02:13:22.384 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:3f67%5]:123 2024-04-19T02:13:22.384 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:22 ntpd[17183]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:13:22.385 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-19T02:13:22.385 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Command line: ntpd -gq 2024-04-19T02:13:22.385 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: ---------------------------------------------------- 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: ntp-4 is maintained by Network Time Foundation, 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: corporation. Support and training for ntp-4 are 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: available at https://www.nwtime.org/support 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: ---------------------------------------------------- 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: proto: precision = 0.045 usec (-24) 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: basedate set to 2022-02-04 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: gps base set to 2022-02-06 (week 2196) 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.386 INFO:teuthology.orchestra.run.smithi136.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.387 INFO:teuthology.orchestra.run.smithi136.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.387 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.388 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:13:22.388 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:13:22.388 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:13:22.388 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Listen normally on 3 enp3s0f1 172.21.15.136:123 2024-04-19T02:13:22.388 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Listen normally on 4 lo [::1]:123 2024-04-19T02:13:22.388 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e43%5]:123 2024-04-19T02:13:22.388 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:22 ntpd[17240]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:13:22.403 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-19T02:13:22.403 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Command line: ntpd -gq 2024-04-19T02:13:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: ---------------------------------------------------- 2024-04-19T02:13:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: ntp-4 is maintained by Network Time Foundation, 2024-04-19T02:13:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-19T02:13:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: corporation. Support and training for ntp-4 are 2024-04-19T02:13:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: available at https://www.nwtime.org/support 2024-04-19T02:13:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: ---------------------------------------------------- 2024-04-19T02:13:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: proto: precision = 0.061 usec (-24) 2024-04-19T02:13:22.405 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: basedate set to 2022-02-04 2024-04-19T02:13:22.405 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: gps base set to 2022-02-06 (week 2196) 2024-04-19T02:13:22.405 INFO:teuthology.orchestra.run.smithi169.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.405 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:13:22.406 INFO:teuthology.orchestra.run.smithi169.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Listen normally on 3 enp3s0f1 172.21.15.169:123 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Listen normally on 4 lo [::1]:123 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f4d%5]:123 2024-04-19T02:13:22.407 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:22 ntpd[17190]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:13:23.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:23 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:23.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:23 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:23.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:23 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:23.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:23 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:23.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:23 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:23.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:23 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:23.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:23 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:23.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:23 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:24.378 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:24 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:24.378 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:24 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:24 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:24 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:24 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:24 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:24 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:24 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:25.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:25 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:25.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:25 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:25.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:25 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:25.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:25 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:25.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:25 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:25.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:25 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:25.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:25.406 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:25.406 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:25 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:26 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:26.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:26 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:26 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:26 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:26 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:26 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:26.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:26 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:26.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.383 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.383 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:26.383 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:26 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:26.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:26.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:26.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:26.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:26 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:27 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:27 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:27 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:27 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:27 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:27 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:27.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:27.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:27.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:27 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:27.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:27 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:27 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:27 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:27 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:27 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:27.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:27 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:27.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:27.406 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:27 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:28.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:28.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:28 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:28.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:28 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:28 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:28 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:28 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:28 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:28.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:28 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:28.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.383 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.383 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:28.383 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:28 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:28.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:28 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:28.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:28 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:28.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:28.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:28 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:29 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:29 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:29 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:29.378 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:29.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:29 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:29.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:29 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:29 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:29 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:29 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:29 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:29.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:29 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:29.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.404 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:29.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:29.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:29.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:29.405 INFO:teuthology.orchestra.run.smithi169.stdout:19 Apr 02:13:29 ntpd[17190]: ntpd: time slew +0.000239 s 2024-04-19T02:13:29.405 INFO:teuthology.orchestra.run.smithi169.stdout:ntpd: time slew +0.000239s 2024-04-19T02:13:29.405 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:13:29.406 INFO:teuthology.orchestra.run.smithi169.stderr:19 Apr 02:13:29 ntpd[17190]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:13:29.453 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:13:29.453 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-04-19T02:13:29.453 INFO:teuthology.orchestra.run.smithi169.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:29.453 INFO:teuthology.orchestra.run.smithi169.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:29.453 INFO:teuthology.orchestra.run.smithi169.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:29.453 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:30 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:30.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:30 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:30 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:30 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:30 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:30 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:30.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:30 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:30.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:30.383 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:30 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:31 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:31 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:31 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:31.378 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.378 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.378 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:31.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:31 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:31.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:31.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:31.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:31.381 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:31.382 INFO:teuthology.orchestra.run.smithi136.stdout:19 Apr 02:13:31 ntpd[17240]: ntpd: time slew +0.000059 s 2024-04-19T02:13:31.382 INFO:teuthology.orchestra.run.smithi136.stdout:ntpd: time slew +0.000059s 2024-04-19T02:13:31.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:13:31.382 INFO:teuthology.orchestra.run.smithi136.stderr:19 Apr 02:13:31 ntpd[17240]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:13:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:13:31.438 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2024-04-19T02:13:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:32.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:32.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:32.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:32.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:32.377 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:32.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:32.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:32.378 INFO:teuthology.orchestra.run.smithi073.stdout:19 Apr 02:13:32 ntpd[17192]: ntpd: time slew -0.001725 s 2024-04-19T02:13:32.378 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.001725s 2024-04-19T02:13:32.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:13:32.378 INFO:teuthology.orchestra.run.smithi073.stderr:19 Apr 02:13:32 ntpd[17192]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:13:32.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:32.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:32.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:13:32.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:13:32.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:13:32.379 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:13:32.380 INFO:teuthology.orchestra.run.smithi116.stdout:19 Apr 02:13:32 ntpd[17183]: ntpd: time slew -0.000289 s 2024-04-19T02:13:32.380 INFO:teuthology.orchestra.run.smithi116.stdout:ntpd: time slew -0.000289s 2024-04-19T02:13:32.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:13:32.380 INFO:teuthology.orchestra.run.smithi116.stderr:19 Apr 02:13:32 ntpd[17183]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:13:32.424 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:13:32.424 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-04-19T02:13:32.424 INFO:teuthology.orchestra.run.smithi116.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.424 INFO:teuthology.orchestra.run.smithi116.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.424 INFO:teuthology.orchestra.run.smithi116.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.424 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:13:32.437 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-19T02:13:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:13:32.438 INFO:teuthology.run_tasks:Running task install... 2024-04-19T02:13:32.450 DEBUG:teuthology.task.install:project ceph 2024-04-19T02:13:32.450 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T02:13:32.451 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'} 2024-04-19T02:13:32.451 INFO:teuthology.task.install:Using flavor: default 2024-04-19T02:13:32.456 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-19T02:13:32.456 INFO:teuthology.task.install:extra packages: [] 2024-04-19T02:13:32.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-04-19T02:13:32.457 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-key list | grep Ceph 2024-04-19T02:13:32.457 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-key list | grep Ceph 2024-04-19T02:13:32.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-key list | grep Ceph 2024-04-19T02:13:32.519 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-19T02:13:32.520 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-19T02:13:32.525 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-19T02:13:32.540 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-19T02:13:32.547 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:13:32.547 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:13:32.548 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:13:32.548 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:13:32.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:13:32.553 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:13:32.553 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:13:32.554 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:13:32.554 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:13:32.554 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:13:32.557 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:13:32.557 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:13:32.558 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:13:32.558 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:13:32.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:13:32.568 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:13:32.569 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:13:32.569 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:13:32.569 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:13:32.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:13:32.708 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default/ 2024-04-19T02:13:32.708 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:32.713 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default/ 2024-04-19T02:13:32.714 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:32.775 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default/ 2024-04-19T02:13:32.775 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:32.778 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default/ 2024-04-19T02:13:32.778 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:32.882 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:13:32.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:13:32.886 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:13:32.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:13:32.886 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:13:32.886 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:13:32.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-19T02:13:32.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-19T02:13:32.902 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-04-19T02:13:32.940 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:13:32.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:13:32.953 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-04-19T02:13:33.074 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:13:33.075 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:13:33.086 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:13:33.087 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:13:33.107 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:13:33.107 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:13:33.124 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:13:33.124 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:13:33.126 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy InRelease 2024-04-19T02:13:33.139 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:13:33.148 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-19T02:13:33.159 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:13:33.172 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-19T02:13:33.181 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy InRelease 2024-04-19T02:13:33.184 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy InRelease 2024-04-19T02:13:33.189 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:13:33.192 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:13:33.202 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T02:13:33.202 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T02:13:33.202 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-04-19T02:13:33.217 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-19T02:13:33.220 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-19T02:13:33.233 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy InRelease 2024-04-19T02:13:33.240 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-04-19T02:13:33.255 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-19T02:13:33.257 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-19T02:13:33.271 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-19T02:13:33.279 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T02:13:33.291 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-04-19T02:13:33.293 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-04-19T02:13:33.309 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-19T02:13:33.334 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-04-19T02:13:33.336 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-04-19T02:13:33.346 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-04-19T02:13:33.363 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T02:13:33.387 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-04-19T02:13:33.420 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 28.6 kB in 0s (83.9 kB/s) 2024-04-19T02:13:33.424 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 28.6 kB in 0s (82.0 kB/s) 2024-04-19T02:13:33.465 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 28.6 kB in 0s (84.6 kB/s) 2024-04-19T02:13:33.579 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 28.6 kB in 0s (57.4 kB/s) 2024-04-19T02:13:34.323 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-19T02:13:34.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1jammy cephadm=18.2.2-1237-g646b8c7d-1jammy ceph-mds=18.2.2-1237-g646b8c7d-1jammy ceph-mgr=18.2.2-1237-g646b8c7d-1jammy ceph-common=18.2.2-1237-g646b8c7d-1jammy ceph-fuse=18.2.2-1237-g646b8c7d-1jammy ceph-test=18.2.2-1237-g646b8c7d-1jammy ceph-volume=18.2.2-1237-g646b8c7d-1jammy radosgw=18.2.2-1237-g646b8c7d-1jammy python3-rados=18.2.2-1237-g646b8c7d-1jammy python3-rgw=18.2.2-1237-g646b8c7d-1jammy python3-cephfs=18.2.2-1237-g646b8c7d-1jammy python3-rbd=18.2.2-1237-g646b8c7d-1jammy libcephfs2=18.2.2-1237-g646b8c7d-1jammy libcephfs-dev=18.2.2-1237-g646b8c7d-1jammy librados2=18.2.2-1237-g646b8c7d-1jammy librbd1=18.2.2-1237-g646b8c7d-1jammy rbd-fuse=18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:34.359 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-19T02:13:34.368 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-19T02:13:34.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1jammy cephadm=18.2.2-1237-g646b8c7d-1jammy ceph-mds=18.2.2-1237-g646b8c7d-1jammy ceph-mgr=18.2.2-1237-g646b8c7d-1jammy ceph-common=18.2.2-1237-g646b8c7d-1jammy ceph-fuse=18.2.2-1237-g646b8c7d-1jammy ceph-test=18.2.2-1237-g646b8c7d-1jammy ceph-volume=18.2.2-1237-g646b8c7d-1jammy radosgw=18.2.2-1237-g646b8c7d-1jammy python3-rados=18.2.2-1237-g646b8c7d-1jammy python3-rgw=18.2.2-1237-g646b8c7d-1jammy python3-cephfs=18.2.2-1237-g646b8c7d-1jammy python3-rbd=18.2.2-1237-g646b8c7d-1jammy libcephfs2=18.2.2-1237-g646b8c7d-1jammy libcephfs-dev=18.2.2-1237-g646b8c7d-1jammy librados2=18.2.2-1237-g646b8c7d-1jammy librbd1=18.2.2-1237-g646b8c7d-1jammy rbd-fuse=18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:34.385 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1jammy cephadm=18.2.2-1237-g646b8c7d-1jammy ceph-mds=18.2.2-1237-g646b8c7d-1jammy ceph-mgr=18.2.2-1237-g646b8c7d-1jammy ceph-common=18.2.2-1237-g646b8c7d-1jammy ceph-fuse=18.2.2-1237-g646b8c7d-1jammy ceph-test=18.2.2-1237-g646b8c7d-1jammy ceph-volume=18.2.2-1237-g646b8c7d-1jammy radosgw=18.2.2-1237-g646b8c7d-1jammy python3-rados=18.2.2-1237-g646b8c7d-1jammy python3-rgw=18.2.2-1237-g646b8c7d-1jammy python3-cephfs=18.2.2-1237-g646b8c7d-1jammy python3-rbd=18.2.2-1237-g646b8c7d-1jammy libcephfs2=18.2.2-1237-g646b8c7d-1jammy libcephfs-dev=18.2.2-1237-g646b8c7d-1jammy librados2=18.2.2-1237-g646b8c7d-1jammy librbd1=18.2.2-1237-g646b8c7d-1jammy rbd-fuse=18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:34.400 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-19T02:13:34.435 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-19T02:13:34.435 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-19T02:13:34.554 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-19T02:13:34.569 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1jammy cephadm=18.2.2-1237-g646b8c7d-1jammy ceph-mds=18.2.2-1237-g646b8c7d-1jammy ceph-mgr=18.2.2-1237-g646b8c7d-1jammy ceph-common=18.2.2-1237-g646b8c7d-1jammy ceph-fuse=18.2.2-1237-g646b8c7d-1jammy ceph-test=18.2.2-1237-g646b8c7d-1jammy ceph-volume=18.2.2-1237-g646b8c7d-1jammy radosgw=18.2.2-1237-g646b8c7d-1jammy python3-rados=18.2.2-1237-g646b8c7d-1jammy python3-rgw=18.2.2-1237-g646b8c7d-1jammy python3-cephfs=18.2.2-1237-g646b8c7d-1jammy python3-rbd=18.2.2-1237-g646b8c7d-1jammy libcephfs2=18.2.2-1237-g646b8c7d-1jammy libcephfs-dev=18.2.2-1237-g646b8c7d-1jammy librados2=18.2.2-1237-g646b8c7d-1jammy librbd1=18.2.2-1237-g646b8c7d-1jammy rbd-fuse=18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:13:34.598 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-04-19T02:13:34.599 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-04-19T02:13:34.612 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-19T02:13:34.612 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-19T02:13:34.619 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-19T02:13:34.637 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-19T02:13:34.638 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-19T02:13:34.783 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:13:34.783 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:13:34.783 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:13:34.783 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:13:34.786 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:13:34.786 INFO:teuthology.orchestra.run.smithi136.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:13:34.786 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:13:34.786 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2024-04-19T02:13:34.786 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:13:34.786 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-19T02:13:34.786 INFO:teuthology.orchestra.run.smithi136.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-19T02:13:34.787 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:13:34.788 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:34.788 INFO:teuthology.orchestra.run.smithi136.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:34.788 INFO:teuthology.orchestra.run.smithi136.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:34.788 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:34.788 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: python3-watchdog 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi136.stdout: btrfs-tools 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:13:34.789 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-19T02:13:34.790 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:34.791 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: python3-watchdog 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout:Recommended packages: 2024-04-19T02:13:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: btrfs-tools 2024-04-19T02:13:34.795 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-19T02:13:34.796 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-19T02:13:34.836 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:13:34.836 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:13:34.837 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:13:34.837 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:13:34.837 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:13:34.837 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:13:34.837 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:13:34.838 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-19T02:13:34.838 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:13:34.838 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-19T02:13:34.838 INFO:teuthology.orchestra.run.smithi169.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-19T02:13:34.838 INFO:teuthology.orchestra.run.smithi169.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-19T02:13:34.839 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-19T02:13:34.839 INFO:teuthology.orchestra.run.smithi169.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:13:34.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-19T02:13:34.841 INFO:teuthology.orchestra.run.smithi169.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-19T02:13:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-19T02:13:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-19T02:13:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-19T02:13:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: python3-watchdog 2024-04-19T02:13:34.842 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-04-19T02:13:34.842 INFO:teuthology.orchestra.run.smithi169.stdout: btrfs-tools 2024-04-19T02:13:34.884 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2024-04-19T02:13:34.884 INFO:teuthology.orchestra.run.smithi136.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:13:34.884 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:13:34.884 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-19T02:13:34.885 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-19T02:13:34.885 INFO:teuthology.orchestra.run.smithi136.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-19T02:13:34.885 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-19T02:13:34.885 INFO:teuthology.orchestra.run.smithi136.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-19T02:13:34.885 INFO:teuthology.orchestra.run.smithi136.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-19T02:13:34.885 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:13:34.885 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:34.886 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:34.887 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-19T02:13:34.887 INFO:teuthology.orchestra.run.smithi136.stdout: socat xmlstarlet 2024-04-19T02:13:34.888 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-19T02:13:34.888 INFO:teuthology.orchestra.run.smithi116.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:13:34.888 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:13:34.889 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-19T02:13:34.889 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-19T02:13:34.889 INFO:teuthology.orchestra.run.smithi116.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-19T02:13:34.889 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi116.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi116.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-19T02:13:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: socat xmlstarlet 2024-04-19T02:13:34.939 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-19T02:13:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:13:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:13:34.939 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-19T02:13:34.941 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:34.942 INFO:teuthology.orchestra.run.smithi169.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-19T02:13:34.943 INFO:teuthology.orchestra.run.smithi169.stdout: socat xmlstarlet 2024-04-19T02:13:34.954 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-19T02:13:34.954 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 162 MB of archives. 2024-04-19T02:13:34.954 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-19T02:13:34.954 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-19T02:13:34.957 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-19T02:13:34.957 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 162 MB of archives. 2024-04-19T02:13:34.957 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-19T02:13:34.957 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-19T02:13:34.967 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:13:34.967 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:13:34.967 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:13:34.967 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:13:34.967 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:13:34.968 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:13:34.968 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:13:34.968 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-19T02:13:34.968 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:13:34.968 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-19T02:13:34.968 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-19T02:13:34.968 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-19T02:13:34.969 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-19T02:13:34.969 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-19T02:13:34.969 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-19T02:13:34.971 INFO:teuthology.orchestra.run.smithi073.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-19T02:13:34.972 INFO:teuthology.orchestra.run.smithi073.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-19T02:13:34.972 INFO:teuthology.orchestra.run.smithi073.stdout: python3-watchdog 2024-04-19T02:13:34.972 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-04-19T02:13:34.972 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-04-19T02:13:35.007 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-19T02:13:35.007 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 162 MB of archives. 2024-04-19T02:13:35.007 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-19T02:13:35.007 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-19T02:13:35.024 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-19T02:13:35.027 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-19T02:13:35.066 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-19T02:13:35.066 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:13:35.066 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:13:35.066 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-19T02:13:35.066 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-19T02:13:35.067 INFO:teuthology.orchestra.run.smithi073.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-19T02:13:35.067 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-19T02:13:35.068 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-19T02:13:35.069 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-19T02:13:35.069 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T02:13:35.069 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T02:13:35.069 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T02:13:35.069 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T02:13:35.069 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-19T02:13:35.069 INFO:teuthology.orchestra.run.smithi073.stdout: socat xmlstarlet 2024-04-19T02:13:35.070 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-19T02:13:35.074 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-19T02:13:35.074 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-19T02:13:35.074 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-19T02:13:35.075 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-19T02:13:35.091 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-19T02:13:35.095 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-19T02:13:35.123 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-19T02:13:35.124 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1jammy [3,440 kB] 2024-04-19T02:13:35.128 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-19T02:13:35.160 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-19T02:13:35.177 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-19T02:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-19T02:13:35.183 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-19T02:13:35.186 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-19T02:13:35.199 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-19T02:13:35.204 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-19T02:13:35.204 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-19T02:13:35.204 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-19T02:13:35.205 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-19T02:13:35.221 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-19T02:13:35.222 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-19T02:13:35.223 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-19T02:13:35.229 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-19T02:13:35.230 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-19T02:13:35.231 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-19T02:13:35.234 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-19T02:13:35.235 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-19T02:13:35.236 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-19T02:13:35.236 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-19T02:13:35.238 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-19T02:13:35.239 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1jammy [3,440 kB] 2024-04-19T02:13:35.254 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-19T02:13:35.254 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 162 MB of archives. 2024-04-19T02:13:35.254 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-19T02:13:35.254 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-19T02:13:35.272 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-19T02:13:35.272 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-19T02:13:35.273 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-19T02:13:35.274 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-19T02:13:35.274 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-19T02:13:35.275 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-19T02:13:35.276 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-19T02:13:35.276 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-19T02:13:35.277 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-19T02:13:35.278 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-19T02:13:35.278 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-19T02:13:35.278 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-19T02:13:35.279 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-19T02:13:35.279 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-19T02:13:35.280 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-19T02:13:35.288 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1jammy [3,440 kB] 2024-04-19T02:13:35.294 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-19T02:13:35.295 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-19T02:13:35.297 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-19T02:13:35.297 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:13:35.297 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-19T02:13:35.297 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-19T02:13:35.298 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-19T02:13:35.299 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-19T02:13:35.299 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-19T02:13:35.316 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-19T02:13:35.316 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-19T02:13:35.318 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:13:35.318 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-19T02:13:35.319 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-19T02:13:35.319 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-19T02:13:35.319 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-19T02:13:35.319 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-19T02:13:35.321 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-19T02:13:35.322 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-19T02:13:35.323 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-19T02:13:35.324 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-19T02:13:35.325 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-19T02:13:35.326 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-19T02:13:35.329 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-19T02:13:35.330 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-19T02:13:35.330 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-19T02:13:35.344 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-19T02:13:35.346 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-19T02:13:35.346 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-19T02:13:35.348 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-19T02:13:35.354 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-19T02:13:35.356 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-19T02:13:35.357 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-19T02:13:35.358 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-19T02:13:35.358 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-19T02:13:35.359 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-19T02:13:35.360 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-19T02:13:35.364 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1jammy [3,440 kB] 2024-04-19T02:13:35.367 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-19T02:13:35.368 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-19T02:13:35.368 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-19T02:13:35.369 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-19T02:13:35.369 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-19T02:13:35.387 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-19T02:13:35.390 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-19T02:13:35.391 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-19T02:13:35.391 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-19T02:13:35.395 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-19T02:13:35.396 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-19T02:13:35.397 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-19T02:13:35.397 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-19T02:13:35.400 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-19T02:13:35.401 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-19T02:13:35.402 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-19T02:13:35.406 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-19T02:13:35.406 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-19T02:13:35.421 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-19T02:13:35.422 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-19T02:13:35.423 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-19T02:13:35.424 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-19T02:13:35.431 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-19T02:13:35.436 INFO:teuthology.orchestra.run.smithi116.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-19T02:13:35.466 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:13:35.470 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-19T02:13:35.473 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-19T02:13:35.477 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-19T02:13:35.478 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-19T02:13:35.530 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-19T02:13:35.538 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-19T02:13:35.563 INFO:teuthology.orchestra.run.smithi136.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-19T02:13:35.581 INFO:teuthology.orchestra.run.smithi136.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-19T02:13:35.583 INFO:teuthology.orchestra.run.smithi136.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-19T02:13:35.584 INFO:teuthology.orchestra.run.smithi136.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-19T02:13:35.585 INFO:teuthology.orchestra.run.smithi136.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-19T02:13:35.587 INFO:teuthology.orchestra.run.smithi136.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-19T02:13:35.588 INFO:teuthology.orchestra.run.smithi136.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-19T02:13:35.608 INFO:teuthology.orchestra.run.smithi136.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-19T02:13:35.613 INFO:teuthology.orchestra.run.smithi136.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:13:35.614 INFO:teuthology.orchestra.run.smithi136.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-19T02:13:35.620 INFO:teuthology.orchestra.run.smithi116.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-19T02:13:35.622 INFO:teuthology.orchestra.run.smithi116.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-19T02:13:35.624 INFO:teuthology.orchestra.run.smithi116.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-19T02:13:35.625 INFO:teuthology.orchestra.run.smithi116.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-19T02:13:35.626 INFO:teuthology.orchestra.run.smithi116.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-19T02:13:35.635 INFO:teuthology.orchestra.run.smithi136.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-19T02:13:35.645 INFO:teuthology.orchestra.run.smithi116.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-19T02:13:35.645 INFO:teuthology.orchestra.run.smithi116.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-19T02:13:35.646 INFO:teuthology.orchestra.run.smithi116.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-19T02:13:35.651 INFO:teuthology.orchestra.run.smithi116.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:13:35.651 INFO:teuthology.orchestra.run.smithi116.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-19T02:13:35.659 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-19T02:13:35.662 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-19T02:13:35.664 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-19T02:13:35.666 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-19T02:13:35.671 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-19T02:13:35.672 INFO:teuthology.orchestra.run.smithi116.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-19T02:13:35.676 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-19T02:13:35.678 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-19T02:13:35.679 INFO:teuthology.orchestra.run.smithi136.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-19T02:13:35.681 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-19T02:13:35.682 INFO:teuthology.orchestra.run.smithi136.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-19T02:13:35.683 INFO:teuthology.orchestra.run.smithi136.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-19T02:13:35.684 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-19T02:13:35.692 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-19T02:13:35.712 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-19T02:13:35.714 INFO:teuthology.orchestra.run.smithi136.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-19T02:13:35.714 INFO:teuthology.orchestra.run.smithi136.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-19T02:13:35.716 INFO:teuthology.orchestra.run.smithi136.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-19T02:13:35.717 INFO:teuthology.orchestra.run.smithi136.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-19T02:13:35.718 INFO:teuthology.orchestra.run.smithi136.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-19T02:13:35.719 INFO:teuthology.orchestra.run.smithi136.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-19T02:13:35.720 INFO:teuthology.orchestra.run.smithi136.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-19T02:13:35.724 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-19T02:13:35.731 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-19T02:13:35.752 INFO:teuthology.orchestra.run.smithi116.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-19T02:13:35.760 INFO:teuthology.orchestra.run.smithi116.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-19T02:13:35.761 INFO:teuthology.orchestra.run.smithi116.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-19T02:13:35.762 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-19T02:13:35.767 INFO:teuthology.orchestra.run.smithi136.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-19T02:13:35.775 INFO:teuthology.orchestra.run.smithi136.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-19T02:13:35.779 INFO:teuthology.orchestra.run.smithi136.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-19T02:13:35.782 INFO:teuthology.orchestra.run.smithi136.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-19T02:13:35.783 INFO:teuthology.orchestra.run.smithi136.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-19T02:13:35.791 INFO:teuthology.orchestra.run.smithi136.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-19T02:13:35.796 INFO:teuthology.orchestra.run.smithi136.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-19T02:13:35.801 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-19T02:13:35.806 INFO:teuthology.orchestra.run.smithi136.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-19T02:13:35.811 INFO:teuthology.orchestra.run.smithi136.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:13:35.818 INFO:teuthology.orchestra.run.smithi116.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-19T02:13:35.819 INFO:teuthology.orchestra.run.smithi116.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-19T02:13:35.821 INFO:teuthology.orchestra.run.smithi116.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-19T02:13:35.822 INFO:teuthology.orchestra.run.smithi116.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-19T02:13:35.824 INFO:teuthology.orchestra.run.smithi116.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-19T02:13:35.825 INFO:teuthology.orchestra.run.smithi116.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-19T02:13:35.826 INFO:teuthology.orchestra.run.smithi116.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-19T02:13:35.828 INFO:teuthology.orchestra.run.smithi136.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-19T02:13:35.858 INFO:teuthology.orchestra.run.smithi116.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-19T02:13:35.872 INFO:teuthology.orchestra.run.smithi169.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-19T02:13:35.874 INFO:teuthology.orchestra.run.smithi169.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-19T02:13:35.874 INFO:teuthology.orchestra.run.smithi116.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-19T02:13:35.876 INFO:teuthology.orchestra.run.smithi169.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-19T02:13:35.876 INFO:teuthology.orchestra.run.smithi169.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-19T02:13:35.878 INFO:teuthology.orchestra.run.smithi136.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-19T02:13:35.878 INFO:teuthology.orchestra.run.smithi169.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-19T02:13:35.879 INFO:teuthology.orchestra.run.smithi169.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-19T02:13:35.879 INFO:teuthology.orchestra.run.smithi169.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-19T02:13:35.880 INFO:teuthology.orchestra.run.smithi169.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-19T02:13:35.884 INFO:teuthology.orchestra.run.smithi169.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:13:35.894 INFO:teuthology.orchestra.run.smithi136.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-19T02:13:35.896 INFO:teuthology.orchestra.run.smithi136.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-19T02:13:35.897 INFO:teuthology.orchestra.run.smithi136.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-19T02:13:35.899 INFO:teuthology.orchestra.run.smithi116.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-19T02:13:35.904 INFO:teuthology.orchestra.run.smithi116.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-19T02:13:35.906 INFO:teuthology.orchestra.run.smithi116.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-19T02:13:35.919 INFO:teuthology.orchestra.run.smithi116.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-19T02:13:35.924 INFO:teuthology.orchestra.run.smithi169.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-19T02:13:35.926 INFO:teuthology.orchestra.run.smithi116.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-19T02:13:35.931 INFO:teuthology.orchestra.run.smithi169.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-19T02:13:35.937 INFO:teuthology.orchestra.run.smithi116.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-19T02:13:35.948 INFO:teuthology.orchestra.run.smithi116.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:13:35.950 INFO:teuthology.orchestra.run.smithi116.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-19T02:13:35.966 INFO:teuthology.orchestra.run.smithi116.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-19T02:13:35.968 INFO:teuthology.orchestra.run.smithi169.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-19T02:13:35.971 INFO:teuthology.orchestra.run.smithi169.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-19T02:13:35.972 INFO:teuthology.orchestra.run.smithi169.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-19T02:13:35.986 INFO:teuthology.orchestra.run.smithi116.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-19T02:13:35.997 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-19T02:13:36.006 INFO:teuthology.orchestra.run.smithi169.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-19T02:13:36.006 INFO:teuthology.orchestra.run.smithi169.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-19T02:13:36.007 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-19T02:13:36.008 INFO:teuthology.orchestra.run.smithi169.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-19T02:13:36.008 INFO:teuthology.orchestra.run.smithi169.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-19T02:13:36.009 INFO:teuthology.orchestra.run.smithi169.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-19T02:13:36.012 INFO:teuthology.orchestra.run.smithi116.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-19T02:13:36.014 INFO:teuthology.orchestra.run.smithi116.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-19T02:13:36.030 INFO:teuthology.orchestra.run.smithi169.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-19T02:13:36.030 INFO:teuthology.orchestra.run.smithi169.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-19T02:13:36.031 INFO:teuthology.orchestra.run.smithi169.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-19T02:13:36.035 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-19T02:13:36.037 INFO:teuthology.orchestra.run.smithi169.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-19T02:13:36.044 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-19T02:13:36.045 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-19T02:13:36.046 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-19T02:13:36.063 INFO:teuthology.orchestra.run.smithi169.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-19T02:13:36.066 INFO:teuthology.orchestra.run.smithi169.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-19T02:13:36.068 INFO:teuthology.orchestra.run.smithi169.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-19T02:13:36.074 INFO:teuthology.orchestra.run.smithi169.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-19T02:13:36.079 INFO:teuthology.orchestra.run.smithi169.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-19T02:13:36.088 INFO:teuthology.orchestra.run.smithi169.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-19T02:13:36.095 INFO:teuthology.orchestra.run.smithi169.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:13:36.096 INFO:teuthology.orchestra.run.smithi169.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-19T02:13:36.099 INFO:teuthology.orchestra.run.smithi169.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-19T02:13:36.111 INFO:teuthology.orchestra.run.smithi169.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-19T02:13:36.120 INFO:teuthology.orchestra.run.smithi169.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-19T02:13:36.122 INFO:teuthology.orchestra.run.smithi169.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-19T02:13:36.227 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-19T02:13:36.474 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-19T02:13:36.483 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-19T02:13:36.578 INFO:teuthology.orchestra.run.smithi169.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1jammy [3,106 kB] 2024-04-19T02:13:36.581 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-19T02:13:36.589 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-19T02:13:36.597 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-19T02:13:36.610 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-19T02:13:36.624 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-19T02:13:36.635 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-19T02:13:36.638 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-19T02:13:36.736 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-19T02:13:36.765 INFO:teuthology.orchestra.run.smithi116.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1jammy [3,106 kB] 2024-04-19T02:13:36.910 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-19T02:13:36.936 INFO:teuthology.orchestra.run.smithi169.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1jammy [680 kB] 2024-04-19T02:13:36.954 INFO:teuthology.orchestra.run.smithi136.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1jammy [3,106 kB] 2024-04-19T02:13:36.979 INFO:teuthology.orchestra.run.smithi169.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1jammy [356 kB] 2024-04-19T02:13:37.013 INFO:teuthology.orchestra.run.smithi169.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1jammy [32.8 kB] 2024-04-19T02:13:37.014 INFO:teuthology.orchestra.run.smithi169.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1jammy [180 kB] 2024-04-19T02:13:37.042 INFO:teuthology.orchestra.run.smithi169.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1jammy [63.7 kB] 2024-04-19T02:13:37.045 INFO:teuthology.orchestra.run.smithi169.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1jammy [330 kB] 2024-04-19T02:13:37.066 INFO:teuthology.orchestra.run.smithi169.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1jammy [5,891 kB] 2024-04-19T02:13:37.076 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-19T02:13:37.101 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-19T02:13:37.162 INFO:teuthology.orchestra.run.smithi116.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1jammy [680 kB] 2024-04-19T02:13:37.206 INFO:teuthology.orchestra.run.smithi116.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1jammy [356 kB] 2024-04-19T02:13:37.231 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:13:37.243 INFO:teuthology.orchestra.run.smithi116.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1jammy [32.8 kB] 2024-04-19T02:13:37.244 INFO:teuthology.orchestra.run.smithi116.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1jammy [180 kB] 2024-04-19T02:13:37.250 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-19T02:13:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-19T02:13:37.276 INFO:teuthology.orchestra.run.smithi116.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1jammy [63.7 kB] 2024-04-19T02:13:37.278 INFO:teuthology.orchestra.run.smithi116.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1jammy [330 kB] 2024-04-19T02:13:37.316 INFO:teuthology.orchestra.run.smithi116.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1jammy [5,891 kB] 2024-04-19T02:13:37.328 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-19T02:13:37.356 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-19T02:13:37.363 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-19T02:13:37.486 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-19T02:13:37.487 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-19T02:13:37.525 INFO:teuthology.orchestra.run.smithi169.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1jammy [112 kB] 2024-04-19T02:13:37.528 INFO:teuthology.orchestra.run.smithi169.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1jammy [441 kB] 2024-04-19T02:13:37.540 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1jammy [3,106 kB] 2024-04-19T02:13:37.558 INFO:teuthology.orchestra.run.smithi169.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1jammy [21.9 MB] 2024-04-19T02:13:37.655 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-19T02:13:37.845 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-19T02:13:37.999 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-19T02:13:38.047 INFO:teuthology.orchestra.run.smithi116.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1jammy [112 kB] 2024-04-19T02:13:38.052 INFO:teuthology.orchestra.run.smithi116.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1jammy [441 kB] 2024-04-19T02:13:38.097 INFO:teuthology.orchestra.run.smithi116.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1jammy [21.9 MB] 2024-04-19T02:13:38.104 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-19T02:13:38.126 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-19T02:13:38.158 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-19T02:13:38.171 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-19T02:13:38.212 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-19T02:13:38.220 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-19T02:13:38.249 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-19T02:13:38.342 INFO:teuthology.orchestra.run.smithi136.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1jammy [680 kB] 2024-04-19T02:13:38.483 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-19T02:13:38.649 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-19T02:13:38.866 INFO:teuthology.orchestra.run.smithi136.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1jammy [356 kB] 2024-04-19T02:13:38.983 INFO:teuthology.orchestra.run.smithi169.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1jammy [5,002 kB] 2024-04-19T02:13:39.006 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-19T02:13:39.024 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-19T02:13:39.035 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-19T02:13:39.088 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-19T02:13:39.093 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-19T02:13:39.102 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-19T02:13:39.134 INFO:teuthology.orchestra.run.smithi136.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1jammy [32.8 kB] 2024-04-19T02:13:39.164 INFO:teuthology.orchestra.run.smithi169.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1jammy [241 kB] 2024-04-19T02:13:39.171 INFO:teuthology.orchestra.run.smithi169.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1jammy [130 kB] 2024-04-19T02:13:39.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:13:39.191 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-19T02:13:39.191 INFO:teuthology.orchestra.run.smithi169.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1jammy [1,490 kB] 2024-04-19T02:13:39.205 INFO:teuthology.orchestra.run.smithi136.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1jammy [180 kB] 2024-04-19T02:13:39.212 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-19T02:13:39.282 INFO:teuthology.orchestra.run.smithi169.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1jammy [6,079 kB] 2024-04-19T02:13:39.314 INFO:teuthology.orchestra.run.smithi136.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1jammy [63.7 kB] 2024-04-19T02:13:39.316 INFO:teuthology.orchestra.run.smithi136.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1jammy [330 kB] 2024-04-19T02:13:39.405 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-19T02:13:39.577 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-19T02:13:39.582 INFO:teuthology.orchestra.run.smithi136.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1jammy [5,891 kB] 2024-04-19T02:13:39.608 INFO:teuthology.orchestra.run.smithi169.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1jammy [22.3 MB] 2024-04-19T02:13:39.763 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-19T02:13:39.890 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1jammy [680 kB] 2024-04-19T02:13:40.255 INFO:teuthology.orchestra.run.smithi116.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1jammy [5,002 kB] 2024-04-19T02:13:40.275 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-19T02:13:40.276 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-19T02:13:40.279 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-19T02:13:40.280 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-19T02:13:40.282 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-19T02:13:40.285 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-19T02:13:40.286 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-19T02:13:40.288 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-19T02:13:40.306 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-19T02:13:40.456 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1jammy [356 kB] 2024-04-19T02:13:40.477 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-19T02:13:40.612 INFO:teuthology.orchestra.run.smithi116.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1jammy [241 kB] 2024-04-19T02:13:40.664 INFO:teuthology.orchestra.run.smithi116.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1jammy [130 kB] 2024-04-19T02:13:40.669 INFO:teuthology.orchestra.run.smithi116.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1jammy [1,490 kB] 2024-04-19T02:13:40.726 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1jammy [32.8 kB] 2024-04-19T02:13:40.781 INFO:teuthology.orchestra.run.smithi116.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1jammy [6,079 kB] 2024-04-19T02:13:40.792 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1jammy [180 kB] 2024-04-19T02:13:40.850 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-19T02:13:40.874 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-19T02:13:40.953 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1jammy [63.7 kB] 2024-04-19T02:13:40.965 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1jammy [330 kB] 2024-04-19T02:13:41.013 INFO:teuthology.orchestra.run.smithi169.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1jammy [14.1 kB] 2024-04-19T02:13:41.014 INFO:teuthology.orchestra.run.smithi169.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [831 kB] 2024-04-19T02:13:41.024 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-19T02:13:41.031 INFO:teuthology.orchestra.run.smithi169.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1jammy [2,154 kB] 2024-04-19T02:13:41.075 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-19T02:13:41.111 INFO:teuthology.orchestra.run.smithi169.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1jammy [238 kB] 2024-04-19T02:13:41.119 INFO:teuthology.orchestra.run.smithi169.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1jammy [144 kB] 2024-04-19T02:13:41.123 INFO:teuthology.orchestra.run.smithi169.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1jammy [2,238 kB] 2024-04-19T02:13:41.135 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-19T02:13:41.161 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:13:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-19T02:13:41.177 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-19T02:13:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-19T02:13:41.222 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-19T02:13:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1jammy [5,891 kB] 2024-04-19T02:13:41.248 INFO:teuthology.orchestra.run.smithi169.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1jammy [8,625 kB] 2024-04-19T02:13:41.346 INFO:teuthology.orchestra.run.smithi116.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1jammy [22.3 MB] 2024-04-19T02:13:41.388 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-19T02:13:41.768 INFO:teuthology.orchestra.run.smithi169.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1jammy [14.3 kB] 2024-04-19T02:13:41.769 INFO:teuthology.orchestra.run.smithi169.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1jammy [42.6 MB] 2024-04-19T02:13:43.487 INFO:teuthology.orchestra.run.smithi116.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1jammy [14.1 kB] 2024-04-19T02:13:43.488 INFO:teuthology.orchestra.run.smithi116.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [831 kB] 2024-04-19T02:13:43.504 INFO:teuthology.orchestra.run.smithi116.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1jammy [2,154 kB] 2024-04-19T02:13:43.692 INFO:teuthology.orchestra.run.smithi116.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1jammy [238 kB] 2024-04-19T02:13:43.707 INFO:teuthology.orchestra.run.smithi116.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1jammy [144 kB] 2024-04-19T02:13:43.712 INFO:teuthology.orchestra.run.smithi116.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1jammy [2,238 kB] 2024-04-19T02:13:43.833 INFO:teuthology.orchestra.run.smithi136.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1jammy [112 kB] 2024-04-19T02:13:43.906 INFO:teuthology.orchestra.run.smithi136.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1jammy [441 kB] 2024-04-19T02:13:43.925 INFO:teuthology.orchestra.run.smithi116.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1jammy [8,625 kB] 2024-04-19T02:13:44.193 INFO:teuthology.orchestra.run.smithi136.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1jammy [21.9 MB] 2024-04-19T02:13:44.508 INFO:teuthology.orchestra.run.smithi169.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1jammy [121 kB] 2024-04-19T02:13:44.510 INFO:teuthology.orchestra.run.smithi169.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1jammy [38.3 kB] 2024-04-19T02:13:44.511 INFO:teuthology.orchestra.run.smithi169.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1jammy [11.6 MB] 2024-04-19T02:13:44.657 INFO:teuthology.orchestra.run.smithi116.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1jammy [14.3 kB] 2024-04-19T02:13:44.657 INFO:teuthology.orchestra.run.smithi116.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1jammy [42.6 MB] 2024-04-19T02:13:45.050 INFO:teuthology.orchestra.run.smithi169.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [93.0 kB] 2024-04-19T02:13:45.606 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 162 MB in 10s (16.0 MB/s) 2024-04-19T02:13:45.662 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1jammy [112 kB] 2024-04-19T02:13:45.715 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-19T02:13:45.738 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1jammy [441 kB] 2024-04-19T02:13:45.772 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-19T02:13:45.777 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-19T02:13:45.859 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:13:46.070 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1jammy [21.9 MB] 2024-04-19T02:13:46.184 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-19T02:13:46.211 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-19T02:13:46.251 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:13:46.587 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:13:46.614 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-19T02:13:46.654 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:13:47.008 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:13:47.034 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-19T02:13:47.074 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:13:47.435 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:13:47.462 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:13:47.502 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:13:47.905 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:13:47.927 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:13:47.972 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:13:48.292 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:13:48.318 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:13:48.358 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:13:48.661 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-19T02:13:48.676 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-19T02:13:48.711 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:13:48.940 INFO:teuthology.orchestra.run.smithi116.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1jammy [121 kB] 2024-04-19T02:13:48.942 INFO:teuthology.orchestra.run.smithi116.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1jammy [38.3 kB] 2024-04-19T02:13:48.943 INFO:teuthology.orchestra.run.smithi116.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1jammy [11.6 MB] 2024-04-19T02:13:49.005 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librados2. 2024-04-19T02:13:49.029 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:49.072 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:49.500 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librbd1. 2024-04-19T02:13:49.526 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../009-librbd1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:49.566 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:50.011 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:13:50.027 INFO:teuthology.orchestra.run.smithi116.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [93.0 kB] 2024-04-19T02:13:50.037 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:50.078 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:50.581 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 162 MB in 15s (10.7 MB/s) 2024-04-19T02:13:50.589 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:13:50.604 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:50.638 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:50.722 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-19T02:13:50.821 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-19T02:13:50.827 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-19T02:13:50.912 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:13:50.950 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:13:50.977 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:13:51.016 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:51.249 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-19T02:13:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:13:51.275 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-19T02:13:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:51.315 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:13:51.335 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:51.655 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:13:51.682 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:13:51.685 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:13:51.712 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-19T02:13:51.713 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:51.752 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:13:52.016 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:13:52.030 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:13:52.043 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-19T02:13:52.056 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-19T02:13:52.083 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:13:52.088 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:13:52.352 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:13:52.379 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-19T02:13:52.410 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-19T02:13:52.533 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:13:52.560 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:13:52.608 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:13:52.654 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:13:52.670 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:52.713 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:53.012 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:13:53.038 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:13:53.058 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:13:53.078 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:13:53.084 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-19T02:13:53.124 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:13:53.364 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:13:53.391 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:13:53.422 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:13:53.460 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:13:53.487 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:53.527 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:53.620 INFO:teuthology.orchestra.run.smithi136.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1jammy [5,002 kB] 2024-04-19T02:13:53.759 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-19T02:13:53.785 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-19T02:13:53.825 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:13:53.971 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:13:53.986 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:54.021 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:54.145 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librados2. 2024-04-19T02:13:54.171 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:54.211 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:54.376 INFO:teuthology.orchestra.run.smithi136.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1jammy [241 kB] 2024-04-19T02:13:54.382 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-19T02:13:54.403 INFO:teuthology.orchestra.run.smithi136.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1jammy [130 kB] 2024-04-19T02:13:54.408 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-19T02:13:54.409 INFO:teuthology.orchestra.run.smithi136.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1jammy [1,490 kB] 2024-04-19T02:13:54.449 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:13:54.545 INFO:teuthology.orchestra.run.smithi136.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1jammy [6,079 kB] 2024-04-19T02:13:54.777 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:13:54.803 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:54.822 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librbd1. 2024-04-19T02:13:54.838 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../009-librbd1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:54.843 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:54.872 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:55.029 INFO:teuthology.orchestra.run.smithi136.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1jammy [22.3 MB] 2024-04-19T02:13:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:13:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:55.275 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:13:55.302 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:55.358 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:55.628 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:13:55.643 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:55.686 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:56.005 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:13:56.015 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1jammy [5,002 kB] 2024-04-19T02:13:56.032 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:13:56.072 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:56.283 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:13:56.298 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:56.333 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:56.577 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:13:56.604 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:56.645 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:56.652 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:13:56.678 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:13:56.719 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:56.808 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1jammy [241 kB] 2024-04-19T02:13:56.823 INFO:teuthology.orchestra.run.smithi136.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1jammy [14.1 kB] 2024-04-19T02:13:56.824 INFO:teuthology.orchestra.run.smithi136.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [831 kB] 2024-04-19T02:13:56.840 INFO:teuthology.orchestra.run.smithi136.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1jammy [2,154 kB] 2024-04-19T02:13:56.842 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1jammy [130 kB] 2024-04-19T02:13:56.855 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1jammy [1,490 kB] 2024-04-19T02:13:56.879 INFO:teuthology.orchestra.run.smithi136.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1jammy [238 kB] 2024-04-19T02:13:56.883 INFO:teuthology.orchestra.run.smithi136.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1jammy [144 kB] 2024-04-19T02:13:56.885 INFO:teuthology.orchestra.run.smithi136.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1jammy [2,238 kB] 2024-04-19T02:13:56.999 INFO:teuthology.orchestra.run.smithi136.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1jammy [8,625 kB] 2024-04-19T02:13:57.047 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:13:57.073 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-19T02:13:57.113 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:13:57.115 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1jammy [6,079 kB] 2024-04-19T02:13:57.132 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-19T02:13:57.158 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-19T02:13:57.190 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:13:57.408 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:13:57.434 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-19T02:13:57.474 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-19T02:13:57.476 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cheroot. 2024-04-19T02:13:57.502 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-19T02:13:57.504 INFO:teuthology.orchestra.run.smithi136.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1jammy [14.3 kB] 2024-04-19T02:13:57.505 INFO:teuthology.orchestra.run.smithi136.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1jammy [42.6 MB] 2024-04-19T02:13:57.542 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:13:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:13:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:57.870 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-19T02:13:57.897 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-19T02:13:57.937 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:13:58.088 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:13:58.115 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-19T02:13:58.122 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1jammy [22.3 MB] 2024-04-19T02:13:58.163 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:13:58.257 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-19T02:13:58.283 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-19T02:13:58.323 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:13:58.474 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:13:58.501 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:58.540 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:58.601 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-19T02:13:58.628 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-19T02:13:58.667 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:13:58.970 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempora. 2024-04-19T02:13:58.996 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-19T02:13:59.026 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:13:59.037 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-19T02:13:59.041 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:59.076 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:13:59.346 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-19T02:13:59.348 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-portend. 2024-04-19T02:13:59.372 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-19T02:13:59.374 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-19T02:13:59.412 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:13:59.414 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-19T02:13:59.667 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-19T02:13:59.682 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-19T02:13:59.717 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-19T02:13:59.832 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:13:59.858 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:13:59.898 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:00.020 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:14:00.047 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-19T02:14:00.087 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:14:00.270 INFO:teuthology.orchestra.run.smithi136.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1jammy [121 kB] 2024-04-19T02:14:00.273 INFO:teuthology.orchestra.run.smithi136.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1jammy [38.3 kB] 2024-04-19T02:14:00.274 INFO:teuthology.orchestra.run.smithi136.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1jammy [11.6 MB] 2024-04-19T02:14:00.337 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:14:00.364 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:00.410 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:00.432 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:14:00.447 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-19T02:14:00.490 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-19T02:14:00.760 INFO:teuthology.orchestra.run.smithi136.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [93.0 kB] 2024-04-19T02:14:00.802 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:14:00.828 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-19T02:14:00.868 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-19T02:14:01.145 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1jammy [14.1 kB] 2024-04-19T02:14:01.145 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [831 kB] 2024-04-19T02:14:01.146 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:14:01.161 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1jammy [2,154 kB] 2024-04-19T02:14:01.172 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-19T02:14:01.300 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1jammy [238 kB] 2024-04-19T02:14:01.327 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1jammy [144 kB] 2024-04-19T02:14:01.328 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 162 MB in 26s (6,265 kB/s) 2024-04-19T02:14:01.330 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1jammy [2,238 kB] 2024-04-19T02:14:01.331 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:14:01.470 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-19T02:14:01.482 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1jammy [8,625 kB] 2024-04-19T02:14:01.568 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-19T02:14:01.573 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-19T02:14:01.657 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:14:01.665 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:14:01.669 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:14:01.683 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-19T02:14:01.692 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:01.724 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:14:01.741 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:01.947 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-19T02:14:01.973 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-19T02:14:02.006 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:14:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:14:02.079 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:14:02.119 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:14:02.211 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1jammy [14.3 kB] 2024-04-19T02:14:02.212 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1jammy [42.6 MB] 2024-04-19T02:14:02.295 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-19T02:14:02.300 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:14:02.321 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-19T02:14:02.326 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-19T02:14:02.353 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:14:02.367 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:14:02.438 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:14:02.464 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-19T02:14:02.505 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:14:02.622 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cheroot. 2024-04-19T02:14:02.649 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-19T02:14:02.689 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:14:02.695 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:14:02.722 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-19T02:14:02.762 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:14:02.841 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:14:02.867 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-19T02:14:02.907 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:14:03.025 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-19T02:14:03.052 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-19T02:14:03.091 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:14:03.182 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:14:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:14:03.252 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:14:03.257 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:03.279 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-19T02:14:03.321 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:14:03.394 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-19T02:14:03.421 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-19T02:14:03.461 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:14:03.622 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:14:03.635 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:14:03.648 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-19T02:14:03.661 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:14:03.680 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:14:03.702 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:03.747 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-19T02:14:03.763 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-19T02:14:03.797 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:14:03.974 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:14:04.001 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-19T02:14:04.041 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:14:04.046 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:14:04.066 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempora. 2024-04-19T02:14:04.073 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:14:04.093 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-19T02:14:04.113 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:04.133 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-19T02:14:04.361 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:14:04.387 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-19T02:14:04.427 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:14:04.441 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-19T02:14:04.444 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-portend. 2024-04-19T02:14:04.467 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-19T02:14:04.471 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-19T02:14:04.508 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:14:04.511 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-19T02:14:04.730 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:14:04.756 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-19T02:14:04.796 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:14:04.836 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librados2. 2024-04-19T02:14:04.862 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:04.902 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:04.980 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-19T02:14:05.007 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-19T02:14:05.041 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:14:05.047 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-19T02:14:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-19T02:14:05.099 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-19T02:14:05.147 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1jammy [121 kB] 2024-04-19T02:14:05.150 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1jammy [38.3 kB] 2024-04-19T02:14:05.221 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1jammy [11.6 MB] 2024-04-19T02:14:05.300 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:14:05.326 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-19T02:14:05.358 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:14:05.364 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librbd1. 2024-04-19T02:14:05.390 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../009-librbd1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:05.402 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:14:05.429 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-19T02:14:05.430 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:05.469 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:14:05.703 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:14:05.730 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-19T02:14:05.770 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-19T02:14:05.783 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1jammy [93.0 kB] 2024-04-19T02:14:05.832 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-certifi. 2024-04-19T02:14:05.858 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:14:05.859 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-19T02:14:05.885 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:05.907 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-19T02:14:05.959 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:06.056 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:14:06.083 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-19T02:14:06.122 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-19T02:14:06.227 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-idna. 2024-04-19T02:14:06.253 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-19T02:14:06.293 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-19T02:14:06.336 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:14:06.339 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 162 MB in 31s (5,279 kB/s) 2024-04-19T02:14:06.351 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:06.385 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:06.400 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:14:06.430 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-19T02:14:06.458 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-19T02:14:06.467 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:14:06.555 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-19T02:14:06.560 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-19T02:14:06.646 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-urllib3. 2024-04-19T02:14:06.648 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:14:06.673 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-19T02:14:06.712 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:14:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:14:06.736 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:14:06.740 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:06.752 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-19T02:14:06.780 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:06.786 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:14:06.934 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-19T02:14:06.950 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-19T02:14:06.984 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:14:07.033 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:14:07.041 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests. 2024-04-19T02:14:07.048 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:07.067 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-19T02:14:07.091 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:07.098 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:14:07.107 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:14:07.125 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:14:07.164 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:14:07.323 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:14:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-19T02:14:07.390 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:14:07.393 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:14:07.409 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-19T02:14:07.443 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:14:07.467 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:14:07.494 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-19T02:14:07.534 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:14:07.726 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:14:07.729 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:14:07.745 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:07.753 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-19T02:14:07.788 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:07.793 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:14:07.813 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:14:07.840 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-19T02:14:07.871 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:14:08.103 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:14:08.129 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:08.158 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:14:08.159 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:14:08.169 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:08.175 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:08.184 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-19T02:14:08.217 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:08.219 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:14:08.389 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:14:08.415 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:14:08.464 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:14:08.491 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-19T02:14:08.522 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:14:08.528 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:14:08.555 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../055-python3-openssl_21.0.0-1_all.deb ... 2024-04-19T02:14:08.595 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-19T02:14:08.858 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:14:08.885 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-19T02:14:08.914 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:08.915 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:14:08.925 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-19T02:14:08.941 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../056-ceph-mgr_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:08.981 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:09.186 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:14:09.201 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:09.244 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:09.351 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:14:09.378 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../057-ceph-mon_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:09.400 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:14:09.418 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:09.427 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:14:09.435 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:14:09.462 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-19T02:14:09.467 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:09.502 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:14:09.564 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:14:09.579 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-19T02:14:09.614 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:14:09.787 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:14:09.788 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:14:09.813 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T02:14:09.815 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-19T02:14:09.845 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:09.855 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:14:09.892 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:14:09.918 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:09.958 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:10.021 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:14:10.043 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../058-ceph-osd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:10.088 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:10.175 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:14:10.198 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-19T02:14:10.202 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-19T02:14:10.225 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-19T02:14:10.241 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:14:10.265 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:14:10.452 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:14:10.468 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:10.510 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:10.519 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:14:10.546 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-19T02:14:10.576 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2024-04-19T02:14:10.585 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:14:10.602 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:10.643 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:10.839 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:14:10.851 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-19T02:14:10.855 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-19T02:14:10.880 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-19T02:14:10.882 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-19T02:14:10.922 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:14:11.071 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2024-04-19T02:14:11.097 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-librbd1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:11.116 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph. 2024-04-19T02:14:11.131 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../059-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:11.137 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:11.166 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:11.183 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:14:11.191 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:14:11.210 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-19T02:14:11.218 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:11.249 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:14:11.250 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:11.477 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:14:11.504 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../060-ceph-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:11.543 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:11.557 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:14:11.583 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:11.612 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-certifi. 2024-04-19T02:14:11.623 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:11.639 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-19T02:14:11.661 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:14:11.678 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-19T02:14:11.688 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:11.727 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:11.901 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:14:11.916 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:11.959 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:11.982 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-idna. 2024-04-19T02:14:12.009 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-19T02:14:12.048 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-19T02:14:12.097 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:14:12.123 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../061-ceph-mds_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:12.166 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:12.287 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:14:12.314 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:12.343 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-urllib3. 2024-04-19T02:14:12.354 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:12.370 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-19T02:14:12.409 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:14:12.558 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:14:12.581 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:14:12.585 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../062-cephadm_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:12.597 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:12.625 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:12.631 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:12.712 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests. 2024-04-19T02:14:12.728 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-19T02:14:12.762 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:14:12.894 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:14:12.910 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../063-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-19T02:14:12.934 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:14:12.944 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-19T02:14:12.961 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:13.001 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:13.025 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:14:13.032 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:14:13.047 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-19T02:14:13.052 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:13.082 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:14:13.101 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:13.247 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-19T02:14:13.262 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../064-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:13.297 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:13.321 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:14:13.347 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-19T02:14:13.387 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:14:13.392 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:14:13.419 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:13.460 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:13.715 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:14:13.738 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-19T02:14:13.742 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-19T02:14:13.764 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-19T02:14:13.782 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-19T02:14:13.804 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:14:13.848 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:14:13.875 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:13.914 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:14.034 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:14:14.050 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:14.083 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cheroot. 2024-04-19T02:14:14.084 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:14.109 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-19T02:14:14.149 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:14:14.225 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:14:14.252 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../055-python3-openssl_21.0.0-1_all.deb ... 2024-04-19T02:14:14.292 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-19T02:14:14.304 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-babel. 2024-04-19T02:14:14.332 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../065-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:14.370 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:14.413 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:14:14.439 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-19T02:14:14.444 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-19T02:14:14.470 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-19T02:14:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:14:14.502 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:14:14.578 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:14:14.605 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../056-ceph-mgr_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:14.636 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:14.724 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:14:14.751 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../066-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-19T02:14:14.790 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:14:14.805 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-19T02:14:14.824 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:14:14.867 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-19T02:14:14.867 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:14.871 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:14:14.907 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:14.973 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:14:14.997 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../057-ceph-mon_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:15.033 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:15.144 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:14:15.171 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../067-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:15.174 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-19T02:14:15.201 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-19T02:14:15.210 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:15.241 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:14:15.401 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:14:15.417 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:15.460 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:15.510 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-tempora. 2024-04-19T02:14:15.534 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-19T02:14:15.556 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:14:15.569 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-19T02:14:15.582 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../068-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-19T02:14:15.622 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:14:15.746 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-19T02:14:15.772 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-19T02:14:15.776 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:14:15.803 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../058-ceph-osd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:15.812 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:14:15.843 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:15.855 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-portend. 2024-04-19T02:14:15.882 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-19T02:14:15.917 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:14:15.922 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-19T02:14:15.944 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-19T02:14:15.983 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:14:16.115 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:14:16.142 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:16.182 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:16.224 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-19T02:14:16.251 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-19T02:14:16.291 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-19T02:14:16.311 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:14:16.338 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-19T02:14:16.378 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-19T02:14:16.594 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:14:16.610 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:14:16.620 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-19T02:14:16.637 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:16.660 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:14:16.678 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:16.690 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-19T02:14:16.717 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-19T02:14:16.756 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:16.871 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph. 2024-04-19T02:14:16.886 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../059-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:16.929 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:17.023 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:14:17.050 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-19T02:14:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-toml. 2024-04-19T02:14:17.089 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-19T02:14:17.095 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-19T02:14:17.143 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-19T02:14:17.207 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:14:17.234 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../060-ceph-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:17.265 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:17.384 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:14:17.410 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-19T02:14:17.446 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:14:17.450 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-19T02:14:17.473 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-19T02:14:17.512 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:14:17.618 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:14:17.645 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../061-ceph-mds_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:17.684 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:14:17.727 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-19T02:14:17.778 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:14:17.858 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:14:17.884 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:14:17.902 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:14:17.924 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:14:17.926 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:17.993 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:18.048 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:14:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:14:18.074 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-19T02:14:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../062-cephadm_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:18.114 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:14:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:18.227 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:14:18.254 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-19T02:14:18.294 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:14:18.382 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:14:18.397 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../063-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-19T02:14:18.432 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-19T02:14:18.451 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:14:18.477 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:14:18.518 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:14:18.562 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-19T02:14:18.589 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-19T02:14:18.629 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:14:18.656 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:14:18.673 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:18.714 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:18.718 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-19T02:14:18.733 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../064-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:18.768 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:18.806 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:14:18.832 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-19T02:14:18.872 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:14:18.940 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2024-04-19T02:14:18.967 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-19T02:14:19.007 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:14:19.142 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:14:19.168 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-19T02:14:19.208 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:14:19.327 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-19T02:14:19.353 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-19T02:14:19.393 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:14:19.545 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:14:19.571 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-19T02:14:19.614 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:14:19.654 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-19T02:14:19.681 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-19T02:14:19.712 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:14:19.723 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-babel. 2024-04-19T02:14:19.750 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../065-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:19.790 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:19.919 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-19T02:14:19.923 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:14:19.935 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-19T02:14:19.949 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-19T02:14:19.978 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:14:19.989 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:14:20.007 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-19T02:14:20.033 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-19T02:14:20.074 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:14:20.109 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:14:20.136 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../066-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-19T02:14:20.176 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:14:20.292 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:14:20.319 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-19T02:14:20.359 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:14:20.377 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2024-04-19T02:14:20.404 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-19T02:14:20.443 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-19T02:14:20.473 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:14:20.500 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-19T02:14:20.521 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:14:20.539 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:14:20.548 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../067-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:20.587 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:20.678 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:14:20.704 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-19T02:14:20.721 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2024-04-19T02:14:20.736 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-19T02:14:20.745 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:14:20.771 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-19T02:14:20.877 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-19T02:14:20.903 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-19T02:14:20.916 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:14:20.943 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../068-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-19T02:14:20.943 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:14:20.982 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:14:21.074 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-19T02:14:21.081 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:14:21.101 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-19T02:14:21.108 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-19T02:14:21.141 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-19T02:14:21.148 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:14:21.246 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:14:21.273 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-19T02:14:21.285 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:14:21.312 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:14:21.313 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-19T02:14:21.351 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:14:21.444 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:14:21.471 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-19T02:14:21.510 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:14:21.618 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:14:21.644 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-19T02:14:21.646 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:14:21.673 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-19T02:14:21.684 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-19T02:14:21.713 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-19T02:14:21.856 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:14:21.883 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-19T02:14:21.922 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-19T02:14:21.954 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:14:21.969 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-19T02:14:22.003 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:14:22.005 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:14:22.021 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:22.041 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-19T02:14:22.054 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:22.068 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-19T02:14:22.124 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:22.193 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:14:22.208 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-19T02:14:22.242 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-19T02:14:22.308 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-certifi. 2024-04-19T02:14:22.324 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-19T02:14:22.358 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-19T02:14:22.385 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-toml. 2024-04-19T02:14:22.401 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-19T02:14:22.435 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-19T02:14:22.520 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:14:22.547 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-19T02:14:22.587 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:14:22.670 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-idna. 2024-04-19T02:14:22.696 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-19T02:14:22.713 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:14:22.736 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-19T02:14:22.739 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-19T02:14:22.779 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:14:22.890 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:14:22.916 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-19T02:14:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:14:23.056 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-urllib3. 2024-04-19T02:14:23.072 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-19T02:14:23.075 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:14:23.090 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:14:23.114 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:14:23.125 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:14:23.199 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:14:23.227 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-19T02:14:23.266 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-19T02:14:23.301 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:14:23.317 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:14:23.351 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:14:23.411 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:14:23.438 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-19T02:14:23.453 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-requests. 2024-04-19T02:14:23.477 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:14:23.478 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-19T02:14:23.509 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:14:23.637 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:14:23.664 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-19T02:14:23.679 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:14:23.704 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:14:23.707 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-19T02:14:23.754 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:14:23.798 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:14:23.803 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:14:23.825 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:23.830 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-19T02:14:23.864 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:23.870 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:14:24.001 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:14:24.025 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-19T02:14:24.065 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:14:24.133 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:14:24.160 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-19T02:14:24.165 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:14:24.181 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:24.199 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:14:24.223 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:24.427 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:14:24.453 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-19T02:14:24.496 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:14:24.519 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:14:24.546 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-19T02:14:24.585 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-19T02:14:24.595 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:14:24.621 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:24.661 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:24.813 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:14:24.828 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-19T02:14:24.871 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:14:24.906 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:14:24.933 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-19T02:14:24.972 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-19T02:14:24.973 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:14:25.000 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../055-python3-openssl_21.0.0-1_all.deb ... 2024-04-19T02:14:25.039 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-19T02:14:25.061 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-19T02:14:25.076 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-19T02:14:25.111 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:14:25.191 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:14:25.218 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-19T02:14:25.257 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:14:25.267 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:14:25.283 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-19T02:14:25.317 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:14:25.400 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:14:25.427 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../056-ceph-mgr_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:25.467 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:25.561 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:14:25.573 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:14:25.576 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-19T02:14:25.588 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-19T02:14:25.619 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:14:25.622 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:14:25.637 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:14:25.664 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-19T02:14:25.704 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-19T02:14:25.820 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:14:25.847 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../057-ceph-mon_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:25.878 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:25.922 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:14:25.938 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-19T02:14:25.980 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:14:25.982 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:14:26.009 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-19T02:14:26.040 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:14:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-19T02:14:26.220 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-19T02:14:26.259 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:14:26.283 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:14:26.310 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-19T02:14:26.350 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-19T02:14:26.482 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:14:26.509 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../058-ceph-osd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:26.548 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:26.628 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:14:26.654 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-19T02:14:26.686 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:14:26.696 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:14:26.722 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-19T02:14:26.762 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:14:26.854 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:14:26.871 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:26.904 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:27.008 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2024-04-19T02:14:27.035 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-19T02:14:27.074 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-19T02:14:27.266 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:14:27.293 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-19T02:14:27.332 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:14:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2024-04-19T02:14:27.454 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-19T02:14:27.479 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:14:27.494 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-19T02:14:27.506 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:27.545 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:27.610 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph. 2024-04-19T02:14:27.636 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../059-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:27.652 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:14:27.677 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:27.680 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:27.718 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:14:27.789 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2024-04-19T02:14:27.815 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-19T02:14:27.855 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:14:27.954 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:14:27.963 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package jq. 2024-04-19T02:14:27.979 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:27.981 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../060-ceph-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:28.012 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:28.021 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-19T02:14:28.158 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2024-04-19T02:14:28.185 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-19T02:14:28.216 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:14:28.274 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package socat. 2024-04-19T02:14:28.290 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-19T02:14:28.332 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:14:28.374 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:14:28.401 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../061-ceph-mds_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:28.440 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:14:28.440 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:28.467 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-19T02:14:28.495 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:14:28.506 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-19T02:14:28.521 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-19T02:14:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:14:28.652 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:14:28.680 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-19T02:14:28.719 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:14:28.827 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:14:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:14:28.853 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../062-cephadm_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:28.877 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:14:28.889 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:28.893 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:28.905 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-19T02:14:28.944 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:14:29.081 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:14:29.106 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:29.148 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:29.163 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:14:29.179 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../063-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-19T02:14:29.213 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-19T02:14:29.272 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:14:29.294 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:14:29.299 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-19T02:14:29.322 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:29.347 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:14:29.361 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:29.533 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-19T02:14:29.562 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../064-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:29.599 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:29.656 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:14:29.658 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:14:29.682 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-openssl_21.0.0-1_all.deb ... 2024-04-19T02:14:29.685 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-19T02:14:29.722 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-19T02:14:29.724 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-19T02:14:30.036 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:14:30.050 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:14:30.064 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-19T02:14:30.077 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-ceph-mgr_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:30.103 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-19T02:14:30.117 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:30.406 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:14:30.422 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-19T02:14:30.465 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:14:30.520 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:14:30.546 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-ceph-mon_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:30.563 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-babel. 2024-04-19T02:14:30.586 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:30.590 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../065-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:30.629 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:30.776 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:14:30.803 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-19T02:14:30.842 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-19T02:14:30.966 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:14:30.993 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../066-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-19T02:14:31.019 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:14:31.032 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:14:31.047 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:31.085 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:31.162 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:14:31.189 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-19T02:14:31.229 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:14:31.381 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:14:31.386 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:14:31.397 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:31.399 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:14:31.413 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../067-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:31.419 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-ceph-osd_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:31.430 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:31.452 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:31.457 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:31.784 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:14:31.812 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-19T02:14:31.850 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:31.884 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:14:31.900 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:31.942 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:31.998 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:14:32.024 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../068-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-19T02:14:32.064 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:14:32.189 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:14:32.205 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-19T02:14:32.247 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:14:32.270 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:14:32.297 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-19T02:14:32.326 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:14:32.336 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:14:32.352 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-19T02:14:32.392 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:14:32.469 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-04-19T02:14:32.495 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:32.535 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:32.626 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:14:32.653 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:14:32.673 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:14:32.692 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:14:32.700 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:32.703 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:14:32.730 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-19T02:14:32.739 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:14:32.770 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-19T02:14:32.854 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:14:32.881 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-ceph-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:32.921 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:32.950 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package jq. 2024-04-19T02:14:32.966 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:33.009 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-19T02:14:33.012 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:14:33.040 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-19T02:14:33.079 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-19T02:14:33.107 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-19T02:14:33.134 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-19T02:14:33.174 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:33.261 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package socat. 2024-04-19T02:14:33.275 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:14:33.277 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-19T02:14:33.301 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-ceph-mds_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:33.319 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:14:33.349 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:33.382 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pygments. 2024-04-19T02:14:33.410 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-19T02:14:33.448 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:14:33.493 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-toml. 2024-04-19T02:14:33.520 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-19T02:14:33.559 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-19T02:14:33.623 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:14:33.650 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-19T02:14:33.698 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:14:33.761 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:14:33.788 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-cephadm_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:33.827 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:33.829 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:14:33.856 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-19T02:14:33.887 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:14:33.903 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:14:33.931 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-19T02:14:33.969 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:14:34.054 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:14:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:34.118 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:34.147 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:14:34.174 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-19T02:14:34.213 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-19T02:14:34.250 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:14:34.276 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:14:34.297 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:14:34.316 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:14:34.324 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-19T02:14:34.363 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:14:34.534 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-19T02:14:34.560 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:34.600 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:34.611 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:14:34.637 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-19T02:14:34.641 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:14:34.669 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-19T02:14:34.677 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:14:34.707 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:14:35.014 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:14:35.041 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:35.082 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:35.437 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:14:35.489 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../107-radosgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:35.504 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:35.647 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2024-04-19T02:14:35.674 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T02:14:35.713 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:36.014 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:14:36.041 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:36.042 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:14:36.068 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-19T02:14:36.072 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:36.108 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:14:36.231 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:14:36.259 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:36.297 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:36.335 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-19T02:14:36.351 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-19T02:14:36.394 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:14:36.522 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:36.562 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:36.601 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:36.618 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:14:36.633 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:36.676 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:36.869 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:14:36.899 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:14:36.906 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:14:36.925 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-19T02:14:36.933 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-19T02:14:36.965 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:14:36.973 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:14:36.987 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:36.995 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:14:37.023 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-19T02:14:37.062 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:37.221 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-19T02:14:37.260 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:14:37.286 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-19T02:14:37.318 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:14:37.318 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-19T02:14:37.345 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-19T02:14:37.358 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:14:37.374 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-19T02:14:37.376 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:14:37.408 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:14:37.582 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-19T02:14:37.613 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:14:37.639 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-19T02:14:37.680 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-19T02:14:37.687 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:14:37.714 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-19T02:14:37.754 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:14:37.778 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:14:37.794 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:14:37.828 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:14:38.000 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-19T02:14:38.026 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-19T02:14:38.034 INFO:teuthology.orchestra.run.smithi169.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-19T02:14:38.066 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:38.115 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:14:38.142 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-19T02:14:38.149 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:38.181 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-19T02:14:38.369 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2024-04-19T02:14:38.396 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-19T02:14:38.429 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:14:38.436 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-19T02:14:38.457 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:38.492 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pygments. 2024-04-19T02:14:38.495 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:38.520 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-19T02:14:38.559 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:14:38.714 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:14:38.740 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-19T02:14:38.780 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:14:39.021 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:14:39.049 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-19T02:14:39.087 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:14:39.110 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:14:39.136 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:14:39.178 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:14:39.258 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user cephadm....done 2024-04-19T02:14:39.390 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:14:39.407 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:14:39.418 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-19T02:14:39.434 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-19T02:14:39.457 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:14:39.473 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-19T02:14:39.479 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:14:39.505 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-19T02:14:39.528 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:14:39.545 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:14:39.760 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:14:39.787 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-19T02:14:39.826 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:14:39.870 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:14:39.889 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:14:39.897 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-19T02:14:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:14:39.936 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:14:39.942 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:39.982 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:40.141 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:14:40.250 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:14:40.257 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:14:40.284 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-19T02:14:40.323 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:14:40.493 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:14:40.531 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:14:40.560 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../107-radosgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:40.588 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:40.635 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:14:40.662 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-19T02:14:40.701 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-19T02:14:40.762 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:14:40.888 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-19T02:14:41.014 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:14:41.041 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-19T02:14:41.071 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-19T02:14:41.197 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:14:41.213 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-19T02:14:41.228 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-19T02:14:41.271 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:14:41.299 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:14:41.315 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:41.358 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:41.383 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:14:41.410 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-19T02:14:41.449 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:14:41.574 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-19T02:14:41.685 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:41.775 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:14:41.794 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:14:41.802 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-19T02:14:41.821 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-19T02:14:41.834 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-19T02:14:41.834 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:14:41.860 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-19T02:14:41.937 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:14:42.063 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:42.110 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:14:42.181 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:14:42.187 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-19T02:14:42.208 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-19T02:14:42.214 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-19T02:14:42.247 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:14:42.253 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:14:42.325 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-19T02:14:42.369 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:14:42.565 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:14:42.592 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-19T02:14:42.631 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:14:42.643 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-19T02:14:42.770 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:14:42.944 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:14:42.960 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:43.003 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:43.021 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:43.082 INFO:teuthology.orchestra.run.smithi116.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-19T02:14:43.140 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:43.281 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:14:43.323 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:14:43.331 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:14:43.339 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:43.358 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-19T02:14:43.381 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:43.397 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:14:43.398 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:14:43.640 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user cephadm....done 2024-04-19T02:14:43.675 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:14:43.675 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:14:43.702 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:43.734 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:14:43.792 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-19T02:14:43.795 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:14:44.003 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package jq. 2024-04-19T02:14:44.018 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:44.078 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-19T02:14:44.088 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:14:44.161 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-19T02:14:44.330 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package socat. 2024-04-19T02:14:44.331 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:14:44.346 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-19T02:14:44.360 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:14:44.387 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-19T02:14:44.397 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:14:44.426 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-19T02:14:44.432 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:14:44.554 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:14:44.683 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:14:44.700 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:14:44.728 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-19T02:14:44.767 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:14:44.814 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:14:44.814 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:14:44.841 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-19T02:14:44.880 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:14:44.935 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:14:45.061 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-19T02:14:45.107 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:14:45.113 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:14:45.129 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:45.162 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:45.203 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:14:45.230 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-19T02:14:45.269 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:14:45.371 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:14:45.597 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:14:45.623 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-19T02:14:45.664 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-19T02:14:45.731 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-19T02:14:45.742 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:14:45.942 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:14:45.969 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-19T02:14:45.974 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-19T02:14:45.993 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:14:46.017 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-19T02:14:46.119 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:14:46.225 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:14:46.245 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:14:46.337 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:14:46.364 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:14:46.476 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:14:46.521 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-19T02:14:46.715 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:14:46.742 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-19T02:14:46.781 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-19T02:14:46.889 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-19T02:14:46.925 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:14:46.927 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:14:46.953 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:46.992 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:47.110 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:14:47.132 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:14:47.138 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-19T02:14:47.176 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:14:47.194 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:47.471 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:14:47.486 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:47.508 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:14:47.529 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:47.571 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:14:47.696 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:14:47.818 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:14:47.832 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:14:47.860 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:47.898 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:47.916 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:14:47.931 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:14:47.943 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-19T02:14:47.982 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:48.040 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-19T02:14:48.161 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:14:48.167 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:14:48.195 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-19T02:14:48.225 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:14:48.345 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:14:48.373 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-19T02:14:48.383 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:48.412 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:14:48.420 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:14:48.509 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-19T02:14:48.513 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:48.579 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:14:48.607 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:48.645 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:14:48.777 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:14:48.790 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-idna (3.3-1) ... 2024-04-19T02:14:48.882 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:14:48.909 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:14:48.923 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-04-19T02:14:48.950 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T02:14:48.956 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:14:48.989 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-19T02:14:49.045 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:14:49.234 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-04-19T02:14:49.250 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-19T02:14:49.268 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:14:49.283 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:14:49.288 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-19T02:14:49.324 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:14:49.326 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-19T02:14:49.354 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:14:49.554 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:14:49.577 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-19T02:14:49.612 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:14:49.621 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pygments. 2024-04-19T02:14:49.638 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-19T02:14:49.671 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:14:49.966 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:14:49.982 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:50.008 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:14:50.024 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:50.134 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:14:50.161 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-19T02:14:50.200 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:14:50.267 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:14:50.410 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:14:50.497 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:50.511 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:14:50.536 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:14:50.538 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-19T02:14:50.578 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:14:50.614 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-19T02:14:50.829 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-19T02:14:50.847 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:14:50.865 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:14:50.874 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-19T02:14:50.922 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:14:50.975 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:14:51.093 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:14:51.213 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-19T02:14:51.394 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:14:51.447 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:14:51.670 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-19T02:14:51.701 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:14:51.728 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../107-radosgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:51.767 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:51.807 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:14:51.921 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:52.050 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:14:52.101 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:14:52.173 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:14:52.320 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:14:52.348 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1237-g646b8c7d-1jammy_all.deb ... 2024-04-19T02:14:52.386 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:52.450 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:14:52.452 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:14:52.562 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:14:52.578 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:52.612 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:52.674 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:14:52.690 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:52.701 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-19T02:14:52.711 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:14:52.732 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:52.837 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:52.907 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:52.960 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-19T02:14:53.102 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:14:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-19T02:14:53.138 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-idna (3.3-1) ... 2024-04-19T02:14:53.167 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:14:53.168 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:53.229 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:14:53.293 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:53.456 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:14:53.463 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-19T02:14:53.490 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:14:53.506 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-19T02:14:53.548 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:14:53.556 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-19T02:14:53.739 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:14:53.865 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-19T02:14:53.895 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-19T02:14:53.942 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:14:53.958 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:14:53.992 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:14:54.132 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:14:54.259 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:14:54.271 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:14:54.299 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-19T02:14:54.333 INFO:teuthology.orchestra.run.smithi136.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-19T02:14:54.337 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-19T02:14:54.543 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-19T02:14:54.698 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:14:54.788 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-19T02:14:54.845 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:14:55.039 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:14:55.096 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:55.103 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user cephadm....done 2024-04-19T02:14:55.148 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:14:55.203 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:14:55.231 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-19T02:14:55.257 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:14:55.259 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:14:55.269 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:14:55.503 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-19T02:14:55.530 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:14:55.559 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:14:55.580 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:14:55.608 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-19T02:14:55.646 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:14:55.762 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:14:55.765 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:14:55.810 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-19T02:14:55.866 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:14:55.888 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:14:55.916 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:14:55.944 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-19T02:14:55.982 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:14:56.053 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:56.131 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:14:56.162 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:14:56.226 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:14:56.288 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:14:56.390 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:14:56.494 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-19T02:14:56.517 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-19T02:14:56.606 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:14:56.745 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:14:56.753 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:14:56.781 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-radosgw_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:56.818 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:14:56.819 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:56.840 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-19T02:14:56.871 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:14:57.170 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-19T02:14:57.189 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:14:57.258 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-19T02:14:57.430 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-19T02:14:57.490 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:14:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:14:57.522 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:14:57.538 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1237-g646b8c7d-1jammy_amd64.deb ... 2024-04-19T02:14:57.582 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:57.698 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:14:57.758 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-19T02:14:57.760 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-19T02:14:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-19T02:14:57.884 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-19T02:14:57.957 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:14:58.036 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:14:58.118 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T02:14:58.152 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-19T02:14:58.162 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-19T02:14:58.225 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:14:58.269 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T02:14:58.428 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:14:58.446 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:14:58.484 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:58.526 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-19T02:14:58.548 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:14:58.688 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:14:58.735 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:14:58.824 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:14:58.843 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-19T02:14:58.861 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:14:59.064 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T02:14:59.112 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:14:59.133 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:14:59.247 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-19T02:14:59.311 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-19T02:14:59.349 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:14:59.379 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:59.393 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:59.606 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:14:59.684 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:14:59.724 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-19T02:14:59.782 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-19T02:14:59.812 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:59.820 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-04-19T02:14:59.955 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:14:59.968 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T02:15:00.000 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:15:00.046 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:15:00.081 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:00.163 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:15:00.190 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:00.236 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-19T02:15:00.276 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:15:00.291 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:00.486 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-19T02:15:00.487 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-19T02:15:00.531 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:15:00.561 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:15:00.613 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-19T02:15:00.762 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:00.782 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-19T02:15:00.865 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:15:00.872 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:00.998 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:01.051 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:15:01.116 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T02:15:01.168 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:15:01.211 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:01.211 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:01.231 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:15:01.250 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-19T02:15:01.469 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:15:01.499 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:15:01.585 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T02:15:01.625 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:15:01.741 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:01.762 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:15:01.776 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:15:01.868 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:01.945 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-19T02:15:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:15:02.030 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-19T02:15:02.077 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-19T02:15:02.139 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-19T02:15:02.222 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-19T02:15:02.398 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-19T02:15:02.453 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-19T02:15:02.506 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-19T02:15:02.666 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:15:02.704 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:15:02.757 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-19T02:15:02.934 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:15:03.000 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-19T02:15:03.164 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:03.205 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:15:03.251 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:03.265 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:03.314 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T02:15:03.367 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:03.484 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:03.493 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T02:15:03.498 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:15:03.595 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:15:03.610 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:03.620 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-19T02:15:03.858 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:15:03.912 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T02:15:03.930 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:15:04.031 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:04.038 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-19T02:15:04.117 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:15:04.157 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:04.178 INFO:teuthology.orchestra.run.smithi169.stdout:Adding group ceph....done 2024-04-19T02:15:04.243 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:04.284 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:04.406 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T02:15:04.409 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:04.515 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-19T02:15:04.519 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:04.552 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-idna (3.3-1) ... 2024-04-19T02:15:04.554 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user ceph....done 2024-04-19T02:15:04.723 INFO:teuthology.orchestra.run.smithi169.stdout:Setting system user ceph properties....done 2024-04-19T02:15:04.738 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-19T02:15:04.739 INFO:teuthology.orchestra.run.smithi169.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T02:15:04.774 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T02:15:04.873 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T02:15:04.879 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:15:05.026 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-19T02:15:05.040 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:05.175 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:05.191 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T02:15:05.301 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:05.327 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T02:15:05.517 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:05.517 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:05.670 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:05.788 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:06.013 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T02:15:06.035 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:06.108 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:15:06.161 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:06.242 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:06.242 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:06.243 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-19T02:15:06.272 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T02:15:06.313 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:15:06.398 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-19T02:15:06.494 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:15:06.524 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T02:15:06.620 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:15:06.744 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:06.746 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:15:06.816 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-19T02:15:07.040 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:15:07.092 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T02:15:07.193 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-19T02:15:07.299 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-19T02:15:07.425 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:07.550 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:15:07.551 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:07.574 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:07.667 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:15:07.669 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T02:15:07.677 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:07.768 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:15:07.803 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:07.805 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:07.805 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:07.929 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:08.061 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:15:08.062 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T02:15:08.259 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:08.312 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-19T02:15:08.347 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T02:15:08.471 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:08.472 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:08.480 INFO:teuthology.orchestra.run.smithi116.stdout:Adding group ceph....done 2024-04-19T02:15:08.571 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-19T02:15:08.698 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-19T02:15:08.765 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user ceph....done 2024-04-19T02:15:08.839 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:15:08.934 INFO:teuthology.orchestra.run.smithi116.stdout:Setting system user ceph properties....done 2024-04-19T02:15:08.935 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:08.940 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-19T02:15:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T02:15:09.059 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:09.082 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-19T02:15:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T02:15:09.220 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:09.220 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:09.341 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:15:09.377 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1) ... 2024-04-19T02:15:09.393 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T02:15:09.450 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-19T02:15:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T02:15:09.735 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:15:09.830 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:09.844 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:15:09.981 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:09.996 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:10.122 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:10.153 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:15:10.248 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:10.436 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:10.436 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:10.443 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:10.443 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:10.479 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:15:10.739 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:15:10.850 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:15:10.882 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:10.883 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:10.976 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-19T02:15:11.017 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:11.121 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-19T02:15:11.143 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:11.190 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T02:15:11.236 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T02:15:11.294 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:11.361 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-19T02:15:11.366 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:15:11.468 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:15:11.488 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T02:15:11.619 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:11.742 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:11.806 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-19T02:15:11.836 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:15:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:11.847 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:12.065 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-19T02:15:12.095 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-19T02:15:12.307 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:15:12.320 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:12.346 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:15:12.425 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-19T02:15:12.464 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:15:12.539 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:12.543 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-19T02:15:12.546 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:12.546 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:12.773 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:15:12.836 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-19T02:15:13.007 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:13.010 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T02:15:13.013 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:13.063 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-19T02:15:13.066 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:15:13.087 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-19T02:15:13.262 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-19T02:15:13.262 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-19T02:15:13.292 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:13.292 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:13.325 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-19T02:15:13.355 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-19T02:15:13.426 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-19T02:15:13.432 INFO:teuthology.orchestra.run.smithi169.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-19T02:15:13.432 INFO:teuthology.orchestra.run.smithi169.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-19T02:15:13.432 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:15:13.432 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:15:13.432 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:15:13.432 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:15:13.433 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:15:13.433 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:15:13.433 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:15:13.433 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-19T02:15:13.434 INFO:teuthology.orchestra.run.smithi169.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-19T02:15:13.435 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-19T02:15:13.435 INFO:teuthology.orchestra.run.smithi169.stdout: bison-doc flex-doc libssl-doc 2024-04-19T02:15:13.465 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-19T02:15:13.466 INFO:teuthology.orchestra.run.smithi169.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-19T02:15:13.467 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-04-19T02:15:13.468 INFO:teuthology.orchestra.run.smithi169.stdout: libssl3 libuuid1 uuid-dev 2024-04-19T02:15:13.545 INFO:teuthology.orchestra.run.smithi169.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-19T02:15:13.545 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 5,495 kB of archives. 2024-04-19T02:15:13.546 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-19T02:15:13.546 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-19T02:15:13.623 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:15:13.660 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-19T02:15:13.694 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-19T02:15:13.726 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-19T02:15:13.726 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-19T02:15:13.727 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-19T02:15:13.742 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-19T02:15:13.742 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-19T02:15:13.743 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-19T02:15:13.744 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-19T02:15:13.744 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-19T02:15:13.848 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:13.873 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-19T02:15:13.963 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:15:13.983 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:14.110 INFO:teuthology.orchestra.run.smithi169.stdout:Preconfiguring packages ... 2024-04-19T02:15:14.116 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T02:15:14.159 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:14.205 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 5,495 kB in 0s (18.4 MB/s) 2024-04-19T02:15:14.217 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-19T02:15:14.229 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:15:14.328 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package flex. 2024-04-19T02:15:14.349 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:14.349 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:14.429 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-19T02:15:14.434 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:14.476 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-19T02:15:14.502 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T02:15:14.628 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T02:15:14.647 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T02:15:14.855 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:14.921 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-19T02:15:14.931 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:15:15.043 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:15.107 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.208 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-19T02:15:15.222 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-19T02:15:15.284 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:15:15.335 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.394 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.511 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.531 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T02:15:15.556 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.609 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:15.636 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.762 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.897 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:15.916 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-19T02:15:15.975 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:16.100 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-19T02:15:16.112 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:16.118 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:16.151 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T02:15:16.260 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T02:15:16.340 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:16.368 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:16.469 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:16.595 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:16.654 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-19T02:15:16.692 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:16.774 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:16.815 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:16.815 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:16.913 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:16.929 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-19T02:15:17.138 INFO:teuthology.orchestra.run.smithi116.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:17.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T02:15:17.180 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T02:15:17.244 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-19T02:15:17.306 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T02:15:17.315 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:17.321 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:17.425 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-19T02:15:17.426 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-19T02:15:17.455 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:17.582 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:15:17.593 INFO:teuthology.orchestra.run.smithi116.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-19T02:15:17.593 INFO:teuthology.orchestra.run.smithi116.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-19T02:15:17.594 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:15:17.594 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:15:17.594 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:15:17.594 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:15:17.594 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:15:17.594 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:15:17.595 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:15:17.595 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-04-19T02:15:17.596 INFO:teuthology.orchestra.run.smithi116.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-19T02:15:17.597 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-04-19T02:15:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: bison-doc flex-doc libssl-doc 2024-04-19T02:15:17.625 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-19T02:15:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-19T02:15:17.627 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages will be upgraded: 2024-04-19T02:15:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: libssl3 libuuid1 uuid-dev 2024-04-19T02:15:17.638 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package bison. 2024-04-19T02:15:17.641 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T02:15:17.684 INFO:teuthology.orchestra.run.smithi116.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-19T02:15:17.684 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 5,495 kB of archives. 2024-04-19T02:15:17.684 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-19T02:15:17.684 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-19T02:15:17.741 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:17.746 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-19T02:15:17.799 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:17.801 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-19T02:15:17.867 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-19T02:15:17.868 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-19T02:15:17.869 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-19T02:15:17.883 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-19T02:15:17.884 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-19T02:15:17.885 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-19T02:15:17.885 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-19T02:15:17.885 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-19T02:15:17.934 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T02:15:18.124 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T02:15:18.149 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-19T02:15:18.191 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:18.210 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-19T02:15:18.252 INFO:teuthology.orchestra.run.smithi116.stdout:Preconfiguring packages ... 2024-04-19T02:15:18.336 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-19T02:15:18.355 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 5,495 kB in 0s (19.5 MB/s) 2024-04-19T02:15:18.445 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T02:15:18.472 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-19T02:15:18.490 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package flex. 2024-04-19T02:15:18.511 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:18.580 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-19T02:15:18.586 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:18.612 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-19T02:15:18.630 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-19T02:15:18.806 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-19T02:15:18.834 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:18.835 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:18.864 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:18.880 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T02:15:18.961 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:19.079 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:19.117 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-19T02:15:19.144 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:19.156 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-19T02:15:19.164 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:19.183 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:19.205 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:19.315 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:19.319 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-19T02:15:19.436 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T02:15:19.452 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:19.494 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:19.565 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T02:15:19.712 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:19.841 INFO:teuthology.orchestra.run.smithi136.stdout:Adding group ceph....done 2024-04-19T02:15:19.925 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T02:15:19.971 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-19T02:15:20.234 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user ceph....done 2024-04-19T02:15:20.242 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:20.246 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:20.251 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:20.261 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T02:15:20.369 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:20.386 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:20.393 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:20.410 INFO:teuthology.orchestra.run.smithi136.stdout:Setting system user ceph properties....done 2024-04-19T02:15:20.427 INFO:teuthology.orchestra.run.smithi136.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T02:15:20.513 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:20.519 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:20.565 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T02:15:20.638 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:20.645 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:20.765 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:20.771 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:20.794 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:20.864 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T02:15:20.889 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:20.890 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:20.925 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:20.969 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-19T02:15:21.023 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:21.102 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-19T02:15:21.150 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:21.251 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:21.302 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:21.348 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:21.378 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:21.474 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:21.504 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:21.625 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package bison. 2024-04-19T02:15:21.630 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:21.729 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:21.735 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-19T02:15:21.786 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:21.845 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:21.845 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:15:21.957 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:21.957 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:22.111 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T02:15:22.127 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-19T02:15:22.161 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:22.332 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:22.406 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T02:15:22.417 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:22.422 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-19T02:15:22.458 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:22.465 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:22.494 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-19T02:15:22.575 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T02:15:22.792 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T02:15:22.853 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-19T02:15:22.880 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:22.919 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:23.144 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:23.146 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-19T02:15:23.162 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:23.196 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:23.269 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:23.449 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T02:15:23.476 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:23.502 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:23.502 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:23.533 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:23.755 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:23.881 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:23.979 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:23.990 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:24.099 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:24.100 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-19T02:15:24.195 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:24.195 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:24.209 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:24.229 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:24.355 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:24.482 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:24.590 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:24.691 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:24.747 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:24.752 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-04-19T02:15:24.800 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:24.882 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-19T02:15:24.952 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:25.033 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:25.034 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:25.079 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:25.111 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-04-19T02:15:25.230 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:25.263 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-04-19T02:15:25.282 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T02:15:25.419 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T02:15:25.490 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:25.591 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:25.718 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:25.757 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T02:15:25.930 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:25.930 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:26.294 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:26.385 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:26.439 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-19T02:15:26.498 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:26.528 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:26.662 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:26.788 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:15:27.077 INFO:teuthology.orchestra.run.smithi116.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:27.082 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:27.141 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:27.530 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:27.861 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T02:15:28.325 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:28.341 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:15:28.794 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:28.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T02:15:28.850 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-19T02:15:29.034 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:29.041 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-04-19T02:15:29.042 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-04-19T02:15:29.211 INFO:teuthology.orchestra.run.smithi136.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-19T02:15:29.211 INFO:teuthology.orchestra.run.smithi136.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-19T02:15:29.211 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:15:29.211 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:15:29.211 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:15:29.211 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:15:29.211 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:15:29.212 INFO:teuthology.orchestra.run.smithi136.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:15:29.212 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:15:29.212 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2024-04-19T02:15:29.213 INFO:teuthology.orchestra.run.smithi136.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-19T02:15:29.214 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2024-04-19T02:15:29.214 INFO:teuthology.orchestra.run.smithi136.stdout: bison-doc flex-doc libssl-doc 2024-04-19T02:15:29.242 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2024-04-19T02:15:29.244 INFO:teuthology.orchestra.run.smithi136.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-19T02:15:29.245 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2024-04-19T02:15:29.245 INFO:teuthology.orchestra.run.smithi136.stdout: libssl3 libuuid1 uuid-dev 2024-04-19T02:15:29.246 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:29.246 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:15:29.302 INFO:teuthology.orchestra.run.smithi136.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-19T02:15:29.302 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 5,495 kB of archives. 2024-04-19T02:15:29.303 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-19T02:15:29.303 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-19T02:15:29.425 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-19T02:15:29.492 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-19T02:15:29.493 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-19T02:15:29.494 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-19T02:15:29.509 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-19T02:15:29.509 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-19T02:15:29.510 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-19T02:15:29.511 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-19T02:15:29.511 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-19T02:15:29.760 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:29.859 INFO:teuthology.orchestra.run.smithi136.stdout:Preconfiguring packages ... 2024-04-19T02:15:29.995 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 5,495 kB in 0s (19.0 MB/s) 2024-04-19T02:15:30.042 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:30.042 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:15:30.140 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package flex. 2024-04-19T02:15:30.240 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-19T02:15:30.246 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:30.288 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-19T02:15:30.537 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:30.663 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:30.814 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:30.879 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:15:31.052 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-19T02:15:31.461 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:31.515 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:31.641 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:31.750 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:31.877 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1jammy) ... 2024-04-19T02:15:31.956 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:31.961 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:32.076 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:32.238 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:32.518 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:32.658 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:32.966 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:33.030 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:33.341 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package bison. 2024-04-19T02:15:33.445 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:33.451 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-19T02:15:33.510 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:33.529 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:33.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T02:15:33.629 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-19T02:15:33.830 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-19T02:15:33.831 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-19T02:15:34.021 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-19T02:15:34.021 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-19T02:15:34.022 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:15:34.022 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T02:15:34.022 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T02:15:34.022 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T02:15:34.022 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T02:15:34.022 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T02:15:34.022 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:15:34.023 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-19T02:15:34.024 INFO:teuthology.orchestra.run.smithi073.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-19T02:15:34.025 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-19T02:15:34.025 INFO:teuthology.orchestra.run.smithi073.stdout: bison-doc flex-doc libssl-doc 2024-04-19T02:15:34.053 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-19T02:15:34.054 INFO:teuthology.orchestra.run.smithi073.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-19T02:15:34.055 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-04-19T02:15:34.056 INFO:teuthology.orchestra.run.smithi073.stdout: libssl3 libuuid1 uuid-dev 2024-04-19T02:15:34.237 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-19T02:15:34.237 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 5,495 kB of archives. 2024-04-19T02:15:34.237 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-19T02:15:34.238 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-19T02:15:34.243 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T02:15:34.270 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-19T02:15:34.309 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:34.572 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T02:15:34.599 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-19T02:15:34.646 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:34.722 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-19T02:15:34.979 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-19T02:15:34.980 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-19T02:15:34.982 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-19T02:15:35.016 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-19T02:15:35.016 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-19T02:15:35.019 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-19T02:15:35.019 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-19T02:15:35.019 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-19T02:15:35.083 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-19T02:15:35.110 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:35.158 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:35.418 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-19T02:15:35.423 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2024-04-19T02:15:35.446 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:35.485 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:35.525 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 5,495 kB in 1s (5,343 kB/s) 2024-04-19T02:15:35.663 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package flex. 2024-04-19T02:15:35.746 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T02:15:35.766 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-19T02:15:35.772 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:35.774 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:35.812 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:35.820 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-19T02:15:36.331 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-19T02:15:36.403 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:36.458 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:36.567 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-19T02:15:36.576 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:36.677 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:36.778 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:36.897 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:36.977 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:37.021 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:37.110 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-19T02:15:37.165 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:37.291 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:37.443 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:37.510 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:37.641 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:38.067 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-19T02:15:38.215 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-19T02:15:38.600 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:38.660 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-19T02:15:38.991 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package bison. 2024-04-19T02:15:39.097 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-19T02:15:39.102 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-19T02:15:39.152 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:39.306 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:39.311 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:39.494 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T02:15:39.521 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-19T02:15:39.568 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:39.839 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T02:15:39.855 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-19T02:15:39.897 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:40.234 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-19T02:15:40.262 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:40.300 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:40.553 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-19T02:15:40.569 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-19T02:15:40.611 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:40.914 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T02:15:40.942 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-19T02:15:40.989 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:41.524 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-19T02:15:41.652 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-19T02:15:41.753 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-19T02:15:41.862 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-19T02:15:41.988 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-19T02:15:42.114 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:42.257 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-19T02:15:42.346 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-19T02:15:42.408 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-19T02:15:42.535 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T02:15:42.661 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T02:15:44.114 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-19T02:15:44.766 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:15:44.770 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:44.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:15:45.073 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-04-19T02:15:45.092 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.092 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.092 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1jammy is installed. 2024-04-19T02:15:45.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:15:45.425 DEBUG:teuthology.orchestra.run.smithi116:> dpkg-query -W -f '${Version}' ceph 2024-04-19T02:15:45.444 INFO:teuthology.orchestra.run.smithi116.stdout:18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.444 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.445 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1jammy is installed. 2024-04-19T02:15:45.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:15:45.585 DEBUG:teuthology.orchestra.run.smithi136:> dpkg-query -W -f '${Version}' ceph 2024-04-19T02:15:45.604 INFO:teuthology.orchestra.run.smithi136.stdout:18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.605 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.605 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1jammy is installed. 2024-04-19T02:15:45.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:15:45.744 DEBUG:teuthology.orchestra.run.smithi169:> dpkg-query -W -f '${Version}' ceph 2024-04-19T02:15:45.763 INFO:teuthology.orchestra.run.smithi169.stdout:18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.763 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1jammy 2024-04-19T02:15:45.764 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1jammy is installed. 2024-04-19T02:15:45.765 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-19T02:15:45.765 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:45.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:15:45.780 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:15:45.780 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:15:45.794 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:15:45.794 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:15:45.809 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:15:45.809 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:15:45.823 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-19T02:15:45.824 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:45.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:15:45.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:15:45.892 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:15:45.892 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:15:45.905 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:15:45.958 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:15:45.959 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:15:45.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:15:46.028 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:15:46.028 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:15:46.042 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:15:46.099 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-19T02:15:46.100 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:46.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:15:46.113 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:15:46.167 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:15:46.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:15:46.180 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:15:46.235 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:15:46.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:15:46.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:15:46.304 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:15:46.304 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:15:46.317 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:15:46.371 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-19T02:15:46.371 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:46.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:15:46.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:15:46.439 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:15:46.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:15:46.453 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:15:46.507 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:15:46.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:15:46.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:15:46.576 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:15:46.576 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:15:46.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:15:46.643 INFO:teuthology.run_tasks:Running task ceph... 2024-04-19T02:15:46.730 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-19T02:15:46.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-04-19T02:15:46.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-04-19T02:15:46.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-04-19T02:15:46.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-04-19T02:15:46.749 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-19T02:15:46.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:15:46.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:15:46.792 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:15:46.794 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:15:46.806 INFO:tasks.ceph:Creating extra log directories... 2024-04-19T02:15:46.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:15:46.846 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:15:46.848 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:15:46.850 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:15:46.876 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-19T02:15:46.876 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-19T02:15:46.876 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7662849', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 2879, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwcwfecSzyGC5hPGahacQVnax+wnplrjmtRlmw7DSXfj7T6yz+DnwdMMf6G0ZQie6+hPU5Je3l+Jz+f0dtBxdA=', 'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLG9zUGTA8hT9+tCZ3q3RrVHobxb9BjrLvTSGeMVSfkooSCHOtdgOJRjG828VA8xF0X6bryR6d9eItGmwqCYq3w=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuhBw/EdpIy2B3Nfk17PzhA9OJsVDFG+dLfXsBkkvytCpMxUGGPurSl0/eiVLIKsp2jivdHi9HBbdbJMl/CBE4=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNXW0Xmx78FVWO+2ORX21NUVzfA5eLC5aXxrZ/UqiRJBOMGTElHwsqdVgfpngYi1ABH9+F1Ul31mS5d+VLZ2JX8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-19T02:15:46.876 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:15:46.902 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:15:46.905 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:15:46.910 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:15:46.915 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:15:46.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:15:46.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:15:46.959 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:15:46.972 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:15:46.972 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T02:15:47.012 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T02:15:47.012 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-19 02:10:00.068973881 +0000 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-19 02:09:59.784976417 +0000 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-19 02:09:59.784976417 +0000 2024-04-19T02:15:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-19T02:15:47.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T02:15:47.114 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-19T02:15:47.114 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-19T02:15:47.114 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00044266 s, 1.2 MB/s 2024-04-19T02:15:47.115 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T02:15:47.168 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-04-19T02:15:47.215 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T02:15:47.216 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:47.216 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-19T02:15:47.216 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:47.216 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-19 02:10:00.580969307 +0000 2024-04-19T02:15:47.216 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-19 02:10:00.292971880 +0000 2024-04-19T02:15:47.216 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-19 02:10:00.292971880 +0000 2024-04-19T02:15:47.216 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-19T02:15:47.216 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T02:15:47.270 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-19T02:15:47.271 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-19T02:15:47.271 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000415483 s, 1.2 MB/s 2024-04-19T02:15:47.272 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T02:15:47.321 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-04-19T02:15:47.367 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T02:15:47.367 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:47.368 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-19T02:15:47.368 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:47.368 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-19 02:10:01.056965056 +0000 2024-04-19T02:15:47.368 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-19 02:10:00.800967342 +0000 2024-04-19T02:15:47.368 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-19 02:10:00.800967342 +0000 2024-04-19T02:15:47.368 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-19T02:15:47.368 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T02:15:47.421 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-19T02:15:47.422 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-19T02:15:47.422 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00044164 s, 1.2 MB/s 2024-04-19T02:15:47.423 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T02:15:47.472 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-04-19T02:15:47.519 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T02:15:47.520 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:47.520 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-04-19T02:15:47.520 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:47.520 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-19 02:10:01.568960483 +0000 2024-04-19T02:15:47.520 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-19 02:10:01.292962948 +0000 2024-04-19T02:15:47.520 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-19 02:10:01.292962948 +0000 2024-04-19T02:15:47.520 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-19T02:15:47.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T02:15:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-19T02:15:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-19T02:15:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000302845 s, 1.7 MB/s 2024-04-19T02:15:47.575 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T02:15:47.625 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T02:15:47.625 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:15:47.625 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T02:15:47.631 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T02:15:47.631 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-19 02:10:04.113402110 +0000 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-19 02:10:03.837404572 +0000 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-19 02:10:03.837404572 +0000 2024-04-19T02:15:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-19T02:15:47.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T02:15:47.736 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-19T02:15:47.736 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-19T02:15:47.736 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000365013 s, 1.4 MB/s 2024-04-19T02:15:47.737 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T02:15:47.786 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-04-19T02:15:47.832 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T02:15:47.833 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:47.833 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-04-19T02:15:47.833 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:47.833 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-19 02:10:04.613397651 +0000 2024-04-19T02:15:47.833 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-19 02:10:04.345400041 +0000 2024-04-19T02:15:47.833 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-19 02:10:04.345400041 +0000 2024-04-19T02:15:47.833 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-19T02:15:47.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T02:15:47.886 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-19T02:15:47.886 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-19T02:15:47.886 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000314442 s, 1.6 MB/s 2024-04-19T02:15:47.887 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T02:15:47.938 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-04-19T02:15:47.984 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T02:15:47.985 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:47.985 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-19T02:15:47.985 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:47.985 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-19 02:10:05.101393297 +0000 2024-04-19T02:15:47.985 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-19 02:10:04.845395580 +0000 2024-04-19T02:15:47.985 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-19 02:10:04.845395580 +0000 2024-04-19T02:15:47.985 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-19T02:15:47.985 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T02:15:48.039 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-19T02:15:48.039 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-19T02:15:48.039 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000344216 s, 1.5 MB/s 2024-04-19T02:15:48.040 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T02:15:48.090 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-19 02:10:05.625388623 +0000 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-19 02:10:05.361390978 +0000 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-19 02:10:05.361390978 +0000 2024-04-19T02:15:48.137 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-19T02:15:48.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T02:15:48.192 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-19T02:15:48.192 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-19T02:15:48.192 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000359774 s, 1.4 MB/s 2024-04-19T02:15:48.194 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T02:15:48.242 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T02:15:48.242 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:15:48.242 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T02:15:48.248 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T02:15:48.248 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-19 02:10:03.583897584 +0000 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-19 02:10:03.323899905 +0000 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-19 02:10:03.323899905 +0000 2024-04-19T02:15:48.296 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-19T02:15:48.296 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T02:15:48.350 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-19T02:15:48.350 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-19T02:15:48.350 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000452833 s, 1.1 MB/s 2024-04-19T02:15:48.352 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T02:15:48.401 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-04-19T02:15:48.448 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T02:15:48.448 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:48.448 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-04-19T02:15:48.448 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:48.448 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-19 02:10:04.095893010 +0000 2024-04-19T02:15:48.448 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-19 02:10:03.815895512 +0000 2024-04-19T02:15:48.449 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-19 02:10:03.815895512 +0000 2024-04-19T02:15:48.449 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-19T02:15:48.449 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T02:15:48.502 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-19T02:15:48.502 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-19T02:15:48.502 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000374968 s, 1.4 MB/s 2024-04-19T02:15:48.503 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T02:15:48.552 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-04-19T02:15:48.599 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T02:15:48.599 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:48.599 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-04-19T02:15:48.599 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:48.599 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-19 02:10:04.607888436 +0000 2024-04-19T02:15:48.600 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-19 02:10:04.339890831 +0000 2024-04-19T02:15:48.600 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-19 02:10:04.339890831 +0000 2024-04-19T02:15:48.600 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-19T02:15:48.600 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T02:15:48.653 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-19T02:15:48.653 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-19T02:15:48.653 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000356707 s, 1.4 MB/s 2024-04-19T02:15:48.654 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T02:15:48.708 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-04-19T02:15:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T02:15:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:15:48.755 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-04-19T02:15:48.755 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:15:48.755 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-19 02:10:05.099884043 +0000 2024-04-19T02:15:48.756 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-19 02:10:04.839886364 +0000 2024-04-19T02:15:48.756 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-19 02:10:04.839886364 +0000 2024-04-19T02:15:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-19T02:15:48.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T02:15:48.809 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-19T02:15:48.809 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-19T02:15:48.809 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000374713 s, 1.4 MB/s 2024-04-19T02:15:48.811 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T02:15:48.864 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T02:15:48.865 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T02:15:48.865 INFO:tasks.ceph:Generating config... 2024-04-19T02:15:48.866 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-19T02:15:48.866 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-19T02:15:48.866 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-19T02:15:48.866 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-19T02:15:48.866 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-19T02:15:48.866 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-19T02:15:48.866 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-19T02:15:48.867 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-19T02:15:48.868 INFO:tasks.ceph:Setting up mon.a... 2024-04-19T02:15:48.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-19T02:15:48.902 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-04-19T02:15:48.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-19T02:15:48.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:15:49.051 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'), ('mon.c', '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]')] 2024-04-19T02:15:49.052 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-19T02:15:49.052 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:49.052 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T02:15:49.100 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --addv b '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --addv c '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:49.184 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:49.185 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 30a6d986-f196-4d3c-8512-6c6489722f8f 2024-04-19T02:15:49.185 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2024-04-19T02:15:49.185 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-04-19T02:15:49.185 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 30a6d986-f196-4d3c-8512-6c6489722f8f 2024-04-19T02:15:49.185 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-04-19T02:15:49.187642+0000 2024-04-19T02:15:49.185 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-04-19T02:15:49.187642+0000 2024-04-19T02:15:49.185 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2024-04-19T02:15:49.186 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-04-19T02:15:49.186 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-04-19T02:15:49.186 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.b 2024-04-19T02:15:49.186 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] mon.c 2024-04-19T02:15:49.186 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-19T02:15:49.188 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T02:15:49.237 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 30a6d986-f196-4d3c-8512-6c6489722f8f... 2024-04-19T02:15:49.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:15:49.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:15:49.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:15:49.286 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-04-19T02:15:49.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.311 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:15:49.312 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 30a6d986-f196-4d3c-8512-6c6489722f8f 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.313 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-04-19T02:15:49.314 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-04-19T02:15:49.315 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression algorithm = zlib 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:15:49.316 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-04-19T02:15:49.317 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.318 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-04-19T02:15:49.319 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-04-19T02:15:49.320 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-04-19T02:15:49.321 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-04-19T02:15:49.321 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-04-19T02:15:49.321 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:15:49.321 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-04-19T02:15:49.321 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.321 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-04-19T02:15:49.321 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.322 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:15:49.323 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-19T02:15:49.324 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 30a6d986-f196-4d3c-8512-6c6489722f8f 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-04-19T02:15:49.325 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-04-19T02:15:49.326 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore compression algorithm = zlib 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore compression mode = aggressive 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-04-19T02:15:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: osd max markdown count = 1000 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.328 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.329 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:15:49.330 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:15:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 30a6d986-f196-4d3c-8512-6c6489722f8f 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-04-19T02:15:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-04-19T02:15:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore compression algorithm = zlib 2024-04-19T02:15:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore compression mode = aggressive 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 1/20 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 1/20 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 4/10 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: osd max markdown count = 1000 2024-04-19T02:15:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-19T02:15:49.338 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:15:49.339 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-04-19T02:15:49.340 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-04-19T02:15:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-04-19T02:15:49.342 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.343 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 30a6d986-f196-4d3c-8512-6c6489722f8f 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:15:49.344 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-04-19T02:15:49.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore compression algorithm = zlib 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore compression mode = aggressive 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-04-19T02:15:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: osd max markdown count = 1000 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-04-19T02:15:49.347 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-04-19T02:15:49.348 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:15:49.349 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-04-19T02:15:49.350 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-04-19T02:15:49.351 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2024-04-19T02:15:49.353 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-19T02:15:49.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-19T02:15:49.445 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-19T02:15:49.445 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:49.445 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-19T02:15:49.451 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:49.451 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-19T02:15:49.496 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-04-19T02:15:49.497 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:49.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:15:49.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:15:49.559 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:15:49.559 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:49.614 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-04-19T02:15:49.615 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:15:49.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:15:49.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:15:49.639 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:15:49.639 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:49.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:15:49.688 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:15:49.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:15:49.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:15:49.713 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:15:49.713 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:49.760 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-04-19T02:15:49.761 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:15:49.761 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:15:49.761 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:15:49.783 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:15:49.784 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:49.832 INFO:tasks.ceph:Setting up mon nodes... 2024-04-19T02:15:49.832 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-19T02:15:49.832 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T02:15:49.876 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T02:15:49.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T02:15:49.916 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T02:15:49.919 INFO:tasks.ceph:Setting up mds nodes... 2024-04-19T02:15:49.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T02:15:50.006 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T02:15:50.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-19T02:15:50.063 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-19T02:15:50.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-19T02:15:50.137 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-19T02:15:50.148 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-19T02:15:50.148 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T02:15:50.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-19T02:15:50.162 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T02:15:50.162 INFO:tasks.ceph:role: osd.0 2024-04-19T02:15:50.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-04-19T02:15:50.163 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T02:15:50.223 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T02:15:50.223 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T02:15:50.223 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T02:15:50.224 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T02:15:50.224 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T02:15:50.224 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-04-19T02:15:50.224 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T02:15:50.224 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T02:15:50.224 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T02:15:50.224 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T02:15:50.691 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-04-19T02:15:50.693 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-04-19T02:15:50.693 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-19T02:15:50.806 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-19T02:15:50.817 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T02:15:50.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:15:50.818 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:50.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-19T02:15:50.922+0000 7f1bab0737c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-19T02:15:50.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-19T02:15:50.922+0000 7f1bab0737c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-19T02:15:50.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-19T02:15:50.922+0000 7f1bab0737c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T02:15:50.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-19T02:15:50.922+0000 7f1bab0737c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T02:15:50.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-19T02:15:50.922+0000 7f1bab0737c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T02:15:50.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-19T02:15:50.930+0000 7f1bab0737c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-19T02:15:53.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-19T02:15:53.981 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-19T02:15:53.995 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T02:15:53.995 INFO:tasks.ceph:role: osd.1 2024-04-19T02:15:53.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:15:53.996 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T02:15:54.057 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T02:15:54.057 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T02:15:54.057 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T02:15:54.058 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T02:15:54.058 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T02:15:54.058 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-19T02:15:54.058 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T02:15:54.058 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T02:15:54.059 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T02:15:54.059 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T02:15:54.551 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-19T02:15:54.553 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-19T02:15:54.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T02:15:54.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-19T02:15:54.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:15:54.675 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T02:15:54.676 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:54.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-19T02:15:54.794+0000 7fa2694e47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-19T02:15:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-19T02:15:54.798+0000 7fa2694e47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-19T02:15:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-19T02:15:54.798+0000 7fa2694e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T02:15:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-19T02:15:54.798+0000 7fa2694e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T02:15:54.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-19T02:15:54.798+0000 7fa2694e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T02:15:54.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-19T02:15:54.798+0000 7fa2694e47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-19T02:15:57.850 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-19T02:15:57.864 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-19T02:15:57.879 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T02:15:57.879 INFO:tasks.ceph:role: osd.2 2024-04-19T02:15:57.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-19T02:15:57.879 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T02:15:57.947 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T02:15:58.396 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-19T02:15:58.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-19T02:15:58.398 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-19T02:15:58.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-19T02:15:58.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:15:58.544 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T02:15:58.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:58.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-19T02:15:58.651+0000 7ff89e9a77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-19T02:15:58.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-19T02:15:58.651+0000 7ff89e9a77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-19T02:15:58.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-19T02:15:58.651+0000 7ff89e9a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T02:15:58.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-19T02:15:58.651+0000 7ff89e9a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T02:15:58.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-19T02:15:58.651+0000 7ff89e9a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T02:15:58.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-19T02:15:58.659+0000 7ff89e9a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-19T02:16:01.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-19T02:16:01.640 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-19T02:16:01.640 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:16:01.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-19T02:16:01.655 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:16:01.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-19T02:16:01.712 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:16:01.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-19T02:16:01.767 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:16:01.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-19T02:16:01.782 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:16:01.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-19T02:16:01.796 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:16:01.796 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-19T02:16:01.810 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:16:01.810 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-19T02:16:01.816 INFO:tasks.ceph:Adding keys to all mons... 2024-04-19T02:16:01.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-19T02:16:01.870 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDV0yFmKvFwNBAAQODKFpLOy3dXNvie1qS+iw== 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDV0yFmtBLXNhAAK7IYU96JBY4yPuisbNgtDw== 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDW0yFmOgWNABAA5S35HGuWxwZSLU9MH/6wnA== 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDW0yFmYtdCNxAA+3SpZvvh0ub+860XyWKfug== 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDa0yFmkoyrLxAAsKpYJNl+P//JyPDG8X3Z7A== 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-04-19T02:16:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDe0yFmQoD+JhAAXWj296TMoYNYivBKOOGwlA== 2024-04-19T02:16:01.872 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-04-19T02:16:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDW0yFm9RVkCBAA2fmlXIBjliOjSsdtDUhGHw== 2024-04-19T02:16:01.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T02:16:01.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T02:16:02.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-19T02:16:02.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T02:16:02.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T02:16:02.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T02:16:02.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-19T02:16:02.460 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-19T02:16:02.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-19T02:16:02.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T02:16:02.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-19T02:16:02.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-19T02:16:02.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T02:16:02.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-19T02:16:02.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-19T02:16:02.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T02:16:02.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-19T02:16:02.929 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:16:02.976 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-19T02:16:02.976 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-19T02:16:02.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-19T02:16:03.025 INFO:tasks.ceph.mon.a:Started 2024-04-19T02:16:03.025 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-19T02:16:03.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-19T02:16:03.028 INFO:tasks.ceph.mon.b:Started 2024-04-19T02:16:03.028 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-19T02:16:03.028 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-19T02:16:03.031 INFO:tasks.ceph.mon.c:Started 2024-04-19T02:16:03.031 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-19T02:16:03.031 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-19T02:16:03.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-19T02:16:03.033 INFO:tasks.ceph.mgr.x:Started 2024-04-19T02:16:03.033 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-19T02:16:03.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-19T02:16:03.036 INFO:tasks.ceph.mgr.y:Started 2024-04-19T02:16:03.036 INFO:tasks.ceph:Setting crush tunables to default 2024-04-19T02:16:03.036 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-04-19T02:16:03.505 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-04-19T02:16:03.530 INFO:tasks.ceph:check_enable_crimson: False 2024-04-19T02:16:03.530 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-19T02:16:03.530 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-19T02:16:03.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-19T02:16:03.545 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-19T02:16:03.545 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-19T02:16:03.559 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-19T02:16:03.559 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-19T02:16:03.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 16c5fbec-2207-41d1-ae33-893b400fd3da 0 2024-04-19T02:16:03.633 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:03.632+0000 7ff51a056180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T02:16:03.633 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:03.632+0000 7f509a344180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T02:16:03.837 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-04-19T02:16:03.855 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 3211257a-5bd5-4a10-8d5f-c3dae1d504e7 1 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-04-19T02:16:04.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d 2 2024-04-19T02:16:04.114 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:04.112+0000 7f509a344180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T02:16:04.118 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:04.116+0000 7ff51a056180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T02:16:04.296 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-04-19T02:16:04.314 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-19T02:16:04.314 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-19T02:16:04.316 INFO:tasks.ceph.osd.0:Started 2024-04-19T02:16:04.317 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T02:16:04.317 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T02:16:04.319 INFO:tasks.ceph.osd.1:Started 2024-04-19T02:16:04.320 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T02:16:04.320 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T02:16:04.322 INFO:tasks.ceph.osd.2:Started 2024-04-19T02:16:04.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:04.324 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:04.324+0000 7ff51a056180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T02:16:04.324 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:04.324+0000 7f509a344180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T02:16:04.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:04.518 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:04.286795+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:04.534 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-19T02:16:04.534 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-19T02:16:04.836 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:04.895 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:04.892+0000 7ff51a056180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T02:16:04.895 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:04.892+0000 7f509a344180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T02:16:04.928 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:04.931+0000 7faac519e7c0 -1 Falling back to public interface 2024-04-19T02:16:04.944 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:04.942+0000 7fdd694a97c0 -1 Falling back to public interface 2024-04-19T02:16:04.945 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:04.946+0000 7f2e9b5097c0 -1 Falling back to public interface 2024-04-19T02:16:04.953 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:04.952+0000 7f509a344180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T02:16:04.953 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:04.952+0000 7ff51a056180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T02:16:05.009 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:05.008+0000 7f509a344180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T02:16:05.010 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:05.008+0000 7ff51a056180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T02:16:05.019 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-19T02:16:05.019 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":5,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:04.286795+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:05.035 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T02:16:05.090 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:05.088+0000 7f509a344180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T02:16:05.090 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:05.088+0000 7ff51a056180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T02:16:05.144 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:05.144+0000 7f509a344180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T02:16:05.144 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:05.144+0000 7ff51a056180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T02:16:05.222 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:05.220+0000 7ff51a056180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T02:16:05.226 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:05.224+0000 7f509a344180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T02:16:05.274 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:05.272+0000 7ff51a056180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T02:16:05.279 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:05.276+0000 7f509a344180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T02:16:05.430 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:05.428+0000 7ff51a056180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T02:16:05.430 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:05.428+0000 7f509a344180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T02:16:05.491 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:05.488+0000 7ff51a056180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T02:16:05.491 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:05.488+0000 7f509a344180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T02:16:06.188 INFO:tasks.ceph.mgr.x.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-19T02:16:06.188 INFO:tasks.ceph.mgr.x.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-19T02:16:06.188 INFO:tasks.ceph.mgr.x.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-04-19T02:16:06.188 INFO:tasks.ceph.mgr.y.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-19T02:16:06.188 INFO:tasks.ceph.mgr.y.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-19T02:16:06.188 INFO:tasks.ceph.mgr.y.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-04-19T02:16:06.258 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:06.256+0000 7ff51a056180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T02:16:06.258 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:06.256+0000 7f509a344180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T02:16:06.475 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:06.472+0000 7ff51a056180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:16:06.477 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:06.476+0000 7f509a344180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:16:06.630 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:06.628+0000 7ff51a056180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T02:16:06.631 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:06.628+0000 7f509a344180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T02:16:06.694 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:06.692+0000 7ff51a056180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T02:16:06.697 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:06.696+0000 7f509a344180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T02:16:06.830 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:06.828+0000 7ff51a056180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:16:06.839 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:06.836+0000 7f509a344180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:16:07.463 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:07.460+0000 7f509a344180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T02:16:07.464 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:07.464+0000 7ff51a056180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T02:16:07.540 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:07.540+0000 7f509a344180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T02:16:07.542 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:07.540+0000 7ff51a056180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T02:16:07.724 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:07.724+0000 7ff51a056180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T02:16:07.725 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:07.724+0000 7f509a344180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T02:16:07.799 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:07.796+0000 7ff51a056180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T02:16:07.800 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:07.796+0000 7f509a344180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T02:16:08.091 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:08.088+0000 7ff51a056180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T02:16:08.094 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:08.092+0000 7f509a344180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T02:16:08.155 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-19T02:16:08.152+0000 7ff51a056180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T02:16:08.157 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:08.156+0000 7f509a344180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T02:16:08.585 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:08.587+0000 7faac519e7c0 -1 osd.2 0 log_to_monitors true 2024-04-19T02:16:08.591 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:08.590+0000 7f2e9b5097c0 -1 osd.1 0 log_to_monitors true 2024-04-19T02:16:08.603 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:08.602+0000 7fdd694a97c0 -1 osd.0 0 log_to_monitors true 2024-04-19T02:16:09.190 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:09.188+0000 7f50418fa640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-19T02:16:09.191 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-19T02:16:09.188+0000 7f50418fa640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-19T02:16:11.340 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:11.631 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-19T02:16:11.631 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":7,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:10.235057+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:11.649 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T02:16:12.976 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:12.978+0000 7f2e97cc5640 -1 osd.1 0 waiting for initial osdmap 2024-04-19T02:16:13.005 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:13.006+0000 7f2e8f2e1640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:16:13.052 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:13.055+0000 7faac195a640 -1 osd.2 0 waiting for initial osdmap 2024-04-19T02:16:13.072 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:13.070+0000 7fdd6544e640 -1 osd.0 0 waiting for initial osdmap 2024-04-19T02:16:13.072 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:13.075+0000 7faab8f76640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:16:13.092 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:13.090+0000 7fdd5d281640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:16:17.951 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:18.250 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-19T02:16:18.250 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":11,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:16.990526+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:18.268 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-19T02:16:18.268 INFO:tasks.ceph:Creating RBD pool 2024-04-19T02:16:18.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-19T02:16:19.073 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-04-19T02:16:19.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-19T02:16:20.074 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-19T02:16:20.102 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-19T02:16:20.103 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-19T02:16:20.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-19T02:16:20.106 INFO:tasks.ceph.mds.a:Started 2024-04-19T02:16:20.106 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-19T02:16:20.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:20.186 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-04-19T02:16:20.405 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:20.405 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:20.069979+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:20.424 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:16:20.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:16:20.717 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-19T02:16:20.735 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:16:21.004 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-19T02:16:21.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:16:21.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:21.348 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6803/684726418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":684726418},{"type":"v1","addr":"172.21.15.73:6803","nonce":684726418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-19T02:16:21.348 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-04-19T02:16:21.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:21.646 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":14,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:21.072169+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:21.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:16:21.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:16:21.955 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-19T02:16:21.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:16:22.262 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-19T02:16:22.280 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 2, 2024-04-19T02:16:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "rbd" 2024-04-19T02:16:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:22.563 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-04-19T02:16:22.578 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-19T02:16:22.579 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-19T02:16:23.106 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-04-19T02:16:23.128 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-19T02:16:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-04-19T02:16:24.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-19T02:16:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 3 and data pool 4 2024-04-19T02:16:24.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:24.789 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:24.789 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:24.476621+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:24.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:25.093 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:24.476621+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:25.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-19T02:16:25.507 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-19T02:16:25.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-19T02:16:26.519 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-19T02:16:26.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:16:26.843 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:26.843 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:16:24.477273+0000","modified":"2024-04-19T02:16:26.492157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4198":{"gid":4198,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/684726418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":684726418},{"type":"v1","addr":"172.21.15.73:6803","nonce":684726418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:16:26.843 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-19T02:16:26.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:27.142 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:25.482999+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:27.159 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-19T02:16:27.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-19T02:16:26.172875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89756,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025764,"statfs":{"total":289910292480,"available":289818382336,"internally_reserved":0,"allocated":507904,"data_stored":1303427,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000918"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124691+0000","last_change":"2024-04-19T02:16:24.124691+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124691+0000","last_undegraded":"2024-04-19T02:16:24.124691+0000","last_fullsized":"2024-04-19T02:16:24.124691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124856+0000","last_change":"2024-04-19T02:16:24.124856+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124856+0000","last_undegraded":"2024-04-19T02:16:24.124856+0000","last_fullsized":"2024-04-19T02:16:24.124856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123926+0000","last_change":"2024-04-19T02:16:24.123926+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123926+0000","last_undegraded":"2024-04-19T02:16:24.123926+0000","last_fullsized":"2024-04-19T02:16:24.123926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124657+0000","last_change":"2024-04-19T02:16:24.124657+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124657+0000","last_undegraded":"2024-04-19T02:16:24.124657+0000","last_fullsized":"2024-04-19T02:16:24.124657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124406+0000","last_change":"2024-04-19T02:16:24.124406+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124406+0000","last_undegraded":"2024-04-19T02:16:24.124406+0000","last_fullsized":"2024-04-19T02:16:24.124406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124183+0000","last_change":"2024-04-19T02:16:24.124183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124183+0000","last_undegraded":"2024-04-19T02:16:24.124183+0000","last_fullsized":"2024-04-19T02:16:24.124183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124494+0000","last_change":"2024-04-19T02:16:24.124494+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124494+0000","last_undegraded":"2024-04-19T02:16:24.124494+0000","last_fullsized":"2024-04-19T02:16:24.124494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123735+0000","last_change":"2024-04-19T02:16:24.123735+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123735+0000","last_undegraded":"2024-04-19T02:16:24.123735+0000","last_fullsized":"2024-04-19T02:16:24.123735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122964+0000","last_change":"2024-04-19T02:16:24.122964+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122964+0000","last_undegraded":"2024-04-19T02:16:24.122964+0000","last_fullsized":"2024-04-19T02:16:24.122964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123755+0000","last_change":"2024-04-19T02:16:24.123755+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123755+0000","last_undegraded":"2024-04-19T02:16:24.123755+0000","last_fullsized":"2024-04-19T02:16:24.123755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121943+0000","last_change":"2024-04-19T02:16:24.121943+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121943+0000","last_undegraded":"2024-04-19T02:16:24.121943+0000","last_fullsized":"2024-04-19T02:16:24.121943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123197+0000","last_change":"2024-04-19T02:16:24.123197+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123197+0000","last_undegraded":"2024-04-19T02:16:24.123197+0000","last_fullsized":"2024-04-19T02:16:24.123197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122996+0000","last_change":"2024-04-19T02:16:24.122996+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122996+0000","last_undegraded":"2024-04-19T02:16:24.122996+0000","last_fullsized":"2024-04-19T02:16:24.122996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122983+0000","last_change":"2024-04-19T02:16:24.122983+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122983+0000","last_undegraded":"2024-04-19T02:16:24.122983+0000","last_fullsized":"2024-04-19T02:16:24.122983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123044+0000","last_change":"2024-04-19T02:16:24.123044+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123044+0000","last_undegraded":"2024-04-19T02:16:24.123044+0000","last_fullsized":"2024-04-19T02:16:24.123044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121682+0000","last_change":"2024-04-19T02:16:24.121682+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121682+0000","last_undegraded":"2024-04-19T02:16:24.121682+0000","last_fullsized":"2024-04-19T02:16:24.121682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123035+0000","last_change":"2024-04-19T02:16:24.123035+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123035+0000","last_undegraded":"2024-04-19T02:16:24.123035+0000","last_fullsized":"2024-04-19T02:16:24.123035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122223+0000","last_change":"2024-04-19T02:16:24.122223+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122223+0000","last_undegraded":"2024-04-19T02:16:24.122223+0000","last_fullsized":"2024-04-19T02:16:24.122223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122097+0000","last_change":"2024-04-19T02:16:24.122097+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122097+0000","last_undegraded":"2024-04-19T02:16:24.122097+0000","last_fullsized":"2024-04-19T02:16:24.122097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119883+0000","last_change":"2024-04-19T02:16:24.119883+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119883+0000","last_undegraded":"2024-04-19T02:16:24.119883+0000","last_fullsized":"2024-04-19T02:16:24.119883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122952+0000","last_change":"2024-04-19T02:16:24.122952+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122952+0000","last_undegraded":"2024-04-19T02:16:24.122952+0000","last_fullsized":"2024-04-19T02:16:24.122952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119812+0000","last_change":"2024-04-19T02:16:24.119812+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119812+0000","last_undegraded":"2024-04-19T02:16:24.119812+0000","last_fullsized":"2024-04-19T02:16:24.119812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119751+0000","last_change":"2024-04-19T02:16:24.119751+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119751+0000","last_undegraded":"2024-04-19T02:16:24.119751+0000","last_fullsized":"2024-04-19T02:16:24.119751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122705+0000","last_change":"2024-04-19T02:16:24.122705+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122705+0000","last_undegraded":"2024-04-19T02:16:24.122705+0000","last_fullsized":"2024-04-19T02:16:24.122705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121733+0000","last_change":"2024-04-19T02:16:24.121733+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121733+0000","last_undegraded":"2024-04-19T02:16:24.121733+0000","last_fullsized":"2024-04-19T02:16:24.121733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120053+0000","last_change":"2024-04-19T02:16:24.120053+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120053+0000","last_undegraded":"2024-04-19T02:16:24.120053+0000","last_fullsized":"2024-04-19T02:16:24.120053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121704+0000","last_change":"2024-04-19T02:16:24.121704+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121704+0000","last_undegraded":"2024-04-19T02:16:24.121704+0000","last_fullsized":"2024-04-19T02:16:24.121704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116578+0000","last_change":"2024-04-19T02:16:24.116578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116578+0000","last_undegraded":"2024-04-19T02:16:24.116578+0000","last_fullsized":"2024-04-19T02:16:24.116578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121426+0000","last_change":"2024-04-19T02:16:24.121426+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121426+0000","last_undegraded":"2024-04-19T02:16:24.121426+0000","last_fullsized":"2024-04-19T02:16:24.121426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121749+0000","last_change":"2024-04-19T02:16:24.121749+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121749+0000","last_undegraded":"2024-04-19T02:16:24.121749+0000","last_fullsized":"2024-04-19T02:16:24.121749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.112029+0000","last_change":"2024-04-19T02:16:24.112029+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.112029+0000","last_undegraded":"2024-04-19T02:16:24.112029+0000","last_fullsized":"2024-04-19T02:16:24.112029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145646+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.145646+0000","last_peered":"2024-04-19T02:16:24.145646+0000","last_clean":"2024-04-19T02:16:24.145646+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.145646+0000","last_undegraded":"2024-04-19T02:16:24.145646+0000","last_fullsized":"2024-04-19T02:16:24.145646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117371+0000","last_change":"2024-04-19T02:16:24.117371+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117371+0000","last_undegraded":"2024-04-19T02:16:24.117371+0000","last_fullsized":"2024-04-19T02:16:24.117371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142625+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.142625+0000","last_peered":"2024-04-19T02:16:24.142625+0000","last_clean":"2024-04-19T02:16:24.142625+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.142625+0000","last_undegraded":"2024-04-19T02:16:24.142625+0000","last_fullsized":"2024-04-19T02:16:24.142625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120247+0000","last_change":"2024-04-19T02:16:24.120247+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120247+0000","last_undegraded":"2024-04-19T02:16:24.120247+0000","last_fullsized":"2024-04-19T02:16:24.120247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128363+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.128363+0000","last_peered":"2024-04-19T02:16:24.128363+0000","last_clean":"2024-04-19T02:16:24.128363+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.128363+0000","last_undegraded":"2024-04-19T02:16:24.128363+0000","last_fullsized":"2024-04-19T02:16:24.128363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121205+0000","last_change":"2024-04-19T02:16:24.121205+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121205+0000","last_undegraded":"2024-04-19T02:16:24.121205+0000","last_fullsized":"2024-04-19T02:16:24.121205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141326+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.141326+0000","last_peered":"2024-04-19T02:16:24.141326+0000","last_clean":"2024-04-19T02:16:24.141326+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.141326+0000","last_undegraded":"2024-04-19T02:16:24.141326+0000","last_fullsized":"2024-04-19T02:16:24.141326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141650+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.141650+0000","last_peered":"2024-04-19T02:16:24.141650+0000","last_clean":"2024-04-19T02:16:24.141650+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.141650+0000","last_undegraded":"2024-04-19T02:16:24.141650+0000","last_fullsized":"2024-04-19T02:16:24.141650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117910+0000","last_change":"2024-04-19T02:16:24.117910+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117910+0000","last_undegraded":"2024-04-19T02:16:24.117910+0000","last_fullsized":"2024-04-19T02:16:24.117910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.127060+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.127060+0000","last_peered":"2024-04-19T02:16:24.127060+0000","last_clean":"2024-04-19T02:16:24.127060+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.127060+0000","last_undegraded":"2024-04-19T02:16:24.127060+0000","last_fullsized":"2024-04-19T02:16:24.127060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118332+0000","last_change":"2024-04-19T02:16:24.118332+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118332+0000","last_undegraded":"2024-04-19T02:16:24.118332+0000","last_fullsized":"2024-04-19T02:16:24.118332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145440+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.145440+0000","last_peered":"2024-04-19T02:16:24.145440+0000","last_clean":"2024-04-19T02:16:24.145440+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.145440+0000","last_undegraded":"2024-04-19T02:16:24.145440+0000","last_fullsized":"2024-04-19T02:16:24.145440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118589+0000","last_change":"2024-04-19T02:16:24.118589+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118589+0000","last_undegraded":"2024-04-19T02:16:24.118589+0000","last_fullsized":"2024-04-19T02:16:24.118589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144176+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.144176+0000","last_peered":"2024-04-19T02:16:24.144176+0000","last_clean":"2024-04-19T02:16:24.144176+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.144176+0000","last_undegraded":"2024-04-19T02:16:24.144176+0000","last_fullsized":"2024-04-19T02:16:24.144176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118907+0000","last_change":"2024-04-19T02:16:24.118907+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118907+0000","last_undegraded":"2024-04-19T02:16:24.118907+0000","last_fullsized":"2024-04-19T02:16:24.118907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143145+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.143145+0000","last_peered":"2024-04-19T02:16:24.143145+0000","last_clean":"2024-04-19T02:16:24.143145+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.143145+0000","last_undegraded":"2024-04-19T02:16:24.143145+0000","last_fullsized":"2024-04-19T02:16:24.143145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118629+0000","last_change":"2024-04-19T02:16:24.118629+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118629+0000","last_undegraded":"2024-04-19T02:16:24.118629+0000","last_fullsized":"2024-04-19T02:16:24.118629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144273+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.144273+0000","last_peered":"2024-04-19T02:16:24.144273+0000","last_clean":"2024-04-19T02:16:24.144273+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.144273+0000","last_undegraded":"2024-04-19T02:16:24.144273+0000","last_fullsized":"2024-04-19T02:16:24.144273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119665+0000","last_change":"2024-04-19T02:16:24.119665+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119665+0000","last_undegraded":"2024-04-19T02:16:24.119665+0000","last_fullsized":"2024-04-19T02:16:24.119665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128307+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.128307+0000","last_peered":"2024-04-19T02:16:24.128307+0000","last_clean":"2024-04-19T02:16:24.128307+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.128307+0000","last_undegraded":"2024-04-19T02:16:24.128307+0000","last_fullsized":"2024-04-19T02:16:24.128307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.136304+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.136304+0000","last_peered":"2024-04-19T02:16:24.136304+0000","last_clean":"2024-04-19T02:16:24.136304+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.136304+0000","last_undegraded":"2024-04-19T02:16:24.136304+0000","last_fullsized":"2024-04-19T02:16:24.136304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119780+0000","last_change":"2024-04-19T02:16:24.119780+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119780+0000","last_undegraded":"2024-04-19T02:16:24.119780+0000","last_fullsized":"2024-04-19T02:16:24.119780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107773+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:23.107773+0000","last_peered":"2024-04-19T02:16:23.107773+0000","last_clean":"2024-04-19T02:16:23.107773+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:23.107773+0000","last_undegraded":"2024-04-19T02:16:23.107773+0000","last_fullsized":"2024-04-19T02:16:23.107773+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107751+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:23.107751+0000","last_peered":"2024-04-19T02:16:23.107751+0000","last_clean":"2024-04-19T02:16:23.107751+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:23.107751+0000","last_undegraded":"2024-04-19T02:16:23.107751+0000","last_fullsized":"2024-04-19T02:16:23.107751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138248+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.138248+0000","last_peered":"2024-04-19T02:16:24.138248+0000","last_clean":"2024-04-19T02:16:24.138248+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.138248+0000","last_undegraded":"2024-04-19T02:16:24.138248+0000","last_fullsized":"2024-04-19T02:16:24.138248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118519+0000","last_change":"2024-04-19T02:16:24.118519+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118519+0000","last_undegraded":"2024-04-19T02:16:24.118519+0000","last_fullsized":"2024-04-19T02:16:24.118519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107780+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:23.107780+0000","last_peered":"2024-04-19T02:16:23.107780+0000","last_clean":"2024-04-19T02:16:23.107780+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:23.107780+0000","last_undegraded":"2024-04-19T02:16:23.107780+0000","last_fullsized":"2024-04-19T02:16:23.107780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142477+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.142477+0000","last_peered":"2024-04-19T02:16:24.142477+0000","last_clean":"2024-04-19T02:16:24.142477+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.142477+0000","last_undegraded":"2024-04-19T02:16:24.142477+0000","last_fullsized":"2024-04-19T02:16:24.142477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114418+0000","last_change":"2024-04-19T02:16:24.114418+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114418+0000","last_undegraded":"2024-04-19T02:16:24.114418+0000","last_fullsized":"2024-04-19T02:16:24.114418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122575+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:23.122575+0000","last_peered":"2024-04-19T02:16:23.122575+0000","last_clean":"2024-04-19T02:16:23.122575+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:23.122575+0000","last_undegraded":"2024-04-19T02:16:23.122575+0000","last_fullsized":"2024-04-19T02:16:23.122575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129218+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.129218+0000","last_peered":"2024-04-19T02:16:24.129218+0000","last_clean":"2024-04-19T02:16:24.129218+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.129218+0000","last_undegraded":"2024-04-19T02:16:24.129218+0000","last_fullsized":"2024-04-19T02:16:24.129218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118177+0000","last_change":"2024-04-19T02:16:24.118177+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118177+0000","last_undegraded":"2024-04-19T02:16:24.118177+0000","last_fullsized":"2024-04-19T02:16:24.118177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107748+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:23.107748+0000","last_peered":"2024-04-19T02:16:23.107748+0000","last_clean":"2024-04-19T02:16:23.107748+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:23.107748+0000","last_undegraded":"2024-04-19T02:16:23.107748+0000","last_fullsized":"2024-04-19T02:16:23.107748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144289+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.144289+0000","last_peered":"2024-04-19T02:16:24.144289+0000","last_clean":"2024-04-19T02:16:24.144289+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.144289+0000","last_undegraded":"2024-04-19T02:16:24.144289+0000","last_fullsized":"2024-04-19T02:16:24.144289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118209+0000","last_change":"2024-04-19T02:16:24.118209+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118209+0000","last_undegraded":"2024-04-19T02:16:24.118209+0000","last_fullsized":"2024-04-19T02:16:24.118209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145614+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.145614+0000","last_peered":"2024-04-19T02:16:24.145614+0000","last_clean":"2024-04-19T02:16:24.145614+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.145614+0000","last_undegraded":"2024-04-19T02:16:24.145614+0000","last_fullsized":"2024-04-19T02:16:24.145614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122761+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:23.122761+0000","last_peered":"2024-04-19T02:16:23.122761+0000","last_clean":"2024-04-19T02:16:23.122761+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:23.122761+0000","last_undegraded":"2024-04-19T02:16:23.122761+0000","last_fullsized":"2024-04-19T02:16:23.122761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114183+0000","last_change":"2024-04-19T02:16:24.114183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114183+0000","last_undegraded":"2024-04-19T02:16:24.114183+0000","last_fullsized":"2024-04-19T02:16:24.114183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138797+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.138797+0000","last_peered":"2024-04-19T02:16:24.138797+0000","last_clean":"2024-04-19T02:16:24.138797+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.138797+0000","last_undegraded":"2024-04-19T02:16:24.138797+0000","last_fullsized":"2024-04-19T02:16:24.138797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.109587+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:23.109587+0000","last_peered":"2024-04-19T02:16:23.109587+0000","last_clean":"2024-04-19T02:16:23.109587+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:23.109587+0000","last_undegraded":"2024-04-19T02:16:23.109587+0000","last_fullsized":"2024-04-19T02:16:23.109587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114120+0000","last_change":"2024-04-19T02:16:24.114120+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114120+0000","last_undegraded":"2024-04-19T02:16:24.114120+0000","last_fullsized":"2024-04-19T02:16:24.114120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138296+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.138296+0000","last_peered":"2024-04-19T02:16:24.138296+0000","last_clean":"2024-04-19T02:16:24.138296+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.138296+0000","last_undegraded":"2024-04-19T02:16:24.138296+0000","last_fullsized":"2024-04-19T02:16:24.138296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122991+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:23.122991+0000","last_peered":"2024-04-19T02:16:23.122991+0000","last_clean":"2024-04-19T02:16:23.122991+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:23.122991+0000","last_undegraded":"2024-04-19T02:16:23.122991+0000","last_fullsized":"2024-04-19T02:16:23.122991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117578+0000","last_change":"2024-04-19T02:16:24.117578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117578+0000","last_undegraded":"2024-04-19T02:16:24.117578+0000","last_fullsized":"2024-04-19T02:16:24.117578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143994+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:24.143994+0000","last_peered":"2024-04-19T02:16:24.143994+0000","last_clean":"2024-04-19T02:16:24.143994+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:24.143994+0000","last_undegraded":"2024-04-19T02:16:24.143994+0000","last_fullsized":"2024-04-19T02:16:24.143994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107724+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:23.107724+0000","last_peered":"2024-04-19T02:16:23.107724+0000","last_clean":"2024-04-19T02:16:23.107724+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:23.107724+0000","last_undegraded":"2024-04-19T02:16:23.107724+0000","last_fullsized":"2024-04-19T02:16:23.107724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114675+0000","last_change":"2024-04-19T02:16:24.114675+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114675+0000","last_undegraded":"2024-04-19T02:16:24.114675+0000","last_fullsized":"2024-04-19T02:16:24.114675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141945+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.141945+0000","last_peered":"2024-04-19T02:16:24.141945+0000","last_clean":"2024-04-19T02:16:24.141945+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.141945+0000","last_undegraded":"2024-04-19T02:16:24.141945+0000","last_fullsized":"2024-04-19T02:16:24.141945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120115+0000","last_change":"2024-04-19T02:16:24.120115+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120115+0000","last_undegraded":"2024-04-19T02:16:24.120115+0000","last_fullsized":"2024-04-19T02:16:24.120115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129180+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.129180+0000","last_peered":"2024-04-19T02:16:24.129180+0000","last_clean":"2024-04-19T02:16:24.129180+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.129180+0000","last_undegraded":"2024-04-19T02:16:24.129180+0000","last_fullsized":"2024-04-19T02:16:24.129180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.143469+0000","last_peered":"2024-04-19T02:16:24.143469+0000","last_clean":"2024-04-19T02:16:24.143469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.143469+0000","last_undegraded":"2024-04-19T02:16:24.143469+0000","last_fullsized":"2024-04-19T02:16:24.143469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119928+0000","last_change":"2024-04-19T02:16:24.119928+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119928+0000","last_undegraded":"2024-04-19T02:16:24.119928+0000","last_fullsized":"2024-04-19T02:16:24.119928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.147014+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.147014+0000","last_peered":"2024-04-19T02:16:24.147014+0000","last_clean":"2024-04-19T02:16:24.147014+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.147014+0000","last_undegraded":"2024-04-19T02:16:24.147014+0000","last_fullsized":"2024-04-19T02:16:24.147014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120109+0000","last_change":"2024-04-19T02:16:24.120109+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120109+0000","last_undegraded":"2024-04-19T02:16:24.120109+0000","last_fullsized":"2024-04-19T02:16:24.120109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116484+0000","last_change":"2024-04-19T02:16:24.116484+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116484+0000","last_undegraded":"2024-04-19T02:16:24.116484+0000","last_fullsized":"2024-04-19T02:16:24.116484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138341+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.138341+0000","last_peered":"2024-04-19T02:16:24.138341+0000","last_clean":"2024-04-19T02:16:24.138341+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.138341+0000","last_undegraded":"2024-04-19T02:16:24.138341+0000","last_fullsized":"2024-04-19T02:16:24.138341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121365+0000","last_change":"2024-04-19T02:16:24.121365+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121365+0000","last_undegraded":"2024-04-19T02:16:24.121365+0000","last_fullsized":"2024-04-19T02:16:24.121365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143315+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.143315+0000","last_peered":"2024-04-19T02:16:24.143315+0000","last_clean":"2024-04-19T02:16:24.143315+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.143315+0000","last_undegraded":"2024-04-19T02:16:24.143315+0000","last_fullsized":"2024-04-19T02:16:24.143315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121192+0000","last_change":"2024-04-19T02:16:24.121192+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121192+0000","last_undegraded":"2024-04-19T02:16:24.121192+0000","last_fullsized":"2024-04-19T02:16:24.121192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.134108+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.134108+0000","last_peered":"2024-04-19T02:16:24.134108+0000","last_clean":"2024-04-19T02:16:24.134108+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.134108+0000","last_undegraded":"2024-04-19T02:16:24.134108+0000","last_fullsized":"2024-04-19T02:16:24.134108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116356+0000","last_change":"2024-04-19T02:16:24.116356+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116356+0000","last_undegraded":"2024-04-19T02:16:24.116356+0000","last_fullsized":"2024-04-19T02:16:24.116356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.124535+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.124535+0000","last_peered":"2024-04-19T02:16:24.124535+0000","last_clean":"2024-04-19T02:16:24.124535+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.124535+0000","last_undegraded":"2024-04-19T02:16:24.124535+0000","last_fullsized":"2024-04-19T02:16:24.124535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121139+0000","last_change":"2024-04-19T02:16:24.121139+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121139+0000","last_undegraded":"2024-04-19T02:16:24.121139+0000","last_fullsized":"2024-04-19T02:16:24.121139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143772+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.143772+0000","last_peered":"2024-04-19T02:16:24.143772+0000","last_clean":"2024-04-19T02:16:24.143772+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.143772+0000","last_undegraded":"2024-04-19T02:16:24.143772+0000","last_fullsized":"2024-04-19T02:16:24.143772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120001+0000","last_change":"2024-04-19T02:16:24.120001+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120001+0000","last_undegraded":"2024-04-19T02:16:24.120001+0000","last_fullsized":"2024-04-19T02:16:24.120001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143602+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.143602+0000","last_peered":"2024-04-19T02:16:24.143602+0000","last_clean":"2024-04-19T02:16:24.143602+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.143602+0000","last_undegraded":"2024-04-19T02:16:24.143602+0000","last_fullsized":"2024-04-19T02:16:24.143602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122233+0000","last_change":"2024-04-19T02:16:24.122233+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122233+0000","last_undegraded":"2024-04-19T02:16:24.122233+0000","last_fullsized":"2024-04-19T02:16:24.122233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138318+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.138318+0000","last_peered":"2024-04-19T02:16:24.138318+0000","last_clean":"2024-04-19T02:16:24.138318+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.138318+0000","last_undegraded":"2024-04-19T02:16:24.138318+0000","last_fullsized":"2024-04-19T02:16:24.138318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120505+0000","last_change":"2024-04-19T02:16:24.120505+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120505+0000","last_undegraded":"2024-04-19T02:16:24.120505+0000","last_fullsized":"2024-04-19T02:16:24.120505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144018+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.144018+0000","last_peered":"2024-04-19T02:16:24.144018+0000","last_clean":"2024-04-19T02:16:24.144018+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.144018+0000","last_undegraded":"2024-04-19T02:16:24.144018+0000","last_fullsized":"2024-04-19T02:16:24.144018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:27.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:27.832 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-19T02:16:26.172875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89756,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025764,"statfs":{"total":289910292480,"available":289818382336,"internally_reserved":0,"allocated":507904,"data_stored":1303427,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000918"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124691+0000","last_change":"2024-04-19T02:16:24.124691+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124691+0000","last_undegraded":"2024-04-19T02:16:24.124691+0000","last_fullsized":"2024-04-19T02:16:24.124691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124856+0000","last_change":"2024-04-19T02:16:24.124856+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124856+0000","last_undegraded":"2024-04-19T02:16:24.124856+0000","last_fullsized":"2024-04-19T02:16:24.124856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123926+0000","last_change":"2024-04-19T02:16:24.123926+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123926+0000","last_undegraded":"2024-04-19T02:16:24.123926+0000","last_fullsized":"2024-04-19T02:16:24.123926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124657+0000","last_change":"2024-04-19T02:16:24.124657+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124657+0000","last_undegraded":"2024-04-19T02:16:24.124657+0000","last_fullsized":"2024-04-19T02:16:24.124657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124406+0000","last_change":"2024-04-19T02:16:24.124406+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124406+0000","last_undegraded":"2024-04-19T02:16:24.124406+0000","last_fullsized":"2024-04-19T02:16:24.124406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124183+0000","last_change":"2024-04-19T02:16:24.124183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124183+0000","last_undegraded":"2024-04-19T02:16:24.124183+0000","last_fullsized":"2024-04-19T02:16:24.124183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124494+0000","last_change":"2024-04-19T02:16:24.124494+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124494+0000","last_undegraded":"2024-04-19T02:16:24.124494+0000","last_fullsized":"2024-04-19T02:16:24.124494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123735+0000","last_change":"2024-04-19T02:16:24.123735+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123735+0000","last_undegraded":"2024-04-19T02:16:24.123735+0000","last_fullsized":"2024-04-19T02:16:24.123735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122964+0000","last_change":"2024-04-19T02:16:24.122964+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122964+0000","last_undegraded":"2024-04-19T02:16:24.122964+0000","last_fullsized":"2024-04-19T02:16:24.122964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123755+0000","last_change":"2024-04-19T02:16:24.123755+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123755+0000","last_undegraded":"2024-04-19T02:16:24.123755+0000","last_fullsized":"2024-04-19T02:16:24.123755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121943+0000","last_change":"2024-04-19T02:16:24.121943+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121943+0000","last_undegraded":"2024-04-19T02:16:24.121943+0000","last_fullsized":"2024-04-19T02:16:24.121943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123197+0000","last_change":"2024-04-19T02:16:24.123197+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123197+0000","last_undegraded":"2024-04-19T02:16:24.123197+0000","last_fullsized":"2024-04-19T02:16:24.123197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122996+0000","last_change":"2024-04-19T02:16:24.122996+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122996+0000","last_undegraded":"2024-04-19T02:16:24.122996+0000","last_fullsized":"2024-04-19T02:16:24.122996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122983+0000","last_change":"2024-04-19T02:16:24.122983+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122983+0000","last_undegraded":"2024-04-19T02:16:24.122983+0000","last_fullsized":"2024-04-19T02:16:24.122983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123044+0000","last_change":"2024-04-19T02:16:24.123044+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123044+0000","last_undegraded":"2024-04-19T02:16:24.123044+0000","last_fullsized":"2024-04-19T02:16:24.123044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121682+0000","last_change":"2024-04-19T02:16:24.121682+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121682+0000","last_undegraded":"2024-04-19T02:16:24.121682+0000","last_fullsized":"2024-04-19T02:16:24.121682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123035+0000","last_change":"2024-04-19T02:16:24.123035+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123035+0000","last_undegraded":"2024-04-19T02:16:24.123035+0000","last_fullsized":"2024-04-19T02:16:24.123035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122223+0000","last_change":"2024-04-19T02:16:24.122223+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122223+0000","last_undegraded":"2024-04-19T02:16:24.122223+0000","last_fullsized":"2024-04-19T02:16:24.122223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122097+0000","last_change":"2024-04-19T02:16:24.122097+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122097+0000","last_undegraded":"2024-04-19T02:16:24.122097+0000","last_fullsized":"2024-04-19T02:16:24.122097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119883+0000","last_change":"2024-04-19T02:16:24.119883+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119883+0000","last_undegraded":"2024-04-19T02:16:24.119883+0000","last_fullsized":"2024-04-19T02:16:24.119883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122952+0000","last_change":"2024-04-19T02:16:24.122952+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122952+0000","last_undegraded":"2024-04-19T02:16:24.122952+0000","last_fullsized":"2024-04-19T02:16:24.122952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119812+0000","last_change":"2024-04-19T02:16:24.119812+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119812+0000","last_undegraded":"2024-04-19T02:16:24.119812+0000","last_fullsized":"2024-04-19T02:16:24.119812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119751+0000","last_change":"2024-04-19T02:16:24.119751+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119751+0000","last_undegraded":"2024-04-19T02:16:24.119751+0000","last_fullsized":"2024-04-19T02:16:24.119751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122705+0000","last_change":"2024-04-19T02:16:24.122705+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122705+0000","last_undegraded":"2024-04-19T02:16:24.122705+0000","last_fullsized":"2024-04-19T02:16:24.122705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121733+0000","last_change":"2024-04-19T02:16:24.121733+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121733+0000","last_undegraded":"2024-04-19T02:16:24.121733+0000","last_fullsized":"2024-04-19T02:16:24.121733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120053+0000","last_change":"2024-04-19T02:16:24.120053+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120053+0000","last_undegraded":"2024-04-19T02:16:24.120053+0000","last_fullsized":"2024-04-19T02:16:24.120053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121704+0000","last_change":"2024-04-19T02:16:24.121704+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121704+0000","last_undegraded":"2024-04-19T02:16:24.121704+0000","last_fullsized":"2024-04-19T02:16:24.121704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116578+0000","last_change":"2024-04-19T02:16:24.116578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116578+0000","last_undegraded":"2024-04-19T02:16:24.116578+0000","last_fullsized":"2024-04-19T02:16:24.116578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121426+0000","last_change":"2024-04-19T02:16:24.121426+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121426+0000","last_undegraded":"2024-04-19T02:16:24.121426+0000","last_fullsized":"2024-04-19T02:16:24.121426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121749+0000","last_change":"2024-04-19T02:16:24.121749+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121749+0000","last_undegraded":"2024-04-19T02:16:24.121749+0000","last_fullsized":"2024-04-19T02:16:24.121749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.112029+0000","last_change":"2024-04-19T02:16:24.112029+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.112029+0000","last_undegraded":"2024-04-19T02:16:24.112029+0000","last_fullsized":"2024-04-19T02:16:24.112029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145646+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.145646+0000","last_peered":"2024-04-19T02:16:24.145646+0000","last_clean":"2024-04-19T02:16:24.145646+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.145646+0000","last_undegraded":"2024-04-19T02:16:24.145646+0000","last_fullsized":"2024-04-19T02:16:24.145646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117371+0000","last_change":"2024-04-19T02:16:24.117371+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117371+0000","last_undegraded":"2024-04-19T02:16:24.117371+0000","last_fullsized":"2024-04-19T02:16:24.117371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142625+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.142625+0000","last_peered":"2024-04-19T02:16:24.142625+0000","last_clean":"2024-04-19T02:16:24.142625+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.142625+0000","last_undegraded":"2024-04-19T02:16:24.142625+0000","last_fullsized":"2024-04-19T02:16:24.142625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120247+0000","last_change":"2024-04-19T02:16:24.120247+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120247+0000","last_undegraded":"2024-04-19T02:16:24.120247+0000","last_fullsized":"2024-04-19T02:16:24.120247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128363+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.128363+0000","last_peered":"2024-04-19T02:16:24.128363+0000","last_clean":"2024-04-19T02:16:24.128363+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.128363+0000","last_undegraded":"2024-04-19T02:16:24.128363+0000","last_fullsized":"2024-04-19T02:16:24.128363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121205+0000","last_change":"2024-04-19T02:16:24.121205+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121205+0000","last_undegraded":"2024-04-19T02:16:24.121205+0000","last_fullsized":"2024-04-19T02:16:24.121205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141326+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.141326+0000","last_peered":"2024-04-19T02:16:24.141326+0000","last_clean":"2024-04-19T02:16:24.141326+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.141326+0000","last_undegraded":"2024-04-19T02:16:24.141326+0000","last_fullsized":"2024-04-19T02:16:24.141326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141650+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.141650+0000","last_peered":"2024-04-19T02:16:24.141650+0000","last_clean":"2024-04-19T02:16:24.141650+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.141650+0000","last_undegraded":"2024-04-19T02:16:24.141650+0000","last_fullsized":"2024-04-19T02:16:24.141650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117910+0000","last_change":"2024-04-19T02:16:24.117910+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117910+0000","last_undegraded":"2024-04-19T02:16:24.117910+0000","last_fullsized":"2024-04-19T02:16:24.117910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.127060+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.127060+0000","last_peered":"2024-04-19T02:16:24.127060+0000","last_clean":"2024-04-19T02:16:24.127060+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.127060+0000","last_undegraded":"2024-04-19T02:16:24.127060+0000","last_fullsized":"2024-04-19T02:16:24.127060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118332+0000","last_change":"2024-04-19T02:16:24.118332+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118332+0000","last_undegraded":"2024-04-19T02:16:24.118332+0000","last_fullsized":"2024-04-19T02:16:24.118332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145440+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.145440+0000","last_peered":"2024-04-19T02:16:24.145440+0000","last_clean":"2024-04-19T02:16:24.145440+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.145440+0000","last_undegraded":"2024-04-19T02:16:24.145440+0000","last_fullsized":"2024-04-19T02:16:24.145440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118589+0000","last_change":"2024-04-19T02:16:24.118589+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118589+0000","last_undegraded":"2024-04-19T02:16:24.118589+0000","last_fullsized":"2024-04-19T02:16:24.118589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144176+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.144176+0000","last_peered":"2024-04-19T02:16:24.144176+0000","last_clean":"2024-04-19T02:16:24.144176+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.144176+0000","last_undegraded":"2024-04-19T02:16:24.144176+0000","last_fullsized":"2024-04-19T02:16:24.144176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118907+0000","last_change":"2024-04-19T02:16:24.118907+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118907+0000","last_undegraded":"2024-04-19T02:16:24.118907+0000","last_fullsized":"2024-04-19T02:16:24.118907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143145+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.143145+0000","last_peered":"2024-04-19T02:16:24.143145+0000","last_clean":"2024-04-19T02:16:24.143145+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.143145+0000","last_undegraded":"2024-04-19T02:16:24.143145+0000","last_fullsized":"2024-04-19T02:16:24.143145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118629+0000","last_change":"2024-04-19T02:16:24.118629+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118629+0000","last_undegraded":"2024-04-19T02:16:24.118629+0000","last_fullsized":"2024-04-19T02:16:24.118629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144273+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.144273+0000","last_peered":"2024-04-19T02:16:24.144273+0000","last_clean":"2024-04-19T02:16:24.144273+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.144273+0000","last_undegraded":"2024-04-19T02:16:24.144273+0000","last_fullsized":"2024-04-19T02:16:24.144273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119665+0000","last_change":"2024-04-19T02:16:24.119665+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119665+0000","last_undegraded":"2024-04-19T02:16:24.119665+0000","last_fullsized":"2024-04-19T02:16:24.119665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128307+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.128307+0000","last_peered":"2024-04-19T02:16:24.128307+0000","last_clean":"2024-04-19T02:16:24.128307+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.128307+0000","last_undegraded":"2024-04-19T02:16:24.128307+0000","last_fullsized":"2024-04-19T02:16:24.128307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.136304+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.136304+0000","last_peered":"2024-04-19T02:16:24.136304+0000","last_clean":"2024-04-19T02:16:24.136304+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.136304+0000","last_undegraded":"2024-04-19T02:16:24.136304+0000","last_fullsized":"2024-04-19T02:16:24.136304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119780+0000","last_change":"2024-04-19T02:16:24.119780+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119780+0000","last_undegraded":"2024-04-19T02:16:24.119780+0000","last_fullsized":"2024-04-19T02:16:24.119780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107773+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:23.107773+0000","last_peered":"2024-04-19T02:16:23.107773+0000","last_clean":"2024-04-19T02:16:23.107773+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:23.107773+0000","last_undegraded":"2024-04-19T02:16:23.107773+0000","last_fullsized":"2024-04-19T02:16:23.107773+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107751+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:23.107751+0000","last_peered":"2024-04-19T02:16:23.107751+0000","last_clean":"2024-04-19T02:16:23.107751+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:23.107751+0000","last_undegraded":"2024-04-19T02:16:23.107751+0000","last_fullsized":"2024-04-19T02:16:23.107751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138248+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.138248+0000","last_peered":"2024-04-19T02:16:24.138248+0000","last_clean":"2024-04-19T02:16:24.138248+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.138248+0000","last_undegraded":"2024-04-19T02:16:24.138248+0000","last_fullsized":"2024-04-19T02:16:24.138248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118519+0000","last_change":"2024-04-19T02:16:24.118519+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118519+0000","last_undegraded":"2024-04-19T02:16:24.118519+0000","last_fullsized":"2024-04-19T02:16:24.118519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107780+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:23.107780+0000","last_peered":"2024-04-19T02:16:23.107780+0000","last_clean":"2024-04-19T02:16:23.107780+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:23.107780+0000","last_undegraded":"2024-04-19T02:16:23.107780+0000","last_fullsized":"2024-04-19T02:16:23.107780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142477+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.142477+0000","last_peered":"2024-04-19T02:16:24.142477+0000","last_clean":"2024-04-19T02:16:24.142477+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.142477+0000","last_undegraded":"2024-04-19T02:16:24.142477+0000","last_fullsized":"2024-04-19T02:16:24.142477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114418+0000","last_change":"2024-04-19T02:16:24.114418+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114418+0000","last_undegraded":"2024-04-19T02:16:24.114418+0000","last_fullsized":"2024-04-19T02:16:24.114418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122575+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:23.122575+0000","last_peered":"2024-04-19T02:16:23.122575+0000","last_clean":"2024-04-19T02:16:23.122575+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:23.122575+0000","last_undegraded":"2024-04-19T02:16:23.122575+0000","last_fullsized":"2024-04-19T02:16:23.122575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129218+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.129218+0000","last_peered":"2024-04-19T02:16:24.129218+0000","last_clean":"2024-04-19T02:16:24.129218+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.129218+0000","last_undegraded":"2024-04-19T02:16:24.129218+0000","last_fullsized":"2024-04-19T02:16:24.129218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118177+0000","last_change":"2024-04-19T02:16:24.118177+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118177+0000","last_undegraded":"2024-04-19T02:16:24.118177+0000","last_fullsized":"2024-04-19T02:16:24.118177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107748+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:23.107748+0000","last_peered":"2024-04-19T02:16:23.107748+0000","last_clean":"2024-04-19T02:16:23.107748+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:23.107748+0000","last_undegraded":"2024-04-19T02:16:23.107748+0000","last_fullsized":"2024-04-19T02:16:23.107748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144289+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.144289+0000","last_peered":"2024-04-19T02:16:24.144289+0000","last_clean":"2024-04-19T02:16:24.144289+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.144289+0000","last_undegraded":"2024-04-19T02:16:24.144289+0000","last_fullsized":"2024-04-19T02:16:24.144289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118209+0000","last_change":"2024-04-19T02:16:24.118209+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118209+0000","last_undegraded":"2024-04-19T02:16:24.118209+0000","last_fullsized":"2024-04-19T02:16:24.118209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145614+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.145614+0000","last_peered":"2024-04-19T02:16:24.145614+0000","last_clean":"2024-04-19T02:16:24.145614+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.145614+0000","last_undegraded":"2024-04-19T02:16:24.145614+0000","last_fullsized":"2024-04-19T02:16:24.145614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122761+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:23.122761+0000","last_peered":"2024-04-19T02:16:23.122761+0000","last_clean":"2024-04-19T02:16:23.122761+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:23.122761+0000","last_undegraded":"2024-04-19T02:16:23.122761+0000","last_fullsized":"2024-04-19T02:16:23.122761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114183+0000","last_change":"2024-04-19T02:16:24.114183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114183+0000","last_undegraded":"2024-04-19T02:16:24.114183+0000","last_fullsized":"2024-04-19T02:16:24.114183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138797+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.138797+0000","last_peered":"2024-04-19T02:16:24.138797+0000","last_clean":"2024-04-19T02:16:24.138797+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.138797+0000","last_undegraded":"2024-04-19T02:16:24.138797+0000","last_fullsized":"2024-04-19T02:16:24.138797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.109587+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:23.109587+0000","last_peered":"2024-04-19T02:16:23.109587+0000","last_clean":"2024-04-19T02:16:23.109587+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:23.109587+0000","last_undegraded":"2024-04-19T02:16:23.109587+0000","last_fullsized":"2024-04-19T02:16:23.109587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114120+0000","last_change":"2024-04-19T02:16:24.114120+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114120+0000","last_undegraded":"2024-04-19T02:16:24.114120+0000","last_fullsized":"2024-04-19T02:16:24.114120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138296+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.138296+0000","last_peered":"2024-04-19T02:16:24.138296+0000","last_clean":"2024-04-19T02:16:24.138296+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.138296+0000","last_undegraded":"2024-04-19T02:16:24.138296+0000","last_fullsized":"2024-04-19T02:16:24.138296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122991+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:23.122991+0000","last_peered":"2024-04-19T02:16:23.122991+0000","last_clean":"2024-04-19T02:16:23.122991+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:23.122991+0000","last_undegraded":"2024-04-19T02:16:23.122991+0000","last_fullsized":"2024-04-19T02:16:23.122991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117578+0000","last_change":"2024-04-19T02:16:24.117578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117578+0000","last_undegraded":"2024-04-19T02:16:24.117578+0000","last_fullsized":"2024-04-19T02:16:24.117578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143994+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:24.143994+0000","last_peered":"2024-04-19T02:16:24.143994+0000","last_clean":"2024-04-19T02:16:24.143994+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:24.143994+0000","last_undegraded":"2024-04-19T02:16:24.143994+0000","last_fullsized":"2024-04-19T02:16:24.143994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107724+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:23.107724+0000","last_peered":"2024-04-19T02:16:23.107724+0000","last_clean":"2024-04-19T02:16:23.107724+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:23.107724+0000","last_undegraded":"2024-04-19T02:16:23.107724+0000","last_fullsized":"2024-04-19T02:16:23.107724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114675+0000","last_change":"2024-04-19T02:16:24.114675+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114675+0000","last_undegraded":"2024-04-19T02:16:24.114675+0000","last_fullsized":"2024-04-19T02:16:24.114675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141945+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.141945+0000","last_peered":"2024-04-19T02:16:24.141945+0000","last_clean":"2024-04-19T02:16:24.141945+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.141945+0000","last_undegraded":"2024-04-19T02:16:24.141945+0000","last_fullsized":"2024-04-19T02:16:24.141945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120115+0000","last_change":"2024-04-19T02:16:24.120115+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120115+0000","last_undegraded":"2024-04-19T02:16:24.120115+0000","last_fullsized":"2024-04-19T02:16:24.120115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129180+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.129180+0000","last_peered":"2024-04-19T02:16:24.129180+0000","last_clean":"2024-04-19T02:16:24.129180+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.129180+0000","last_undegraded":"2024-04-19T02:16:24.129180+0000","last_fullsized":"2024-04-19T02:16:24.129180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.143469+0000","last_peered":"2024-04-19T02:16:24.143469+0000","last_clean":"2024-04-19T02:16:24.143469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.143469+0000","last_undegraded":"2024-04-19T02:16:24.143469+0000","last_fullsized":"2024-04-19T02:16:24.143469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119928+0000","last_change":"2024-04-19T02:16:24.119928+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119928+0000","last_undegraded":"2024-04-19T02:16:24.119928+0000","last_fullsized":"2024-04-19T02:16:24.119928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.147014+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.147014+0000","last_peered":"2024-04-19T02:16:24.147014+0000","last_clean":"2024-04-19T02:16:24.147014+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.147014+0000","last_undegraded":"2024-04-19T02:16:24.147014+0000","last_fullsized":"2024-04-19T02:16:24.147014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120109+0000","last_change":"2024-04-19T02:16:24.120109+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120109+0000","last_undegraded":"2024-04-19T02:16:24.120109+0000","last_fullsized":"2024-04-19T02:16:24.120109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116484+0000","last_change":"2024-04-19T02:16:24.116484+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116484+0000","last_undegraded":"2024-04-19T02:16:24.116484+0000","last_fullsized":"2024-04-19T02:16:24.116484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138341+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.138341+0000","last_peered":"2024-04-19T02:16:24.138341+0000","last_clean":"2024-04-19T02:16:24.138341+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.138341+0000","last_undegraded":"2024-04-19T02:16:24.138341+0000","last_fullsized":"2024-04-19T02:16:24.138341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121365+0000","last_change":"2024-04-19T02:16:24.121365+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121365+0000","last_undegraded":"2024-04-19T02:16:24.121365+0000","last_fullsized":"2024-04-19T02:16:24.121365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143315+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.143315+0000","last_peered":"2024-04-19T02:16:24.143315+0000","last_clean":"2024-04-19T02:16:24.143315+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.143315+0000","last_undegraded":"2024-04-19T02:16:24.143315+0000","last_fullsized":"2024-04-19T02:16:24.143315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121192+0000","last_change":"2024-04-19T02:16:24.121192+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121192+0000","last_undegraded":"2024-04-19T02:16:24.121192+0000","last_fullsized":"2024-04-19T02:16:24.121192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.134108+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.134108+0000","last_peered":"2024-04-19T02:16:24.134108+0000","last_clean":"2024-04-19T02:16:24.134108+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.134108+0000","last_undegraded":"2024-04-19T02:16:24.134108+0000","last_fullsized":"2024-04-19T02:16:24.134108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116356+0000","last_change":"2024-04-19T02:16:24.116356+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116356+0000","last_undegraded":"2024-04-19T02:16:24.116356+0000","last_fullsized":"2024-04-19T02:16:24.116356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.124535+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.124535+0000","last_peered":"2024-04-19T02:16:24.124535+0000","last_clean":"2024-04-19T02:16:24.124535+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.124535+0000","last_undegraded":"2024-04-19T02:16:24.124535+0000","last_fullsized":"2024-04-19T02:16:24.124535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121139+0000","last_change":"2024-04-19T02:16:24.121139+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121139+0000","last_undegraded":"2024-04-19T02:16:24.121139+0000","last_fullsized":"2024-04-19T02:16:24.121139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143772+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.143772+0000","last_peered":"2024-04-19T02:16:24.143772+0000","last_clean":"2024-04-19T02:16:24.143772+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.143772+0000","last_undegraded":"2024-04-19T02:16:24.143772+0000","last_fullsized":"2024-04-19T02:16:24.143772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120001+0000","last_change":"2024-04-19T02:16:24.120001+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120001+0000","last_undegraded":"2024-04-19T02:16:24.120001+0000","last_fullsized":"2024-04-19T02:16:24.120001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143602+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.143602+0000","last_peered":"2024-04-19T02:16:24.143602+0000","last_clean":"2024-04-19T02:16:24.143602+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.143602+0000","last_undegraded":"2024-04-19T02:16:24.143602+0000","last_fullsized":"2024-04-19T02:16:24.143602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122233+0000","last_change":"2024-04-19T02:16:24.122233+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122233+0000","last_undegraded":"2024-04-19T02:16:24.122233+0000","last_fullsized":"2024-04-19T02:16:24.122233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138318+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.138318+0000","last_peered":"2024-04-19T02:16:24.138318+0000","last_clean":"2024-04-19T02:16:24.138318+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.138318+0000","last_undegraded":"2024-04-19T02:16:24.138318+0000","last_fullsized":"2024-04-19T02:16:24.138318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120505+0000","last_change":"2024-04-19T02:16:24.120505+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120505+0000","last_undegraded":"2024-04-19T02:16:24.120505+0000","last_fullsized":"2024-04-19T02:16:24.120505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144018+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.144018+0000","last_peered":"2024-04-19T02:16:24.144018+0000","last_clean":"2024-04-19T02:16:24.144018+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.144018+0000","last_undegraded":"2024-04-19T02:16:24.144018+0000","last_fullsized":"2024-04-19T02:16:24.144018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:27.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:28.170 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:28.186 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-19T02:16:26.172875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89756,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025764,"statfs":{"total":289910292480,"available":289818382336,"internally_reserved":0,"allocated":507904,"data_stored":1303427,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000918"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124691+0000","last_change":"2024-04-19T02:16:24.124691+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124691+0000","last_undegraded":"2024-04-19T02:16:24.124691+0000","last_fullsized":"2024-04-19T02:16:24.124691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124856+0000","last_change":"2024-04-19T02:16:24.124856+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124856+0000","last_undegraded":"2024-04-19T02:16:24.124856+0000","last_fullsized":"2024-04-19T02:16:24.124856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123926+0000","last_change":"2024-04-19T02:16:24.123926+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123926+0000","last_undegraded":"2024-04-19T02:16:24.123926+0000","last_fullsized":"2024-04-19T02:16:24.123926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124657+0000","last_change":"2024-04-19T02:16:24.124657+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124657+0000","last_undegraded":"2024-04-19T02:16:24.124657+0000","last_fullsized":"2024-04-19T02:16:24.124657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124406+0000","last_change":"2024-04-19T02:16:24.124406+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124406+0000","last_undegraded":"2024-04-19T02:16:24.124406+0000","last_fullsized":"2024-04-19T02:16:24.124406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124183+0000","last_change":"2024-04-19T02:16:24.124183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124183+0000","last_undegraded":"2024-04-19T02:16:24.124183+0000","last_fullsized":"2024-04-19T02:16:24.124183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124494+0000","last_change":"2024-04-19T02:16:24.124494+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124494+0000","last_undegraded":"2024-04-19T02:16:24.124494+0000","last_fullsized":"2024-04-19T02:16:24.124494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123735+0000","last_change":"2024-04-19T02:16:24.123735+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123735+0000","last_undegraded":"2024-04-19T02:16:24.123735+0000","last_fullsized":"2024-04-19T02:16:24.123735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122964+0000","last_change":"2024-04-19T02:16:24.122964+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122964+0000","last_undegraded":"2024-04-19T02:16:24.122964+0000","last_fullsized":"2024-04-19T02:16:24.122964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123755+0000","last_change":"2024-04-19T02:16:24.123755+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123755+0000","last_undegraded":"2024-04-19T02:16:24.123755+0000","last_fullsized":"2024-04-19T02:16:24.123755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121943+0000","last_change":"2024-04-19T02:16:24.121943+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121943+0000","last_undegraded":"2024-04-19T02:16:24.121943+0000","last_fullsized":"2024-04-19T02:16:24.121943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123197+0000","last_change":"2024-04-19T02:16:24.123197+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123197+0000","last_undegraded":"2024-04-19T02:16:24.123197+0000","last_fullsized":"2024-04-19T02:16:24.123197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122996+0000","last_change":"2024-04-19T02:16:24.122996+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122996+0000","last_undegraded":"2024-04-19T02:16:24.122996+0000","last_fullsized":"2024-04-19T02:16:24.122996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122983+0000","last_change":"2024-04-19T02:16:24.122983+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122983+0000","last_undegraded":"2024-04-19T02:16:24.122983+0000","last_fullsized":"2024-04-19T02:16:24.122983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123044+0000","last_change":"2024-04-19T02:16:24.123044+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123044+0000","last_undegraded":"2024-04-19T02:16:24.123044+0000","last_fullsized":"2024-04-19T02:16:24.123044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121682+0000","last_change":"2024-04-19T02:16:24.121682+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121682+0000","last_undegraded":"2024-04-19T02:16:24.121682+0000","last_fullsized":"2024-04-19T02:16:24.121682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123035+0000","last_change":"2024-04-19T02:16:24.123035+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123035+0000","last_undegraded":"2024-04-19T02:16:24.123035+0000","last_fullsized":"2024-04-19T02:16:24.123035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122223+0000","last_change":"2024-04-19T02:16:24.122223+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122223+0000","last_undegraded":"2024-04-19T02:16:24.122223+0000","last_fullsized":"2024-04-19T02:16:24.122223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122097+0000","last_change":"2024-04-19T02:16:24.122097+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122097+0000","last_undegraded":"2024-04-19T02:16:24.122097+0000","last_fullsized":"2024-04-19T02:16:24.122097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119883+0000","last_change":"2024-04-19T02:16:24.119883+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119883+0000","last_undegraded":"2024-04-19T02:16:24.119883+0000","last_fullsized":"2024-04-19T02:16:24.119883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122952+0000","last_change":"2024-04-19T02:16:24.122952+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122952+0000","last_undegraded":"2024-04-19T02:16:24.122952+0000","last_fullsized":"2024-04-19T02:16:24.122952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119812+0000","last_change":"2024-04-19T02:16:24.119812+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119812+0000","last_undegraded":"2024-04-19T02:16:24.119812+0000","last_fullsized":"2024-04-19T02:16:24.119812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119751+0000","last_change":"2024-04-19T02:16:24.119751+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119751+0000","last_undegraded":"2024-04-19T02:16:24.119751+0000","last_fullsized":"2024-04-19T02:16:24.119751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122705+0000","last_change":"2024-04-19T02:16:24.122705+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122705+0000","last_undegraded":"2024-04-19T02:16:24.122705+0000","last_fullsized":"2024-04-19T02:16:24.122705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121733+0000","last_change":"2024-04-19T02:16:24.121733+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121733+0000","last_undegraded":"2024-04-19T02:16:24.121733+0000","last_fullsized":"2024-04-19T02:16:24.121733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120053+0000","last_change":"2024-04-19T02:16:24.120053+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120053+0000","last_undegraded":"2024-04-19T02:16:24.120053+0000","last_fullsized":"2024-04-19T02:16:24.120053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121704+0000","last_change":"2024-04-19T02:16:24.121704+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121704+0000","last_undegraded":"2024-04-19T02:16:24.121704+0000","last_fullsized":"2024-04-19T02:16:24.121704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116578+0000","last_change":"2024-04-19T02:16:24.116578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116578+0000","last_undegraded":"2024-04-19T02:16:24.116578+0000","last_fullsized":"2024-04-19T02:16:24.116578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121426+0000","last_change":"2024-04-19T02:16:24.121426+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121426+0000","last_undegraded":"2024-04-19T02:16:24.121426+0000","last_fullsized":"2024-04-19T02:16:24.121426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121749+0000","last_change":"2024-04-19T02:16:24.121749+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121749+0000","last_undegraded":"2024-04-19T02:16:24.121749+0000","last_fullsized":"2024-04-19T02:16:24.121749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.112029+0000","last_change":"2024-04-19T02:16:24.112029+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.112029+0000","last_undegraded":"2024-04-19T02:16:24.112029+0000","last_fullsized":"2024-04-19T02:16:24.112029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145646+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.145646+0000","last_peered":"2024-04-19T02:16:24.145646+0000","last_clean":"2024-04-19T02:16:24.145646+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.145646+0000","last_undegraded":"2024-04-19T02:16:24.145646+0000","last_fullsized":"2024-04-19T02:16:24.145646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117371+0000","last_change":"2024-04-19T02:16:24.117371+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117371+0000","last_undegraded":"2024-04-19T02:16:24.117371+0000","last_fullsized":"2024-04-19T02:16:24.117371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142625+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.142625+0000","last_peered":"2024-04-19T02:16:24.142625+0000","last_clean":"2024-04-19T02:16:24.142625+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.142625+0000","last_undegraded":"2024-04-19T02:16:24.142625+0000","last_fullsized":"2024-04-19T02:16:24.142625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120247+0000","last_change":"2024-04-19T02:16:24.120247+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120247+0000","last_undegraded":"2024-04-19T02:16:24.120247+0000","last_fullsized":"2024-04-19T02:16:24.120247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128363+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.128363+0000","last_peered":"2024-04-19T02:16:24.128363+0000","last_clean":"2024-04-19T02:16:24.128363+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.128363+0000","last_undegraded":"2024-04-19T02:16:24.128363+0000","last_fullsized":"2024-04-19T02:16:24.128363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121205+0000","last_change":"2024-04-19T02:16:24.121205+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121205+0000","last_undegraded":"2024-04-19T02:16:24.121205+0000","last_fullsized":"2024-04-19T02:16:24.121205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141326+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.141326+0000","last_peered":"2024-04-19T02:16:24.141326+0000","last_clean":"2024-04-19T02:16:24.141326+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.141326+0000","last_undegraded":"2024-04-19T02:16:24.141326+0000","last_fullsized":"2024-04-19T02:16:24.141326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141650+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.141650+0000","last_peered":"2024-04-19T02:16:24.141650+0000","last_clean":"2024-04-19T02:16:24.141650+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.141650+0000","last_undegraded":"2024-04-19T02:16:24.141650+0000","last_fullsized":"2024-04-19T02:16:24.141650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117910+0000","last_change":"2024-04-19T02:16:24.117910+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117910+0000","last_undegraded":"2024-04-19T02:16:24.117910+0000","last_fullsized":"2024-04-19T02:16:24.117910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.127060+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.127060+0000","last_peered":"2024-04-19T02:16:24.127060+0000","last_clean":"2024-04-19T02:16:24.127060+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.127060+0000","last_undegraded":"2024-04-19T02:16:24.127060+0000","last_fullsized":"2024-04-19T02:16:24.127060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118332+0000","last_change":"2024-04-19T02:16:24.118332+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118332+0000","last_undegraded":"2024-04-19T02:16:24.118332+0000","last_fullsized":"2024-04-19T02:16:24.118332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145440+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.145440+0000","last_peered":"2024-04-19T02:16:24.145440+0000","last_clean":"2024-04-19T02:16:24.145440+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.145440+0000","last_undegraded":"2024-04-19T02:16:24.145440+0000","last_fullsized":"2024-04-19T02:16:24.145440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118589+0000","last_change":"2024-04-19T02:16:24.118589+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118589+0000","last_undegraded":"2024-04-19T02:16:24.118589+0000","last_fullsized":"2024-04-19T02:16:24.118589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144176+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.144176+0000","last_peered":"2024-04-19T02:16:24.144176+0000","last_clean":"2024-04-19T02:16:24.144176+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.144176+0000","last_undegraded":"2024-04-19T02:16:24.144176+0000","last_fullsized":"2024-04-19T02:16:24.144176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118907+0000","last_change":"2024-04-19T02:16:24.118907+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118907+0000","last_undegraded":"2024-04-19T02:16:24.118907+0000","last_fullsized":"2024-04-19T02:16:24.118907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143145+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.143145+0000","last_peered":"2024-04-19T02:16:24.143145+0000","last_clean":"2024-04-19T02:16:24.143145+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.143145+0000","last_undegraded":"2024-04-19T02:16:24.143145+0000","last_fullsized":"2024-04-19T02:16:24.143145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118629+0000","last_change":"2024-04-19T02:16:24.118629+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118629+0000","last_undegraded":"2024-04-19T02:16:24.118629+0000","last_fullsized":"2024-04-19T02:16:24.118629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144273+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.144273+0000","last_peered":"2024-04-19T02:16:24.144273+0000","last_clean":"2024-04-19T02:16:24.144273+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.144273+0000","last_undegraded":"2024-04-19T02:16:24.144273+0000","last_fullsized":"2024-04-19T02:16:24.144273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119665+0000","last_change":"2024-04-19T02:16:24.119665+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119665+0000","last_undegraded":"2024-04-19T02:16:24.119665+0000","last_fullsized":"2024-04-19T02:16:24.119665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128307+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.128307+0000","last_peered":"2024-04-19T02:16:24.128307+0000","last_clean":"2024-04-19T02:16:24.128307+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.128307+0000","last_undegraded":"2024-04-19T02:16:24.128307+0000","last_fullsized":"2024-04-19T02:16:24.128307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.136304+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.136304+0000","last_peered":"2024-04-19T02:16:24.136304+0000","last_clean":"2024-04-19T02:16:24.136304+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.136304+0000","last_undegraded":"2024-04-19T02:16:24.136304+0000","last_fullsized":"2024-04-19T02:16:24.136304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119780+0000","last_change":"2024-04-19T02:16:24.119780+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119780+0000","last_undegraded":"2024-04-19T02:16:24.119780+0000","last_fullsized":"2024-04-19T02:16:24.119780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107773+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:23.107773+0000","last_peered":"2024-04-19T02:16:23.107773+0000","last_clean":"2024-04-19T02:16:23.107773+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:23.107773+0000","last_undegraded":"2024-04-19T02:16:23.107773+0000","last_fullsized":"2024-04-19T02:16:23.107773+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107751+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:23.107751+0000","last_peered":"2024-04-19T02:16:23.107751+0000","last_clean":"2024-04-19T02:16:23.107751+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:23.107751+0000","last_undegraded":"2024-04-19T02:16:23.107751+0000","last_fullsized":"2024-04-19T02:16:23.107751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138248+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.138248+0000","last_peered":"2024-04-19T02:16:24.138248+0000","last_clean":"2024-04-19T02:16:24.138248+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.138248+0000","last_undegraded":"2024-04-19T02:16:24.138248+0000","last_fullsized":"2024-04-19T02:16:24.138248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118519+0000","last_change":"2024-04-19T02:16:24.118519+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118519+0000","last_undegraded":"2024-04-19T02:16:24.118519+0000","last_fullsized":"2024-04-19T02:16:24.118519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107780+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:23.107780+0000","last_peered":"2024-04-19T02:16:23.107780+0000","last_clean":"2024-04-19T02:16:23.107780+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:23.107780+0000","last_undegraded":"2024-04-19T02:16:23.107780+0000","last_fullsized":"2024-04-19T02:16:23.107780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142477+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.142477+0000","last_peered":"2024-04-19T02:16:24.142477+0000","last_clean":"2024-04-19T02:16:24.142477+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.142477+0000","last_undegraded":"2024-04-19T02:16:24.142477+0000","last_fullsized":"2024-04-19T02:16:24.142477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114418+0000","last_change":"2024-04-19T02:16:24.114418+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114418+0000","last_undegraded":"2024-04-19T02:16:24.114418+0000","last_fullsized":"2024-04-19T02:16:24.114418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122575+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:23.122575+0000","last_peered":"2024-04-19T02:16:23.122575+0000","last_clean":"2024-04-19T02:16:23.122575+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:23.122575+0000","last_undegraded":"2024-04-19T02:16:23.122575+0000","last_fullsized":"2024-04-19T02:16:23.122575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129218+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.129218+0000","last_peered":"2024-04-19T02:16:24.129218+0000","last_clean":"2024-04-19T02:16:24.129218+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.129218+0000","last_undegraded":"2024-04-19T02:16:24.129218+0000","last_fullsized":"2024-04-19T02:16:24.129218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118177+0000","last_change":"2024-04-19T02:16:24.118177+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118177+0000","last_undegraded":"2024-04-19T02:16:24.118177+0000","last_fullsized":"2024-04-19T02:16:24.118177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107748+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:23.107748+0000","last_peered":"2024-04-19T02:16:23.107748+0000","last_clean":"2024-04-19T02:16:23.107748+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:23.107748+0000","last_undegraded":"2024-04-19T02:16:23.107748+0000","last_fullsized":"2024-04-19T02:16:23.107748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144289+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.144289+0000","last_peered":"2024-04-19T02:16:24.144289+0000","last_clean":"2024-04-19T02:16:24.144289+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.144289+0000","last_undegraded":"2024-04-19T02:16:24.144289+0000","last_fullsized":"2024-04-19T02:16:24.144289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118209+0000","last_change":"2024-04-19T02:16:24.118209+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118209+0000","last_undegraded":"2024-04-19T02:16:24.118209+0000","last_fullsized":"2024-04-19T02:16:24.118209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145614+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.145614+0000","last_peered":"2024-04-19T02:16:24.145614+0000","last_clean":"2024-04-19T02:16:24.145614+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.145614+0000","last_undegraded":"2024-04-19T02:16:24.145614+0000","last_fullsized":"2024-04-19T02:16:24.145614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122761+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:23.122761+0000","last_peered":"2024-04-19T02:16:23.122761+0000","last_clean":"2024-04-19T02:16:23.122761+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:23.122761+0000","last_undegraded":"2024-04-19T02:16:23.122761+0000","last_fullsized":"2024-04-19T02:16:23.122761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114183+0000","last_change":"2024-04-19T02:16:24.114183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114183+0000","last_undegraded":"2024-04-19T02:16:24.114183+0000","last_fullsized":"2024-04-19T02:16:24.114183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138797+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.138797+0000","last_peered":"2024-04-19T02:16:24.138797+0000","last_clean":"2024-04-19T02:16:24.138797+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.138797+0000","last_undegraded":"2024-04-19T02:16:24.138797+0000","last_fullsized":"2024-04-19T02:16:24.138797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.109587+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:23.109587+0000","last_peered":"2024-04-19T02:16:23.109587+0000","last_clean":"2024-04-19T02:16:23.109587+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:23.109587+0000","last_undegraded":"2024-04-19T02:16:23.109587+0000","last_fullsized":"2024-04-19T02:16:23.109587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114120+0000","last_change":"2024-04-19T02:16:24.114120+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114120+0000","last_undegraded":"2024-04-19T02:16:24.114120+0000","last_fullsized":"2024-04-19T02:16:24.114120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138296+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.138296+0000","last_peered":"2024-04-19T02:16:24.138296+0000","last_clean":"2024-04-19T02:16:24.138296+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.138296+0000","last_undegraded":"2024-04-19T02:16:24.138296+0000","last_fullsized":"2024-04-19T02:16:24.138296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122991+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:23.122991+0000","last_peered":"2024-04-19T02:16:23.122991+0000","last_clean":"2024-04-19T02:16:23.122991+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:23.122991+0000","last_undegraded":"2024-04-19T02:16:23.122991+0000","last_fullsized":"2024-04-19T02:16:23.122991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117578+0000","last_change":"2024-04-19T02:16:24.117578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117578+0000","last_undegraded":"2024-04-19T02:16:24.117578+0000","last_fullsized":"2024-04-19T02:16:24.117578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143994+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:24.143994+0000","last_peered":"2024-04-19T02:16:24.143994+0000","last_clean":"2024-04-19T02:16:24.143994+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:24.143994+0000","last_undegraded":"2024-04-19T02:16:24.143994+0000","last_fullsized":"2024-04-19T02:16:24.143994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107724+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:23.107724+0000","last_peered":"2024-04-19T02:16:23.107724+0000","last_clean":"2024-04-19T02:16:23.107724+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:23.107724+0000","last_undegraded":"2024-04-19T02:16:23.107724+0000","last_fullsized":"2024-04-19T02:16:23.107724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114675+0000","last_change":"2024-04-19T02:16:24.114675+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114675+0000","last_undegraded":"2024-04-19T02:16:24.114675+0000","last_fullsized":"2024-04-19T02:16:24.114675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141945+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.141945+0000","last_peered":"2024-04-19T02:16:24.141945+0000","last_clean":"2024-04-19T02:16:24.141945+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.141945+0000","last_undegraded":"2024-04-19T02:16:24.141945+0000","last_fullsized":"2024-04-19T02:16:24.141945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120115+0000","last_change":"2024-04-19T02:16:24.120115+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120115+0000","last_undegraded":"2024-04-19T02:16:24.120115+0000","last_fullsized":"2024-04-19T02:16:24.120115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129180+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.129180+0000","last_peered":"2024-04-19T02:16:24.129180+0000","last_clean":"2024-04-19T02:16:24.129180+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.129180+0000","last_undegraded":"2024-04-19T02:16:24.129180+0000","last_fullsized":"2024-04-19T02:16:24.129180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.143469+0000","last_peered":"2024-04-19T02:16:24.143469+0000","last_clean":"2024-04-19T02:16:24.143469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.143469+0000","last_undegraded":"2024-04-19T02:16:24.143469+0000","last_fullsized":"2024-04-19T02:16:24.143469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119928+0000","last_change":"2024-04-19T02:16:24.119928+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119928+0000","last_undegraded":"2024-04-19T02:16:24.119928+0000","last_fullsized":"2024-04-19T02:16:24.119928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.147014+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.147014+0000","last_peered":"2024-04-19T02:16:24.147014+0000","last_clean":"2024-04-19T02:16:24.147014+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.147014+0000","last_undegraded":"2024-04-19T02:16:24.147014+0000","last_fullsized":"2024-04-19T02:16:24.147014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120109+0000","last_change":"2024-04-19T02:16:24.120109+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120109+0000","last_undegraded":"2024-04-19T02:16:24.120109+0000","last_fullsized":"2024-04-19T02:16:24.120109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116484+0000","last_change":"2024-04-19T02:16:24.116484+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116484+0000","last_undegraded":"2024-04-19T02:16:24.116484+0000","last_fullsized":"2024-04-19T02:16:24.116484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138341+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.138341+0000","last_peered":"2024-04-19T02:16:24.138341+0000","last_clean":"2024-04-19T02:16:24.138341+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.138341+0000","last_undegraded":"2024-04-19T02:16:24.138341+0000","last_fullsized":"2024-04-19T02:16:24.138341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121365+0000","last_change":"2024-04-19T02:16:24.121365+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121365+0000","last_undegraded":"2024-04-19T02:16:24.121365+0000","last_fullsized":"2024-04-19T02:16:24.121365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143315+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.143315+0000","last_peered":"2024-04-19T02:16:24.143315+0000","last_clean":"2024-04-19T02:16:24.143315+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.143315+0000","last_undegraded":"2024-04-19T02:16:24.143315+0000","last_fullsized":"2024-04-19T02:16:24.143315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121192+0000","last_change":"2024-04-19T02:16:24.121192+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121192+0000","last_undegraded":"2024-04-19T02:16:24.121192+0000","last_fullsized":"2024-04-19T02:16:24.121192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.134108+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.134108+0000","last_peered":"2024-04-19T02:16:24.134108+0000","last_clean":"2024-04-19T02:16:24.134108+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.134108+0000","last_undegraded":"2024-04-19T02:16:24.134108+0000","last_fullsized":"2024-04-19T02:16:24.134108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116356+0000","last_change":"2024-04-19T02:16:24.116356+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116356+0000","last_undegraded":"2024-04-19T02:16:24.116356+0000","last_fullsized":"2024-04-19T02:16:24.116356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.124535+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.124535+0000","last_peered":"2024-04-19T02:16:24.124535+0000","last_clean":"2024-04-19T02:16:24.124535+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.124535+0000","last_undegraded":"2024-04-19T02:16:24.124535+0000","last_fullsized":"2024-04-19T02:16:24.124535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121139+0000","last_change":"2024-04-19T02:16:24.121139+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121139+0000","last_undegraded":"2024-04-19T02:16:24.121139+0000","last_fullsized":"2024-04-19T02:16:24.121139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143772+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.143772+0000","last_peered":"2024-04-19T02:16:24.143772+0000","last_clean":"2024-04-19T02:16:24.143772+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.143772+0000","last_undegraded":"2024-04-19T02:16:24.143772+0000","last_fullsized":"2024-04-19T02:16:24.143772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120001+0000","last_change":"2024-04-19T02:16:24.120001+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120001+0000","last_undegraded":"2024-04-19T02:16:24.120001+0000","last_fullsized":"2024-04-19T02:16:24.120001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143602+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.143602+0000","last_peered":"2024-04-19T02:16:24.143602+0000","last_clean":"2024-04-19T02:16:24.143602+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.143602+0000","last_undegraded":"2024-04-19T02:16:24.143602+0000","last_fullsized":"2024-04-19T02:16:24.143602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122233+0000","last_change":"2024-04-19T02:16:24.122233+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122233+0000","last_undegraded":"2024-04-19T02:16:24.122233+0000","last_fullsized":"2024-04-19T02:16:24.122233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138318+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.138318+0000","last_peered":"2024-04-19T02:16:24.138318+0000","last_clean":"2024-04-19T02:16:24.138318+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.138318+0000","last_undegraded":"2024-04-19T02:16:24.138318+0000","last_fullsized":"2024-04-19T02:16:24.138318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120505+0000","last_change":"2024-04-19T02:16:24.120505+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120505+0000","last_undegraded":"2024-04-19T02:16:24.120505+0000","last_fullsized":"2024-04-19T02:16:24.120505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144018+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.144018+0000","last_peered":"2024-04-19T02:16:24.144018+0000","last_clean":"2024-04-19T02:16:24.144018+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.144018+0000","last_undegraded":"2024-04-19T02:16:24.144018+0000","last_fullsized":"2024-04-19T02:16:24.144018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124610+0000', 'last_change': '2024-04-19T02:16:24.124610+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124610+0000', 'last_undegraded': '2024-04-19T02:16:24.124610+0000', 'last_fullsized': '2024-04-19T02:16:24.124610+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124691+0000', 'last_change': '2024-04-19T02:16:24.124691+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124691+0000', 'last_undegraded': '2024-04-19T02:16:24.124691+0000', 'last_fullsized': '2024-04-19T02:16:24.124691+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124856+0000', 'last_change': '2024-04-19T02:16:24.124856+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124856+0000', 'last_undegraded': '2024-04-19T02:16:24.124856+0000', 'last_fullsized': '2024-04-19T02:16:24.124856+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-19T02:16:28.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124610+0000', 'last_change': '2024-04-19T02:16:24.124610+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124610+0000', 'last_undegraded': '2024-04-19T02:16:24.124610+0000', 'last_fullsized': '2024-04-19T02:16:24.124610+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.123926+0000', 'last_change': '2024-04-19T02:16:24.123926+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.123926+0000', 'last_undegraded': '2024-04-19T02:16:24.123926+0000', 'last_fullsized': '2024-04-19T02:16:24.123926+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124657+0000', 'last_change': '2024-04-19T02:16:24.124657+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124657+0000', 'last_undegraded': '2024-04-19T02:16:24.124657+0000', 'last_fullsized': '2024-04-19T02:16:24.124657+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124406+0000', 'last_change': '2024-04-19T02:16:24.124406+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124406+0000', 'last_undegraded': '2024-04-19T02:16:24.124406+0000', 'last_fullsized': '2024-04-19T02:16:24.124406+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124183+0000', 'last_change': '2024-04-19T02:16:24.124183+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124183+0000', 'last_undegraded': '2024-04-19T02:16:24.124183+0000', 'last_fullsized': '2024-04-19T02:16:24.124183+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.124494+0000', 'last_change': '2024-04-19T02:16:24.124494+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.124494+0000', 'last_undegraded': '2024-04-19T02:16:24.124494+0000', 'last_fullsized': '2024-04-19T02:16:24.124494+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.123735+0000', 'last_change': '2024-04-19T02:16:24.123735+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.123735+0000', 'last_undegraded': '2024-04-19T02:16:24.123735+0000', 'last_fullsized': '2024-04-19T02:16:24.123735+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122964+0000', 'last_change': '2024-04-19T02:16:24.122964+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122964+0000', 'last_undegraded': '2024-04-19T02:16:24.122964+0000', 'last_fullsized': '2024-04-19T02:16:24.122964+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.123755+0000', 'last_change': '2024-04-19T02:16:24.123755+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.123755+0000', 'last_undegraded': '2024-04-19T02:16:24.123755+0000', 'last_fullsized': '2024-04-19T02:16:24.123755+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121943+0000', 'last_change': '2024-04-19T02:16:24.121943+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121943+0000', 'last_undegraded': '2024-04-19T02:16:24.121943+0000', 'last_fullsized': '2024-04-19T02:16:24.121943+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.123197+0000', 'last_change': '2024-04-19T02:16:24.123197+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.123197+0000', 'last_undegraded': '2024-04-19T02:16:24.123197+0000', 'last_fullsized': '2024-04-19T02:16:24.123197+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-19T02:16:28.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122996+0000', 'last_change': '2024-04-19T02:16:24.122996+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122996+0000', 'last_undegraded': '2024-04-19T02:16:24.122996+0000', 'last_fullsized': '2024-04-19T02:16:24.122996+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122983+0000', 'last_change': '2024-04-19T02:16:24.122983+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122983+0000', 'last_undegraded': '2024-04-19T02:16:24.122983+0000', 'last_fullsized': '2024-04-19T02:16:24.122983+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.123044+0000', 'last_change': '2024-04-19T02:16:24.123044+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.123044+0000', 'last_undegraded': '2024-04-19T02:16:24.123044+0000', 'last_fullsized': '2024-04-19T02:16:24.123044+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121682+0000', 'last_change': '2024-04-19T02:16:24.121682+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121682+0000', 'last_undegraded': '2024-04-19T02:16:24.121682+0000', 'last_fullsized': '2024-04-19T02:16:24.121682+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.123035+0000', 'last_change': '2024-04-19T02:16:24.123035+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.123035+0000', 'last_undegraded': '2024-04-19T02:16:24.123035+0000', 'last_fullsized': '2024-04-19T02:16:24.123035+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122223+0000', 'last_change': '2024-04-19T02:16:24.122223+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122223+0000', 'last_undegraded': '2024-04-19T02:16:24.122223+0000', 'last_fullsized': '2024-04-19T02:16:24.122223+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122097+0000', 'last_change': '2024-04-19T02:16:24.122097+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122097+0000', 'last_undegraded': '2024-04-19T02:16:24.122097+0000', 'last_fullsized': '2024-04-19T02:16:24.122097+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119883+0000', 'last_change': '2024-04-19T02:16:24.119883+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119883+0000', 'last_undegraded': '2024-04-19T02:16:24.119883+0000', 'last_fullsized': '2024-04-19T02:16:24.119883+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122952+0000', 'last_change': '2024-04-19T02:16:24.122952+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122952+0000', 'last_undegraded': '2024-04-19T02:16:24.122952+0000', 'last_fullsized': '2024-04-19T02:16:24.122952+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119812+0000', 'last_change': '2024-04-19T02:16:24.119812+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119812+0000', 'last_undegraded': '2024-04-19T02:16:24.119812+0000', 'last_fullsized': '2024-04-19T02:16:24.119812+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119751+0000', 'last_change': '2024-04-19T02:16:24.119751+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119751+0000', 'last_undegraded': '2024-04-19T02:16:24.119751+0000', 'last_fullsized': '2024-04-19T02:16:24.119751+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-19T02:16:28.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122705+0000', 'last_change': '2024-04-19T02:16:24.122705+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122705+0000', 'last_undegraded': '2024-04-19T02:16:24.122705+0000', 'last_fullsized': '2024-04-19T02:16:24.122705+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121733+0000', 'last_change': '2024-04-19T02:16:24.121733+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121733+0000', 'last_undegraded': '2024-04-19T02:16:24.121733+0000', 'last_fullsized': '2024-04-19T02:16:24.121733+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.120053+0000', 'last_change': '2024-04-19T02:16:24.120053+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.120053+0000', 'last_undegraded': '2024-04-19T02:16:24.120053+0000', 'last_fullsized': '2024-04-19T02:16:24.120053+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121704+0000', 'last_change': '2024-04-19T02:16:24.121704+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121704+0000', 'last_undegraded': '2024-04-19T02:16:24.121704+0000', 'last_fullsized': '2024-04-19T02:16:24.121704+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.116578+0000', 'last_change': '2024-04-19T02:16:24.116578+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.116578+0000', 'last_undegraded': '2024-04-19T02:16:24.116578+0000', 'last_fullsized': '2024-04-19T02:16:24.116578+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121426+0000', 'last_change': '2024-04-19T02:16:24.121426+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121426+0000', 'last_undegraded': '2024-04-19T02:16:24.121426+0000', 'last_fullsized': '2024-04-19T02:16:24.121426+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121749+0000', 'last_change': '2024-04-19T02:16:24.121749+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121749+0000', 'last_undegraded': '2024-04-19T02:16:24.121749+0000', 'last_fullsized': '2024-04-19T02:16:24.121749+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.112029+0000', 'last_change': '2024-04-19T02:16:24.112029+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.112029+0000', 'last_undegraded': '2024-04-19T02:16:24.112029+0000', 'last_fullsized': '2024-04-19T02:16:24.112029+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.117371+0000', 'last_change': '2024-04-19T02:16:24.117371+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.117371+0000', 'last_undegraded': '2024-04-19T02:16:24.117371+0000', 'last_fullsized': '2024-04-19T02:16:24.117371+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.120247+0000', 'last_change': '2024-04-19T02:16:24.120247+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.120247+0000', 'last_undegraded': '2024-04-19T02:16:24.120247+0000', 'last_fullsized': '2024-04-19T02:16:24.120247+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121205+0000', 'last_change': '2024-04-19T02:16:24.121205+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121205+0000', 'last_undegraded': '2024-04-19T02:16:24.121205+0000', 'last_fullsized': '2024-04-19T02:16:24.121205+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-19T02:16:28.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.117910+0000', 'last_change': '2024-04-19T02:16:24.117910+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.117910+0000', 'last_undegraded': '2024-04-19T02:16:24.117910+0000', 'last_fullsized': '2024-04-19T02:16:24.117910+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.118332+0000', 'last_change': '2024-04-19T02:16:24.118332+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.118332+0000', 'last_undegraded': '2024-04-19T02:16:24.118332+0000', 'last_fullsized': '2024-04-19T02:16:24.118332+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.118589+0000', 'last_change': '2024-04-19T02:16:24.118589+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.118589+0000', 'last_undegraded': '2024-04-19T02:16:24.118589+0000', 'last_fullsized': '2024-04-19T02:16:24.118589+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.118907+0000', 'last_change': '2024-04-19T02:16:24.118907+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.118907+0000', 'last_undegraded': '2024-04-19T02:16:24.118907+0000', 'last_fullsized': '2024-04-19T02:16:24.118907+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.118629+0000', 'last_change': '2024-04-19T02:16:24.118629+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.118629+0000', 'last_undegraded': '2024-04-19T02:16:24.118629+0000', 'last_fullsized': '2024-04-19T02:16:24.118629+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119665+0000', 'last_change': '2024-04-19T02:16:24.119665+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119665+0000', 'last_undegraded': '2024-04-19T02:16:24.119665+0000', 'last_fullsized': '2024-04-19T02:16:24.119665+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-19T02:16:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119827+0000', 'last_change': '2024-04-19T02:16:24.119827+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119827+0000', 'last_undegraded': '2024-04-19T02:16:24.119827+0000', 'last_fullsized': '2024-04-19T02:16:24.119827+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119780+0000', 'last_change': '2024-04-19T02:16:24.119780+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119780+0000', 'last_undegraded': '2024-04-19T02:16:24.119780+0000', 'last_fullsized': '2024-04-19T02:16:24.119780+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.118519+0000', 'last_change': '2024-04-19T02:16:24.118519+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.118519+0000', 'last_undegraded': '2024-04-19T02:16:24.118519+0000', 'last_fullsized': '2024-04-19T02:16:24.118519+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.114418+0000', 'last_change': '2024-04-19T02:16:24.114418+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.114418+0000', 'last_undegraded': '2024-04-19T02:16:24.114418+0000', 'last_fullsized': '2024-04-19T02:16:24.114418+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.118177+0000', 'last_change': '2024-04-19T02:16:24.118177+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.118177+0000', 'last_undegraded': '2024-04-19T02:16:24.118177+0000', 'last_fullsized': '2024-04-19T02:16:24.118177+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.118209+0000', 'last_change': '2024-04-19T02:16:24.118209+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.118209+0000', 'last_undegraded': '2024-04-19T02:16:24.118209+0000', 'last_fullsized': '2024-04-19T02:16:24.118209+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.114183+0000', 'last_change': '2024-04-19T02:16:24.114183+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.114183+0000', 'last_undegraded': '2024-04-19T02:16:24.114183+0000', 'last_fullsized': '2024-04-19T02:16:24.114183+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.114120+0000', 'last_change': '2024-04-19T02:16:24.114120+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.114120+0000', 'last_undegraded': '2024-04-19T02:16:24.114120+0000', 'last_fullsized': '2024-04-19T02:16:24.114120+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.117578+0000', 'last_change': '2024-04-19T02:16:24.117578+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.117578+0000', 'last_undegraded': '2024-04-19T02:16:24.117578+0000', 'last_fullsized': '2024-04-19T02:16:24.117578+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.114675+0000', 'last_change': '2024-04-19T02:16:24.114675+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.114675+0000', 'last_undegraded': '2024-04-19T02:16:24.114675+0000', 'last_fullsized': '2024-04-19T02:16:24.114675+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119827+0000', 'last_change': '2024-04-19T02:16:24.119827+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119827+0000', 'last_undegraded': '2024-04-19T02:16:24.119827+0000', 'last_fullsized': '2024-04-19T02:16:24.119827+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-19T02:16:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.120115+0000', 'last_change': '2024-04-19T02:16:24.120115+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.120115+0000', 'last_undegraded': '2024-04-19T02:16:24.120115+0000', 'last_fullsized': '2024-04-19T02:16:24.120115+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.119928+0000', 'last_change': '2024-04-19T02:16:24.119928+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.119928+0000', 'last_undegraded': '2024-04-19T02:16:24.119928+0000', 'last_fullsized': '2024-04-19T02:16:24.119928+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.120109+0000', 'last_change': '2024-04-19T02:16:24.120109+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.120109+0000', 'last_undegraded': '2024-04-19T02:16:24.120109+0000', 'last_fullsized': '2024-04-19T02:16:24.120109+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.116484+0000', 'last_change': '2024-04-19T02:16:24.116484+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.116484+0000', 'last_undegraded': '2024-04-19T02:16:24.116484+0000', 'last_fullsized': '2024-04-19T02:16:24.116484+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121365+0000', 'last_change': '2024-04-19T02:16:24.121365+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121365+0000', 'last_undegraded': '2024-04-19T02:16:24.121365+0000', 'last_fullsized': '2024-04-19T02:16:24.121365+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121192+0000', 'last_change': '2024-04-19T02:16:24.121192+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121192+0000', 'last_undegraded': '2024-04-19T02:16:24.121192+0000', 'last_fullsized': '2024-04-19T02:16:24.121192+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.116356+0000', 'last_change': '2024-04-19T02:16:24.116356+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.116356+0000', 'last_undegraded': '2024-04-19T02:16:24.116356+0000', 'last_fullsized': '2024-04-19T02:16:24.116356+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.121139+0000', 'last_change': '2024-04-19T02:16:24.121139+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.121139+0000', 'last_undegraded': '2024-04-19T02:16:24.121139+0000', 'last_fullsized': '2024-04-19T02:16:24.121139+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.120001+0000', 'last_change': '2024-04-19T02:16:24.120001+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.120001+0000', 'last_undegraded': '2024-04-19T02:16:24.120001+0000', 'last_fullsized': '2024-04-19T02:16:24.120001+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.122233+0000', 'last_change': '2024-04-19T02:16:24.122233+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.122233+0000', 'last_undegraded': '2024-04-19T02:16:24.122233+0000', 'last_fullsized': '2024-04-19T02:16:24.122233+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-19T02:16:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-19T02:16:24.120505+0000', 'last_change': '2024-04-19T02:16:24.120505+0000', 'last_active': '2024-04-19T02:16:24.102963+0000', 'last_peered': '2024-04-19T02:16:24.102963+0000', 'last_clean': '2024-04-19T02:16:24.102963+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:16:24.120505+0000', 'last_undegraded': '2024-04-19T02:16:24.120505+0000', 'last_fullsized': '2024-04-19T02:16:24.120505+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'last_clean_scrub_stamp': '2024-04-19T02:16:24.102963+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T02:16:28.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:16:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492973,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":91910144,"bytes_avail":289818382336,"bytes_total":289910292480,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-19T02:16:03.366167+0000","services":{}},"progress_events":{}} 2024-04-19T02:16:28.584 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-19T02:16:28.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:28.887 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:28.902 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-19T02:16:28.173349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89756,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025764,"statfs":{"total":289910292480,"available":289818382336,"internally_reserved":0,"allocated":507904,"data_stored":1303427,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.068728"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124691+0000","last_change":"2024-04-19T02:16:24.124691+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124691+0000","last_undegraded":"2024-04-19T02:16:24.124691+0000","last_fullsized":"2024-04-19T02:16:24.124691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124856+0000","last_change":"2024-04-19T02:16:24.124856+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124856+0000","last_undegraded":"2024-04-19T02:16:24.124856+0000","last_fullsized":"2024-04-19T02:16:24.124856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124610+0000","last_change":"2024-04-19T02:16:24.124610+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124610+0000","last_undegraded":"2024-04-19T02:16:24.124610+0000","last_fullsized":"2024-04-19T02:16:24.124610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123926+0000","last_change":"2024-04-19T02:16:24.123926+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123926+0000","last_undegraded":"2024-04-19T02:16:24.123926+0000","last_fullsized":"2024-04-19T02:16:24.123926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124657+0000","last_change":"2024-04-19T02:16:24.124657+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124657+0000","last_undegraded":"2024-04-19T02:16:24.124657+0000","last_fullsized":"2024-04-19T02:16:24.124657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124406+0000","last_change":"2024-04-19T02:16:24.124406+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124406+0000","last_undegraded":"2024-04-19T02:16:24.124406+0000","last_fullsized":"2024-04-19T02:16:24.124406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124183+0000","last_change":"2024-04-19T02:16:24.124183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124183+0000","last_undegraded":"2024-04-19T02:16:24.124183+0000","last_fullsized":"2024-04-19T02:16:24.124183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.124494+0000","last_change":"2024-04-19T02:16:24.124494+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.124494+0000","last_undegraded":"2024-04-19T02:16:24.124494+0000","last_fullsized":"2024-04-19T02:16:24.124494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123735+0000","last_change":"2024-04-19T02:16:24.123735+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123735+0000","last_undegraded":"2024-04-19T02:16:24.123735+0000","last_fullsized":"2024-04-19T02:16:24.123735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122964+0000","last_change":"2024-04-19T02:16:24.122964+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122964+0000","last_undegraded":"2024-04-19T02:16:24.122964+0000","last_fullsized":"2024-04-19T02:16:24.122964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123755+0000","last_change":"2024-04-19T02:16:24.123755+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123755+0000","last_undegraded":"2024-04-19T02:16:24.123755+0000","last_fullsized":"2024-04-19T02:16:24.123755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121943+0000","last_change":"2024-04-19T02:16:24.121943+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121943+0000","last_undegraded":"2024-04-19T02:16:24.121943+0000","last_fullsized":"2024-04-19T02:16:24.121943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123197+0000","last_change":"2024-04-19T02:16:24.123197+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123197+0000","last_undegraded":"2024-04-19T02:16:24.123197+0000","last_fullsized":"2024-04-19T02:16:24.123197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122996+0000","last_change":"2024-04-19T02:16:24.122996+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122996+0000","last_undegraded":"2024-04-19T02:16:24.122996+0000","last_fullsized":"2024-04-19T02:16:24.122996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122983+0000","last_change":"2024-04-19T02:16:24.122983+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122983+0000","last_undegraded":"2024-04-19T02:16:24.122983+0000","last_fullsized":"2024-04-19T02:16:24.122983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123044+0000","last_change":"2024-04-19T02:16:24.123044+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123044+0000","last_undegraded":"2024-04-19T02:16:24.123044+0000","last_fullsized":"2024-04-19T02:16:24.123044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121682+0000","last_change":"2024-04-19T02:16:24.121682+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121682+0000","last_undegraded":"2024-04-19T02:16:24.121682+0000","last_fullsized":"2024-04-19T02:16:24.121682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.123035+0000","last_change":"2024-04-19T02:16:24.123035+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.123035+0000","last_undegraded":"2024-04-19T02:16:24.123035+0000","last_fullsized":"2024-04-19T02:16:24.123035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122223+0000","last_change":"2024-04-19T02:16:24.122223+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122223+0000","last_undegraded":"2024-04-19T02:16:24.122223+0000","last_fullsized":"2024-04-19T02:16:24.122223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122097+0000","last_change":"2024-04-19T02:16:24.122097+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122097+0000","last_undegraded":"2024-04-19T02:16:24.122097+0000","last_fullsized":"2024-04-19T02:16:24.122097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119883+0000","last_change":"2024-04-19T02:16:24.119883+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119883+0000","last_undegraded":"2024-04-19T02:16:24.119883+0000","last_fullsized":"2024-04-19T02:16:24.119883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122952+0000","last_change":"2024-04-19T02:16:24.122952+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122952+0000","last_undegraded":"2024-04-19T02:16:24.122952+0000","last_fullsized":"2024-04-19T02:16:24.122952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119812+0000","last_change":"2024-04-19T02:16:24.119812+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119812+0000","last_undegraded":"2024-04-19T02:16:24.119812+0000","last_fullsized":"2024-04-19T02:16:24.119812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119751+0000","last_change":"2024-04-19T02:16:24.119751+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119751+0000","last_undegraded":"2024-04-19T02:16:24.119751+0000","last_fullsized":"2024-04-19T02:16:24.119751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122705+0000","last_change":"2024-04-19T02:16:24.122705+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122705+0000","last_undegraded":"2024-04-19T02:16:24.122705+0000","last_fullsized":"2024-04-19T02:16:24.122705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121733+0000","last_change":"2024-04-19T02:16:24.121733+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121733+0000","last_undegraded":"2024-04-19T02:16:24.121733+0000","last_fullsized":"2024-04-19T02:16:24.121733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120053+0000","last_change":"2024-04-19T02:16:24.120053+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120053+0000","last_undegraded":"2024-04-19T02:16:24.120053+0000","last_fullsized":"2024-04-19T02:16:24.120053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121704+0000","last_change":"2024-04-19T02:16:24.121704+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121704+0000","last_undegraded":"2024-04-19T02:16:24.121704+0000","last_fullsized":"2024-04-19T02:16:24.121704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116578+0000","last_change":"2024-04-19T02:16:24.116578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116578+0000","last_undegraded":"2024-04-19T02:16:24.116578+0000","last_fullsized":"2024-04-19T02:16:24.116578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121426+0000","last_change":"2024-04-19T02:16:24.121426+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121426+0000","last_undegraded":"2024-04-19T02:16:24.121426+0000","last_fullsized":"2024-04-19T02:16:24.121426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121749+0000","last_change":"2024-04-19T02:16:24.121749+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121749+0000","last_undegraded":"2024-04-19T02:16:24.121749+0000","last_fullsized":"2024-04-19T02:16:24.121749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.112029+0000","last_change":"2024-04-19T02:16:24.112029+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.112029+0000","last_undegraded":"2024-04-19T02:16:24.112029+0000","last_fullsized":"2024-04-19T02:16:24.112029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145646+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.145646+0000","last_peered":"2024-04-19T02:16:24.145646+0000","last_clean":"2024-04-19T02:16:24.145646+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.145646+0000","last_undegraded":"2024-04-19T02:16:24.145646+0000","last_fullsized":"2024-04-19T02:16:24.145646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117371+0000","last_change":"2024-04-19T02:16:24.117371+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117371+0000","last_undegraded":"2024-04-19T02:16:24.117371+0000","last_fullsized":"2024-04-19T02:16:24.117371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142625+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.142625+0000","last_peered":"2024-04-19T02:16:24.142625+0000","last_clean":"2024-04-19T02:16:24.142625+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.142625+0000","last_undegraded":"2024-04-19T02:16:24.142625+0000","last_fullsized":"2024-04-19T02:16:24.142625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120247+0000","last_change":"2024-04-19T02:16:24.120247+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120247+0000","last_undegraded":"2024-04-19T02:16:24.120247+0000","last_fullsized":"2024-04-19T02:16:24.120247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128363+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.128363+0000","last_peered":"2024-04-19T02:16:24.128363+0000","last_clean":"2024-04-19T02:16:24.128363+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.128363+0000","last_undegraded":"2024-04-19T02:16:24.128363+0000","last_fullsized":"2024-04-19T02:16:24.128363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121205+0000","last_change":"2024-04-19T02:16:24.121205+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121205+0000","last_undegraded":"2024-04-19T02:16:24.121205+0000","last_fullsized":"2024-04-19T02:16:24.121205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141326+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.141326+0000","last_peered":"2024-04-19T02:16:24.141326+0000","last_clean":"2024-04-19T02:16:24.141326+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.141326+0000","last_undegraded":"2024-04-19T02:16:24.141326+0000","last_fullsized":"2024-04-19T02:16:24.141326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141650+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.141650+0000","last_peered":"2024-04-19T02:16:24.141650+0000","last_clean":"2024-04-19T02:16:24.141650+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.141650+0000","last_undegraded":"2024-04-19T02:16:24.141650+0000","last_fullsized":"2024-04-19T02:16:24.141650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117910+0000","last_change":"2024-04-19T02:16:24.117910+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117910+0000","last_undegraded":"2024-04-19T02:16:24.117910+0000","last_fullsized":"2024-04-19T02:16:24.117910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.127060+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.127060+0000","last_peered":"2024-04-19T02:16:24.127060+0000","last_clean":"2024-04-19T02:16:24.127060+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.127060+0000","last_undegraded":"2024-04-19T02:16:24.127060+0000","last_fullsized":"2024-04-19T02:16:24.127060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118332+0000","last_change":"2024-04-19T02:16:24.118332+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118332+0000","last_undegraded":"2024-04-19T02:16:24.118332+0000","last_fullsized":"2024-04-19T02:16:24.118332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145440+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.145440+0000","last_peered":"2024-04-19T02:16:24.145440+0000","last_clean":"2024-04-19T02:16:24.145440+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.145440+0000","last_undegraded":"2024-04-19T02:16:24.145440+0000","last_fullsized":"2024-04-19T02:16:24.145440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118589+0000","last_change":"2024-04-19T02:16:24.118589+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118589+0000","last_undegraded":"2024-04-19T02:16:24.118589+0000","last_fullsized":"2024-04-19T02:16:24.118589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144176+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.144176+0000","last_peered":"2024-04-19T02:16:24.144176+0000","last_clean":"2024-04-19T02:16:24.144176+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.144176+0000","last_undegraded":"2024-04-19T02:16:24.144176+0000","last_fullsized":"2024-04-19T02:16:24.144176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118907+0000","last_change":"2024-04-19T02:16:24.118907+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118907+0000","last_undegraded":"2024-04-19T02:16:24.118907+0000","last_fullsized":"2024-04-19T02:16:24.118907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143145+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.143145+0000","last_peered":"2024-04-19T02:16:24.143145+0000","last_clean":"2024-04-19T02:16:24.143145+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.143145+0000","last_undegraded":"2024-04-19T02:16:24.143145+0000","last_fullsized":"2024-04-19T02:16:24.143145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118629+0000","last_change":"2024-04-19T02:16:24.118629+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118629+0000","last_undegraded":"2024-04-19T02:16:24.118629+0000","last_fullsized":"2024-04-19T02:16:24.118629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144273+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.144273+0000","last_peered":"2024-04-19T02:16:24.144273+0000","last_clean":"2024-04-19T02:16:24.144273+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.144273+0000","last_undegraded":"2024-04-19T02:16:24.144273+0000","last_fullsized":"2024-04-19T02:16:24.144273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119665+0000","last_change":"2024-04-19T02:16:24.119665+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119665+0000","last_undegraded":"2024-04-19T02:16:24.119665+0000","last_fullsized":"2024-04-19T02:16:24.119665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.128307+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.128307+0000","last_peered":"2024-04-19T02:16:24.128307+0000","last_clean":"2024-04-19T02:16:24.128307+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.128307+0000","last_undegraded":"2024-04-19T02:16:24.128307+0000","last_fullsized":"2024-04-19T02:16:24.128307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.136304+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.136304+0000","last_peered":"2024-04-19T02:16:24.136304+0000","last_clean":"2024-04-19T02:16:24.136304+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.136304+0000","last_undegraded":"2024-04-19T02:16:24.136304+0000","last_fullsized":"2024-04-19T02:16:24.136304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119780+0000","last_change":"2024-04-19T02:16:24.119780+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119780+0000","last_undegraded":"2024-04-19T02:16:24.119780+0000","last_fullsized":"2024-04-19T02:16:24.119780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107773+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:23.107773+0000","last_peered":"2024-04-19T02:16:23.107773+0000","last_clean":"2024-04-19T02:16:23.107773+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:23.107773+0000","last_undegraded":"2024-04-19T02:16:23.107773+0000","last_fullsized":"2024-04-19T02:16:23.107773+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107751+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:23.107751+0000","last_peered":"2024-04-19T02:16:23.107751+0000","last_clean":"2024-04-19T02:16:23.107751+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:23.107751+0000","last_undegraded":"2024-04-19T02:16:23.107751+0000","last_fullsized":"2024-04-19T02:16:23.107751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138248+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.138248+0000","last_peered":"2024-04-19T02:16:24.138248+0000","last_clean":"2024-04-19T02:16:24.138248+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.138248+0000","last_undegraded":"2024-04-19T02:16:24.138248+0000","last_fullsized":"2024-04-19T02:16:24.138248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118519+0000","last_change":"2024-04-19T02:16:24.118519+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118519+0000","last_undegraded":"2024-04-19T02:16:24.118519+0000","last_fullsized":"2024-04-19T02:16:24.118519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107780+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:23.107780+0000","last_peered":"2024-04-19T02:16:23.107780+0000","last_clean":"2024-04-19T02:16:23.107780+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:23.107780+0000","last_undegraded":"2024-04-19T02:16:23.107780+0000","last_fullsized":"2024-04-19T02:16:23.107780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.142477+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.142477+0000","last_peered":"2024-04-19T02:16:24.142477+0000","last_clean":"2024-04-19T02:16:24.142477+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.142477+0000","last_undegraded":"2024-04-19T02:16:24.142477+0000","last_fullsized":"2024-04-19T02:16:24.142477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114418+0000","last_change":"2024-04-19T02:16:24.114418+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114418+0000","last_undegraded":"2024-04-19T02:16:24.114418+0000","last_fullsized":"2024-04-19T02:16:24.114418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122575+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:23.122575+0000","last_peered":"2024-04-19T02:16:23.122575+0000","last_clean":"2024-04-19T02:16:23.122575+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:23.122575+0000","last_undegraded":"2024-04-19T02:16:23.122575+0000","last_fullsized":"2024-04-19T02:16:23.122575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129218+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.129218+0000","last_peered":"2024-04-19T02:16:24.129218+0000","last_clean":"2024-04-19T02:16:24.129218+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.129218+0000","last_undegraded":"2024-04-19T02:16:24.129218+0000","last_fullsized":"2024-04-19T02:16:24.129218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118177+0000","last_change":"2024-04-19T02:16:24.118177+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118177+0000","last_undegraded":"2024-04-19T02:16:24.118177+0000","last_fullsized":"2024-04-19T02:16:24.118177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107748+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:23.107748+0000","last_peered":"2024-04-19T02:16:23.107748+0000","last_clean":"2024-04-19T02:16:23.107748+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:23.107748+0000","last_undegraded":"2024-04-19T02:16:23.107748+0000","last_fullsized":"2024-04-19T02:16:23.107748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144289+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.144289+0000","last_peered":"2024-04-19T02:16:24.144289+0000","last_clean":"2024-04-19T02:16:24.144289+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.144289+0000","last_undegraded":"2024-04-19T02:16:24.144289+0000","last_fullsized":"2024-04-19T02:16:24.144289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.118209+0000","last_change":"2024-04-19T02:16:24.118209+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.118209+0000","last_undegraded":"2024-04-19T02:16:24.118209+0000","last_fullsized":"2024-04-19T02:16:24.118209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.145614+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.145614+0000","last_peered":"2024-04-19T02:16:24.145614+0000","last_clean":"2024-04-19T02:16:24.145614+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.145614+0000","last_undegraded":"2024-04-19T02:16:24.145614+0000","last_fullsized":"2024-04-19T02:16:24.145614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122761+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:23.122761+0000","last_peered":"2024-04-19T02:16:23.122761+0000","last_clean":"2024-04-19T02:16:23.122761+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:23.122761+0000","last_undegraded":"2024-04-19T02:16:23.122761+0000","last_fullsized":"2024-04-19T02:16:23.122761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114183+0000","last_change":"2024-04-19T02:16:24.114183+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114183+0000","last_undegraded":"2024-04-19T02:16:24.114183+0000","last_fullsized":"2024-04-19T02:16:24.114183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138797+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.138797+0000","last_peered":"2024-04-19T02:16:24.138797+0000","last_clean":"2024-04-19T02:16:24.138797+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.138797+0000","last_undegraded":"2024-04-19T02:16:24.138797+0000","last_fullsized":"2024-04-19T02:16:24.138797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.109587+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:23.109587+0000","last_peered":"2024-04-19T02:16:23.109587+0000","last_clean":"2024-04-19T02:16:23.109587+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:23.109587+0000","last_undegraded":"2024-04-19T02:16:23.109587+0000","last_fullsized":"2024-04-19T02:16:23.109587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114120+0000","last_change":"2024-04-19T02:16:24.114120+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114120+0000","last_undegraded":"2024-04-19T02:16:24.114120+0000","last_fullsized":"2024-04-19T02:16:24.114120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138296+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.138296+0000","last_peered":"2024-04-19T02:16:24.138296+0000","last_clean":"2024-04-19T02:16:24.138296+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.138296+0000","last_undegraded":"2024-04-19T02:16:24.138296+0000","last_fullsized":"2024-04-19T02:16:24.138296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.122991+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:23.122991+0000","last_peered":"2024-04-19T02:16:23.122991+0000","last_clean":"2024-04-19T02:16:23.122991+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:23.122991+0000","last_undegraded":"2024-04-19T02:16:23.122991+0000","last_fullsized":"2024-04-19T02:16:23.122991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.117578+0000","last_change":"2024-04-19T02:16:24.117578+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.117578+0000","last_undegraded":"2024-04-19T02:16:24.117578+0000","last_fullsized":"2024-04-19T02:16:24.117578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143994+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:24.143994+0000","last_peered":"2024-04-19T02:16:24.143994+0000","last_clean":"2024-04-19T02:16:24.143994+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:24.143994+0000","last_undegraded":"2024-04-19T02:16:24.143994+0000","last_fullsized":"2024-04-19T02:16:24.143994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:16:23.107724+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:23.107724+0000","last_peered":"2024-04-19T02:16:23.107724+0000","last_clean":"2024-04-19T02:16:23.107724+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:23.107724+0000","last_undegraded":"2024-04-19T02:16:23.107724+0000","last_fullsized":"2024-04-19T02:16:23.107724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.114675+0000","last_change":"2024-04-19T02:16:24.114675+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.114675+0000","last_undegraded":"2024-04-19T02:16:24.114675+0000","last_fullsized":"2024-04-19T02:16:24.114675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119827+0000","last_change":"2024-04-19T02:16:24.119827+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119827+0000","last_undegraded":"2024-04-19T02:16:24.119827+0000","last_fullsized":"2024-04-19T02:16:24.119827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.141945+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.141945+0000","last_peered":"2024-04-19T02:16:24.141945+0000","last_clean":"2024-04-19T02:16:24.141945+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.141945+0000","last_undegraded":"2024-04-19T02:16:24.141945+0000","last_fullsized":"2024-04-19T02:16:24.141945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120115+0000","last_change":"2024-04-19T02:16:24.120115+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120115+0000","last_undegraded":"2024-04-19T02:16:24.120115+0000","last_fullsized":"2024-04-19T02:16:24.120115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.129180+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.129180+0000","last_peered":"2024-04-19T02:16:24.129180+0000","last_clean":"2024-04-19T02:16:24.129180+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.129180+0000","last_undegraded":"2024-04-19T02:16:24.129180+0000","last_fullsized":"2024-04-19T02:16:24.129180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.143469+0000","last_peered":"2024-04-19T02:16:24.143469+0000","last_clean":"2024-04-19T02:16:24.143469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.143469+0000","last_undegraded":"2024-04-19T02:16:24.143469+0000","last_fullsized":"2024-04-19T02:16:24.143469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.119928+0000","last_change":"2024-04-19T02:16:24.119928+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.119928+0000","last_undegraded":"2024-04-19T02:16:24.119928+0000","last_fullsized":"2024-04-19T02:16:24.119928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.147014+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.147014+0000","last_peered":"2024-04-19T02:16:24.147014+0000","last_clean":"2024-04-19T02:16:24.147014+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.147014+0000","last_undegraded":"2024-04-19T02:16:24.147014+0000","last_fullsized":"2024-04-19T02:16:24.147014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120109+0000","last_change":"2024-04-19T02:16:24.120109+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120109+0000","last_undegraded":"2024-04-19T02:16:24.120109+0000","last_fullsized":"2024-04-19T02:16:24.120109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116484+0000","last_change":"2024-04-19T02:16:24.116484+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116484+0000","last_undegraded":"2024-04-19T02:16:24.116484+0000","last_fullsized":"2024-04-19T02:16:24.116484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138341+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.138341+0000","last_peered":"2024-04-19T02:16:24.138341+0000","last_clean":"2024-04-19T02:16:24.138341+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.138341+0000","last_undegraded":"2024-04-19T02:16:24.138341+0000","last_fullsized":"2024-04-19T02:16:24.138341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121365+0000","last_change":"2024-04-19T02:16:24.121365+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121365+0000","last_undegraded":"2024-04-19T02:16:24.121365+0000","last_fullsized":"2024-04-19T02:16:24.121365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143315+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.143315+0000","last_peered":"2024-04-19T02:16:24.143315+0000","last_clean":"2024-04-19T02:16:24.143315+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.143315+0000","last_undegraded":"2024-04-19T02:16:24.143315+0000","last_fullsized":"2024-04-19T02:16:24.143315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121192+0000","last_change":"2024-04-19T02:16:24.121192+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121192+0000","last_undegraded":"2024-04-19T02:16:24.121192+0000","last_fullsized":"2024-04-19T02:16:24.121192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.134108+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.134108+0000","last_peered":"2024-04-19T02:16:24.134108+0000","last_clean":"2024-04-19T02:16:24.134108+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.134108+0000","last_undegraded":"2024-04-19T02:16:24.134108+0000","last_fullsized":"2024-04-19T02:16:24.134108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.116356+0000","last_change":"2024-04-19T02:16:24.116356+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.116356+0000","last_undegraded":"2024-04-19T02:16:24.116356+0000","last_fullsized":"2024-04-19T02:16:24.116356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.124535+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.124535+0000","last_peered":"2024-04-19T02:16:24.124535+0000","last_clean":"2024-04-19T02:16:24.124535+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.124535+0000","last_undegraded":"2024-04-19T02:16:24.124535+0000","last_fullsized":"2024-04-19T02:16:24.124535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.121139+0000","last_change":"2024-04-19T02:16:24.121139+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.121139+0000","last_undegraded":"2024-04-19T02:16:24.121139+0000","last_fullsized":"2024-04-19T02:16:24.121139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143772+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.143772+0000","last_peered":"2024-04-19T02:16:24.143772+0000","last_clean":"2024-04-19T02:16:24.143772+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.143772+0000","last_undegraded":"2024-04-19T02:16:24.143772+0000","last_fullsized":"2024-04-19T02:16:24.143772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120001+0000","last_change":"2024-04-19T02:16:24.120001+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120001+0000","last_undegraded":"2024-04-19T02:16:24.120001+0000","last_fullsized":"2024-04-19T02:16:24.120001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.143602+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.143602+0000","last_peered":"2024-04-19T02:16:24.143602+0000","last_clean":"2024-04-19T02:16:24.143602+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.143602+0000","last_undegraded":"2024-04-19T02:16:24.143602+0000","last_fullsized":"2024-04-19T02:16:24.143602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.122233+0000","last_change":"2024-04-19T02:16:24.122233+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.122233+0000","last_undegraded":"2024-04-19T02:16:24.122233+0000","last_fullsized":"2024-04-19T02:16:24.122233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.138318+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.138318+0000","last_peered":"2024-04-19T02:16:24.138318+0000","last_clean":"2024-04-19T02:16:24.138318+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.138318+0000","last_undegraded":"2024-04-19T02:16:24.138318+0000","last_fullsized":"2024-04-19T02:16:24.138318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-19T02:16:24.120505+0000","last_change":"2024-04-19T02:16:24.120505+0000","last_active":"2024-04-19T02:16:24.102963+0000","last_peered":"2024-04-19T02:16:24.102963+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:16:24.120505+0000","last_undegraded":"2024-04-19T02:16:24.120505+0000","last_fullsized":"2024-04-19T02:16:24.120505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.144018+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.144018+0000","last_peered":"2024-04-19T02:16:24.144018+0000","last_clean":"2024-04-19T02:16:24.144018+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.144018+0000","last_undegraded":"2024-04-19T02:16:24.144018+0000","last_fullsized":"2024-04-19T02:16:24.144018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31304,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340536,"statfs":{"total":96636764160,"available":96604708864,"internally_reserved":0,"allocated":188416,"data_stored":631265,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:30.218 INFO:tasks.ceph.mds.a.smithi073.stderr:2024-04-19T02:16:30.216+0000 7f88c0304640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-19T02:16:31.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:32.231 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-19T02:16:32.174710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89900,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025620,"statfs":{"total":289910292480,"available":289818234880,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002378"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521326+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:24.521326+0000","last_peered":"2024-04-19T02:16:24.521326+0000","last_clean":"2024-04-19T02:16:24.521326+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:24.521326+0000","last_undegraded":"2024-04-19T02:16:24.521326+0000","last_fullsized":"2024-04-19T02:16:24.521326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519236+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:24.519236+0000","last_peered":"2024-04-19T02:16:24.519236+0000","last_clean":"2024-04-19T02:16:24.519236+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:24.519236+0000","last_undegraded":"2024-04-19T02:16:24.519236+0000","last_fullsized":"2024-04-19T02:16:24.519236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527393+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:24.527393+0000","last_peered":"2024-04-19T02:16:24.527393+0000","last_clean":"2024-04-19T02:16:24.527393+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:24.527393+0000","last_undegraded":"2024-04-19T02:16:24.527393+0000","last_fullsized":"2024-04-19T02:16:24.527393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521797+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:24.521797+0000","last_peered":"2024-04-19T02:16:24.521797+0000","last_clean":"2024-04-19T02:16:24.521797+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:24.521797+0000","last_undegraded":"2024-04-19T02:16:24.521797+0000","last_fullsized":"2024-04-19T02:16:24.521797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518437+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:24.518437+0000","last_peered":"2024-04-19T02:16:24.518437+0000","last_clean":"2024-04-19T02:16:24.518437+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:24.518437+0000","last_undegraded":"2024-04-19T02:16:24.518437+0000","last_fullsized":"2024-04-19T02:16:24.518437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519225+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:24.519225+0000","last_peered":"2024-04-19T02:16:24.519225+0000","last_clean":"2024-04-19T02:16:24.519225+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:24.519225+0000","last_undegraded":"2024-04-19T02:16:24.519225+0000","last_fullsized":"2024-04-19T02:16:24.519225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518975+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:24.518975+0000","last_peered":"2024-04-19T02:16:24.518975+0000","last_clean":"2024-04-19T02:16:24.518975+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:24.518975+0000","last_undegraded":"2024-04-19T02:16:24.518975+0000","last_fullsized":"2024-04-19T02:16:24.518975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519248+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:24.519248+0000","last_peered":"2024-04-19T02:16:24.519248+0000","last_clean":"2024-04-19T02:16:24.519248+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:24.519248+0000","last_undegraded":"2024-04-19T02:16:24.519248+0000","last_fullsized":"2024-04-19T02:16:24.519248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513937+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:24.513937+0000","last_peered":"2024-04-19T02:16:24.513937+0000","last_clean":"2024-04-19T02:16:24.513937+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:24.513937+0000","last_undegraded":"2024-04-19T02:16:24.513937+0000","last_fullsized":"2024-04-19T02:16:24.513937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521455+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:24.521455+0000","last_peered":"2024-04-19T02:16:24.521455+0000","last_clean":"2024-04-19T02:16:24.521455+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:24.521455+0000","last_undegraded":"2024-04-19T02:16:24.521455+0000","last_fullsized":"2024-04-19T02:16:24.521455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521791+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:24.521791+0000","last_peered":"2024-04-19T02:16:24.521791+0000","last_clean":"2024-04-19T02:16:24.521791+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:24.521791+0000","last_undegraded":"2024-04-19T02:16:24.521791+0000","last_fullsized":"2024-04-19T02:16:24.521791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525459+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:24.525459+0000","last_peered":"2024-04-19T02:16:24.525459+0000","last_clean":"2024-04-19T02:16:24.525459+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:24.525459+0000","last_undegraded":"2024-04-19T02:16:24.525459+0000","last_fullsized":"2024-04-19T02:16:24.525459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519126+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:24.519126+0000","last_peered":"2024-04-19T02:16:24.519126+0000","last_clean":"2024-04-19T02:16:24.519126+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:24.519126+0000","last_undegraded":"2024-04-19T02:16:24.519126+0000","last_fullsized":"2024-04-19T02:16:24.519126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520744+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:24.520744+0000","last_peered":"2024-04-19T02:16:24.520744+0000","last_clean":"2024-04-19T02:16:24.520744+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:24.520744+0000","last_undegraded":"2024-04-19T02:16:24.520744+0000","last_fullsized":"2024-04-19T02:16:24.520744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520230+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:24.520230+0000","last_peered":"2024-04-19T02:16:24.520230+0000","last_clean":"2024-04-19T02:16:24.520230+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:24.520230+0000","last_undegraded":"2024-04-19T02:16:24.520230+0000","last_fullsized":"2024-04-19T02:16:24.520230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520060+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:24.520060+0000","last_peered":"2024-04-19T02:16:24.520060+0000","last_clean":"2024-04-19T02:16:24.520060+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:24.520060+0000","last_undegraded":"2024-04-19T02:16:24.520060+0000","last_fullsized":"2024-04-19T02:16:24.520060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514988+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:24.514988+0000","last_peered":"2024-04-19T02:16:24.514988+0000","last_clean":"2024-04-19T02:16:24.514988+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:24.514988+0000","last_undegraded":"2024-04-19T02:16:24.514988+0000","last_fullsized":"2024-04-19T02:16:24.514988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519056+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:24.519056+0000","last_peered":"2024-04-19T02:16:24.519056+0000","last_clean":"2024-04-19T02:16:24.519056+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:24.519056+0000","last_undegraded":"2024-04-19T02:16:24.519056+0000","last_fullsized":"2024-04-19T02:16:24.519056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514210+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:24.514210+0000","last_peered":"2024-04-19T02:16:24.514210+0000","last_clean":"2024-04-19T02:16:24.514210+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:24.514210+0000","last_undegraded":"2024-04-19T02:16:24.514210+0000","last_fullsized":"2024-04-19T02:16:24.514210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521557+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:24.521557+0000","last_peered":"2024-04-19T02:16:24.521557+0000","last_clean":"2024-04-19T02:16:24.521557+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:24.521557+0000","last_undegraded":"2024-04-19T02:16:24.521557+0000","last_fullsized":"2024-04-19T02:16:24.521557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520111+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:24.520111+0000","last_peered":"2024-04-19T02:16:24.520111+0000","last_clean":"2024-04-19T02:16:24.520111+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:24.520111+0000","last_undegraded":"2024-04-19T02:16:24.520111+0000","last_fullsized":"2024-04-19T02:16:24.520111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524330+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:24.524330+0000","last_peered":"2024-04-19T02:16:24.524330+0000","last_clean":"2024-04-19T02:16:24.524330+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:24.524330+0000","last_undegraded":"2024-04-19T02:16:24.524330+0000","last_fullsized":"2024-04-19T02:16:24.524330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521993+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:24.521993+0000","last_peered":"2024-04-19T02:16:24.521993+0000","last_clean":"2024-04-19T02:16:24.521993+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:24.521993+0000","last_undegraded":"2024-04-19T02:16:24.521993+0000","last_fullsized":"2024-04-19T02:16:24.521993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519561+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:24.519561+0000","last_peered":"2024-04-19T02:16:24.519561+0000","last_clean":"2024-04-19T02:16:24.519561+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:24.519561+0000","last_undegraded":"2024-04-19T02:16:24.519561+0000","last_fullsized":"2024-04-19T02:16:24.519561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523521+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:24.523521+0000","last_peered":"2024-04-19T02:16:24.523521+0000","last_clean":"2024-04-19T02:16:24.523521+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:24.523521+0000","last_undegraded":"2024-04-19T02:16:24.523521+0000","last_fullsized":"2024-04-19T02:16:24.523521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526425+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:24.526425+0000","last_peered":"2024-04-19T02:16:24.526425+0000","last_clean":"2024-04-19T02:16:24.526425+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:24.526425+0000","last_undegraded":"2024-04-19T02:16:24.526425+0000","last_fullsized":"2024-04-19T02:16:24.526425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527334+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:24.527334+0000","last_peered":"2024-04-19T02:16:24.527334+0000","last_clean":"2024-04-19T02:16:24.527334+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:24.527334+0000","last_undegraded":"2024-04-19T02:16:24.527334+0000","last_fullsized":"2024-04-19T02:16:24.527334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525176+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:24.525176+0000","last_peered":"2024-04-19T02:16:24.525176+0000","last_clean":"2024-04-19T02:16:24.525176+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:24.525176+0000","last_undegraded":"2024-04-19T02:16:24.525176+0000","last_fullsized":"2024-04-19T02:16:24.525176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513429+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:24.513429+0000","last_peered":"2024-04-19T02:16:24.513429+0000","last_clean":"2024-04-19T02:16:24.513429+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:24.513429+0000","last_undegraded":"2024-04-19T02:16:24.513429+0000","last_fullsized":"2024-04-19T02:16:24.513429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522053+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:24.522053+0000","last_peered":"2024-04-19T02:16:24.522053+0000","last_clean":"2024-04-19T02:16:24.522053+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:24.522053+0000","last_undegraded":"2024-04-19T02:16:24.522053+0000","last_fullsized":"2024-04-19T02:16:24.522053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512827+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:24.512827+0000","last_peered":"2024-04-19T02:16:24.512827+0000","last_clean":"2024-04-19T02:16:24.512827+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:24.512827+0000","last_undegraded":"2024-04-19T02:16:24.512827+0000","last_fullsized":"2024-04-19T02:16:24.512827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515064+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:24.515064+0000","last_peered":"2024-04-19T02:16:24.515064+0000","last_clean":"2024-04-19T02:16:24.515064+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:24.515064+0000","last_undegraded":"2024-04-19T02:16:24.515064+0000","last_fullsized":"2024-04-19T02:16:24.515064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518921+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:24.518921+0000","last_peered":"2024-04-19T02:16:24.518921+0000","last_clean":"2024-04-19T02:16:24.518921+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:24.518921+0000","last_undegraded":"2024-04-19T02:16:24.518921+0000","last_fullsized":"2024-04-19T02:16:24.518921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.530969+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.530969+0000","last_peered":"2024-04-19T02:16:24.530969+0000","last_clean":"2024-04-19T02:16:24.530969+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.530969+0000","last_undegraded":"2024-04-19T02:16:24.530969+0000","last_fullsized":"2024-04-19T02:16:24.530969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522746+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:24.522746+0000","last_peered":"2024-04-19T02:16:24.522746+0000","last_clean":"2024-04-19T02:16:24.522746+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:24.522746+0000","last_undegraded":"2024-04-19T02:16:24.522746+0000","last_fullsized":"2024-04-19T02:16:24.522746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488581+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.488581+0000","last_peered":"2024-04-19T02:16:24.488581+0000","last_clean":"2024-04-19T02:16:24.488581+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.488581+0000","last_undegraded":"2024-04-19T02:16:24.488581+0000","last_fullsized":"2024-04-19T02:16:24.488581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526731+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:24.526731+0000","last_peered":"2024-04-19T02:16:24.526731+0000","last_clean":"2024-04-19T02:16:24.526731+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:24.526731+0000","last_undegraded":"2024-04-19T02:16:24.526731+0000","last_fullsized":"2024-04-19T02:16:24.526731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495683+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.495683+0000","last_peered":"2024-04-19T02:16:24.495683+0000","last_clean":"2024-04-19T02:16:24.495683+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.495683+0000","last_undegraded":"2024-04-19T02:16:24.495683+0000","last_fullsized":"2024-04-19T02:16:24.495683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526825+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:24.526825+0000","last_peered":"2024-04-19T02:16:24.526825+0000","last_clean":"2024-04-19T02:16:24.526825+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:24.526825+0000","last_undegraded":"2024-04-19T02:16:24.526825+0000","last_fullsized":"2024-04-19T02:16:24.526825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.529809+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.529809+0000","last_peered":"2024-04-19T02:16:24.529809+0000","last_clean":"2024-04-19T02:16:24.529809+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.529809+0000","last_undegraded":"2024-04-19T02:16:24.529809+0000","last_fullsized":"2024-04-19T02:16:24.529809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.516091+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.516091+0000","last_peered":"2024-04-19T02:16:24.516091+0000","last_clean":"2024-04-19T02:16:24.516091+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.516091+0000","last_undegraded":"2024-04-19T02:16:24.516091+0000","last_fullsized":"2024-04-19T02:16:24.516091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524969+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:24.524969+0000","last_peered":"2024-04-19T02:16:24.524969+0000","last_clean":"2024-04-19T02:16:24.524969+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:24.524969+0000","last_undegraded":"2024-04-19T02:16:24.524969+0000","last_fullsized":"2024-04-19T02:16:24.524969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519660+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.519660+0000","last_peered":"2024-04-19T02:16:24.519660+0000","last_clean":"2024-04-19T02:16:24.519660+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.519660+0000","last_undegraded":"2024-04-19T02:16:24.519660+0000","last_fullsized":"2024-04-19T02:16:24.519660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519536+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:24.519536+0000","last_peered":"2024-04-19T02:16:24.519536+0000","last_clean":"2024-04-19T02:16:24.519536+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:24.519536+0000","last_undegraded":"2024-04-19T02:16:24.519536+0000","last_fullsized":"2024-04-19T02:16:24.519536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521517+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.521517+0000","last_peered":"2024-04-19T02:16:24.521517+0000","last_clean":"2024-04-19T02:16:24.521517+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.521517+0000","last_undegraded":"2024-04-19T02:16:24.521517+0000","last_fullsized":"2024-04-19T02:16:24.521517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.509240+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:24.509240+0000","last_peered":"2024-04-19T02:16:24.509240+0000","last_clean":"2024-04-19T02:16:24.509240+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:24.509240+0000","last_undegraded":"2024-04-19T02:16:24.509240+0000","last_fullsized":"2024-04-19T02:16:24.509240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498902+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.498902+0000","last_peered":"2024-04-19T02:16:24.498902+0000","last_clean":"2024-04-19T02:16:24.498902+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.498902+0000","last_undegraded":"2024-04-19T02:16:24.498902+0000","last_fullsized":"2024-04-19T02:16:24.498902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524255+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:24.524255+0000","last_peered":"2024-04-19T02:16:24.524255+0000","last_clean":"2024-04-19T02:16:24.524255+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:24.524255+0000","last_undegraded":"2024-04-19T02:16:24.524255+0000","last_fullsized":"2024-04-19T02:16:24.524255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523741+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.523741+0000","last_peered":"2024-04-19T02:16:24.523741+0000","last_clean":"2024-04-19T02:16:24.523741+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.523741+0000","last_undegraded":"2024-04-19T02:16:24.523741+0000","last_fullsized":"2024-04-19T02:16:24.523741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521748+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:24.521748+0000","last_peered":"2024-04-19T02:16:24.521748+0000","last_clean":"2024-04-19T02:16:24.521748+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:24.521748+0000","last_undegraded":"2024-04-19T02:16:24.521748+0000","last_fullsized":"2024-04-19T02:16:24.521748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491382+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.491382+0000","last_peered":"2024-04-19T02:16:24.491382+0000","last_clean":"2024-04-19T02:16:24.491382+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.491382+0000","last_undegraded":"2024-04-19T02:16:24.491382+0000","last_fullsized":"2024-04-19T02:16:24.491382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526992+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:24.526992+0000","last_peered":"2024-04-19T02:16:24.526992+0000","last_clean":"2024-04-19T02:16:24.526992+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:24.526992+0000","last_undegraded":"2024-04-19T02:16:24.526992+0000","last_fullsized":"2024-04-19T02:16:24.526992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495981+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.495981+0000","last_peered":"2024-04-19T02:16:24.495981+0000","last_clean":"2024-04-19T02:16:24.495981+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.495981+0000","last_undegraded":"2024-04-19T02:16:24.495981+0000","last_fullsized":"2024-04-19T02:16:24.495981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521669+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:24.521669+0000","last_peered":"2024-04-19T02:16:24.521669+0000","last_clean":"2024-04-19T02:16:24.521669+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:24.521669+0000","last_undegraded":"2024-04-19T02:16:24.521669+0000","last_fullsized":"2024-04-19T02:16:24.521669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490556+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.490556+0000","last_peered":"2024-04-19T02:16:24.490556+0000","last_clean":"2024-04-19T02:16:24.490556+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.490556+0000","last_undegraded":"2024-04-19T02:16:24.490556+0000","last_fullsized":"2024-04-19T02:16:24.490556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514902+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:24.514902+0000","last_peered":"2024-04-19T02:16:24.514902+0000","last_clean":"2024-04-19T02:16:24.514902+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:24.514902+0000","last_undegraded":"2024-04-19T02:16:24.514902+0000","last_fullsized":"2024-04-19T02:16:24.514902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493180+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:24.493180+0000","last_peered":"2024-04-19T02:16:24.493180+0000","last_clean":"2024-04-19T02:16:24.493180+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:24.493180+0000","last_undegraded":"2024-04-19T02:16:24.493180+0000","last_fullsized":"2024-04-19T02:16:24.493180+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.496022+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:24.496022+0000","last_peered":"2024-04-19T02:16:24.496022+0000","last_clean":"2024-04-19T02:16:24.496022+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:24.496022+0000","last_undegraded":"2024-04-19T02:16:24.496022+0000","last_fullsized":"2024-04-19T02:16:24.496022+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488896+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.488896+0000","last_peered":"2024-04-19T02:16:24.488896+0000","last_clean":"2024-04-19T02:16:24.488896+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.488896+0000","last_undegraded":"2024-04-19T02:16:24.488896+0000","last_fullsized":"2024-04-19T02:16:24.488896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527437+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:24.527437+0000","last_peered":"2024-04-19T02:16:24.527437+0000","last_clean":"2024-04-19T02:16:24.527437+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:24.527437+0000","last_undegraded":"2024-04-19T02:16:24.527437+0000","last_fullsized":"2024-04-19T02:16:24.527437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493324+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:24.493324+0000","last_peered":"2024-04-19T02:16:24.493324+0000","last_clean":"2024-04-19T02:16:24.493324+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:24.493324+0000","last_undegraded":"2024-04-19T02:16:24.493324+0000","last_fullsized":"2024-04-19T02:16:24.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490067+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.490067+0000","last_peered":"2024-04-19T02:16:24.490067+0000","last_clean":"2024-04-19T02:16:24.490067+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.490067+0000","last_undegraded":"2024-04-19T02:16:24.490067+0000","last_fullsized":"2024-04-19T02:16:24.490067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518949+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:24.518949+0000","last_peered":"2024-04-19T02:16:24.518949+0000","last_clean":"2024-04-19T02:16:24.518949+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:24.518949+0000","last_undegraded":"2024-04-19T02:16:24.518949+0000","last_fullsized":"2024-04-19T02:16:24.518949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490281+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:24.490281+0000","last_peered":"2024-04-19T02:16:24.490281+0000","last_clean":"2024-04-19T02:16:24.490281+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:24.490281+0000","last_undegraded":"2024-04-19T02:16:24.490281+0000","last_fullsized":"2024-04-19T02:16:24.490281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490834+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.490834+0000","last_peered":"2024-04-19T02:16:24.490834+0000","last_clean":"2024-04-19T02:16:24.490834+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.490834+0000","last_undegraded":"2024-04-19T02:16:24.490834+0000","last_fullsized":"2024-04-19T02:16:24.490834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514947+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:24.514947+0000","last_peered":"2024-04-19T02:16:24.514947+0000","last_clean":"2024-04-19T02:16:24.514947+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:24.514947+0000","last_undegraded":"2024-04-19T02:16:24.514947+0000","last_fullsized":"2024-04-19T02:16:24.514947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491655+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:24.491655+0000","last_peered":"2024-04-19T02:16:24.491655+0000","last_clean":"2024-04-19T02:16:24.491655+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:24.491655+0000","last_undegraded":"2024-04-19T02:16:24.491655+0000","last_fullsized":"2024-04-19T02:16:24.491655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495064+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.495064+0000","last_peered":"2024-04-19T02:16:24.495064+0000","last_clean":"2024-04-19T02:16:24.495064+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.495064+0000","last_undegraded":"2024-04-19T02:16:24.495064+0000","last_fullsized":"2024-04-19T02:16:24.495064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513571+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:24.513571+0000","last_peered":"2024-04-19T02:16:24.513571+0000","last_clean":"2024-04-19T02:16:24.513571+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:24.513571+0000","last_undegraded":"2024-04-19T02:16:24.513571+0000","last_fullsized":"2024-04-19T02:16:24.513571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.500388+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.500388+0000","last_peered":"2024-04-19T02:16:24.500388+0000","last_clean":"2024-04-19T02:16:24.500388+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.500388+0000","last_undegraded":"2024-04-19T02:16:24.500388+0000","last_fullsized":"2024-04-19T02:16:24.500388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488762+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:24.488762+0000","last_peered":"2024-04-19T02:16:24.488762+0000","last_clean":"2024-04-19T02:16:24.488762+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:24.488762+0000","last_undegraded":"2024-04-19T02:16:24.488762+0000","last_fullsized":"2024-04-19T02:16:24.488762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522145+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:24.522145+0000","last_peered":"2024-04-19T02:16:24.522145+0000","last_clean":"2024-04-19T02:16:24.522145+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:24.522145+0000","last_undegraded":"2024-04-19T02:16:24.522145+0000","last_fullsized":"2024-04-19T02:16:24.522145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488841+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.488841+0000","last_peered":"2024-04-19T02:16:24.488841+0000","last_clean":"2024-04-19T02:16:24.488841+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.488841+0000","last_undegraded":"2024-04-19T02:16:24.488841+0000","last_fullsized":"2024-04-19T02:16:24.488841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498940+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:24.498940+0000","last_peered":"2024-04-19T02:16:24.498940+0000","last_clean":"2024-04-19T02:16:24.498940+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:24.498940+0000","last_undegraded":"2024-04-19T02:16:24.498940+0000","last_fullsized":"2024-04-19T02:16:24.498940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525050+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:24.525050+0000","last_peered":"2024-04-19T02:16:24.525050+0000","last_clean":"2024-04-19T02:16:24.525050+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:24.525050+0000","last_undegraded":"2024-04-19T02:16:24.525050+0000","last_fullsized":"2024-04-19T02:16:24.525050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513005+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.513005+0000","last_peered":"2024-04-19T02:16:24.513005+0000","last_clean":"2024-04-19T02:16:24.513005+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.513005+0000","last_undegraded":"2024-04-19T02:16:24.513005+0000","last_fullsized":"2024-04-19T02:16:24.513005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491847+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:24.491847+0000","last_peered":"2024-04-19T02:16:24.491847+0000","last_clean":"2024-04-19T02:16:24.491847+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:24.491847+0000","last_undegraded":"2024-04-19T02:16:24.491847+0000","last_fullsized":"2024-04-19T02:16:24.491847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526485+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:24.526485+0000","last_peered":"2024-04-19T02:16:24.526485+0000","last_clean":"2024-04-19T02:16:24.526485+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:24.526485+0000","last_undegraded":"2024-04-19T02:16:24.526485+0000","last_fullsized":"2024-04-19T02:16:24.526485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491629+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:24.491629+0000","last_peered":"2024-04-19T02:16:24.491629+0000","last_clean":"2024-04-19T02:16:24.491629+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:24.491629+0000","last_undegraded":"2024-04-19T02:16:24.491629+0000","last_fullsized":"2024-04-19T02:16:24.491629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491493+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:24.491493+0000","last_peered":"2024-04-19T02:16:24.491493+0000","last_clean":"2024-04-19T02:16:24.491493+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:24.491493+0000","last_undegraded":"2024-04-19T02:16:24.491493+0000","last_fullsized":"2024-04-19T02:16:24.491493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522177+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:24.522177+0000","last_peered":"2024-04-19T02:16:24.522177+0000","last_clean":"2024-04-19T02:16:24.522177+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:24.522177+0000","last_undegraded":"2024-04-19T02:16:24.522177+0000","last_fullsized":"2024-04-19T02:16:24.522177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521806+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:24.521806+0000","last_peered":"2024-04-19T02:16:24.521806+0000","last_clean":"2024-04-19T02:16:24.521806+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:24.521806+0000","last_undegraded":"2024-04-19T02:16:24.521806+0000","last_fullsized":"2024-04-19T02:16:24.521806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.533109+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.533109+0000","last_peered":"2024-04-19T02:16:24.533109+0000","last_clean":"2024-04-19T02:16:24.533109+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.533109+0000","last_undegraded":"2024-04-19T02:16:24.533109+0000","last_fullsized":"2024-04-19T02:16:24.533109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514198+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:24.514198+0000","last_peered":"2024-04-19T02:16:24.514198+0000","last_clean":"2024-04-19T02:16:24.514198+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:24.514198+0000","last_undegraded":"2024-04-19T02:16:24.514198+0000","last_fullsized":"2024-04-19T02:16:24.514198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524105+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.524105+0000","last_peered":"2024-04-19T02:16:24.524105+0000","last_clean":"2024-04-19T02:16:24.524105+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.524105+0000","last_undegraded":"2024-04-19T02:16:24.524105+0000","last_fullsized":"2024-04-19T02:16:24.524105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.491469+0000","last_peered":"2024-04-19T02:16:24.491469+0000","last_clean":"2024-04-19T02:16:24.491469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.491469+0000","last_undegraded":"2024-04-19T02:16:24.491469+0000","last_fullsized":"2024-04-19T02:16:24.491469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521373+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:24.521373+0000","last_peered":"2024-04-19T02:16:24.521373+0000","last_clean":"2024-04-19T02:16:24.521373+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:24.521373+0000","last_undegraded":"2024-04-19T02:16:24.521373+0000","last_fullsized":"2024-04-19T02:16:24.521373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.492272+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.492272+0000","last_peered":"2024-04-19T02:16:24.492272+0000","last_clean":"2024-04-19T02:16:24.492272+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.492272+0000","last_undegraded":"2024-04-19T02:16:24.492272+0000","last_fullsized":"2024-04-19T02:16:24.492272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512722+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:24.512722+0000","last_peered":"2024-04-19T02:16:24.512722+0000","last_clean":"2024-04-19T02:16:24.512722+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:24.512722+0000","last_undegraded":"2024-04-19T02:16:24.512722+0000","last_fullsized":"2024-04-19T02:16:24.512722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522303+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:24.522303+0000","last_peered":"2024-04-19T02:16:24.522303+0000","last_clean":"2024-04-19T02:16:24.522303+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:24.522303+0000","last_undegraded":"2024-04-19T02:16:24.522303+0000","last_fullsized":"2024-04-19T02:16:24.522303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488585+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.488585+0000","last_peered":"2024-04-19T02:16:24.488585+0000","last_clean":"2024-04-19T02:16:24.488585+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.488585+0000","last_undegraded":"2024-04-19T02:16:24.488585+0000","last_fullsized":"2024-04-19T02:16:24.488585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.503371+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:24.503371+0000","last_peered":"2024-04-19T02:16:24.503371+0000","last_clean":"2024-04-19T02:16:24.503371+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:24.503371+0000","last_undegraded":"2024-04-19T02:16:24.503371+0000","last_fullsized":"2024-04-19T02:16:24.503371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490145+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.490145+0000","last_peered":"2024-04-19T02:16:24.490145+0000","last_clean":"2024-04-19T02:16:24.490145+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.490145+0000","last_undegraded":"2024-04-19T02:16:24.490145+0000","last_fullsized":"2024-04-19T02:16:24.490145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526148+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:24.526148+0000","last_peered":"2024-04-19T02:16:24.526148+0000","last_clean":"2024-04-19T02:16:24.526148+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:24.526148+0000","last_undegraded":"2024-04-19T02:16:24.526148+0000","last_fullsized":"2024-04-19T02:16:24.526148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514216+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.514216+0000","last_peered":"2024-04-19T02:16:24.514216+0000","last_clean":"2024-04-19T02:16:24.514216+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.514216+0000","last_undegraded":"2024-04-19T02:16:24.514216+0000","last_fullsized":"2024-04-19T02:16:24.514216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521760+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:24.521760+0000","last_peered":"2024-04-19T02:16:24.521760+0000","last_clean":"2024-04-19T02:16:24.521760+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:24.521760+0000","last_undegraded":"2024-04-19T02:16:24.521760+0000","last_fullsized":"2024-04-19T02:16:24.521760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520388+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.520388+0000","last_peered":"2024-04-19T02:16:24.520388+0000","last_clean":"2024-04-19T02:16:24.520388+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.520388+0000","last_undegraded":"2024-04-19T02:16:24.520388+0000","last_fullsized":"2024-04-19T02:16:24.520388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514797+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:24.514797+0000","last_peered":"2024-04-19T02:16:24.514797+0000","last_clean":"2024-04-19T02:16:24.514797+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:24.514797+0000","last_undegraded":"2024-04-19T02:16:24.514797+0000","last_fullsized":"2024-04-19T02:16:24.514797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.531294+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.531294+0000","last_peered":"2024-04-19T02:16:24.531294+0000","last_clean":"2024-04-19T02:16:24.531294+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.531294+0000","last_undegraded":"2024-04-19T02:16:24.531294+0000","last_fullsized":"2024-04-19T02:16:24.531294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.511560+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:24.511560+0000","last_peered":"2024-04-19T02:16:24.511560+0000","last_clean":"2024-04-19T02:16:24.511560+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:24.511560+0000","last_undegraded":"2024-04-19T02:16:24.511560+0000","last_fullsized":"2024-04-19T02:16:24.511560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523814+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.523814+0000","last_peered":"2024-04-19T02:16:24.523814+0000","last_clean":"2024-04-19T02:16:24.523814+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.523814+0000","last_undegraded":"2024-04-19T02:16:24.523814+0000","last_fullsized":"2024-04-19T02:16:24.523814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519363+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:24.519363+0000","last_peered":"2024-04-19T02:16:24.519363+0000","last_clean":"2024-04-19T02:16:24.519363+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:24.519363+0000","last_undegraded":"2024-04-19T02:16:24.519363+0000","last_fullsized":"2024-04-19T02:16:24.519363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.510268+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.510268+0000","last_peered":"2024-04-19T02:16:24.510268+0000","last_clean":"2024-04-19T02:16:24.510268+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.510268+0000","last_undegraded":"2024-04-19T02:16:24.510268+0000","last_fullsized":"2024-04-19T02:16:24.510268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515136+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:24.515136+0000","last_peered":"2024-04-19T02:16:24.515136+0000","last_clean":"2024-04-19T02:16:24.515136+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:24.515136+0000","last_undegraded":"2024-04-19T02:16:24.515136+0000","last_fullsized":"2024-04-19T02:16:24.515136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523813+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.523813+0000","last_peered":"2024-04-19T02:16:24.523813+0000","last_clean":"2024-04-19T02:16:24.523813+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.523813+0000","last_undegraded":"2024-04-19T02:16:24.523813+0000","last_fullsized":"2024-04-19T02:16:24.523813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:32.236 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-19T02:16:32.236 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-19T02:16:32.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-19T02:16:32.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-19T02:16:32.237 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-19T02:16:32.609 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:32.626 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":20445},{"type":"v1","addr":"172.21.15.73:6801","nonce":20445}]},"active_addr":"172.21.15.73:6801/20445","active_change":"2024-04-19T02:16:08.163233+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1157729397}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2155200545}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2788520021}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2298434424}]}]} 2024-04-19T02:16:32.629 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-19T02:16:32.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T02:16:32.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:32.915 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:25.482999+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:32.932 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T02:16:32.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:33.202 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:25.482999+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:33.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T02:16:33.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T02:16:33.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T02:16:33.368 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-19T02:16:33.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:16:33.384 INFO:teuthology.orchestra.run.smithi073.stdout:34359738377 2024-04-19T02:16:33.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:16:33.386 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-19T02:16:33.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:16:33.660 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2024-04-19T02:16:33.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2024-04-19T02:16:33.725 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-19T02:16:33.734 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2024-04-19T02:16:33.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.0 2024-04-19T02:16:33.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.1 2024-04-19T02:16:34.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:16:34.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:16:34.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:16:34.995 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-19T02:16:35.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.2 2024-04-19T02:16:35.013 DEBUG:teuthology.parallel:result is None 2024-04-19T02:16:35.037 INFO:teuthology.orchestra.run.smithi073.stdout:34359738377 2024-04-19T02:16:35.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.0 2024-04-19T02:16:35.054 DEBUG:teuthology.parallel:result is None 2024-04-19T02:16:35.090 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-19T02:16:35.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.1 2024-04-19T02:16:35.106 DEBUG:teuthology.parallel:result is None 2024-04-19T02:16:35.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T02:16:35.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-19T02:16:34.175367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89900,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025620,"statfs":{"total":289910292480,"available":289818234880,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.688501"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521326+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:24.521326+0000","last_peered":"2024-04-19T02:16:24.521326+0000","last_clean":"2024-04-19T02:16:24.521326+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:24.521326+0000","last_undegraded":"2024-04-19T02:16:24.521326+0000","last_fullsized":"2024-04-19T02:16:24.521326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519236+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:24.519236+0000","last_peered":"2024-04-19T02:16:24.519236+0000","last_clean":"2024-04-19T02:16:24.519236+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:24.519236+0000","last_undegraded":"2024-04-19T02:16:24.519236+0000","last_fullsized":"2024-04-19T02:16:24.519236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527393+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:24.527393+0000","last_peered":"2024-04-19T02:16:24.527393+0000","last_clean":"2024-04-19T02:16:24.527393+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:24.527393+0000","last_undegraded":"2024-04-19T02:16:24.527393+0000","last_fullsized":"2024-04-19T02:16:24.527393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521797+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:24.521797+0000","last_peered":"2024-04-19T02:16:24.521797+0000","last_clean":"2024-04-19T02:16:24.521797+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:24.521797+0000","last_undegraded":"2024-04-19T02:16:24.521797+0000","last_fullsized":"2024-04-19T02:16:24.521797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518437+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:24.518437+0000","last_peered":"2024-04-19T02:16:24.518437+0000","last_clean":"2024-04-19T02:16:24.518437+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:24.518437+0000","last_undegraded":"2024-04-19T02:16:24.518437+0000","last_fullsized":"2024-04-19T02:16:24.518437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519225+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:24.519225+0000","last_peered":"2024-04-19T02:16:24.519225+0000","last_clean":"2024-04-19T02:16:24.519225+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:24.519225+0000","last_undegraded":"2024-04-19T02:16:24.519225+0000","last_fullsized":"2024-04-19T02:16:24.519225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518975+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:24.518975+0000","last_peered":"2024-04-19T02:16:24.518975+0000","last_clean":"2024-04-19T02:16:24.518975+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:24.518975+0000","last_undegraded":"2024-04-19T02:16:24.518975+0000","last_fullsized":"2024-04-19T02:16:24.518975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519248+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:24.519248+0000","last_peered":"2024-04-19T02:16:24.519248+0000","last_clean":"2024-04-19T02:16:24.519248+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:24.519248+0000","last_undegraded":"2024-04-19T02:16:24.519248+0000","last_fullsized":"2024-04-19T02:16:24.519248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513937+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:24.513937+0000","last_peered":"2024-04-19T02:16:24.513937+0000","last_clean":"2024-04-19T02:16:24.513937+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:24.513937+0000","last_undegraded":"2024-04-19T02:16:24.513937+0000","last_fullsized":"2024-04-19T02:16:24.513937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521455+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:24.521455+0000","last_peered":"2024-04-19T02:16:24.521455+0000","last_clean":"2024-04-19T02:16:24.521455+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:24.521455+0000","last_undegraded":"2024-04-19T02:16:24.521455+0000","last_fullsized":"2024-04-19T02:16:24.521455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521791+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:24.521791+0000","last_peered":"2024-04-19T02:16:24.521791+0000","last_clean":"2024-04-19T02:16:24.521791+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:24.521791+0000","last_undegraded":"2024-04-19T02:16:24.521791+0000","last_fullsized":"2024-04-19T02:16:24.521791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525459+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:24.525459+0000","last_peered":"2024-04-19T02:16:24.525459+0000","last_clean":"2024-04-19T02:16:24.525459+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:24.525459+0000","last_undegraded":"2024-04-19T02:16:24.525459+0000","last_fullsized":"2024-04-19T02:16:24.525459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519126+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:24.519126+0000","last_peered":"2024-04-19T02:16:24.519126+0000","last_clean":"2024-04-19T02:16:24.519126+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:24.519126+0000","last_undegraded":"2024-04-19T02:16:24.519126+0000","last_fullsized":"2024-04-19T02:16:24.519126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520744+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:24.520744+0000","last_peered":"2024-04-19T02:16:24.520744+0000","last_clean":"2024-04-19T02:16:24.520744+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:24.520744+0000","last_undegraded":"2024-04-19T02:16:24.520744+0000","last_fullsized":"2024-04-19T02:16:24.520744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520230+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:24.520230+0000","last_peered":"2024-04-19T02:16:24.520230+0000","last_clean":"2024-04-19T02:16:24.520230+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:24.520230+0000","last_undegraded":"2024-04-19T02:16:24.520230+0000","last_fullsized":"2024-04-19T02:16:24.520230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520060+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:24.520060+0000","last_peered":"2024-04-19T02:16:24.520060+0000","last_clean":"2024-04-19T02:16:24.520060+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:24.520060+0000","last_undegraded":"2024-04-19T02:16:24.520060+0000","last_fullsized":"2024-04-19T02:16:24.520060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514988+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:24.514988+0000","last_peered":"2024-04-19T02:16:24.514988+0000","last_clean":"2024-04-19T02:16:24.514988+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:24.514988+0000","last_undegraded":"2024-04-19T02:16:24.514988+0000","last_fullsized":"2024-04-19T02:16:24.514988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519056+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:24.519056+0000","last_peered":"2024-04-19T02:16:24.519056+0000","last_clean":"2024-04-19T02:16:24.519056+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:24.519056+0000","last_undegraded":"2024-04-19T02:16:24.519056+0000","last_fullsized":"2024-04-19T02:16:24.519056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514210+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:24.514210+0000","last_peered":"2024-04-19T02:16:24.514210+0000","last_clean":"2024-04-19T02:16:24.514210+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:24.514210+0000","last_undegraded":"2024-04-19T02:16:24.514210+0000","last_fullsized":"2024-04-19T02:16:24.514210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521557+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:24.521557+0000","last_peered":"2024-04-19T02:16:24.521557+0000","last_clean":"2024-04-19T02:16:24.521557+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:24.521557+0000","last_undegraded":"2024-04-19T02:16:24.521557+0000","last_fullsized":"2024-04-19T02:16:24.521557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520111+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:24.520111+0000","last_peered":"2024-04-19T02:16:24.520111+0000","last_clean":"2024-04-19T02:16:24.520111+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:24.520111+0000","last_undegraded":"2024-04-19T02:16:24.520111+0000","last_fullsized":"2024-04-19T02:16:24.520111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524330+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:24.524330+0000","last_peered":"2024-04-19T02:16:24.524330+0000","last_clean":"2024-04-19T02:16:24.524330+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:24.524330+0000","last_undegraded":"2024-04-19T02:16:24.524330+0000","last_fullsized":"2024-04-19T02:16:24.524330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521993+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:24.521993+0000","last_peered":"2024-04-19T02:16:24.521993+0000","last_clean":"2024-04-19T02:16:24.521993+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:24.521993+0000","last_undegraded":"2024-04-19T02:16:24.521993+0000","last_fullsized":"2024-04-19T02:16:24.521993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519561+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:24.519561+0000","last_peered":"2024-04-19T02:16:24.519561+0000","last_clean":"2024-04-19T02:16:24.519561+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:24.519561+0000","last_undegraded":"2024-04-19T02:16:24.519561+0000","last_fullsized":"2024-04-19T02:16:24.519561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523521+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:24.523521+0000","last_peered":"2024-04-19T02:16:24.523521+0000","last_clean":"2024-04-19T02:16:24.523521+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:24.523521+0000","last_undegraded":"2024-04-19T02:16:24.523521+0000","last_fullsized":"2024-04-19T02:16:24.523521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526425+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:24.526425+0000","last_peered":"2024-04-19T02:16:24.526425+0000","last_clean":"2024-04-19T02:16:24.526425+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:24.526425+0000","last_undegraded":"2024-04-19T02:16:24.526425+0000","last_fullsized":"2024-04-19T02:16:24.526425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527334+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:24.527334+0000","last_peered":"2024-04-19T02:16:24.527334+0000","last_clean":"2024-04-19T02:16:24.527334+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:24.527334+0000","last_undegraded":"2024-04-19T02:16:24.527334+0000","last_fullsized":"2024-04-19T02:16:24.527334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525176+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:24.525176+0000","last_peered":"2024-04-19T02:16:24.525176+0000","last_clean":"2024-04-19T02:16:24.525176+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:24.525176+0000","last_undegraded":"2024-04-19T02:16:24.525176+0000","last_fullsized":"2024-04-19T02:16:24.525176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513429+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:24.513429+0000","last_peered":"2024-04-19T02:16:24.513429+0000","last_clean":"2024-04-19T02:16:24.513429+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:24.513429+0000","last_undegraded":"2024-04-19T02:16:24.513429+0000","last_fullsized":"2024-04-19T02:16:24.513429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522053+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:24.522053+0000","last_peered":"2024-04-19T02:16:24.522053+0000","last_clean":"2024-04-19T02:16:24.522053+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:24.522053+0000","last_undegraded":"2024-04-19T02:16:24.522053+0000","last_fullsized":"2024-04-19T02:16:24.522053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512827+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:24.512827+0000","last_peered":"2024-04-19T02:16:24.512827+0000","last_clean":"2024-04-19T02:16:24.512827+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:24.512827+0000","last_undegraded":"2024-04-19T02:16:24.512827+0000","last_fullsized":"2024-04-19T02:16:24.512827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515064+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:24.515064+0000","last_peered":"2024-04-19T02:16:24.515064+0000","last_clean":"2024-04-19T02:16:24.515064+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:24.515064+0000","last_undegraded":"2024-04-19T02:16:24.515064+0000","last_fullsized":"2024-04-19T02:16:24.515064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518921+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:24.518921+0000","last_peered":"2024-04-19T02:16:24.518921+0000","last_clean":"2024-04-19T02:16:24.518921+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:24.518921+0000","last_undegraded":"2024-04-19T02:16:24.518921+0000","last_fullsized":"2024-04-19T02:16:24.518921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.530969+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.530969+0000","last_peered":"2024-04-19T02:16:24.530969+0000","last_clean":"2024-04-19T02:16:24.530969+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.530969+0000","last_undegraded":"2024-04-19T02:16:24.530969+0000","last_fullsized":"2024-04-19T02:16:24.530969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522746+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:24.522746+0000","last_peered":"2024-04-19T02:16:24.522746+0000","last_clean":"2024-04-19T02:16:24.522746+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:24.522746+0000","last_undegraded":"2024-04-19T02:16:24.522746+0000","last_fullsized":"2024-04-19T02:16:24.522746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488581+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.488581+0000","last_peered":"2024-04-19T02:16:24.488581+0000","last_clean":"2024-04-19T02:16:24.488581+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.488581+0000","last_undegraded":"2024-04-19T02:16:24.488581+0000","last_fullsized":"2024-04-19T02:16:24.488581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526731+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:24.526731+0000","last_peered":"2024-04-19T02:16:24.526731+0000","last_clean":"2024-04-19T02:16:24.526731+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:24.526731+0000","last_undegraded":"2024-04-19T02:16:24.526731+0000","last_fullsized":"2024-04-19T02:16:24.526731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495683+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.495683+0000","last_peered":"2024-04-19T02:16:24.495683+0000","last_clean":"2024-04-19T02:16:24.495683+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.495683+0000","last_undegraded":"2024-04-19T02:16:24.495683+0000","last_fullsized":"2024-04-19T02:16:24.495683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526825+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:24.526825+0000","last_peered":"2024-04-19T02:16:24.526825+0000","last_clean":"2024-04-19T02:16:24.526825+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:24.526825+0000","last_undegraded":"2024-04-19T02:16:24.526825+0000","last_fullsized":"2024-04-19T02:16:24.526825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.529809+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.529809+0000","last_peered":"2024-04-19T02:16:24.529809+0000","last_clean":"2024-04-19T02:16:24.529809+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.529809+0000","last_undegraded":"2024-04-19T02:16:24.529809+0000","last_fullsized":"2024-04-19T02:16:24.529809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.516091+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.516091+0000","last_peered":"2024-04-19T02:16:24.516091+0000","last_clean":"2024-04-19T02:16:24.516091+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.516091+0000","last_undegraded":"2024-04-19T02:16:24.516091+0000","last_fullsized":"2024-04-19T02:16:24.516091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524969+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:24.524969+0000","last_peered":"2024-04-19T02:16:24.524969+0000","last_clean":"2024-04-19T02:16:24.524969+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:24.524969+0000","last_undegraded":"2024-04-19T02:16:24.524969+0000","last_fullsized":"2024-04-19T02:16:24.524969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519660+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.519660+0000","last_peered":"2024-04-19T02:16:24.519660+0000","last_clean":"2024-04-19T02:16:24.519660+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.519660+0000","last_undegraded":"2024-04-19T02:16:24.519660+0000","last_fullsized":"2024-04-19T02:16:24.519660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519536+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:24.519536+0000","last_peered":"2024-04-19T02:16:24.519536+0000","last_clean":"2024-04-19T02:16:24.519536+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:24.519536+0000","last_undegraded":"2024-04-19T02:16:24.519536+0000","last_fullsized":"2024-04-19T02:16:24.519536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521517+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.521517+0000","last_peered":"2024-04-19T02:16:24.521517+0000","last_clean":"2024-04-19T02:16:24.521517+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.521517+0000","last_undegraded":"2024-04-19T02:16:24.521517+0000","last_fullsized":"2024-04-19T02:16:24.521517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.509240+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:24.509240+0000","last_peered":"2024-04-19T02:16:24.509240+0000","last_clean":"2024-04-19T02:16:24.509240+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:24.509240+0000","last_undegraded":"2024-04-19T02:16:24.509240+0000","last_fullsized":"2024-04-19T02:16:24.509240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498902+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.498902+0000","last_peered":"2024-04-19T02:16:24.498902+0000","last_clean":"2024-04-19T02:16:24.498902+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.498902+0000","last_undegraded":"2024-04-19T02:16:24.498902+0000","last_fullsized":"2024-04-19T02:16:24.498902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524255+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:24.524255+0000","last_peered":"2024-04-19T02:16:24.524255+0000","last_clean":"2024-04-19T02:16:24.524255+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:24.524255+0000","last_undegraded":"2024-04-19T02:16:24.524255+0000","last_fullsized":"2024-04-19T02:16:24.524255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523741+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.523741+0000","last_peered":"2024-04-19T02:16:24.523741+0000","last_clean":"2024-04-19T02:16:24.523741+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.523741+0000","last_undegraded":"2024-04-19T02:16:24.523741+0000","last_fullsized":"2024-04-19T02:16:24.523741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521748+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:24.521748+0000","last_peered":"2024-04-19T02:16:24.521748+0000","last_clean":"2024-04-19T02:16:24.521748+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:24.521748+0000","last_undegraded":"2024-04-19T02:16:24.521748+0000","last_fullsized":"2024-04-19T02:16:24.521748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491382+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.491382+0000","last_peered":"2024-04-19T02:16:24.491382+0000","last_clean":"2024-04-19T02:16:24.491382+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.491382+0000","last_undegraded":"2024-04-19T02:16:24.491382+0000","last_fullsized":"2024-04-19T02:16:24.491382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526992+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:24.526992+0000","last_peered":"2024-04-19T02:16:24.526992+0000","last_clean":"2024-04-19T02:16:24.526992+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:24.526992+0000","last_undegraded":"2024-04-19T02:16:24.526992+0000","last_fullsized":"2024-04-19T02:16:24.526992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495981+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.495981+0000","last_peered":"2024-04-19T02:16:24.495981+0000","last_clean":"2024-04-19T02:16:24.495981+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.495981+0000","last_undegraded":"2024-04-19T02:16:24.495981+0000","last_fullsized":"2024-04-19T02:16:24.495981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521669+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:24.521669+0000","last_peered":"2024-04-19T02:16:24.521669+0000","last_clean":"2024-04-19T02:16:24.521669+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:24.521669+0000","last_undegraded":"2024-04-19T02:16:24.521669+0000","last_fullsized":"2024-04-19T02:16:24.521669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490556+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.490556+0000","last_peered":"2024-04-19T02:16:24.490556+0000","last_clean":"2024-04-19T02:16:24.490556+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.490556+0000","last_undegraded":"2024-04-19T02:16:24.490556+0000","last_fullsized":"2024-04-19T02:16:24.490556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514902+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:24.514902+0000","last_peered":"2024-04-19T02:16:24.514902+0000","last_clean":"2024-04-19T02:16:24.514902+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:24.514902+0000","last_undegraded":"2024-04-19T02:16:24.514902+0000","last_fullsized":"2024-04-19T02:16:24.514902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493180+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:24.493180+0000","last_peered":"2024-04-19T02:16:24.493180+0000","last_clean":"2024-04-19T02:16:24.493180+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:24.493180+0000","last_undegraded":"2024-04-19T02:16:24.493180+0000","last_fullsized":"2024-04-19T02:16:24.493180+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.496022+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:24.496022+0000","last_peered":"2024-04-19T02:16:24.496022+0000","last_clean":"2024-04-19T02:16:24.496022+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:24.496022+0000","last_undegraded":"2024-04-19T02:16:24.496022+0000","last_fullsized":"2024-04-19T02:16:24.496022+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488896+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.488896+0000","last_peered":"2024-04-19T02:16:24.488896+0000","last_clean":"2024-04-19T02:16:24.488896+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.488896+0000","last_undegraded":"2024-04-19T02:16:24.488896+0000","last_fullsized":"2024-04-19T02:16:24.488896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527437+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:24.527437+0000","last_peered":"2024-04-19T02:16:24.527437+0000","last_clean":"2024-04-19T02:16:24.527437+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:24.527437+0000","last_undegraded":"2024-04-19T02:16:24.527437+0000","last_fullsized":"2024-04-19T02:16:24.527437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493324+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:24.493324+0000","last_peered":"2024-04-19T02:16:24.493324+0000","last_clean":"2024-04-19T02:16:24.493324+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:24.493324+0000","last_undegraded":"2024-04-19T02:16:24.493324+0000","last_fullsized":"2024-04-19T02:16:24.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490067+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.490067+0000","last_peered":"2024-04-19T02:16:24.490067+0000","last_clean":"2024-04-19T02:16:24.490067+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.490067+0000","last_undegraded":"2024-04-19T02:16:24.490067+0000","last_fullsized":"2024-04-19T02:16:24.490067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518949+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:24.518949+0000","last_peered":"2024-04-19T02:16:24.518949+0000","last_clean":"2024-04-19T02:16:24.518949+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:24.518949+0000","last_undegraded":"2024-04-19T02:16:24.518949+0000","last_fullsized":"2024-04-19T02:16:24.518949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490281+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:24.490281+0000","last_peered":"2024-04-19T02:16:24.490281+0000","last_clean":"2024-04-19T02:16:24.490281+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:24.490281+0000","last_undegraded":"2024-04-19T02:16:24.490281+0000","last_fullsized":"2024-04-19T02:16:24.490281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490834+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.490834+0000","last_peered":"2024-04-19T02:16:24.490834+0000","last_clean":"2024-04-19T02:16:24.490834+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.490834+0000","last_undegraded":"2024-04-19T02:16:24.490834+0000","last_fullsized":"2024-04-19T02:16:24.490834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514947+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:24.514947+0000","last_peered":"2024-04-19T02:16:24.514947+0000","last_clean":"2024-04-19T02:16:24.514947+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:24.514947+0000","last_undegraded":"2024-04-19T02:16:24.514947+0000","last_fullsized":"2024-04-19T02:16:24.514947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491655+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:24.491655+0000","last_peered":"2024-04-19T02:16:24.491655+0000","last_clean":"2024-04-19T02:16:24.491655+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:24.491655+0000","last_undegraded":"2024-04-19T02:16:24.491655+0000","last_fullsized":"2024-04-19T02:16:24.491655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495064+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.495064+0000","last_peered":"2024-04-19T02:16:24.495064+0000","last_clean":"2024-04-19T02:16:24.495064+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.495064+0000","last_undegraded":"2024-04-19T02:16:24.495064+0000","last_fullsized":"2024-04-19T02:16:24.495064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513571+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:24.513571+0000","last_peered":"2024-04-19T02:16:24.513571+0000","last_clean":"2024-04-19T02:16:24.513571+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:24.513571+0000","last_undegraded":"2024-04-19T02:16:24.513571+0000","last_fullsized":"2024-04-19T02:16:24.513571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.500388+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.500388+0000","last_peered":"2024-04-19T02:16:24.500388+0000","last_clean":"2024-04-19T02:16:24.500388+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.500388+0000","last_undegraded":"2024-04-19T02:16:24.500388+0000","last_fullsized":"2024-04-19T02:16:24.500388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488762+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:24.488762+0000","last_peered":"2024-04-19T02:16:24.488762+0000","last_clean":"2024-04-19T02:16:24.488762+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:24.488762+0000","last_undegraded":"2024-04-19T02:16:24.488762+0000","last_fullsized":"2024-04-19T02:16:24.488762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522145+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:24.522145+0000","last_peered":"2024-04-19T02:16:24.522145+0000","last_clean":"2024-04-19T02:16:24.522145+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:24.522145+0000","last_undegraded":"2024-04-19T02:16:24.522145+0000","last_fullsized":"2024-04-19T02:16:24.522145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488841+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.488841+0000","last_peered":"2024-04-19T02:16:24.488841+0000","last_clean":"2024-04-19T02:16:24.488841+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.488841+0000","last_undegraded":"2024-04-19T02:16:24.488841+0000","last_fullsized":"2024-04-19T02:16:24.488841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498940+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:24.498940+0000","last_peered":"2024-04-19T02:16:24.498940+0000","last_clean":"2024-04-19T02:16:24.498940+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:24.498940+0000","last_undegraded":"2024-04-19T02:16:24.498940+0000","last_fullsized":"2024-04-19T02:16:24.498940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525050+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:24.525050+0000","last_peered":"2024-04-19T02:16:24.525050+0000","last_clean":"2024-04-19T02:16:24.525050+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:24.525050+0000","last_undegraded":"2024-04-19T02:16:24.525050+0000","last_fullsized":"2024-04-19T02:16:24.525050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513005+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.513005+0000","last_peered":"2024-04-19T02:16:24.513005+0000","last_clean":"2024-04-19T02:16:24.513005+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.513005+0000","last_undegraded":"2024-04-19T02:16:24.513005+0000","last_fullsized":"2024-04-19T02:16:24.513005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491847+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:24.491847+0000","last_peered":"2024-04-19T02:16:24.491847+0000","last_clean":"2024-04-19T02:16:24.491847+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:24.491847+0000","last_undegraded":"2024-04-19T02:16:24.491847+0000","last_fullsized":"2024-04-19T02:16:24.491847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526485+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:24.526485+0000","last_peered":"2024-04-19T02:16:24.526485+0000","last_clean":"2024-04-19T02:16:24.526485+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:24.526485+0000","last_undegraded":"2024-04-19T02:16:24.526485+0000","last_fullsized":"2024-04-19T02:16:24.526485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:16:28.399827+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:28.399827+0000","last_peered":"2024-04-19T02:16:28.399827+0000","last_clean":"2024-04-19T02:16:28.399827+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:28.399827+0000","last_undegraded":"2024-04-19T02:16:28.399827+0000","last_fullsized":"2024-04-19T02:16:28.399827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491493+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:24.491493+0000","last_peered":"2024-04-19T02:16:24.491493+0000","last_clean":"2024-04-19T02:16:24.491493+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:24.491493+0000","last_undegraded":"2024-04-19T02:16:24.491493+0000","last_fullsized":"2024-04-19T02:16:24.491493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522177+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:24.522177+0000","last_peered":"2024-04-19T02:16:24.522177+0000","last_clean":"2024-04-19T02:16:24.522177+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:24.522177+0000","last_undegraded":"2024-04-19T02:16:24.522177+0000","last_fullsized":"2024-04-19T02:16:24.522177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521806+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:24.521806+0000","last_peered":"2024-04-19T02:16:24.521806+0000","last_clean":"2024-04-19T02:16:24.521806+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:24.521806+0000","last_undegraded":"2024-04-19T02:16:24.521806+0000","last_fullsized":"2024-04-19T02:16:24.521806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.533109+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.533109+0000","last_peered":"2024-04-19T02:16:24.533109+0000","last_clean":"2024-04-19T02:16:24.533109+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.533109+0000","last_undegraded":"2024-04-19T02:16:24.533109+0000","last_fullsized":"2024-04-19T02:16:24.533109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514198+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:24.514198+0000","last_peered":"2024-04-19T02:16:24.514198+0000","last_clean":"2024-04-19T02:16:24.514198+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:24.514198+0000","last_undegraded":"2024-04-19T02:16:24.514198+0000","last_fullsized":"2024-04-19T02:16:24.514198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524105+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.524105+0000","last_peered":"2024-04-19T02:16:24.524105+0000","last_clean":"2024-04-19T02:16:24.524105+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.524105+0000","last_undegraded":"2024-04-19T02:16:24.524105+0000","last_fullsized":"2024-04-19T02:16:24.524105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.491469+0000","last_peered":"2024-04-19T02:16:24.491469+0000","last_clean":"2024-04-19T02:16:24.491469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.491469+0000","last_undegraded":"2024-04-19T02:16:24.491469+0000","last_fullsized":"2024-04-19T02:16:24.491469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521373+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:24.521373+0000","last_peered":"2024-04-19T02:16:24.521373+0000","last_clean":"2024-04-19T02:16:24.521373+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:24.521373+0000","last_undegraded":"2024-04-19T02:16:24.521373+0000","last_fullsized":"2024-04-19T02:16:24.521373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.492272+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.492272+0000","last_peered":"2024-04-19T02:16:24.492272+0000","last_clean":"2024-04-19T02:16:24.492272+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.492272+0000","last_undegraded":"2024-04-19T02:16:24.492272+0000","last_fullsized":"2024-04-19T02:16:24.492272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512722+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:24.512722+0000","last_peered":"2024-04-19T02:16:24.512722+0000","last_clean":"2024-04-19T02:16:24.512722+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:24.512722+0000","last_undegraded":"2024-04-19T02:16:24.512722+0000","last_fullsized":"2024-04-19T02:16:24.512722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522303+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:24.522303+0000","last_peered":"2024-04-19T02:16:24.522303+0000","last_clean":"2024-04-19T02:16:24.522303+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:24.522303+0000","last_undegraded":"2024-04-19T02:16:24.522303+0000","last_fullsized":"2024-04-19T02:16:24.522303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488585+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.488585+0000","last_peered":"2024-04-19T02:16:24.488585+0000","last_clean":"2024-04-19T02:16:24.488585+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.488585+0000","last_undegraded":"2024-04-19T02:16:24.488585+0000","last_fullsized":"2024-04-19T02:16:24.488585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.503371+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:24.503371+0000","last_peered":"2024-04-19T02:16:24.503371+0000","last_clean":"2024-04-19T02:16:24.503371+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:24.503371+0000","last_undegraded":"2024-04-19T02:16:24.503371+0000","last_fullsized":"2024-04-19T02:16:24.503371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490145+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.490145+0000","last_peered":"2024-04-19T02:16:24.490145+0000","last_clean":"2024-04-19T02:16:24.490145+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.490145+0000","last_undegraded":"2024-04-19T02:16:24.490145+0000","last_fullsized":"2024-04-19T02:16:24.490145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526148+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:24.526148+0000","last_peered":"2024-04-19T02:16:24.526148+0000","last_clean":"2024-04-19T02:16:24.526148+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:24.526148+0000","last_undegraded":"2024-04-19T02:16:24.526148+0000","last_fullsized":"2024-04-19T02:16:24.526148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514216+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.514216+0000","last_peered":"2024-04-19T02:16:24.514216+0000","last_clean":"2024-04-19T02:16:24.514216+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.514216+0000","last_undegraded":"2024-04-19T02:16:24.514216+0000","last_fullsized":"2024-04-19T02:16:24.514216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521760+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:24.521760+0000","last_peered":"2024-04-19T02:16:24.521760+0000","last_clean":"2024-04-19T02:16:24.521760+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:24.521760+0000","last_undegraded":"2024-04-19T02:16:24.521760+0000","last_fullsized":"2024-04-19T02:16:24.521760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520388+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.520388+0000","last_peered":"2024-04-19T02:16:24.520388+0000","last_clean":"2024-04-19T02:16:24.520388+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.520388+0000","last_undegraded":"2024-04-19T02:16:24.520388+0000","last_fullsized":"2024-04-19T02:16:24.520388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514797+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:24.514797+0000","last_peered":"2024-04-19T02:16:24.514797+0000","last_clean":"2024-04-19T02:16:24.514797+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:24.514797+0000","last_undegraded":"2024-04-19T02:16:24.514797+0000","last_fullsized":"2024-04-19T02:16:24.514797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.531294+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.531294+0000","last_peered":"2024-04-19T02:16:24.531294+0000","last_clean":"2024-04-19T02:16:24.531294+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.531294+0000","last_undegraded":"2024-04-19T02:16:24.531294+0000","last_fullsized":"2024-04-19T02:16:24.531294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.511560+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:24.511560+0000","last_peered":"2024-04-19T02:16:24.511560+0000","last_clean":"2024-04-19T02:16:24.511560+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:24.511560+0000","last_undegraded":"2024-04-19T02:16:24.511560+0000","last_fullsized":"2024-04-19T02:16:24.511560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523814+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.523814+0000","last_peered":"2024-04-19T02:16:24.523814+0000","last_clean":"2024-04-19T02:16:24.523814+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.523814+0000","last_undegraded":"2024-04-19T02:16:24.523814+0000","last_fullsized":"2024-04-19T02:16:24.523814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519363+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:24.519363+0000","last_peered":"2024-04-19T02:16:24.519363+0000","last_clean":"2024-04-19T02:16:24.519363+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:24.519363+0000","last_undegraded":"2024-04-19T02:16:24.519363+0000","last_fullsized":"2024-04-19T02:16:24.519363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.510268+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.510268+0000","last_peered":"2024-04-19T02:16:24.510268+0000","last_clean":"2024-04-19T02:16:24.510268+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.510268+0000","last_undegraded":"2024-04-19T02:16:24.510268+0000","last_fullsized":"2024-04-19T02:16:24.510268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515136+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:24.515136+0000","last_peered":"2024-04-19T02:16:24.515136+0000","last_clean":"2024-04-19T02:16:24.515136+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:24.515136+0000","last_undegraded":"2024-04-19T02:16:24.515136+0000","last_fullsized":"2024-04-19T02:16:24.515136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523813+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.523813+0000","last_peered":"2024-04-19T02:16:24.523813+0000","last_clean":"2024-04-19T02:16:24.523813+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.523813+0000","last_undegraded":"2024-04-19T02:16:24.523813+0000","last_fullsized":"2024-04-19T02:16:24.523813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:35.451 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:35.778 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:35.780 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:35.795 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-19T02:16:34.175367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89900,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025620,"statfs":{"total":289910292480,"available":289818234880,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.688501"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521326+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:24.521326+0000","last_peered":"2024-04-19T02:16:24.521326+0000","last_clean":"2024-04-19T02:16:24.521326+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:24.521326+0000","last_undegraded":"2024-04-19T02:16:24.521326+0000","last_fullsized":"2024-04-19T02:16:24.521326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519236+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:24.519236+0000","last_peered":"2024-04-19T02:16:24.519236+0000","last_clean":"2024-04-19T02:16:24.519236+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:24.519236+0000","last_undegraded":"2024-04-19T02:16:24.519236+0000","last_fullsized":"2024-04-19T02:16:24.519236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527393+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:24.527393+0000","last_peered":"2024-04-19T02:16:24.527393+0000","last_clean":"2024-04-19T02:16:24.527393+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:24.527393+0000","last_undegraded":"2024-04-19T02:16:24.527393+0000","last_fullsized":"2024-04-19T02:16:24.527393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521797+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:24.521797+0000","last_peered":"2024-04-19T02:16:24.521797+0000","last_clean":"2024-04-19T02:16:24.521797+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:24.521797+0000","last_undegraded":"2024-04-19T02:16:24.521797+0000","last_fullsized":"2024-04-19T02:16:24.521797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518437+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:24.518437+0000","last_peered":"2024-04-19T02:16:24.518437+0000","last_clean":"2024-04-19T02:16:24.518437+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:24.518437+0000","last_undegraded":"2024-04-19T02:16:24.518437+0000","last_fullsized":"2024-04-19T02:16:24.518437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519225+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:24.519225+0000","last_peered":"2024-04-19T02:16:24.519225+0000","last_clean":"2024-04-19T02:16:24.519225+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:24.519225+0000","last_undegraded":"2024-04-19T02:16:24.519225+0000","last_fullsized":"2024-04-19T02:16:24.519225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518975+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:24.518975+0000","last_peered":"2024-04-19T02:16:24.518975+0000","last_clean":"2024-04-19T02:16:24.518975+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:24.518975+0000","last_undegraded":"2024-04-19T02:16:24.518975+0000","last_fullsized":"2024-04-19T02:16:24.518975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519248+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:24.519248+0000","last_peered":"2024-04-19T02:16:24.519248+0000","last_clean":"2024-04-19T02:16:24.519248+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:24.519248+0000","last_undegraded":"2024-04-19T02:16:24.519248+0000","last_fullsized":"2024-04-19T02:16:24.519248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513937+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:24.513937+0000","last_peered":"2024-04-19T02:16:24.513937+0000","last_clean":"2024-04-19T02:16:24.513937+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:24.513937+0000","last_undegraded":"2024-04-19T02:16:24.513937+0000","last_fullsized":"2024-04-19T02:16:24.513937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521455+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:24.521455+0000","last_peered":"2024-04-19T02:16:24.521455+0000","last_clean":"2024-04-19T02:16:24.521455+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:24.521455+0000","last_undegraded":"2024-04-19T02:16:24.521455+0000","last_fullsized":"2024-04-19T02:16:24.521455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521791+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:24.521791+0000","last_peered":"2024-04-19T02:16:24.521791+0000","last_clean":"2024-04-19T02:16:24.521791+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:24.521791+0000","last_undegraded":"2024-04-19T02:16:24.521791+0000","last_fullsized":"2024-04-19T02:16:24.521791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525459+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:24.525459+0000","last_peered":"2024-04-19T02:16:24.525459+0000","last_clean":"2024-04-19T02:16:24.525459+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:24.525459+0000","last_undegraded":"2024-04-19T02:16:24.525459+0000","last_fullsized":"2024-04-19T02:16:24.525459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519126+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:24.519126+0000","last_peered":"2024-04-19T02:16:24.519126+0000","last_clean":"2024-04-19T02:16:24.519126+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:24.519126+0000","last_undegraded":"2024-04-19T02:16:24.519126+0000","last_fullsized":"2024-04-19T02:16:24.519126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520744+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:24.520744+0000","last_peered":"2024-04-19T02:16:24.520744+0000","last_clean":"2024-04-19T02:16:24.520744+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:24.520744+0000","last_undegraded":"2024-04-19T02:16:24.520744+0000","last_fullsized":"2024-04-19T02:16:24.520744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520230+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:24.520230+0000","last_peered":"2024-04-19T02:16:24.520230+0000","last_clean":"2024-04-19T02:16:24.520230+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:24.520230+0000","last_undegraded":"2024-04-19T02:16:24.520230+0000","last_fullsized":"2024-04-19T02:16:24.520230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520060+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:24.520060+0000","last_peered":"2024-04-19T02:16:24.520060+0000","last_clean":"2024-04-19T02:16:24.520060+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:24.520060+0000","last_undegraded":"2024-04-19T02:16:24.520060+0000","last_fullsized":"2024-04-19T02:16:24.520060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514988+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:24.514988+0000","last_peered":"2024-04-19T02:16:24.514988+0000","last_clean":"2024-04-19T02:16:24.514988+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:24.514988+0000","last_undegraded":"2024-04-19T02:16:24.514988+0000","last_fullsized":"2024-04-19T02:16:24.514988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519056+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:24.519056+0000","last_peered":"2024-04-19T02:16:24.519056+0000","last_clean":"2024-04-19T02:16:24.519056+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:24.519056+0000","last_undegraded":"2024-04-19T02:16:24.519056+0000","last_fullsized":"2024-04-19T02:16:24.519056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514210+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:24.514210+0000","last_peered":"2024-04-19T02:16:24.514210+0000","last_clean":"2024-04-19T02:16:24.514210+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:24.514210+0000","last_undegraded":"2024-04-19T02:16:24.514210+0000","last_fullsized":"2024-04-19T02:16:24.514210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521557+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:24.521557+0000","last_peered":"2024-04-19T02:16:24.521557+0000","last_clean":"2024-04-19T02:16:24.521557+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:24.521557+0000","last_undegraded":"2024-04-19T02:16:24.521557+0000","last_fullsized":"2024-04-19T02:16:24.521557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520111+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:24.520111+0000","last_peered":"2024-04-19T02:16:24.520111+0000","last_clean":"2024-04-19T02:16:24.520111+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:24.520111+0000","last_undegraded":"2024-04-19T02:16:24.520111+0000","last_fullsized":"2024-04-19T02:16:24.520111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524330+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:24.524330+0000","last_peered":"2024-04-19T02:16:24.524330+0000","last_clean":"2024-04-19T02:16:24.524330+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:24.524330+0000","last_undegraded":"2024-04-19T02:16:24.524330+0000","last_fullsized":"2024-04-19T02:16:24.524330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521993+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:24.521993+0000","last_peered":"2024-04-19T02:16:24.521993+0000","last_clean":"2024-04-19T02:16:24.521993+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:24.521993+0000","last_undegraded":"2024-04-19T02:16:24.521993+0000","last_fullsized":"2024-04-19T02:16:24.521993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519561+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:24.519561+0000","last_peered":"2024-04-19T02:16:24.519561+0000","last_clean":"2024-04-19T02:16:24.519561+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:24.519561+0000","last_undegraded":"2024-04-19T02:16:24.519561+0000","last_fullsized":"2024-04-19T02:16:24.519561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523521+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:24.523521+0000","last_peered":"2024-04-19T02:16:24.523521+0000","last_clean":"2024-04-19T02:16:24.523521+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:24.523521+0000","last_undegraded":"2024-04-19T02:16:24.523521+0000","last_fullsized":"2024-04-19T02:16:24.523521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526425+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:24.526425+0000","last_peered":"2024-04-19T02:16:24.526425+0000","last_clean":"2024-04-19T02:16:24.526425+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:24.526425+0000","last_undegraded":"2024-04-19T02:16:24.526425+0000","last_fullsized":"2024-04-19T02:16:24.526425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527334+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:24.527334+0000","last_peered":"2024-04-19T02:16:24.527334+0000","last_clean":"2024-04-19T02:16:24.527334+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:24.527334+0000","last_undegraded":"2024-04-19T02:16:24.527334+0000","last_fullsized":"2024-04-19T02:16:24.527334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525176+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:24.525176+0000","last_peered":"2024-04-19T02:16:24.525176+0000","last_clean":"2024-04-19T02:16:24.525176+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:24.525176+0000","last_undegraded":"2024-04-19T02:16:24.525176+0000","last_fullsized":"2024-04-19T02:16:24.525176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513429+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:24.513429+0000","last_peered":"2024-04-19T02:16:24.513429+0000","last_clean":"2024-04-19T02:16:24.513429+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:24.513429+0000","last_undegraded":"2024-04-19T02:16:24.513429+0000","last_fullsized":"2024-04-19T02:16:24.513429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522053+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:24.522053+0000","last_peered":"2024-04-19T02:16:24.522053+0000","last_clean":"2024-04-19T02:16:24.522053+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:24.522053+0000","last_undegraded":"2024-04-19T02:16:24.522053+0000","last_fullsized":"2024-04-19T02:16:24.522053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512827+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:24.512827+0000","last_peered":"2024-04-19T02:16:24.512827+0000","last_clean":"2024-04-19T02:16:24.512827+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:24.512827+0000","last_undegraded":"2024-04-19T02:16:24.512827+0000","last_fullsized":"2024-04-19T02:16:24.512827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515064+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:24.515064+0000","last_peered":"2024-04-19T02:16:24.515064+0000","last_clean":"2024-04-19T02:16:24.515064+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:24.515064+0000","last_undegraded":"2024-04-19T02:16:24.515064+0000","last_fullsized":"2024-04-19T02:16:24.515064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518921+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:24.518921+0000","last_peered":"2024-04-19T02:16:24.518921+0000","last_clean":"2024-04-19T02:16:24.518921+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:24.518921+0000","last_undegraded":"2024-04-19T02:16:24.518921+0000","last_fullsized":"2024-04-19T02:16:24.518921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.530969+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.530969+0000","last_peered":"2024-04-19T02:16:24.530969+0000","last_clean":"2024-04-19T02:16:24.530969+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.530969+0000","last_undegraded":"2024-04-19T02:16:24.530969+0000","last_fullsized":"2024-04-19T02:16:24.530969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522746+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:24.522746+0000","last_peered":"2024-04-19T02:16:24.522746+0000","last_clean":"2024-04-19T02:16:24.522746+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:24.522746+0000","last_undegraded":"2024-04-19T02:16:24.522746+0000","last_fullsized":"2024-04-19T02:16:24.522746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488581+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.488581+0000","last_peered":"2024-04-19T02:16:24.488581+0000","last_clean":"2024-04-19T02:16:24.488581+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.488581+0000","last_undegraded":"2024-04-19T02:16:24.488581+0000","last_fullsized":"2024-04-19T02:16:24.488581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526731+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:24.526731+0000","last_peered":"2024-04-19T02:16:24.526731+0000","last_clean":"2024-04-19T02:16:24.526731+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:24.526731+0000","last_undegraded":"2024-04-19T02:16:24.526731+0000","last_fullsized":"2024-04-19T02:16:24.526731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495683+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.495683+0000","last_peered":"2024-04-19T02:16:24.495683+0000","last_clean":"2024-04-19T02:16:24.495683+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.495683+0000","last_undegraded":"2024-04-19T02:16:24.495683+0000","last_fullsized":"2024-04-19T02:16:24.495683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526825+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:24.526825+0000","last_peered":"2024-04-19T02:16:24.526825+0000","last_clean":"2024-04-19T02:16:24.526825+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:24.526825+0000","last_undegraded":"2024-04-19T02:16:24.526825+0000","last_fullsized":"2024-04-19T02:16:24.526825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.529809+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.529809+0000","last_peered":"2024-04-19T02:16:24.529809+0000","last_clean":"2024-04-19T02:16:24.529809+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.529809+0000","last_undegraded":"2024-04-19T02:16:24.529809+0000","last_fullsized":"2024-04-19T02:16:24.529809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.516091+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.516091+0000","last_peered":"2024-04-19T02:16:24.516091+0000","last_clean":"2024-04-19T02:16:24.516091+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.516091+0000","last_undegraded":"2024-04-19T02:16:24.516091+0000","last_fullsized":"2024-04-19T02:16:24.516091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524969+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:24.524969+0000","last_peered":"2024-04-19T02:16:24.524969+0000","last_clean":"2024-04-19T02:16:24.524969+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:24.524969+0000","last_undegraded":"2024-04-19T02:16:24.524969+0000","last_fullsized":"2024-04-19T02:16:24.524969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519660+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.519660+0000","last_peered":"2024-04-19T02:16:24.519660+0000","last_clean":"2024-04-19T02:16:24.519660+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.519660+0000","last_undegraded":"2024-04-19T02:16:24.519660+0000","last_fullsized":"2024-04-19T02:16:24.519660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519536+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:24.519536+0000","last_peered":"2024-04-19T02:16:24.519536+0000","last_clean":"2024-04-19T02:16:24.519536+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:24.519536+0000","last_undegraded":"2024-04-19T02:16:24.519536+0000","last_fullsized":"2024-04-19T02:16:24.519536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521517+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.521517+0000","last_peered":"2024-04-19T02:16:24.521517+0000","last_clean":"2024-04-19T02:16:24.521517+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.521517+0000","last_undegraded":"2024-04-19T02:16:24.521517+0000","last_fullsized":"2024-04-19T02:16:24.521517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.509240+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:24.509240+0000","last_peered":"2024-04-19T02:16:24.509240+0000","last_clean":"2024-04-19T02:16:24.509240+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:24.509240+0000","last_undegraded":"2024-04-19T02:16:24.509240+0000","last_fullsized":"2024-04-19T02:16:24.509240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498902+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.498902+0000","last_peered":"2024-04-19T02:16:24.498902+0000","last_clean":"2024-04-19T02:16:24.498902+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.498902+0000","last_undegraded":"2024-04-19T02:16:24.498902+0000","last_fullsized":"2024-04-19T02:16:24.498902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524255+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:24.524255+0000","last_peered":"2024-04-19T02:16:24.524255+0000","last_clean":"2024-04-19T02:16:24.524255+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:24.524255+0000","last_undegraded":"2024-04-19T02:16:24.524255+0000","last_fullsized":"2024-04-19T02:16:24.524255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523741+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.523741+0000","last_peered":"2024-04-19T02:16:24.523741+0000","last_clean":"2024-04-19T02:16:24.523741+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.523741+0000","last_undegraded":"2024-04-19T02:16:24.523741+0000","last_fullsized":"2024-04-19T02:16:24.523741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521748+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:24.521748+0000","last_peered":"2024-04-19T02:16:24.521748+0000","last_clean":"2024-04-19T02:16:24.521748+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:24.521748+0000","last_undegraded":"2024-04-19T02:16:24.521748+0000","last_fullsized":"2024-04-19T02:16:24.521748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491382+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.491382+0000","last_peered":"2024-04-19T02:16:24.491382+0000","last_clean":"2024-04-19T02:16:24.491382+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.491382+0000","last_undegraded":"2024-04-19T02:16:24.491382+0000","last_fullsized":"2024-04-19T02:16:24.491382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526992+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:24.526992+0000","last_peered":"2024-04-19T02:16:24.526992+0000","last_clean":"2024-04-19T02:16:24.526992+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:24.526992+0000","last_undegraded":"2024-04-19T02:16:24.526992+0000","last_fullsized":"2024-04-19T02:16:24.526992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495981+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.495981+0000","last_peered":"2024-04-19T02:16:24.495981+0000","last_clean":"2024-04-19T02:16:24.495981+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.495981+0000","last_undegraded":"2024-04-19T02:16:24.495981+0000","last_fullsized":"2024-04-19T02:16:24.495981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521669+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:24.521669+0000","last_peered":"2024-04-19T02:16:24.521669+0000","last_clean":"2024-04-19T02:16:24.521669+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:24.521669+0000","last_undegraded":"2024-04-19T02:16:24.521669+0000","last_fullsized":"2024-04-19T02:16:24.521669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490556+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.490556+0000","last_peered":"2024-04-19T02:16:24.490556+0000","last_clean":"2024-04-19T02:16:24.490556+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.490556+0000","last_undegraded":"2024-04-19T02:16:24.490556+0000","last_fullsized":"2024-04-19T02:16:24.490556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514902+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:24.514902+0000","last_peered":"2024-04-19T02:16:24.514902+0000","last_clean":"2024-04-19T02:16:24.514902+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:24.514902+0000","last_undegraded":"2024-04-19T02:16:24.514902+0000","last_fullsized":"2024-04-19T02:16:24.514902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493180+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:24.493180+0000","last_peered":"2024-04-19T02:16:24.493180+0000","last_clean":"2024-04-19T02:16:24.493180+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:24.493180+0000","last_undegraded":"2024-04-19T02:16:24.493180+0000","last_fullsized":"2024-04-19T02:16:24.493180+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.496022+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:24.496022+0000","last_peered":"2024-04-19T02:16:24.496022+0000","last_clean":"2024-04-19T02:16:24.496022+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:24.496022+0000","last_undegraded":"2024-04-19T02:16:24.496022+0000","last_fullsized":"2024-04-19T02:16:24.496022+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488896+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.488896+0000","last_peered":"2024-04-19T02:16:24.488896+0000","last_clean":"2024-04-19T02:16:24.488896+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.488896+0000","last_undegraded":"2024-04-19T02:16:24.488896+0000","last_fullsized":"2024-04-19T02:16:24.488896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527437+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:24.527437+0000","last_peered":"2024-04-19T02:16:24.527437+0000","last_clean":"2024-04-19T02:16:24.527437+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:24.527437+0000","last_undegraded":"2024-04-19T02:16:24.527437+0000","last_fullsized":"2024-04-19T02:16:24.527437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493324+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:24.493324+0000","last_peered":"2024-04-19T02:16:24.493324+0000","last_clean":"2024-04-19T02:16:24.493324+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:24.493324+0000","last_undegraded":"2024-04-19T02:16:24.493324+0000","last_fullsized":"2024-04-19T02:16:24.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490067+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.490067+0000","last_peered":"2024-04-19T02:16:24.490067+0000","last_clean":"2024-04-19T02:16:24.490067+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.490067+0000","last_undegraded":"2024-04-19T02:16:24.490067+0000","last_fullsized":"2024-04-19T02:16:24.490067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518949+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:24.518949+0000","last_peered":"2024-04-19T02:16:24.518949+0000","last_clean":"2024-04-19T02:16:24.518949+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:24.518949+0000","last_undegraded":"2024-04-19T02:16:24.518949+0000","last_fullsized":"2024-04-19T02:16:24.518949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490281+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:24.490281+0000","last_peered":"2024-04-19T02:16:24.490281+0000","last_clean":"2024-04-19T02:16:24.490281+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:24.490281+0000","last_undegraded":"2024-04-19T02:16:24.490281+0000","last_fullsized":"2024-04-19T02:16:24.490281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490834+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.490834+0000","last_peered":"2024-04-19T02:16:24.490834+0000","last_clean":"2024-04-19T02:16:24.490834+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.490834+0000","last_undegraded":"2024-04-19T02:16:24.490834+0000","last_fullsized":"2024-04-19T02:16:24.490834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514947+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:24.514947+0000","last_peered":"2024-04-19T02:16:24.514947+0000","last_clean":"2024-04-19T02:16:24.514947+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:24.514947+0000","last_undegraded":"2024-04-19T02:16:24.514947+0000","last_fullsized":"2024-04-19T02:16:24.514947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491655+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:24.491655+0000","last_peered":"2024-04-19T02:16:24.491655+0000","last_clean":"2024-04-19T02:16:24.491655+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:24.491655+0000","last_undegraded":"2024-04-19T02:16:24.491655+0000","last_fullsized":"2024-04-19T02:16:24.491655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495064+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.495064+0000","last_peered":"2024-04-19T02:16:24.495064+0000","last_clean":"2024-04-19T02:16:24.495064+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.495064+0000","last_undegraded":"2024-04-19T02:16:24.495064+0000","last_fullsized":"2024-04-19T02:16:24.495064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513571+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:24.513571+0000","last_peered":"2024-04-19T02:16:24.513571+0000","last_clean":"2024-04-19T02:16:24.513571+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:24.513571+0000","last_undegraded":"2024-04-19T02:16:24.513571+0000","last_fullsized":"2024-04-19T02:16:24.513571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.500388+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.500388+0000","last_peered":"2024-04-19T02:16:24.500388+0000","last_clean":"2024-04-19T02:16:24.500388+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.500388+0000","last_undegraded":"2024-04-19T02:16:24.500388+0000","last_fullsized":"2024-04-19T02:16:24.500388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488762+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:24.488762+0000","last_peered":"2024-04-19T02:16:24.488762+0000","last_clean":"2024-04-19T02:16:24.488762+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:24.488762+0000","last_undegraded":"2024-04-19T02:16:24.488762+0000","last_fullsized":"2024-04-19T02:16:24.488762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522145+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:24.522145+0000","last_peered":"2024-04-19T02:16:24.522145+0000","last_clean":"2024-04-19T02:16:24.522145+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:24.522145+0000","last_undegraded":"2024-04-19T02:16:24.522145+0000","last_fullsized":"2024-04-19T02:16:24.522145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488841+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.488841+0000","last_peered":"2024-04-19T02:16:24.488841+0000","last_clean":"2024-04-19T02:16:24.488841+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.488841+0000","last_undegraded":"2024-04-19T02:16:24.488841+0000","last_fullsized":"2024-04-19T02:16:24.488841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498940+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:24.498940+0000","last_peered":"2024-04-19T02:16:24.498940+0000","last_clean":"2024-04-19T02:16:24.498940+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:24.498940+0000","last_undegraded":"2024-04-19T02:16:24.498940+0000","last_fullsized":"2024-04-19T02:16:24.498940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525050+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:24.525050+0000","last_peered":"2024-04-19T02:16:24.525050+0000","last_clean":"2024-04-19T02:16:24.525050+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:24.525050+0000","last_undegraded":"2024-04-19T02:16:24.525050+0000","last_fullsized":"2024-04-19T02:16:24.525050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513005+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.513005+0000","last_peered":"2024-04-19T02:16:24.513005+0000","last_clean":"2024-04-19T02:16:24.513005+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.513005+0000","last_undegraded":"2024-04-19T02:16:24.513005+0000","last_fullsized":"2024-04-19T02:16:24.513005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491847+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:24.491847+0000","last_peered":"2024-04-19T02:16:24.491847+0000","last_clean":"2024-04-19T02:16:24.491847+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:24.491847+0000","last_undegraded":"2024-04-19T02:16:24.491847+0000","last_fullsized":"2024-04-19T02:16:24.491847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526485+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:24.526485+0000","last_peered":"2024-04-19T02:16:24.526485+0000","last_clean":"2024-04-19T02:16:24.526485+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:24.526485+0000","last_undegraded":"2024-04-19T02:16:24.526485+0000","last_fullsized":"2024-04-19T02:16:24.526485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:16:28.399827+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:28.399827+0000","last_peered":"2024-04-19T02:16:28.399827+0000","last_clean":"2024-04-19T02:16:28.399827+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:28.399827+0000","last_undegraded":"2024-04-19T02:16:28.399827+0000","last_fullsized":"2024-04-19T02:16:28.399827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491493+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:24.491493+0000","last_peered":"2024-04-19T02:16:24.491493+0000","last_clean":"2024-04-19T02:16:24.491493+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:24.491493+0000","last_undegraded":"2024-04-19T02:16:24.491493+0000","last_fullsized":"2024-04-19T02:16:24.491493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522177+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:24.522177+0000","last_peered":"2024-04-19T02:16:24.522177+0000","last_clean":"2024-04-19T02:16:24.522177+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:24.522177+0000","last_undegraded":"2024-04-19T02:16:24.522177+0000","last_fullsized":"2024-04-19T02:16:24.522177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521806+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:24.521806+0000","last_peered":"2024-04-19T02:16:24.521806+0000","last_clean":"2024-04-19T02:16:24.521806+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:24.521806+0000","last_undegraded":"2024-04-19T02:16:24.521806+0000","last_fullsized":"2024-04-19T02:16:24.521806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.533109+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.533109+0000","last_peered":"2024-04-19T02:16:24.533109+0000","last_clean":"2024-04-19T02:16:24.533109+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.533109+0000","last_undegraded":"2024-04-19T02:16:24.533109+0000","last_fullsized":"2024-04-19T02:16:24.533109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514198+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:24.514198+0000","last_peered":"2024-04-19T02:16:24.514198+0000","last_clean":"2024-04-19T02:16:24.514198+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:24.514198+0000","last_undegraded":"2024-04-19T02:16:24.514198+0000","last_fullsized":"2024-04-19T02:16:24.514198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524105+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.524105+0000","last_peered":"2024-04-19T02:16:24.524105+0000","last_clean":"2024-04-19T02:16:24.524105+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.524105+0000","last_undegraded":"2024-04-19T02:16:24.524105+0000","last_fullsized":"2024-04-19T02:16:24.524105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.491469+0000","last_peered":"2024-04-19T02:16:24.491469+0000","last_clean":"2024-04-19T02:16:24.491469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.491469+0000","last_undegraded":"2024-04-19T02:16:24.491469+0000","last_fullsized":"2024-04-19T02:16:24.491469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521373+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:24.521373+0000","last_peered":"2024-04-19T02:16:24.521373+0000","last_clean":"2024-04-19T02:16:24.521373+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:24.521373+0000","last_undegraded":"2024-04-19T02:16:24.521373+0000","last_fullsized":"2024-04-19T02:16:24.521373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.492272+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.492272+0000","last_peered":"2024-04-19T02:16:24.492272+0000","last_clean":"2024-04-19T02:16:24.492272+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.492272+0000","last_undegraded":"2024-04-19T02:16:24.492272+0000","last_fullsized":"2024-04-19T02:16:24.492272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512722+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:24.512722+0000","last_peered":"2024-04-19T02:16:24.512722+0000","last_clean":"2024-04-19T02:16:24.512722+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:24.512722+0000","last_undegraded":"2024-04-19T02:16:24.512722+0000","last_fullsized":"2024-04-19T02:16:24.512722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522303+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:24.522303+0000","last_peered":"2024-04-19T02:16:24.522303+0000","last_clean":"2024-04-19T02:16:24.522303+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:24.522303+0000","last_undegraded":"2024-04-19T02:16:24.522303+0000","last_fullsized":"2024-04-19T02:16:24.522303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488585+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.488585+0000","last_peered":"2024-04-19T02:16:24.488585+0000","last_clean":"2024-04-19T02:16:24.488585+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.488585+0000","last_undegraded":"2024-04-19T02:16:24.488585+0000","last_fullsized":"2024-04-19T02:16:24.488585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.503371+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:24.503371+0000","last_peered":"2024-04-19T02:16:24.503371+0000","last_clean":"2024-04-19T02:16:24.503371+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:24.503371+0000","last_undegraded":"2024-04-19T02:16:24.503371+0000","last_fullsized":"2024-04-19T02:16:24.503371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490145+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.490145+0000","last_peered":"2024-04-19T02:16:24.490145+0000","last_clean":"2024-04-19T02:16:24.490145+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.490145+0000","last_undegraded":"2024-04-19T02:16:24.490145+0000","last_fullsized":"2024-04-19T02:16:24.490145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526148+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:24.526148+0000","last_peered":"2024-04-19T02:16:24.526148+0000","last_clean":"2024-04-19T02:16:24.526148+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:24.526148+0000","last_undegraded":"2024-04-19T02:16:24.526148+0000","last_fullsized":"2024-04-19T02:16:24.526148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514216+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.514216+0000","last_peered":"2024-04-19T02:16:24.514216+0000","last_clean":"2024-04-19T02:16:24.514216+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.514216+0000","last_undegraded":"2024-04-19T02:16:24.514216+0000","last_fullsized":"2024-04-19T02:16:24.514216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521760+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:24.521760+0000","last_peered":"2024-04-19T02:16:24.521760+0000","last_clean":"2024-04-19T02:16:24.521760+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:24.521760+0000","last_undegraded":"2024-04-19T02:16:24.521760+0000","last_fullsized":"2024-04-19T02:16:24.521760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520388+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.520388+0000","last_peered":"2024-04-19T02:16:24.520388+0000","last_clean":"2024-04-19T02:16:24.520388+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.520388+0000","last_undegraded":"2024-04-19T02:16:24.520388+0000","last_fullsized":"2024-04-19T02:16:24.520388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514797+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:24.514797+0000","last_peered":"2024-04-19T02:16:24.514797+0000","last_clean":"2024-04-19T02:16:24.514797+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:24.514797+0000","last_undegraded":"2024-04-19T02:16:24.514797+0000","last_fullsized":"2024-04-19T02:16:24.514797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.531294+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.531294+0000","last_peered":"2024-04-19T02:16:24.531294+0000","last_clean":"2024-04-19T02:16:24.531294+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.531294+0000","last_undegraded":"2024-04-19T02:16:24.531294+0000","last_fullsized":"2024-04-19T02:16:24.531294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.511560+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:24.511560+0000","last_peered":"2024-04-19T02:16:24.511560+0000","last_clean":"2024-04-19T02:16:24.511560+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:24.511560+0000","last_undegraded":"2024-04-19T02:16:24.511560+0000","last_fullsized":"2024-04-19T02:16:24.511560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523814+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.523814+0000","last_peered":"2024-04-19T02:16:24.523814+0000","last_clean":"2024-04-19T02:16:24.523814+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.523814+0000","last_undegraded":"2024-04-19T02:16:24.523814+0000","last_fullsized":"2024-04-19T02:16:24.523814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519363+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:24.519363+0000","last_peered":"2024-04-19T02:16:24.519363+0000","last_clean":"2024-04-19T02:16:24.519363+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:24.519363+0000","last_undegraded":"2024-04-19T02:16:24.519363+0000","last_fullsized":"2024-04-19T02:16:24.519363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.510268+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.510268+0000","last_peered":"2024-04-19T02:16:24.510268+0000","last_clean":"2024-04-19T02:16:24.510268+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.510268+0000","last_undegraded":"2024-04-19T02:16:24.510268+0000","last_fullsized":"2024-04-19T02:16:24.510268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515136+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:24.515136+0000","last_peered":"2024-04-19T02:16:24.515136+0000","last_clean":"2024-04-19T02:16:24.515136+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:24.515136+0000","last_undegraded":"2024-04-19T02:16:24.515136+0000","last_fullsized":"2024-04-19T02:16:24.515136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523813+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.523813+0000","last_peered":"2024-04-19T02:16:24.523813+0000","last_clean":"2024-04-19T02:16:24.523813+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.523813+0000","last_undegraded":"2024-04-19T02:16:24.523813+0000","last_fullsized":"2024-04-19T02:16:24.523813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:35.799 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T02:16:35.799 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-19T02:16:35.799 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-19T02:16:35.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-19T02:16:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:36.162 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-19T02:16:36.180 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-19T02:16:36.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:36.478 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:25.482999+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:36.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:16:36.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-19T02:16:36.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:16:37.094 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-19T02:16:37.113 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T02:16:37.408 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-19T02:16:37.425 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T02:16:37.707 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-19T02:16:37.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:16:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:38.031 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:16:24.477273+0000","modified":"2024-04-19T02:16:26.492157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4198":{"gid":4198,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/684726418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":684726418},{"type":"v1","addr":"172.21.15.73:6803","nonce":684726418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:16:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-19T02:16:38.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:38.337 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:38.338 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:25.482999+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:38.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:16:38.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:16:38.638 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-19T02:16:38.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:16:38.946 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-19T02:16:38.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T02:16:39.281 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-19T02:16:39.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T02:16:39.586 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-19T02:16:39.605 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:16:24.477273+0000","modified":"2024-04-19T02:16:26.492157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4198":{"gid":4198,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/684726418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":684726418},{"type":"v1","addr":"172.21.15.73:6803","nonce":684726418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-19T02:16:39.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:16:40.209 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:40.209 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:16:25.482999+0000","last_up_change":"2024-04-19T02:16:13.982256+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:16:40.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:16:40.527 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:40.527 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:16:24.477273+0000","modified":"2024-04-19T02:16:26.492157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4198":{"gid":4198,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/684726418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":684726418},{"type":"v1","addr":"172.21.15.73:6803","nonce":684726418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:16:40.528 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-19T02:16:40.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-19T02:16:24.477273+0000', 'modified': '2024-04-19T02:16:26.492157+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4198': {'gid': 4198, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6803/684726418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 684726418}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 684726418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-19T02:16:40.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-19T02:16:40.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-19T02:16:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-19T02:16:40.780+0000 7f69abfff640 0 client.4489 ms_handle_reset on v2:172.21.15.73:6802/684726418 2024-04-19T02:16:40.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-19T02:16:40.800+0000 7f69abfff640 0 client.4644 ms_handle_reset on v2:172.21.15.73:6802/684726418 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "30a6d986-f196-4d3c-8512-6c6489722f8f", 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4198, 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 16.319359344999999, 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 5, 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 18, 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 18, 2024-04-19T02:16:40.800 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 20.613127856999998 2024-04-19T02:16:40.801 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:16:40.815 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-19T02:16:40.826 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-19T02:16:40.826 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T02:16:40.826 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-19T02:16:40.826 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-19T02:16:40.827 DEBUG:teuthology.orchestra.run.smithi073:> sync 2024-04-19T02:16:41.103 DEBUG:teuthology.orchestra.run.smithi116:> sync 2024-04-19T02:16:41.172 DEBUG:teuthology.orchestra.run.smithi136:> sync 2024-04-19T02:16:41.317 DEBUG:teuthology.orchestra.run.smithi169:> sync 2024-04-19T02:16:41.533 DEBUG:tasks.thrashosds:checking console status of smithi073 2024-04-19T02:16:41.533 DEBUG:teuthology.orchestra.console.smithi073:Waiting for login prompt 2024-04-19T02:16:41.534 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi073 2024-04-19T02:16:41.623 DEBUG:teuthology.orchestra.console.smithi073:expect before: [Enter `^Ec?' for help] 2024-04-19T02:16:41.623 DEBUG:teuthology.orchestra.console.smithi073:expect after: smithi073 login: 2024-04-19T02:16:41.675 DEBUG:teuthology.orchestra.console.smithi073:console disconnect output: [Enter `^Ec?' for help] smithi073 login: [disconnect] 2024-04-19T02:16:41.776 DEBUG:tasks.thrashosds:checking console status of smithi116 2024-04-19T02:16:41.776 DEBUG:teuthology.orchestra.console.smithi116:Waiting for login prompt 2024-04-19T02:16:41.776 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi116 2024-04-19T02:16:41.901 DEBUG:teuthology.orchestra.console.smithi116:expect before: [Enter `^Ec?' for help] 2024-04-19T02:16:41.902 DEBUG:teuthology.orchestra.console.smithi116:expect after: smithi116 login: 2024-04-19T02:16:41.954 DEBUG:teuthology.orchestra.console.smithi116:console disconnect output: [Enter `^Ec?' for help] smithi116 login: [disconnect] 2024-04-19T02:16:42.055 DEBUG:tasks.thrashosds:checking console status of smithi136 2024-04-19T02:16:42.055 DEBUG:teuthology.orchestra.console.smithi136:Waiting for login prompt 2024-04-19T02:16:42.055 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi136 2024-04-19T02:16:42.132 DEBUG:teuthology.orchestra.console.smithi136:expect before: [Enter `^Ec?' for help] 2024-04-19T02:16:42.132 DEBUG:teuthology.orchestra.console.smithi136:expect after: smithi136 login: 2024-04-19T02:16:42.184 DEBUG:teuthology.orchestra.console.smithi136:console disconnect output: [Enter `^Ec?' for help] smithi136 login: [disconnect] 2024-04-19T02:16:42.285 DEBUG:tasks.thrashosds:checking console status of smithi169 2024-04-19T02:16:42.285 DEBUG:teuthology.orchestra.console.smithi169:Waiting for login prompt 2024-04-19T02:16:42.285 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi169 2024-04-19T02:16:42.369 DEBUG:teuthology.orchestra.console.smithi169:expect before: [Enter `^Ec?' for help] 2024-04-19T02:16:42.369 DEBUG:teuthology.orchestra.console.smithi169:expect after: smithi169 login: 2024-04-19T02:16:42.422 DEBUG:teuthology.orchestra.console.smithi169:console disconnect output: [Enter `^Ec?' for help] smithi169 login: [disconnect] 2024-04-19T02:16:42.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-19T02:16:42.854 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-19T02:16:42.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T02:16:42.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:43.160 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:43.179 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-19T02:16:42.178022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89900,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025620,"statfs":{"total":289910292480,"available":289818234880,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004276"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521326+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:24.521326+0000","last_peered":"2024-04-19T02:16:24.521326+0000","last_clean":"2024-04-19T02:16:24.521326+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:24.521326+0000","last_undegraded":"2024-04-19T02:16:24.521326+0000","last_fullsized":"2024-04-19T02:16:24.521326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519236+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:24.519236+0000","last_peered":"2024-04-19T02:16:24.519236+0000","last_clean":"2024-04-19T02:16:24.519236+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:24.519236+0000","last_undegraded":"2024-04-19T02:16:24.519236+0000","last_fullsized":"2024-04-19T02:16:24.519236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527393+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:24.527393+0000","last_peered":"2024-04-19T02:16:24.527393+0000","last_clean":"2024-04-19T02:16:24.527393+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:24.527393+0000","last_undegraded":"2024-04-19T02:16:24.527393+0000","last_fullsized":"2024-04-19T02:16:24.527393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521797+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:24.521797+0000","last_peered":"2024-04-19T02:16:24.521797+0000","last_clean":"2024-04-19T02:16:24.521797+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:24.521797+0000","last_undegraded":"2024-04-19T02:16:24.521797+0000","last_fullsized":"2024-04-19T02:16:24.521797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518437+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:24.518437+0000","last_peered":"2024-04-19T02:16:24.518437+0000","last_clean":"2024-04-19T02:16:24.518437+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:24.518437+0000","last_undegraded":"2024-04-19T02:16:24.518437+0000","last_fullsized":"2024-04-19T02:16:24.518437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519225+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:24.519225+0000","last_peered":"2024-04-19T02:16:24.519225+0000","last_clean":"2024-04-19T02:16:24.519225+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:24.519225+0000","last_undegraded":"2024-04-19T02:16:24.519225+0000","last_fullsized":"2024-04-19T02:16:24.519225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518975+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:24.518975+0000","last_peered":"2024-04-19T02:16:24.518975+0000","last_clean":"2024-04-19T02:16:24.518975+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:24.518975+0000","last_undegraded":"2024-04-19T02:16:24.518975+0000","last_fullsized":"2024-04-19T02:16:24.518975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519248+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:24.519248+0000","last_peered":"2024-04-19T02:16:24.519248+0000","last_clean":"2024-04-19T02:16:24.519248+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:24.519248+0000","last_undegraded":"2024-04-19T02:16:24.519248+0000","last_fullsized":"2024-04-19T02:16:24.519248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513937+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:24.513937+0000","last_peered":"2024-04-19T02:16:24.513937+0000","last_clean":"2024-04-19T02:16:24.513937+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:24.513937+0000","last_undegraded":"2024-04-19T02:16:24.513937+0000","last_fullsized":"2024-04-19T02:16:24.513937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521455+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:24.521455+0000","last_peered":"2024-04-19T02:16:24.521455+0000","last_clean":"2024-04-19T02:16:24.521455+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:24.521455+0000","last_undegraded":"2024-04-19T02:16:24.521455+0000","last_fullsized":"2024-04-19T02:16:24.521455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521791+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:24.521791+0000","last_peered":"2024-04-19T02:16:24.521791+0000","last_clean":"2024-04-19T02:16:24.521791+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:24.521791+0000","last_undegraded":"2024-04-19T02:16:24.521791+0000","last_fullsized":"2024-04-19T02:16:24.521791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525459+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:24.525459+0000","last_peered":"2024-04-19T02:16:24.525459+0000","last_clean":"2024-04-19T02:16:24.525459+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:24.525459+0000","last_undegraded":"2024-04-19T02:16:24.525459+0000","last_fullsized":"2024-04-19T02:16:24.525459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519126+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:24.519126+0000","last_peered":"2024-04-19T02:16:24.519126+0000","last_clean":"2024-04-19T02:16:24.519126+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:24.519126+0000","last_undegraded":"2024-04-19T02:16:24.519126+0000","last_fullsized":"2024-04-19T02:16:24.519126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520744+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:24.520744+0000","last_peered":"2024-04-19T02:16:24.520744+0000","last_clean":"2024-04-19T02:16:24.520744+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:24.520744+0000","last_undegraded":"2024-04-19T02:16:24.520744+0000","last_fullsized":"2024-04-19T02:16:24.520744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520230+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:24.520230+0000","last_peered":"2024-04-19T02:16:24.520230+0000","last_clean":"2024-04-19T02:16:24.520230+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:24.520230+0000","last_undegraded":"2024-04-19T02:16:24.520230+0000","last_fullsized":"2024-04-19T02:16:24.520230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520060+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:24.520060+0000","last_peered":"2024-04-19T02:16:24.520060+0000","last_clean":"2024-04-19T02:16:24.520060+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:24.520060+0000","last_undegraded":"2024-04-19T02:16:24.520060+0000","last_fullsized":"2024-04-19T02:16:24.520060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514988+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:24.514988+0000","last_peered":"2024-04-19T02:16:24.514988+0000","last_clean":"2024-04-19T02:16:24.514988+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:24.514988+0000","last_undegraded":"2024-04-19T02:16:24.514988+0000","last_fullsized":"2024-04-19T02:16:24.514988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519056+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:24.519056+0000","last_peered":"2024-04-19T02:16:24.519056+0000","last_clean":"2024-04-19T02:16:24.519056+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:24.519056+0000","last_undegraded":"2024-04-19T02:16:24.519056+0000","last_fullsized":"2024-04-19T02:16:24.519056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514210+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:24.514210+0000","last_peered":"2024-04-19T02:16:24.514210+0000","last_clean":"2024-04-19T02:16:24.514210+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:24.514210+0000","last_undegraded":"2024-04-19T02:16:24.514210+0000","last_fullsized":"2024-04-19T02:16:24.514210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521557+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:24.521557+0000","last_peered":"2024-04-19T02:16:24.521557+0000","last_clean":"2024-04-19T02:16:24.521557+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:24.521557+0000","last_undegraded":"2024-04-19T02:16:24.521557+0000","last_fullsized":"2024-04-19T02:16:24.521557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520111+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:24.520111+0000","last_peered":"2024-04-19T02:16:24.520111+0000","last_clean":"2024-04-19T02:16:24.520111+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:24.520111+0000","last_undegraded":"2024-04-19T02:16:24.520111+0000","last_fullsized":"2024-04-19T02:16:24.520111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524330+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:24.524330+0000","last_peered":"2024-04-19T02:16:24.524330+0000","last_clean":"2024-04-19T02:16:24.524330+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:24.524330+0000","last_undegraded":"2024-04-19T02:16:24.524330+0000","last_fullsized":"2024-04-19T02:16:24.524330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521993+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:24.521993+0000","last_peered":"2024-04-19T02:16:24.521993+0000","last_clean":"2024-04-19T02:16:24.521993+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:24.521993+0000","last_undegraded":"2024-04-19T02:16:24.521993+0000","last_fullsized":"2024-04-19T02:16:24.521993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519561+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:24.519561+0000","last_peered":"2024-04-19T02:16:24.519561+0000","last_clean":"2024-04-19T02:16:24.519561+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:24.519561+0000","last_undegraded":"2024-04-19T02:16:24.519561+0000","last_fullsized":"2024-04-19T02:16:24.519561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523521+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:24.523521+0000","last_peered":"2024-04-19T02:16:24.523521+0000","last_clean":"2024-04-19T02:16:24.523521+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:24.523521+0000","last_undegraded":"2024-04-19T02:16:24.523521+0000","last_fullsized":"2024-04-19T02:16:24.523521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526425+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:24.526425+0000","last_peered":"2024-04-19T02:16:24.526425+0000","last_clean":"2024-04-19T02:16:24.526425+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:24.526425+0000","last_undegraded":"2024-04-19T02:16:24.526425+0000","last_fullsized":"2024-04-19T02:16:24.526425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527334+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:24.527334+0000","last_peered":"2024-04-19T02:16:24.527334+0000","last_clean":"2024-04-19T02:16:24.527334+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:24.527334+0000","last_undegraded":"2024-04-19T02:16:24.527334+0000","last_fullsized":"2024-04-19T02:16:24.527334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525176+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:24.525176+0000","last_peered":"2024-04-19T02:16:24.525176+0000","last_clean":"2024-04-19T02:16:24.525176+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:24.525176+0000","last_undegraded":"2024-04-19T02:16:24.525176+0000","last_fullsized":"2024-04-19T02:16:24.525176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513429+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:24.513429+0000","last_peered":"2024-04-19T02:16:24.513429+0000","last_clean":"2024-04-19T02:16:24.513429+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:24.513429+0000","last_undegraded":"2024-04-19T02:16:24.513429+0000","last_fullsized":"2024-04-19T02:16:24.513429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522053+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:24.522053+0000","last_peered":"2024-04-19T02:16:24.522053+0000","last_clean":"2024-04-19T02:16:24.522053+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:24.522053+0000","last_undegraded":"2024-04-19T02:16:24.522053+0000","last_fullsized":"2024-04-19T02:16:24.522053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512827+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:24.512827+0000","last_peered":"2024-04-19T02:16:24.512827+0000","last_clean":"2024-04-19T02:16:24.512827+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:24.512827+0000","last_undegraded":"2024-04-19T02:16:24.512827+0000","last_fullsized":"2024-04-19T02:16:24.512827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515064+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:24.515064+0000","last_peered":"2024-04-19T02:16:24.515064+0000","last_clean":"2024-04-19T02:16:24.515064+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:24.515064+0000","last_undegraded":"2024-04-19T02:16:24.515064+0000","last_fullsized":"2024-04-19T02:16:24.515064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518921+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:24.518921+0000","last_peered":"2024-04-19T02:16:24.518921+0000","last_clean":"2024-04-19T02:16:24.518921+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:24.518921+0000","last_undegraded":"2024-04-19T02:16:24.518921+0000","last_fullsized":"2024-04-19T02:16:24.518921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.530969+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.530969+0000","last_peered":"2024-04-19T02:16:24.530969+0000","last_clean":"2024-04-19T02:16:24.530969+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.530969+0000","last_undegraded":"2024-04-19T02:16:24.530969+0000","last_fullsized":"2024-04-19T02:16:24.530969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522746+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:24.522746+0000","last_peered":"2024-04-19T02:16:24.522746+0000","last_clean":"2024-04-19T02:16:24.522746+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:24.522746+0000","last_undegraded":"2024-04-19T02:16:24.522746+0000","last_fullsized":"2024-04-19T02:16:24.522746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488581+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.488581+0000","last_peered":"2024-04-19T02:16:24.488581+0000","last_clean":"2024-04-19T02:16:24.488581+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.488581+0000","last_undegraded":"2024-04-19T02:16:24.488581+0000","last_fullsized":"2024-04-19T02:16:24.488581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526731+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:24.526731+0000","last_peered":"2024-04-19T02:16:24.526731+0000","last_clean":"2024-04-19T02:16:24.526731+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:24.526731+0000","last_undegraded":"2024-04-19T02:16:24.526731+0000","last_fullsized":"2024-04-19T02:16:24.526731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495683+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.495683+0000","last_peered":"2024-04-19T02:16:24.495683+0000","last_clean":"2024-04-19T02:16:24.495683+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.495683+0000","last_undegraded":"2024-04-19T02:16:24.495683+0000","last_fullsized":"2024-04-19T02:16:24.495683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526825+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:24.526825+0000","last_peered":"2024-04-19T02:16:24.526825+0000","last_clean":"2024-04-19T02:16:24.526825+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:24.526825+0000","last_undegraded":"2024-04-19T02:16:24.526825+0000","last_fullsized":"2024-04-19T02:16:24.526825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.529809+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.529809+0000","last_peered":"2024-04-19T02:16:24.529809+0000","last_clean":"2024-04-19T02:16:24.529809+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.529809+0000","last_undegraded":"2024-04-19T02:16:24.529809+0000","last_fullsized":"2024-04-19T02:16:24.529809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.516091+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.516091+0000","last_peered":"2024-04-19T02:16:24.516091+0000","last_clean":"2024-04-19T02:16:24.516091+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.516091+0000","last_undegraded":"2024-04-19T02:16:24.516091+0000","last_fullsized":"2024-04-19T02:16:24.516091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524969+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:24.524969+0000","last_peered":"2024-04-19T02:16:24.524969+0000","last_clean":"2024-04-19T02:16:24.524969+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:24.524969+0000","last_undegraded":"2024-04-19T02:16:24.524969+0000","last_fullsized":"2024-04-19T02:16:24.524969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519660+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.519660+0000","last_peered":"2024-04-19T02:16:24.519660+0000","last_clean":"2024-04-19T02:16:24.519660+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.519660+0000","last_undegraded":"2024-04-19T02:16:24.519660+0000","last_fullsized":"2024-04-19T02:16:24.519660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519536+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:24.519536+0000","last_peered":"2024-04-19T02:16:24.519536+0000","last_clean":"2024-04-19T02:16:24.519536+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:24.519536+0000","last_undegraded":"2024-04-19T02:16:24.519536+0000","last_fullsized":"2024-04-19T02:16:24.519536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521517+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.521517+0000","last_peered":"2024-04-19T02:16:24.521517+0000","last_clean":"2024-04-19T02:16:24.521517+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.521517+0000","last_undegraded":"2024-04-19T02:16:24.521517+0000","last_fullsized":"2024-04-19T02:16:24.521517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.509240+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:24.509240+0000","last_peered":"2024-04-19T02:16:24.509240+0000","last_clean":"2024-04-19T02:16:24.509240+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:24.509240+0000","last_undegraded":"2024-04-19T02:16:24.509240+0000","last_fullsized":"2024-04-19T02:16:24.509240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498902+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.498902+0000","last_peered":"2024-04-19T02:16:24.498902+0000","last_clean":"2024-04-19T02:16:24.498902+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.498902+0000","last_undegraded":"2024-04-19T02:16:24.498902+0000","last_fullsized":"2024-04-19T02:16:24.498902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524255+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:24.524255+0000","last_peered":"2024-04-19T02:16:24.524255+0000","last_clean":"2024-04-19T02:16:24.524255+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:24.524255+0000","last_undegraded":"2024-04-19T02:16:24.524255+0000","last_fullsized":"2024-04-19T02:16:24.524255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523741+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.523741+0000","last_peered":"2024-04-19T02:16:24.523741+0000","last_clean":"2024-04-19T02:16:24.523741+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.523741+0000","last_undegraded":"2024-04-19T02:16:24.523741+0000","last_fullsized":"2024-04-19T02:16:24.523741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521748+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:24.521748+0000","last_peered":"2024-04-19T02:16:24.521748+0000","last_clean":"2024-04-19T02:16:24.521748+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:24.521748+0000","last_undegraded":"2024-04-19T02:16:24.521748+0000","last_fullsized":"2024-04-19T02:16:24.521748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491382+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.491382+0000","last_peered":"2024-04-19T02:16:24.491382+0000","last_clean":"2024-04-19T02:16:24.491382+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.491382+0000","last_undegraded":"2024-04-19T02:16:24.491382+0000","last_fullsized":"2024-04-19T02:16:24.491382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526992+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:24.526992+0000","last_peered":"2024-04-19T02:16:24.526992+0000","last_clean":"2024-04-19T02:16:24.526992+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:24.526992+0000","last_undegraded":"2024-04-19T02:16:24.526992+0000","last_fullsized":"2024-04-19T02:16:24.526992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495981+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.495981+0000","last_peered":"2024-04-19T02:16:24.495981+0000","last_clean":"2024-04-19T02:16:24.495981+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.495981+0000","last_undegraded":"2024-04-19T02:16:24.495981+0000","last_fullsized":"2024-04-19T02:16:24.495981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521669+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:24.521669+0000","last_peered":"2024-04-19T02:16:24.521669+0000","last_clean":"2024-04-19T02:16:24.521669+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:24.521669+0000","last_undegraded":"2024-04-19T02:16:24.521669+0000","last_fullsized":"2024-04-19T02:16:24.521669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490556+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.490556+0000","last_peered":"2024-04-19T02:16:24.490556+0000","last_clean":"2024-04-19T02:16:24.490556+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.490556+0000","last_undegraded":"2024-04-19T02:16:24.490556+0000","last_fullsized":"2024-04-19T02:16:24.490556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514902+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:24.514902+0000","last_peered":"2024-04-19T02:16:24.514902+0000","last_clean":"2024-04-19T02:16:24.514902+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:24.514902+0000","last_undegraded":"2024-04-19T02:16:24.514902+0000","last_fullsized":"2024-04-19T02:16:24.514902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493180+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:24.493180+0000","last_peered":"2024-04-19T02:16:24.493180+0000","last_clean":"2024-04-19T02:16:24.493180+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:24.493180+0000","last_undegraded":"2024-04-19T02:16:24.493180+0000","last_fullsized":"2024-04-19T02:16:24.493180+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.496022+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:24.496022+0000","last_peered":"2024-04-19T02:16:24.496022+0000","last_clean":"2024-04-19T02:16:24.496022+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:24.496022+0000","last_undegraded":"2024-04-19T02:16:24.496022+0000","last_fullsized":"2024-04-19T02:16:24.496022+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488896+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.488896+0000","last_peered":"2024-04-19T02:16:24.488896+0000","last_clean":"2024-04-19T02:16:24.488896+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.488896+0000","last_undegraded":"2024-04-19T02:16:24.488896+0000","last_fullsized":"2024-04-19T02:16:24.488896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527437+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:24.527437+0000","last_peered":"2024-04-19T02:16:24.527437+0000","last_clean":"2024-04-19T02:16:24.527437+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:24.527437+0000","last_undegraded":"2024-04-19T02:16:24.527437+0000","last_fullsized":"2024-04-19T02:16:24.527437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493324+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:24.493324+0000","last_peered":"2024-04-19T02:16:24.493324+0000","last_clean":"2024-04-19T02:16:24.493324+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:24.493324+0000","last_undegraded":"2024-04-19T02:16:24.493324+0000","last_fullsized":"2024-04-19T02:16:24.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490067+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.490067+0000","last_peered":"2024-04-19T02:16:24.490067+0000","last_clean":"2024-04-19T02:16:24.490067+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.490067+0000","last_undegraded":"2024-04-19T02:16:24.490067+0000","last_fullsized":"2024-04-19T02:16:24.490067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518949+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:24.518949+0000","last_peered":"2024-04-19T02:16:24.518949+0000","last_clean":"2024-04-19T02:16:24.518949+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:24.518949+0000","last_undegraded":"2024-04-19T02:16:24.518949+0000","last_fullsized":"2024-04-19T02:16:24.518949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490281+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:24.490281+0000","last_peered":"2024-04-19T02:16:24.490281+0000","last_clean":"2024-04-19T02:16:24.490281+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:24.490281+0000","last_undegraded":"2024-04-19T02:16:24.490281+0000","last_fullsized":"2024-04-19T02:16:24.490281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490834+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.490834+0000","last_peered":"2024-04-19T02:16:24.490834+0000","last_clean":"2024-04-19T02:16:24.490834+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.490834+0000","last_undegraded":"2024-04-19T02:16:24.490834+0000","last_fullsized":"2024-04-19T02:16:24.490834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514947+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:24.514947+0000","last_peered":"2024-04-19T02:16:24.514947+0000","last_clean":"2024-04-19T02:16:24.514947+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:24.514947+0000","last_undegraded":"2024-04-19T02:16:24.514947+0000","last_fullsized":"2024-04-19T02:16:24.514947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491655+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:24.491655+0000","last_peered":"2024-04-19T02:16:24.491655+0000","last_clean":"2024-04-19T02:16:24.491655+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:24.491655+0000","last_undegraded":"2024-04-19T02:16:24.491655+0000","last_fullsized":"2024-04-19T02:16:24.491655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495064+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.495064+0000","last_peered":"2024-04-19T02:16:24.495064+0000","last_clean":"2024-04-19T02:16:24.495064+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.495064+0000","last_undegraded":"2024-04-19T02:16:24.495064+0000","last_fullsized":"2024-04-19T02:16:24.495064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513571+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:24.513571+0000","last_peered":"2024-04-19T02:16:24.513571+0000","last_clean":"2024-04-19T02:16:24.513571+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:24.513571+0000","last_undegraded":"2024-04-19T02:16:24.513571+0000","last_fullsized":"2024-04-19T02:16:24.513571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.500388+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.500388+0000","last_peered":"2024-04-19T02:16:24.500388+0000","last_clean":"2024-04-19T02:16:24.500388+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.500388+0000","last_undegraded":"2024-04-19T02:16:24.500388+0000","last_fullsized":"2024-04-19T02:16:24.500388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488762+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:24.488762+0000","last_peered":"2024-04-19T02:16:24.488762+0000","last_clean":"2024-04-19T02:16:24.488762+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:24.488762+0000","last_undegraded":"2024-04-19T02:16:24.488762+0000","last_fullsized":"2024-04-19T02:16:24.488762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522145+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:24.522145+0000","last_peered":"2024-04-19T02:16:24.522145+0000","last_clean":"2024-04-19T02:16:24.522145+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:24.522145+0000","last_undegraded":"2024-04-19T02:16:24.522145+0000","last_fullsized":"2024-04-19T02:16:24.522145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488841+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.488841+0000","last_peered":"2024-04-19T02:16:24.488841+0000","last_clean":"2024-04-19T02:16:24.488841+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.488841+0000","last_undegraded":"2024-04-19T02:16:24.488841+0000","last_fullsized":"2024-04-19T02:16:24.488841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498940+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:24.498940+0000","last_peered":"2024-04-19T02:16:24.498940+0000","last_clean":"2024-04-19T02:16:24.498940+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:24.498940+0000","last_undegraded":"2024-04-19T02:16:24.498940+0000","last_fullsized":"2024-04-19T02:16:24.498940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525050+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:24.525050+0000","last_peered":"2024-04-19T02:16:24.525050+0000","last_clean":"2024-04-19T02:16:24.525050+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:24.525050+0000","last_undegraded":"2024-04-19T02:16:24.525050+0000","last_fullsized":"2024-04-19T02:16:24.525050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513005+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.513005+0000","last_peered":"2024-04-19T02:16:24.513005+0000","last_clean":"2024-04-19T02:16:24.513005+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.513005+0000","last_undegraded":"2024-04-19T02:16:24.513005+0000","last_fullsized":"2024-04-19T02:16:24.513005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491847+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:24.491847+0000","last_peered":"2024-04-19T02:16:24.491847+0000","last_clean":"2024-04-19T02:16:24.491847+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:24.491847+0000","last_undegraded":"2024-04-19T02:16:24.491847+0000","last_fullsized":"2024-04-19T02:16:24.491847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526485+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:24.526485+0000","last_peered":"2024-04-19T02:16:24.526485+0000","last_clean":"2024-04-19T02:16:24.526485+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:24.526485+0000","last_undegraded":"2024-04-19T02:16:24.526485+0000","last_fullsized":"2024-04-19T02:16:24.526485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:16:28.399827+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:28.399827+0000","last_peered":"2024-04-19T02:16:28.399827+0000","last_clean":"2024-04-19T02:16:28.399827+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:28.399827+0000","last_undegraded":"2024-04-19T02:16:28.399827+0000","last_fullsized":"2024-04-19T02:16:28.399827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491493+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:24.491493+0000","last_peered":"2024-04-19T02:16:24.491493+0000","last_clean":"2024-04-19T02:16:24.491493+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:24.491493+0000","last_undegraded":"2024-04-19T02:16:24.491493+0000","last_fullsized":"2024-04-19T02:16:24.491493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522177+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:24.522177+0000","last_peered":"2024-04-19T02:16:24.522177+0000","last_clean":"2024-04-19T02:16:24.522177+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:24.522177+0000","last_undegraded":"2024-04-19T02:16:24.522177+0000","last_fullsized":"2024-04-19T02:16:24.522177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521806+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:24.521806+0000","last_peered":"2024-04-19T02:16:24.521806+0000","last_clean":"2024-04-19T02:16:24.521806+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:24.521806+0000","last_undegraded":"2024-04-19T02:16:24.521806+0000","last_fullsized":"2024-04-19T02:16:24.521806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.533109+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.533109+0000","last_peered":"2024-04-19T02:16:24.533109+0000","last_clean":"2024-04-19T02:16:24.533109+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.533109+0000","last_undegraded":"2024-04-19T02:16:24.533109+0000","last_fullsized":"2024-04-19T02:16:24.533109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514198+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:24.514198+0000","last_peered":"2024-04-19T02:16:24.514198+0000","last_clean":"2024-04-19T02:16:24.514198+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:24.514198+0000","last_undegraded":"2024-04-19T02:16:24.514198+0000","last_fullsized":"2024-04-19T02:16:24.514198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524105+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.524105+0000","last_peered":"2024-04-19T02:16:24.524105+0000","last_clean":"2024-04-19T02:16:24.524105+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.524105+0000","last_undegraded":"2024-04-19T02:16:24.524105+0000","last_fullsized":"2024-04-19T02:16:24.524105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.491469+0000","last_peered":"2024-04-19T02:16:24.491469+0000","last_clean":"2024-04-19T02:16:24.491469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.491469+0000","last_undegraded":"2024-04-19T02:16:24.491469+0000","last_fullsized":"2024-04-19T02:16:24.491469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521373+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:24.521373+0000","last_peered":"2024-04-19T02:16:24.521373+0000","last_clean":"2024-04-19T02:16:24.521373+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:24.521373+0000","last_undegraded":"2024-04-19T02:16:24.521373+0000","last_fullsized":"2024-04-19T02:16:24.521373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.492272+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.492272+0000","last_peered":"2024-04-19T02:16:24.492272+0000","last_clean":"2024-04-19T02:16:24.492272+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.492272+0000","last_undegraded":"2024-04-19T02:16:24.492272+0000","last_fullsized":"2024-04-19T02:16:24.492272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512722+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:24.512722+0000","last_peered":"2024-04-19T02:16:24.512722+0000","last_clean":"2024-04-19T02:16:24.512722+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:24.512722+0000","last_undegraded":"2024-04-19T02:16:24.512722+0000","last_fullsized":"2024-04-19T02:16:24.512722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522303+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:24.522303+0000","last_peered":"2024-04-19T02:16:24.522303+0000","last_clean":"2024-04-19T02:16:24.522303+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:24.522303+0000","last_undegraded":"2024-04-19T02:16:24.522303+0000","last_fullsized":"2024-04-19T02:16:24.522303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488585+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.488585+0000","last_peered":"2024-04-19T02:16:24.488585+0000","last_clean":"2024-04-19T02:16:24.488585+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.488585+0000","last_undegraded":"2024-04-19T02:16:24.488585+0000","last_fullsized":"2024-04-19T02:16:24.488585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.503371+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:24.503371+0000","last_peered":"2024-04-19T02:16:24.503371+0000","last_clean":"2024-04-19T02:16:24.503371+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:24.503371+0000","last_undegraded":"2024-04-19T02:16:24.503371+0000","last_fullsized":"2024-04-19T02:16:24.503371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490145+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.490145+0000","last_peered":"2024-04-19T02:16:24.490145+0000","last_clean":"2024-04-19T02:16:24.490145+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.490145+0000","last_undegraded":"2024-04-19T02:16:24.490145+0000","last_fullsized":"2024-04-19T02:16:24.490145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526148+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:24.526148+0000","last_peered":"2024-04-19T02:16:24.526148+0000","last_clean":"2024-04-19T02:16:24.526148+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:24.526148+0000","last_undegraded":"2024-04-19T02:16:24.526148+0000","last_fullsized":"2024-04-19T02:16:24.526148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514216+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.514216+0000","last_peered":"2024-04-19T02:16:24.514216+0000","last_clean":"2024-04-19T02:16:24.514216+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.514216+0000","last_undegraded":"2024-04-19T02:16:24.514216+0000","last_fullsized":"2024-04-19T02:16:24.514216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521760+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:24.521760+0000","last_peered":"2024-04-19T02:16:24.521760+0000","last_clean":"2024-04-19T02:16:24.521760+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:24.521760+0000","last_undegraded":"2024-04-19T02:16:24.521760+0000","last_fullsized":"2024-04-19T02:16:24.521760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520388+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.520388+0000","last_peered":"2024-04-19T02:16:24.520388+0000","last_clean":"2024-04-19T02:16:24.520388+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.520388+0000","last_undegraded":"2024-04-19T02:16:24.520388+0000","last_fullsized":"2024-04-19T02:16:24.520388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514797+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:24.514797+0000","last_peered":"2024-04-19T02:16:24.514797+0000","last_clean":"2024-04-19T02:16:24.514797+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:24.514797+0000","last_undegraded":"2024-04-19T02:16:24.514797+0000","last_fullsized":"2024-04-19T02:16:24.514797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.531294+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.531294+0000","last_peered":"2024-04-19T02:16:24.531294+0000","last_clean":"2024-04-19T02:16:24.531294+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.531294+0000","last_undegraded":"2024-04-19T02:16:24.531294+0000","last_fullsized":"2024-04-19T02:16:24.531294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.511560+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:24.511560+0000","last_peered":"2024-04-19T02:16:24.511560+0000","last_clean":"2024-04-19T02:16:24.511560+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:24.511560+0000","last_undegraded":"2024-04-19T02:16:24.511560+0000","last_fullsized":"2024-04-19T02:16:24.511560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523814+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.523814+0000","last_peered":"2024-04-19T02:16:24.523814+0000","last_clean":"2024-04-19T02:16:24.523814+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.523814+0000","last_undegraded":"2024-04-19T02:16:24.523814+0000","last_fullsized":"2024-04-19T02:16:24.523814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519363+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:24.519363+0000","last_peered":"2024-04-19T02:16:24.519363+0000","last_clean":"2024-04-19T02:16:24.519363+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:24.519363+0000","last_undegraded":"2024-04-19T02:16:24.519363+0000","last_fullsized":"2024-04-19T02:16:24.519363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.510268+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.510268+0000","last_peered":"2024-04-19T02:16:24.510268+0000","last_clean":"2024-04-19T02:16:24.510268+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.510268+0000","last_undegraded":"2024-04-19T02:16:24.510268+0000","last_fullsized":"2024-04-19T02:16:24.510268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515136+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:24.515136+0000","last_peered":"2024-04-19T02:16:24.515136+0000","last_clean":"2024-04-19T02:16:24.515136+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:24.515136+0000","last_undegraded":"2024-04-19T02:16:24.515136+0000","last_fullsized":"2024-04-19T02:16:24.515136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523813+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.523813+0000","last_peered":"2024-04-19T02:16:24.523813+0000","last_clean":"2024-04-19T02:16:24.523813+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.523813+0000","last_undegraded":"2024-04-19T02:16:24.523813+0000","last_fullsized":"2024-04-19T02:16:24.523813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:43.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:43.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:43.536 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:43.552 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-19T02:16:42.178022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89900,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025620,"statfs":{"total":289910292480,"available":289818234880,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004276"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521326+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:24.521326+0000","last_peered":"2024-04-19T02:16:24.521326+0000","last_clean":"2024-04-19T02:16:24.521326+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:24.521326+0000","last_undegraded":"2024-04-19T02:16:24.521326+0000","last_fullsized":"2024-04-19T02:16:24.521326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519236+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:24.519236+0000","last_peered":"2024-04-19T02:16:24.519236+0000","last_clean":"2024-04-19T02:16:24.519236+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:24.519236+0000","last_undegraded":"2024-04-19T02:16:24.519236+0000","last_fullsized":"2024-04-19T02:16:24.519236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527393+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:24.527393+0000","last_peered":"2024-04-19T02:16:24.527393+0000","last_clean":"2024-04-19T02:16:24.527393+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:24.527393+0000","last_undegraded":"2024-04-19T02:16:24.527393+0000","last_fullsized":"2024-04-19T02:16:24.527393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521797+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:24.521797+0000","last_peered":"2024-04-19T02:16:24.521797+0000","last_clean":"2024-04-19T02:16:24.521797+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:24.521797+0000","last_undegraded":"2024-04-19T02:16:24.521797+0000","last_fullsized":"2024-04-19T02:16:24.521797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518437+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:24.518437+0000","last_peered":"2024-04-19T02:16:24.518437+0000","last_clean":"2024-04-19T02:16:24.518437+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:24.518437+0000","last_undegraded":"2024-04-19T02:16:24.518437+0000","last_fullsized":"2024-04-19T02:16:24.518437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519225+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:24.519225+0000","last_peered":"2024-04-19T02:16:24.519225+0000","last_clean":"2024-04-19T02:16:24.519225+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:24.519225+0000","last_undegraded":"2024-04-19T02:16:24.519225+0000","last_fullsized":"2024-04-19T02:16:24.519225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518975+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:24.518975+0000","last_peered":"2024-04-19T02:16:24.518975+0000","last_clean":"2024-04-19T02:16:24.518975+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:24.518975+0000","last_undegraded":"2024-04-19T02:16:24.518975+0000","last_fullsized":"2024-04-19T02:16:24.518975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519248+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:24.519248+0000","last_peered":"2024-04-19T02:16:24.519248+0000","last_clean":"2024-04-19T02:16:24.519248+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:24.519248+0000","last_undegraded":"2024-04-19T02:16:24.519248+0000","last_fullsized":"2024-04-19T02:16:24.519248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513937+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:24.513937+0000","last_peered":"2024-04-19T02:16:24.513937+0000","last_clean":"2024-04-19T02:16:24.513937+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:24.513937+0000","last_undegraded":"2024-04-19T02:16:24.513937+0000","last_fullsized":"2024-04-19T02:16:24.513937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521455+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:24.521455+0000","last_peered":"2024-04-19T02:16:24.521455+0000","last_clean":"2024-04-19T02:16:24.521455+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:24.521455+0000","last_undegraded":"2024-04-19T02:16:24.521455+0000","last_fullsized":"2024-04-19T02:16:24.521455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521791+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:24.521791+0000","last_peered":"2024-04-19T02:16:24.521791+0000","last_clean":"2024-04-19T02:16:24.521791+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:24.521791+0000","last_undegraded":"2024-04-19T02:16:24.521791+0000","last_fullsized":"2024-04-19T02:16:24.521791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525459+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:24.525459+0000","last_peered":"2024-04-19T02:16:24.525459+0000","last_clean":"2024-04-19T02:16:24.525459+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:24.525459+0000","last_undegraded":"2024-04-19T02:16:24.525459+0000","last_fullsized":"2024-04-19T02:16:24.525459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519126+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:24.519126+0000","last_peered":"2024-04-19T02:16:24.519126+0000","last_clean":"2024-04-19T02:16:24.519126+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:24.519126+0000","last_undegraded":"2024-04-19T02:16:24.519126+0000","last_fullsized":"2024-04-19T02:16:24.519126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520744+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:24.520744+0000","last_peered":"2024-04-19T02:16:24.520744+0000","last_clean":"2024-04-19T02:16:24.520744+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:24.520744+0000","last_undegraded":"2024-04-19T02:16:24.520744+0000","last_fullsized":"2024-04-19T02:16:24.520744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520230+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:24.520230+0000","last_peered":"2024-04-19T02:16:24.520230+0000","last_clean":"2024-04-19T02:16:24.520230+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:24.520230+0000","last_undegraded":"2024-04-19T02:16:24.520230+0000","last_fullsized":"2024-04-19T02:16:24.520230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520060+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:24.520060+0000","last_peered":"2024-04-19T02:16:24.520060+0000","last_clean":"2024-04-19T02:16:24.520060+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:24.520060+0000","last_undegraded":"2024-04-19T02:16:24.520060+0000","last_fullsized":"2024-04-19T02:16:24.520060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514988+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:24.514988+0000","last_peered":"2024-04-19T02:16:24.514988+0000","last_clean":"2024-04-19T02:16:24.514988+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:24.514988+0000","last_undegraded":"2024-04-19T02:16:24.514988+0000","last_fullsized":"2024-04-19T02:16:24.514988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519056+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:24.519056+0000","last_peered":"2024-04-19T02:16:24.519056+0000","last_clean":"2024-04-19T02:16:24.519056+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:24.519056+0000","last_undegraded":"2024-04-19T02:16:24.519056+0000","last_fullsized":"2024-04-19T02:16:24.519056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514210+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:24.514210+0000","last_peered":"2024-04-19T02:16:24.514210+0000","last_clean":"2024-04-19T02:16:24.514210+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:24.514210+0000","last_undegraded":"2024-04-19T02:16:24.514210+0000","last_fullsized":"2024-04-19T02:16:24.514210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521557+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:24.521557+0000","last_peered":"2024-04-19T02:16:24.521557+0000","last_clean":"2024-04-19T02:16:24.521557+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:24.521557+0000","last_undegraded":"2024-04-19T02:16:24.521557+0000","last_fullsized":"2024-04-19T02:16:24.521557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520111+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:24.520111+0000","last_peered":"2024-04-19T02:16:24.520111+0000","last_clean":"2024-04-19T02:16:24.520111+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:24.520111+0000","last_undegraded":"2024-04-19T02:16:24.520111+0000","last_fullsized":"2024-04-19T02:16:24.520111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524330+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:24.524330+0000","last_peered":"2024-04-19T02:16:24.524330+0000","last_clean":"2024-04-19T02:16:24.524330+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:24.524330+0000","last_undegraded":"2024-04-19T02:16:24.524330+0000","last_fullsized":"2024-04-19T02:16:24.524330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521993+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:24.521993+0000","last_peered":"2024-04-19T02:16:24.521993+0000","last_clean":"2024-04-19T02:16:24.521993+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:24.521993+0000","last_undegraded":"2024-04-19T02:16:24.521993+0000","last_fullsized":"2024-04-19T02:16:24.521993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519561+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:24.519561+0000","last_peered":"2024-04-19T02:16:24.519561+0000","last_clean":"2024-04-19T02:16:24.519561+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:24.519561+0000","last_undegraded":"2024-04-19T02:16:24.519561+0000","last_fullsized":"2024-04-19T02:16:24.519561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523521+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:24.523521+0000","last_peered":"2024-04-19T02:16:24.523521+0000","last_clean":"2024-04-19T02:16:24.523521+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:24.523521+0000","last_undegraded":"2024-04-19T02:16:24.523521+0000","last_fullsized":"2024-04-19T02:16:24.523521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526425+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:24.526425+0000","last_peered":"2024-04-19T02:16:24.526425+0000","last_clean":"2024-04-19T02:16:24.526425+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:24.526425+0000","last_undegraded":"2024-04-19T02:16:24.526425+0000","last_fullsized":"2024-04-19T02:16:24.526425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527334+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:24.527334+0000","last_peered":"2024-04-19T02:16:24.527334+0000","last_clean":"2024-04-19T02:16:24.527334+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:24.527334+0000","last_undegraded":"2024-04-19T02:16:24.527334+0000","last_fullsized":"2024-04-19T02:16:24.527334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525176+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:24.525176+0000","last_peered":"2024-04-19T02:16:24.525176+0000","last_clean":"2024-04-19T02:16:24.525176+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:24.525176+0000","last_undegraded":"2024-04-19T02:16:24.525176+0000","last_fullsized":"2024-04-19T02:16:24.525176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513429+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:24.513429+0000","last_peered":"2024-04-19T02:16:24.513429+0000","last_clean":"2024-04-19T02:16:24.513429+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:24.513429+0000","last_undegraded":"2024-04-19T02:16:24.513429+0000","last_fullsized":"2024-04-19T02:16:24.513429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522053+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:24.522053+0000","last_peered":"2024-04-19T02:16:24.522053+0000","last_clean":"2024-04-19T02:16:24.522053+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:24.522053+0000","last_undegraded":"2024-04-19T02:16:24.522053+0000","last_fullsized":"2024-04-19T02:16:24.522053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512827+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:24.512827+0000","last_peered":"2024-04-19T02:16:24.512827+0000","last_clean":"2024-04-19T02:16:24.512827+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:24.512827+0000","last_undegraded":"2024-04-19T02:16:24.512827+0000","last_fullsized":"2024-04-19T02:16:24.512827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515064+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:24.515064+0000","last_peered":"2024-04-19T02:16:24.515064+0000","last_clean":"2024-04-19T02:16:24.515064+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:24.515064+0000","last_undegraded":"2024-04-19T02:16:24.515064+0000","last_fullsized":"2024-04-19T02:16:24.515064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518921+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:24.518921+0000","last_peered":"2024-04-19T02:16:24.518921+0000","last_clean":"2024-04-19T02:16:24.518921+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:24.518921+0000","last_undegraded":"2024-04-19T02:16:24.518921+0000","last_fullsized":"2024-04-19T02:16:24.518921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.530969+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.530969+0000","last_peered":"2024-04-19T02:16:24.530969+0000","last_clean":"2024-04-19T02:16:24.530969+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.530969+0000","last_undegraded":"2024-04-19T02:16:24.530969+0000","last_fullsized":"2024-04-19T02:16:24.530969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522746+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:24.522746+0000","last_peered":"2024-04-19T02:16:24.522746+0000","last_clean":"2024-04-19T02:16:24.522746+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:24.522746+0000","last_undegraded":"2024-04-19T02:16:24.522746+0000","last_fullsized":"2024-04-19T02:16:24.522746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488581+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.488581+0000","last_peered":"2024-04-19T02:16:24.488581+0000","last_clean":"2024-04-19T02:16:24.488581+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.488581+0000","last_undegraded":"2024-04-19T02:16:24.488581+0000","last_fullsized":"2024-04-19T02:16:24.488581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526731+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:24.526731+0000","last_peered":"2024-04-19T02:16:24.526731+0000","last_clean":"2024-04-19T02:16:24.526731+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:24.526731+0000","last_undegraded":"2024-04-19T02:16:24.526731+0000","last_fullsized":"2024-04-19T02:16:24.526731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495683+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.495683+0000","last_peered":"2024-04-19T02:16:24.495683+0000","last_clean":"2024-04-19T02:16:24.495683+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.495683+0000","last_undegraded":"2024-04-19T02:16:24.495683+0000","last_fullsized":"2024-04-19T02:16:24.495683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526825+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:24.526825+0000","last_peered":"2024-04-19T02:16:24.526825+0000","last_clean":"2024-04-19T02:16:24.526825+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:24.526825+0000","last_undegraded":"2024-04-19T02:16:24.526825+0000","last_fullsized":"2024-04-19T02:16:24.526825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.529809+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.529809+0000","last_peered":"2024-04-19T02:16:24.529809+0000","last_clean":"2024-04-19T02:16:24.529809+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.529809+0000","last_undegraded":"2024-04-19T02:16:24.529809+0000","last_fullsized":"2024-04-19T02:16:24.529809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.516091+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.516091+0000","last_peered":"2024-04-19T02:16:24.516091+0000","last_clean":"2024-04-19T02:16:24.516091+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.516091+0000","last_undegraded":"2024-04-19T02:16:24.516091+0000","last_fullsized":"2024-04-19T02:16:24.516091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524969+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:24.524969+0000","last_peered":"2024-04-19T02:16:24.524969+0000","last_clean":"2024-04-19T02:16:24.524969+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:24.524969+0000","last_undegraded":"2024-04-19T02:16:24.524969+0000","last_fullsized":"2024-04-19T02:16:24.524969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519660+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.519660+0000","last_peered":"2024-04-19T02:16:24.519660+0000","last_clean":"2024-04-19T02:16:24.519660+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.519660+0000","last_undegraded":"2024-04-19T02:16:24.519660+0000","last_fullsized":"2024-04-19T02:16:24.519660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519536+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:24.519536+0000","last_peered":"2024-04-19T02:16:24.519536+0000","last_clean":"2024-04-19T02:16:24.519536+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:24.519536+0000","last_undegraded":"2024-04-19T02:16:24.519536+0000","last_fullsized":"2024-04-19T02:16:24.519536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521517+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.521517+0000","last_peered":"2024-04-19T02:16:24.521517+0000","last_clean":"2024-04-19T02:16:24.521517+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.521517+0000","last_undegraded":"2024-04-19T02:16:24.521517+0000","last_fullsized":"2024-04-19T02:16:24.521517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.509240+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:24.509240+0000","last_peered":"2024-04-19T02:16:24.509240+0000","last_clean":"2024-04-19T02:16:24.509240+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:24.509240+0000","last_undegraded":"2024-04-19T02:16:24.509240+0000","last_fullsized":"2024-04-19T02:16:24.509240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498902+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.498902+0000","last_peered":"2024-04-19T02:16:24.498902+0000","last_clean":"2024-04-19T02:16:24.498902+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.498902+0000","last_undegraded":"2024-04-19T02:16:24.498902+0000","last_fullsized":"2024-04-19T02:16:24.498902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524255+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:24.524255+0000","last_peered":"2024-04-19T02:16:24.524255+0000","last_clean":"2024-04-19T02:16:24.524255+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:24.524255+0000","last_undegraded":"2024-04-19T02:16:24.524255+0000","last_fullsized":"2024-04-19T02:16:24.524255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523741+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.523741+0000","last_peered":"2024-04-19T02:16:24.523741+0000","last_clean":"2024-04-19T02:16:24.523741+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.523741+0000","last_undegraded":"2024-04-19T02:16:24.523741+0000","last_fullsized":"2024-04-19T02:16:24.523741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521748+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:24.521748+0000","last_peered":"2024-04-19T02:16:24.521748+0000","last_clean":"2024-04-19T02:16:24.521748+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:24.521748+0000","last_undegraded":"2024-04-19T02:16:24.521748+0000","last_fullsized":"2024-04-19T02:16:24.521748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491382+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.491382+0000","last_peered":"2024-04-19T02:16:24.491382+0000","last_clean":"2024-04-19T02:16:24.491382+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.491382+0000","last_undegraded":"2024-04-19T02:16:24.491382+0000","last_fullsized":"2024-04-19T02:16:24.491382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526992+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:24.526992+0000","last_peered":"2024-04-19T02:16:24.526992+0000","last_clean":"2024-04-19T02:16:24.526992+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:24.526992+0000","last_undegraded":"2024-04-19T02:16:24.526992+0000","last_fullsized":"2024-04-19T02:16:24.526992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495981+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.495981+0000","last_peered":"2024-04-19T02:16:24.495981+0000","last_clean":"2024-04-19T02:16:24.495981+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.495981+0000","last_undegraded":"2024-04-19T02:16:24.495981+0000","last_fullsized":"2024-04-19T02:16:24.495981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521669+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:24.521669+0000","last_peered":"2024-04-19T02:16:24.521669+0000","last_clean":"2024-04-19T02:16:24.521669+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:24.521669+0000","last_undegraded":"2024-04-19T02:16:24.521669+0000","last_fullsized":"2024-04-19T02:16:24.521669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490556+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.490556+0000","last_peered":"2024-04-19T02:16:24.490556+0000","last_clean":"2024-04-19T02:16:24.490556+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.490556+0000","last_undegraded":"2024-04-19T02:16:24.490556+0000","last_fullsized":"2024-04-19T02:16:24.490556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514902+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:24.514902+0000","last_peered":"2024-04-19T02:16:24.514902+0000","last_clean":"2024-04-19T02:16:24.514902+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:24.514902+0000","last_undegraded":"2024-04-19T02:16:24.514902+0000","last_fullsized":"2024-04-19T02:16:24.514902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493180+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:24.493180+0000","last_peered":"2024-04-19T02:16:24.493180+0000","last_clean":"2024-04-19T02:16:24.493180+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:24.493180+0000","last_undegraded":"2024-04-19T02:16:24.493180+0000","last_fullsized":"2024-04-19T02:16:24.493180+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.496022+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:24.496022+0000","last_peered":"2024-04-19T02:16:24.496022+0000","last_clean":"2024-04-19T02:16:24.496022+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:24.496022+0000","last_undegraded":"2024-04-19T02:16:24.496022+0000","last_fullsized":"2024-04-19T02:16:24.496022+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488896+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.488896+0000","last_peered":"2024-04-19T02:16:24.488896+0000","last_clean":"2024-04-19T02:16:24.488896+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.488896+0000","last_undegraded":"2024-04-19T02:16:24.488896+0000","last_fullsized":"2024-04-19T02:16:24.488896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527437+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:24.527437+0000","last_peered":"2024-04-19T02:16:24.527437+0000","last_clean":"2024-04-19T02:16:24.527437+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:24.527437+0000","last_undegraded":"2024-04-19T02:16:24.527437+0000","last_fullsized":"2024-04-19T02:16:24.527437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493324+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:24.493324+0000","last_peered":"2024-04-19T02:16:24.493324+0000","last_clean":"2024-04-19T02:16:24.493324+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:24.493324+0000","last_undegraded":"2024-04-19T02:16:24.493324+0000","last_fullsized":"2024-04-19T02:16:24.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490067+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.490067+0000","last_peered":"2024-04-19T02:16:24.490067+0000","last_clean":"2024-04-19T02:16:24.490067+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.490067+0000","last_undegraded":"2024-04-19T02:16:24.490067+0000","last_fullsized":"2024-04-19T02:16:24.490067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518949+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:24.518949+0000","last_peered":"2024-04-19T02:16:24.518949+0000","last_clean":"2024-04-19T02:16:24.518949+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:24.518949+0000","last_undegraded":"2024-04-19T02:16:24.518949+0000","last_fullsized":"2024-04-19T02:16:24.518949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490281+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:24.490281+0000","last_peered":"2024-04-19T02:16:24.490281+0000","last_clean":"2024-04-19T02:16:24.490281+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:24.490281+0000","last_undegraded":"2024-04-19T02:16:24.490281+0000","last_fullsized":"2024-04-19T02:16:24.490281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490834+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.490834+0000","last_peered":"2024-04-19T02:16:24.490834+0000","last_clean":"2024-04-19T02:16:24.490834+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.490834+0000","last_undegraded":"2024-04-19T02:16:24.490834+0000","last_fullsized":"2024-04-19T02:16:24.490834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514947+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:24.514947+0000","last_peered":"2024-04-19T02:16:24.514947+0000","last_clean":"2024-04-19T02:16:24.514947+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:24.514947+0000","last_undegraded":"2024-04-19T02:16:24.514947+0000","last_fullsized":"2024-04-19T02:16:24.514947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491655+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:24.491655+0000","last_peered":"2024-04-19T02:16:24.491655+0000","last_clean":"2024-04-19T02:16:24.491655+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:24.491655+0000","last_undegraded":"2024-04-19T02:16:24.491655+0000","last_fullsized":"2024-04-19T02:16:24.491655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495064+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.495064+0000","last_peered":"2024-04-19T02:16:24.495064+0000","last_clean":"2024-04-19T02:16:24.495064+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.495064+0000","last_undegraded":"2024-04-19T02:16:24.495064+0000","last_fullsized":"2024-04-19T02:16:24.495064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513571+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:24.513571+0000","last_peered":"2024-04-19T02:16:24.513571+0000","last_clean":"2024-04-19T02:16:24.513571+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:24.513571+0000","last_undegraded":"2024-04-19T02:16:24.513571+0000","last_fullsized":"2024-04-19T02:16:24.513571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.500388+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.500388+0000","last_peered":"2024-04-19T02:16:24.500388+0000","last_clean":"2024-04-19T02:16:24.500388+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.500388+0000","last_undegraded":"2024-04-19T02:16:24.500388+0000","last_fullsized":"2024-04-19T02:16:24.500388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488762+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:24.488762+0000","last_peered":"2024-04-19T02:16:24.488762+0000","last_clean":"2024-04-19T02:16:24.488762+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:24.488762+0000","last_undegraded":"2024-04-19T02:16:24.488762+0000","last_fullsized":"2024-04-19T02:16:24.488762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522145+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:24.522145+0000","last_peered":"2024-04-19T02:16:24.522145+0000","last_clean":"2024-04-19T02:16:24.522145+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:24.522145+0000","last_undegraded":"2024-04-19T02:16:24.522145+0000","last_fullsized":"2024-04-19T02:16:24.522145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488841+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.488841+0000","last_peered":"2024-04-19T02:16:24.488841+0000","last_clean":"2024-04-19T02:16:24.488841+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.488841+0000","last_undegraded":"2024-04-19T02:16:24.488841+0000","last_fullsized":"2024-04-19T02:16:24.488841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498940+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:24.498940+0000","last_peered":"2024-04-19T02:16:24.498940+0000","last_clean":"2024-04-19T02:16:24.498940+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:24.498940+0000","last_undegraded":"2024-04-19T02:16:24.498940+0000","last_fullsized":"2024-04-19T02:16:24.498940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525050+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:24.525050+0000","last_peered":"2024-04-19T02:16:24.525050+0000","last_clean":"2024-04-19T02:16:24.525050+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:24.525050+0000","last_undegraded":"2024-04-19T02:16:24.525050+0000","last_fullsized":"2024-04-19T02:16:24.525050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513005+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.513005+0000","last_peered":"2024-04-19T02:16:24.513005+0000","last_clean":"2024-04-19T02:16:24.513005+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.513005+0000","last_undegraded":"2024-04-19T02:16:24.513005+0000","last_fullsized":"2024-04-19T02:16:24.513005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491847+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:24.491847+0000","last_peered":"2024-04-19T02:16:24.491847+0000","last_clean":"2024-04-19T02:16:24.491847+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:24.491847+0000","last_undegraded":"2024-04-19T02:16:24.491847+0000","last_fullsized":"2024-04-19T02:16:24.491847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526485+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:24.526485+0000","last_peered":"2024-04-19T02:16:24.526485+0000","last_clean":"2024-04-19T02:16:24.526485+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:24.526485+0000","last_undegraded":"2024-04-19T02:16:24.526485+0000","last_fullsized":"2024-04-19T02:16:24.526485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:16:28.399827+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:28.399827+0000","last_peered":"2024-04-19T02:16:28.399827+0000","last_clean":"2024-04-19T02:16:28.399827+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:28.399827+0000","last_undegraded":"2024-04-19T02:16:28.399827+0000","last_fullsized":"2024-04-19T02:16:28.399827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491493+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:24.491493+0000","last_peered":"2024-04-19T02:16:24.491493+0000","last_clean":"2024-04-19T02:16:24.491493+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:24.491493+0000","last_undegraded":"2024-04-19T02:16:24.491493+0000","last_fullsized":"2024-04-19T02:16:24.491493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522177+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:24.522177+0000","last_peered":"2024-04-19T02:16:24.522177+0000","last_clean":"2024-04-19T02:16:24.522177+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:24.522177+0000","last_undegraded":"2024-04-19T02:16:24.522177+0000","last_fullsized":"2024-04-19T02:16:24.522177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521806+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:24.521806+0000","last_peered":"2024-04-19T02:16:24.521806+0000","last_clean":"2024-04-19T02:16:24.521806+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:24.521806+0000","last_undegraded":"2024-04-19T02:16:24.521806+0000","last_fullsized":"2024-04-19T02:16:24.521806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.533109+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.533109+0000","last_peered":"2024-04-19T02:16:24.533109+0000","last_clean":"2024-04-19T02:16:24.533109+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.533109+0000","last_undegraded":"2024-04-19T02:16:24.533109+0000","last_fullsized":"2024-04-19T02:16:24.533109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514198+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:24.514198+0000","last_peered":"2024-04-19T02:16:24.514198+0000","last_clean":"2024-04-19T02:16:24.514198+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:24.514198+0000","last_undegraded":"2024-04-19T02:16:24.514198+0000","last_fullsized":"2024-04-19T02:16:24.514198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524105+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.524105+0000","last_peered":"2024-04-19T02:16:24.524105+0000","last_clean":"2024-04-19T02:16:24.524105+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.524105+0000","last_undegraded":"2024-04-19T02:16:24.524105+0000","last_fullsized":"2024-04-19T02:16:24.524105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.491469+0000","last_peered":"2024-04-19T02:16:24.491469+0000","last_clean":"2024-04-19T02:16:24.491469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.491469+0000","last_undegraded":"2024-04-19T02:16:24.491469+0000","last_fullsized":"2024-04-19T02:16:24.491469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521373+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:24.521373+0000","last_peered":"2024-04-19T02:16:24.521373+0000","last_clean":"2024-04-19T02:16:24.521373+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:24.521373+0000","last_undegraded":"2024-04-19T02:16:24.521373+0000","last_fullsized":"2024-04-19T02:16:24.521373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.492272+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.492272+0000","last_peered":"2024-04-19T02:16:24.492272+0000","last_clean":"2024-04-19T02:16:24.492272+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.492272+0000","last_undegraded":"2024-04-19T02:16:24.492272+0000","last_fullsized":"2024-04-19T02:16:24.492272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512722+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:24.512722+0000","last_peered":"2024-04-19T02:16:24.512722+0000","last_clean":"2024-04-19T02:16:24.512722+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:24.512722+0000","last_undegraded":"2024-04-19T02:16:24.512722+0000","last_fullsized":"2024-04-19T02:16:24.512722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522303+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:24.522303+0000","last_peered":"2024-04-19T02:16:24.522303+0000","last_clean":"2024-04-19T02:16:24.522303+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:24.522303+0000","last_undegraded":"2024-04-19T02:16:24.522303+0000","last_fullsized":"2024-04-19T02:16:24.522303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488585+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.488585+0000","last_peered":"2024-04-19T02:16:24.488585+0000","last_clean":"2024-04-19T02:16:24.488585+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.488585+0000","last_undegraded":"2024-04-19T02:16:24.488585+0000","last_fullsized":"2024-04-19T02:16:24.488585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.503371+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:24.503371+0000","last_peered":"2024-04-19T02:16:24.503371+0000","last_clean":"2024-04-19T02:16:24.503371+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:24.503371+0000","last_undegraded":"2024-04-19T02:16:24.503371+0000","last_fullsized":"2024-04-19T02:16:24.503371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490145+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.490145+0000","last_peered":"2024-04-19T02:16:24.490145+0000","last_clean":"2024-04-19T02:16:24.490145+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.490145+0000","last_undegraded":"2024-04-19T02:16:24.490145+0000","last_fullsized":"2024-04-19T02:16:24.490145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526148+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:24.526148+0000","last_peered":"2024-04-19T02:16:24.526148+0000","last_clean":"2024-04-19T02:16:24.526148+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:24.526148+0000","last_undegraded":"2024-04-19T02:16:24.526148+0000","last_fullsized":"2024-04-19T02:16:24.526148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514216+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.514216+0000","last_peered":"2024-04-19T02:16:24.514216+0000","last_clean":"2024-04-19T02:16:24.514216+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.514216+0000","last_undegraded":"2024-04-19T02:16:24.514216+0000","last_fullsized":"2024-04-19T02:16:24.514216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521760+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:24.521760+0000","last_peered":"2024-04-19T02:16:24.521760+0000","last_clean":"2024-04-19T02:16:24.521760+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:24.521760+0000","last_undegraded":"2024-04-19T02:16:24.521760+0000","last_fullsized":"2024-04-19T02:16:24.521760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520388+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.520388+0000","last_peered":"2024-04-19T02:16:24.520388+0000","last_clean":"2024-04-19T02:16:24.520388+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.520388+0000","last_undegraded":"2024-04-19T02:16:24.520388+0000","last_fullsized":"2024-04-19T02:16:24.520388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514797+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:24.514797+0000","last_peered":"2024-04-19T02:16:24.514797+0000","last_clean":"2024-04-19T02:16:24.514797+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:24.514797+0000","last_undegraded":"2024-04-19T02:16:24.514797+0000","last_fullsized":"2024-04-19T02:16:24.514797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.531294+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.531294+0000","last_peered":"2024-04-19T02:16:24.531294+0000","last_clean":"2024-04-19T02:16:24.531294+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.531294+0000","last_undegraded":"2024-04-19T02:16:24.531294+0000","last_fullsized":"2024-04-19T02:16:24.531294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.511560+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:24.511560+0000","last_peered":"2024-04-19T02:16:24.511560+0000","last_clean":"2024-04-19T02:16:24.511560+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:24.511560+0000","last_undegraded":"2024-04-19T02:16:24.511560+0000","last_fullsized":"2024-04-19T02:16:24.511560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523814+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.523814+0000","last_peered":"2024-04-19T02:16:24.523814+0000","last_clean":"2024-04-19T02:16:24.523814+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.523814+0000","last_undegraded":"2024-04-19T02:16:24.523814+0000","last_fullsized":"2024-04-19T02:16:24.523814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519363+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:24.519363+0000","last_peered":"2024-04-19T02:16:24.519363+0000","last_clean":"2024-04-19T02:16:24.519363+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:24.519363+0000","last_undegraded":"2024-04-19T02:16:24.519363+0000","last_fullsized":"2024-04-19T02:16:24.519363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.510268+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.510268+0000","last_peered":"2024-04-19T02:16:24.510268+0000","last_clean":"2024-04-19T02:16:24.510268+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.510268+0000","last_undegraded":"2024-04-19T02:16:24.510268+0000","last_fullsized":"2024-04-19T02:16:24.510268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515136+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:24.515136+0000","last_peered":"2024-04-19T02:16:24.515136+0000","last_clean":"2024-04-19T02:16:24.515136+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:24.515136+0000","last_undegraded":"2024-04-19T02:16:24.515136+0000","last_fullsized":"2024-04-19T02:16:24.515136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523813+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.523813+0000","last_peered":"2024-04-19T02:16:24.523813+0000","last_clean":"2024-04-19T02:16:24.523813+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.523813+0000","last_undegraded":"2024-04-19T02:16:24.523813+0000","last_fullsized":"2024-04-19T02:16:24.523813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:43.556 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T02:16:43.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 18 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 30a6d986-f196-4d3c-8512-6c6489722f8f 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-04-19T02:16:03.364103+0000 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-04-19T02:16:25.482999+0000 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:crush_version 4 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:full_ratio 0.95 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:backfillfull_ratio 0.9 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:nearfull_ratio 0.85 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:require_min_compat_client luminous 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:min_compat_client jewel 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:require_osd_release reef 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:stretch_mode_enabled false 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi073.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi073.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi073.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi073.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi073.stdout:max_osd 3 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/21424,v1:172.21.15.116:6801/21424] [v2:172.21.15.116:6802/21424,v1:172.21.15.116:6803/21424] exists,up 16c5fbec-2207-41d1-ae33-893b400fd3da 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/21483,v1:172.21.15.136:6801/21483] [v2:172.21.15.136:6802/21483,v1:172.21.15.136:6803/21483] exists,up 3211257a-5bd5-4a10-8d5f-c3dae1d504e7 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/21523,v1:172.21.15.169:6801/21523] [v2:172.21.15.169:6802/21523,v1:172.21.15.169:6803/21523] exists,up 1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d 2024-04-19T02:16:43.910 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/21424,v1:172.21.15.116:6801/21424] [v2:172.21.15.116:6802/21424,v1:172.21.15.116:6803/21424] exists,up 16c5fbec-2207-41d1-ae33-893b400fd3da', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/21483,v1:172.21.15.136:6801/21483] [v2:172.21.15.136:6802/21483,v1:172.21.15.136:6803/21483] exists,up 3211257a-5bd5-4a10-8d5f-c3dae1d504e7', 'osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/21523,v1:172.21.15.169:6801/21523] [v2:172.21.15.169:6802/21523,v1:172.21.15.169:6803/21523] exists,up 1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d'] 2024-04-19T02:16:43.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-19T02:16:44.022 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mon.a", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster": "ceph", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket_mode": "", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_client_required": "cephx, none", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_cluster_required": "cephx", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_debug": "true", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-19T02:16:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_required": "cephx", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_supported": "cephx", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio": "true", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_poll_ms": "250", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_reap_max": "16", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_async_discard": "false", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_block_size": "4096", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio": "false", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_inflight_ios": "false", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_enable_discard": "false", 2024-04-19T02:16:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry": "3", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash": "0", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring": "false", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_hipri": "false", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_type": "", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_alloc_size": "1048576", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_allocator": "hybrid", 2024-04-19T02:16:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_buffered_io": "true", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_for_zeros": "false", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_compact_log_sync": "false", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_log_runway": "4194304", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_prefetch": "1048576", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_flush_size": "524288", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_log_runway": "1048576", 2024-04-19T02:16:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery": "false", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_sync_write": "false", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocation_from_file": "true", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocator": "hybrid", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-19T02:16:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_create": "true", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_create": "false", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_path": "", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_size": "0", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_path": "", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_preallocate_file": "false", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_size": "107374182400", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_create": "false", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_path": "", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_size": "100663296", 2024-04-19T02:16:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs": "true", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune": "true", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-19T02:16:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size": "0", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_type": "2q", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_clone_cow": "true", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-19T02:16:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_mode": "none", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_csum_type": "crc32c", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_freelist": "false", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-19T02:16:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_small_allocations": "0", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_read": "true", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_write": "false", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-19T02:16:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fail_eio": "false", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-19T02:16:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount": "false", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount": "false", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_ignore_data_csum": "false", 2024-04-19T02:16:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_op_age": "5.000000", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_alloc_size": "0", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size": "0", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_deferred_txc": "32", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size": "0", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-19T02:16:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_nid_prealloc": "1024", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_retry_disk_reads": "3", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cf": "true", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-19T02:16:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_mem": "512", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_tracing": "false", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-19T02:16:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_zero_block_detection": "false", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-19T02:16:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_signatures": "false", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_version": "2", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_signatures": "false", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_version": "2", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_signatures": "false", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_version": "2", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_sign_messages": "true", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "chdir": "", 2024-04-19T02:16:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "client_acl_type": "", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_asio_thread_count": "2", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_mid": "0.750000", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_size": "16384", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_caps_release_delay": "5", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_check_pool_perm": "true", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_force_sync_read": "false", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_getattr_caps": "false", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_inject_tick_delay": "0", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_remount": "false", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_dirsize_rbytes": "true", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_force_lazyio": "false", 2024-04-19T02:16:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_fs": "", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_release_failure": "false", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_inline_size": "4096", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mds_namespace": "", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_metadata": "", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_gid": "-1", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_timeout": "300", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_uid": "-1", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mountpoint": "/", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_notify_timeout": "10", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc": "true", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty": "104857600", 2024-04-19T02:16:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_objects": "1000", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_size": "209715200", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_target_dirty": "8388608", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_permissions": "true", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota": "true", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota_df": "true", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_bytes": "0", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_periods": "4", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_min": "131072", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_reconnect_stale": "false", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_shutdown_timeout": "30", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_snapdir": ".snap", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_tick_interval": "1", 2024-04-19T02:16:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_trace": "", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "client_try_dentry_invalidate": "false", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_faked_inos": "false", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_random_mds": "false", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog": "false", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_port": "12201", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_monitors": "default=true", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog": "false", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_level": "info", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "-", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network": "", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network_interface": "", 2024-04-19T02:16:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_isal": "false", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_level": "5", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_winsize": "-15", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zstd_level": "1", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_op_num_threads": "6", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_seastar_smp": "1", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook": "", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook_timeout": "10", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "daemonize": "false", 2024-04-19T02:16:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "daos_pool": "tank", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_alienstore": "0/5", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_allow_any_pool_priority": "false", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok": "1/5", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok_assert_abort": "false", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asserts_on_shutdown": "true", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_auth": "20/20", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bdev": "1/3", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluefs": "1/5", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluestore": "1/5", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_buffer": "0/1", 2024-04-19T02:16:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ceph_exporter": "1/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephfs_mirror": "0/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephsqlite": "0/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_client": "0/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_compressor": "1/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_context": "0/1", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crush": "1/1", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crypto": "1/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cyanstore": "0/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_deliberately_leak_memory": "false", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_disable_randomized_ping": "false", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_dpdk": "1/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_eventtrace": "1/5", 2024-04-19T02:16:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filer": "0/1", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filestore": "1/3", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_finisher": "1/1", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_fuse": "1/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeat_testing_span": "0", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeatmap": "1/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_javaclient": "1/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journal": "1/3", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journaler": "0/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_kstore": "1/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_leveldb": "4/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_lockdep": "0/1", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mclock": "1/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds": "1/5", 2024-04-19T02:16:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_balancer": "1/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_locker": "1/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log": "1/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log_expire": "1/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_migrator": "1/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_memstore": "1/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgr": "2/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgrc": "1/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mon": "20/20", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_monc": "0/10", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ms": "1/1", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_none": "0/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objclass": "0/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objectcacher": "0/5", 2024-04-19T02:16:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objecter": "0/1", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_optracker": "0/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_osd": "1/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_paxos": "20/20", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_perfcounter": "1/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_prioritycache": "1/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rados": "0/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd": "0/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_mirror": "0/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_pwl": "0/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_replay": "0/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_refs": "0/0", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_reserver": "1/1", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw": "1/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_access": "1/5", 2024-04-19T02:16:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_datacache": "1/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_dbstore": "1/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_flight": "1/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_sync": "1/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rocksdb": "4/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore": "0/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_backref": "0/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cache": "0/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cleaner": "0/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_device": "0/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_epm": "0/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-19T02:16:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_journal": "0/5", 2024-04-19T02:16:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_lba": "0/5", 2024-04-19T02:16:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_odata": "0/5", 2024-04-19T02:16:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_omap": "0/5", 2024-04-19T02:16:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_onode": "0/5", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_t": "0/5", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_tm": "0/5", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_striper": "0/1", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_test": "0/5", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_throttle": "1/1", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_timer": "0/1", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_tp": "0/5", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "device_failure_prediction_mode": "none", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_graylog": "false", 2024-04-19T02:16:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_journald": "false", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_stderr": "true", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_syslog": "false", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event_tracing": "false", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_addr": "0.0.0.0", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_http_port": "9926", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_prio_limit": "5", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sort_metrics": "true", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_stats_period": "5", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "fake_statfs_for_testing": "0", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "fatal_signal_handlers": "true", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_purge_ops": "10", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_truncate_ops": "128", 2024-04-19T02:16:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_apply_finisher_threads": "1", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_blackhole": "false", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_clone_range": "true", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_snap": "true", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_caller_concurrency": "10", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_collect_device_partition_information": "true", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_commit_timeout": "600.000000", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_inject_read_err": "false", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_omap_check": "false", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_verify_split": "false", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_dump_file": "", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-19T02:16:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fadvise": "true", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fail_eio": "true", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_shards": "16", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_size": "128", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap": "false", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap_threshold": "4096", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_inject_stall": "0", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_parallel": "false", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_trailing": "false", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_writeahead": "false", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_kill_at": "0", 2024-04-19T02:16:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs": "0", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-19T02:16:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size": "0", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_merge_threshold": "-10", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_odsync_write": "false", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend": "rocksdb", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend_path": "", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-19T02:16:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_timeout": "60", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_threads": "2", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_punch_hole": "false", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_ops": "50", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_seek_data_hole": "false", 2024-04-19T02:16:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc": "false", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_splice": "false", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_multiple": "2", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_rand_factor": "20", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_update_to": "1000", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_enable": "true", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-19T02:16:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_xfs_extsize": "false", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_zfs_snap": "false", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "fio_dir": "/tmp/fio", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "30a6d986-f196-4d3c-8512-6c6489722f8f", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_allow_other": "true", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_atomic_o_trunc": "true", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_big_writes": "true", 2024-04-19T02:16:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_debug": "false", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_default_permissions": "false", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_disable_pagecache": "false", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_max_write": "0", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_multithreaded": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_require_active_mds": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_set_user_groups": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_move": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_read": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_write": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_use_invalidate_cb": "true", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_target_name": "ceph", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_file": "", 2024-04-19T02:16:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_inject_failure": "0", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_interval": "5", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "host": "smithi073", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-19T02:16:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "inject_early_sigterm": "false", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_agent_port": "6799", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_tracing_enable": "false", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_aio": "true", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_align_min_size": "65536", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_align": "true", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_size": "4096", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_dio": "true", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_discard": "false", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_force_aio": "false", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_ignore_corruption": "false", 2024-04-19T02:16:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_bytes": "10485760", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_entries": "100", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_replay_from": "0", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_write_header_frequency": "0", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_zero_on_create": "false", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prefetch_periods": "10", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prezero_periods": "5", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_write_head_interval": "15", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "", 2024-04-19T02:16:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "keyfile": "", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_backend": "rocksdb", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_default_stripe_size": "65536", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount": "false", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_bytes": "67108864", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_ops": "512", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_nid_prealloc": "1024", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_onode_map_size": "1024", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_submit_transaction": "false", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_transaction": "false", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_block_size": "65536", 2024-04-19T02:16:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_bloom_size": "0", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_cache_size": "536870912", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_compact_on_mount": "false", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_compression": "false", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_log": "", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_max_open_files": "0", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_paranoid": "false", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "librados_thread_count": "2", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep": "false", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep_force_backtrace": "false", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "log_coarse_timestamps": "true", 2024-04-19T02:16:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_flush_on_exit": "false", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_host": "127.0.0.1", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_port": "12201", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_new": "1000", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_recent": "10000", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stderr_prefix": "", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stop_at_utilization": "0.970000", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": "true", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_graylog": "false", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_journald": "false", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_stderr": "false", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_syslog": "false", 2024-04-19T02:16:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "max_rotating_auth_attempts": "10", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_action_on_write_error": "1", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_alternate_name_max": "8192", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_asio_thread_count": "2", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_export_pin": "true", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_dirs": "true", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_interval": "5", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_interval": "10", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max": "-1", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max_until": "-1", 2024-04-19T02:16:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_merge_size": "50", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_midchunk": "0.300000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_start": "0.200000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_minchunk": "0.001000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_mode": "0", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_max": "1.200000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_min": "0.800000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_bits": "3", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_size": "10000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-19T02:16:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_target_decay": "10.000000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_grace": "15.000000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_interval": "4.000000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_mid": "0.700000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_release_free_interval": "10", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_reservation": "0.050000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_interval": "1", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_threshold": "262144", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-19T02:16:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_prealloc_inos": "1000", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_connect_bootstrapping": "false", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_damage_table_max_entries": "10000", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_auth_pins": "false", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_frag": "false", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_scatterstat": "false", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_subtrees": "false", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_decay_halflife": "5.000000", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_default_dir_hash": "2", 2024-04-19T02:16:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_defer_session_stale": "true", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_deny_all_reconnect": "false", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_keys_per_op": "16384", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_commit_size": "10", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_entries": "0", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_prefetch": "true", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_on_map": "false", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_early_reply": "true", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enable_op_tracker": "true", 2024-04-19T02:16:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enforce_unique_name": "true", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random": "true", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_summarize_threshold": "10", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-19T02:16:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_health_dummy": "false", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_migrator_session_race": "false", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_join_fs": "", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_journal_format": "1", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_create_at": "0", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_export_at": "0", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_import_at": "0", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_at": "0", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_expire_at": "0", 2024-04-19T02:16:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_replay_at": "0", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_link_at": "0", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_mdstable_at": "0", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_openc_at": "0", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_rename_at": "0", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_events_per_segment": "1024", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_events": "-1", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_segments": "128", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_pause": "false", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_segment_size": "0", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_warn_factor": "2.000000", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_caps_per_client": "1048576", 2024-04-19T02:16:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_flushes": "100000", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_requests": "100000", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_export_size": "20971520", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_file_recover": "32", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_files": "64", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops": "8192", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_snaps_per_dir": "100", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_metrics_update_interval": "2", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_per_client": "100", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_working_set": "10000", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-19T02:16:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_numa_node": "-1", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_complaint_time": "30.000000", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_duration": "600", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_size": "20", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_slow_op_size": "20", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_log_threshold": "5", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_grace": "15", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_interval": "5", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_caps": "30000", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-19T02:16:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_threshold": "262144", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_interval": "1.000000", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_gid": "0", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_uid": "0", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-19T02:16:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_shutdown_check": "0", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_skip_ino": "0", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_max_uid": "4294967294", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_min_uid": "0", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_rstat": "false", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_standby_replay_damaged": "false", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_symlink_recovery": "true", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_exports": "0", 2024-04-19T02:16:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_fragments": "0", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_tick_interval": "5.000000", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_valgrind_exit": "false", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_backtrace": "1", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_scatter": "false", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_sessions": "false", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool_debug": "false", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_device_bytes": "1073741824", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_set": "false", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_size": "65536", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_bytes": "134217728", 2024-04-19T02:16:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_messages": "512", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_disabled_modules": "", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_max_pg_num_change": "128", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_bytes": "134217728", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_messages": "128", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-19T02:16:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_bytes": "134217728", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_messages": "128", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_bytes": "536870912", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_messages": "8192", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_pool": "true", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_standby_modules": "true", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_period": "5", 2024-04-19T02:16:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_threshold": "5", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_tick_period": "2", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_delete": "true", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_size_one": "true", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_auth_validate_all_caps": "true", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_bytes": "104857600", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_directed_command_retry": "2", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-19T02:16:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_parallel": "3", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_log_interval": "1.000000", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_interval": "10.000000", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-19T02:16:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_file_level": "debug", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_file": "true", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_journald": "false", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-19T02:16:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_bootstrap": "false", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_start": "false", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_trim": "true", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cpu_threads": "4", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_crush_min_required_version": "hammer", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_daemon_bytes": "419430400", 2024-04-19T02:16:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_crit": "5", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_warn": "5", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_size_warn": "16106127360", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_json": "false", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_transactions": "false", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_extra_checks": "false", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-19T02:16:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_quincy": "false", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_reef": "false", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_down_mkfs_grace": "120", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_default_strategy": "1", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_timeout": "5.000000", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-19T02:16:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_divisor": "2", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_enable_op_tracker": "true", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_fake_pool_delete": "false", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_force_quorum_join": "false", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_globalid_prealloc": "10000", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_detail_to_clog": "false", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_log_update_period": "5", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_max_detail": "50", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog": "true", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_interval": "600", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host": "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host_override": "", 2024-04-19T02:16:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_initial_members": "", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease": "5.000000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_full_interval": "50", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max": "10000", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max_summary": "50", 2024-04-19T02:16:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_epochs": "500", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_osd": "10000", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pg_per_osd": "10000", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pool_pg_num": "65536", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-19T02:16:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_force_trim_to": "0", 2024-04-19T02:16:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_skip_sanity": "false", 2024-04-19T02:16:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_autotune": "true", 2024-04-19T02:16:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_target": "2147483648", 2024-04-19T02:16:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_beacon_grace": "30", 2024-04-19T02:16:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-19T02:16:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_digest_period": "5", 2024-04-19T02:16:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_inactive_grace": "60", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_min_osdmap_epochs": "500", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_complaint_time": "30", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_duration": "600", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_size": "20", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_size": "20", 2024-04-19T02:16:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_log_threshold": "5", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_in": "false", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-19T02:16:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size": "500", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_interval": "600", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_force_trim_to": "0", 2024-04-19T02:16:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-19T02:16:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_down_reporters": "2", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_report_timeout": "900", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-19T02:16:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_stuck_threshold": "60", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-19T02:16:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_probe_timeout": "2.000000", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_change": "0.050000", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_osds": "4", 2024-04-19T02:16:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-19T02:16:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-19T02:16:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-19T02:16:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-19T02:16:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-19T02:16:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_interval": "86400", 2024-04-19T02:16:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_max_keys": "100", 2024-04-19T02:16:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_timeout": "300", 2024-04-19T02:16:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_session_timeout": "300", 2024-04-19T02:16:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_smart_report_timeout": "5", 2024-04-19T02:16:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stat_smooth_intervals": "6", 2024-04-19T02:16:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-19T02:16:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_min_size": "2", 2024-04-19T02:16:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_size": "4", 2024-04-19T02:16:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-19T02:16:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-19T02:16:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_debug": "false", 2024-04-19T02:16:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-19T02:16:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-19T02:16:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_provider_kill_at": "0", 2024-04-19T02:16:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_requester_kill_at": "0", 2024-04-19T02:16:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_timeout": "60.000000", 2024-04-19T02:16:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_target_pg_per_osd": "100", 2024-04-19T02:16:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_tick_interval": "5", 2024-04-19T02:16:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_interval": "300.000000", 2024-04-19T02:16:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_use_min_delay_socket": "false", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_older_version_delay": "604800", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-19T02:16:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_misplaced": "false", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_older_version": "true", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-19T02:16:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": "", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-19T02:16:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_tracing_enabled": "false", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_op_threads": "3", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_cm": "false", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_device_name": "", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_dscp": "96", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-19T02:16:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-19T02:16:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_local_gid": "", 2024-04-19T02:16:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-19T02:16:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_port_num": "1", 2024-04-19T02:16:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-19T02:16:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-19T02:16:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-19T02:16:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-19T02:16:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_sl": "3", 2024-04-19T02:16:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_support_srq": "true", 2024-04-19T02:16:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_type": "ib", 2024-04-19T02:16:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_reap_threshold": "5", 2024-04-19T02:16:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_before_connect": "false", 2024-04-19T02:16:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv4": "true", 2024-04-19T02:16:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv6": "false", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr1": "true", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr2": "true", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_max": "7568", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_min": "6800", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_count": "3", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_delay": "5", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_client": "false", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mds": "false", 2024-04-19T02:16:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mgr": "false", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mon": "false", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_osd": "false", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_client_mode": "crc secure", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_mode": "crc secure", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_type": "", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_compress_secure": "false", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_idle_timeout": "900", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_ready_timeout": "10", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_data": "true", 2024-04-19T02:16:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_header": "true", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bad_msg": "false", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bug": "true", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_old_message": "true", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_skipped_message": "false", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_coremask": "0xF", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-19T02:16:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-19T02:16:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_enable_tso": "true", 2024-04-19T02:16:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-19T02:16:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-19T02:16:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hugepages": "", 2024-04-19T02:16:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-19T02:16:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-19T02:16:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_lro": "true", 2024-04-19T02:16:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_memory_channel": "4", 2024-04-19T02:16:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-19T02:16:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_pmd": "", 2024-04-19T02:16:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_port_id": "0", 2024-04-19T02:16:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-19T02:16:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-19T02:16:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_on_send": "false", 2024-04-19T02:16:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_initial_backoff": "0.200000", 2024-04-19T02:16:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_max": "1.000000", 2024-04-19T02:16:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-19T02:16:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_type": "", 2024-04-19T02:16:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-19T02:16:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_network_congestion": "0", 2024-04-19T02:16:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_socket_failures": "0", 2024-04-19T02:16:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_learn_addr_from_peer": "true", 2024-04-19T02:16:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_accept_failures": "4", 2024-04-19T02:16:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_backoff": "15.000000", 2024-04-19T02:16:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_client_mode": "secure crc", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_service_mode": "secure crc", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_min_size": "1024", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_mode": "none", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_min_cost": "65536", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_public_type": "", 2024-04-19T02:16:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_service_mode": "crc secure", 2024-04-19T02:16:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_listen_backlog": "512", 2024-04-19T02:16:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_nodelay": "true", 2024-04-19T02:16:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-19T02:16:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_rcvbuf": "0", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_type": "async+posix", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "no_config_file": "false", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_completion_locks_per_session": "32", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_ops": "1024", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-19T02:16:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_tick_interval": "5.000000", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_timeout": "10.000000", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "objectstore_blackhole": "false", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "openssl_engine_opts": "", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_delay_time": "5.000000", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_hist_halflife": "1000", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_low_ops": "2", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_ops": "4", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-19T02:16:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_slop": "0.020000", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_asio_thread_count": "2", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_async_recovery_min_cost": "100", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_max": "512", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_min": "64", 2024-04-19T02:16:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_degraded": "false", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_peering": "false", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_unfound": "true", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_beacon_report_interval": "300", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_duration": "30", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_max_block_size": "67108864", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blkin_trace_all": "false", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-19T02:16:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-19T02:16:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_for_log_corruption": "false", 2024-04-19T02:16:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-19T02:16:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T02:16:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-19T02:16:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T02:16:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_update_on_start": "true", 2024-04-19T02:16:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_cap": "256", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_size_cap": "524288000", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_op_priority": "63", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_watch_timeout": "30", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_command_max_records": "256", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_compact_on_start": "false", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-19T02:16:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-19T02:16:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_on_start": "true", 2024-04-19T02:16:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_weight_set": "true", 2024-04-19T02:16:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-19T02:16:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-19T02:16:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-19T02:16:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-19T02:16:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_feed_pullee": "-1", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_misdirected_ops": "false", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_acting_change": "false", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_purge_strays": "false", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_op_order": "false", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-19T02:16:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-19T02:16:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-19T02:16:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-19T02:16:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_shutdown": "false", 2024-04-19T02:16:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_snaps": "false", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_keys": "1024", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-19T02:16:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_stride": "524288", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_notify_timeout": "30", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep": "0.000000", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-19T02:16:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_discard_disconnected_ops": "true", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_enable_op_tracker": "true", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_info": "true", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown": "true", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-19T02:16:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-19T02:16:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-19T02:16:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_function_tracing": "false", 2024-04-19T02:16:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_grace": "20", 2024-04-19T02:16:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_interval": "6", 2024-04-19T02:16:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-19T02:16:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_peers": "10", 2024-04-19T02:16:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_size": "2000", 2024-04-19T02:16:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_stale": "600", 2024-04-19T02:16:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-19T02:16:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_max_size": "100000", 2024-04-19T02:16:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_min_size": "1000", 2024-04-19T02:16:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-19T02:16:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-19T02:16:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-19T02:16:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-19T02:16:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-19T02:16:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-19T02:16:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_size": "5120", 2024-04-19T02:16:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_kill_backfill_at": "0", 2024-04-19T02:16:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-19T02:16:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_cache_size": "50", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_dedup": "true", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max": "40", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_share_max_epochs": "40", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_name_len": "100", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_size": "0", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_backfills": "1", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_count": "5", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_period": "600", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_name_len": "2048", 2024-04-19T02:16:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_namespace_len": "256", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_size": "134217728", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_blocked_by": "16", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_log_entries": "10000", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pgls": "1024", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_cost": "8388608", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_objects": "10", 2024-04-19T02:16:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_scrubs": "3", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_trimming_pgs": "2", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_op_reply_len": "64", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_size": "90", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-19T02:16:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_profile": "balanced", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-19T02:16:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_base": "805306368", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_min": "134217728", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-19T02:16:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target": "4294967296", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_autotune": "false", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_pg_log_entries": "250", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_recovery_priority": "0", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_interval": "5", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-19T02:16:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_cache_shards": "32", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_op_tracker_shard": "32", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_auto_affinity": "true", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_node": "-1", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_prefer_iface": "true", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objecter_finishers": "1", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore": "bluestore", 2024-04-19T02:16:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_fuse": "false", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_tracing": "false", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_complaint_time": "30.000000", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_duration": "600", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_size": "20", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_size": "20", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_log_threshold": "5", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards": "0", 2024-04-19T02:16:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_hdd": "5", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_ssd": "8", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_min_cost": "65536", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue_cut_off": "high", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_timeout": "15", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_open_classes_on_start": "true", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_os_flags": "0", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_peering_op_priority": "255", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_cost": "1048576", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_priority": "5", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_max": "10000", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_min": "100", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crimson": "false", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flags": "0", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_min_size": "0", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_num": "32", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pgp_num": "0", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_size": "2", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_type": "replicated", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_push_per_object_cost": "1000", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap": "true", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_cost": "20971520", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active": "0", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_single_start": "1", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_priority": "3", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_priority": "5", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep": "0.000000", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_repair_during_recovery": "false", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_requested_scrub_priority": "120", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair": "false", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_hour": "0", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_week_day": "0", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_max": "25", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_min": "5", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_cost": "52428800", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_during_recovery": "false", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_hour": "0", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_week_day": "0", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_event_cost": "4096", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_invalid_stats": "true", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_preemptions": "5", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_priority": "5", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_sleep": "0.000000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_skip_data_digest": "false", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_smart_report_timeout": "5", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_cost": "1048576", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_priority": "5", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_transaction_size": "30", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tracing": "false", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_use_stale_snap": "false", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "osdc_blkin_trace_all": "false", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_kill_at": "0", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_max_join_drift": "10", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min": "500", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min_wait": "0.050000", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_propose_interval": "1.000000", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max": "500", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_min": "250", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_stash_full_interval": "25", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_max": "500", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_min": "250", 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "perf": "true", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "-", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrv": "", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "public_bind_addr": "-", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network": "", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network_interface": "", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_enabled": "false", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_session_max_number": "256", 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_mon_op_timeout": "0", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_osd_op_timeout": "0", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_tracing": "false", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_atime_update_interval": "60", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_parent_reads": "false", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_snap_reads": "false", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blkin_trace_all": "false", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-19T02:16:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache": "true", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_policy": "writearound", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_size": "33554432", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-19T02:16:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_clone_copy_on_read": "false", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_compression_hint": "none", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_concurrent_management_ops": "10", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_clone_format": "auto", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_data_pool": "", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_features": "61", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_format": "2", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_map_options": "", 2024-04-19T02:16:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_order": "22", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_pool": "rbd", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_count": "0", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_unit": "0", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_enable_alloc_hint": "true", 2024-04-19T02:16:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-19T02:16:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler": "simple", 2024-04-19T02:16:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-19T02:16:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-19T02:16:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-19T02:16:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-19T02:16:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-19T02:16:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_order": "24", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_pool": "", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_splay_width": "4", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_parent_reads": "false", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_snap_reads": "false", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-19T02:16:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-19T02:16:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-19T02:16:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mtime_update_interval": "60", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_non_blocking_aio": "true", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_thread_timeout": "60", 2024-04-19T02:16:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_threads": "1", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_parent_cache_enabled": "false", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_plugins": "", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst": "0", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_limit": "0", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_exclude_ops": "0", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst": "0", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_limit": "0", 2024-04-19T02:16:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-19T02:16:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_read_from_replica_policy": "default", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_skip_partial_discard": "true", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_tracing": "false", 2024-04-19T02:16:44.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_names": "true", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_pool": "true", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_base_url": "", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_log_level": "", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_acl_grants_max_num": "100", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_admin_entry": "admin", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_backend_store": "rados", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_barbican_url": "", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_beast_enable_async": "true", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-19T02:16:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_enabled": "true", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_expiry_interval": "900", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_lru_size": "10000", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_config_store": "rados", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_content_length_compat": "false", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress": "true", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cors_rules_max_num": "100", 2024-04-19T02:16:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cross_domain_policy": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_addr": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_password": "", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-19T02:16:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_username": "", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_require_ssl": "true", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-19T02:16:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_addr": "", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_auth": "token", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_namespace": "", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_prefix": "", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-19T02:16:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_token_file": "", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_buffersize": "524288", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_time": "300", 2024-04-19T02:16:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_changes_size": "1000", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_num_shards": "128", 2024-04-19T02:16:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_window": "30", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-19T02:16:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-19T02:16:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_name": "", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_s3website_name": "", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dynamic_resharding": "true", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_gc_threads": "true", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_lc_threads": "true", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_ops_log": "false", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_quota_threads": "true", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_static_website": "false", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_usage_log": "false", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enforce_swift_acls": "true", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_exit_timeout_secs": "120", 2024-04-19T02:16:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_expose_bucket": "false", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_extended_http_attrs": "", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_filter": "none", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontends": "beast port=7480", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred": "50", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_objs": "32", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-19T02:16:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_period": "3600", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_init_timeout": "300", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-19T02:16:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_domain": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password_path": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_project": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_tenant": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token_path": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_user": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_api_version": "2", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_domain": "", 2024-04-19T02:16:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_password": "", 2024-04-19T02:16:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_project": "", 2024-04-19T02:16:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-19T02:16:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_user": "", 2024-04-19T02:16:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_url": "", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_debug_interval": "-1", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_lock_max_time": "90", 2024-04-19T02:16:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_objs": "32", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_rules": "1000", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_worker": "3", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_thread_delay": "0", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_dnattr": "uid", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchfilter": "", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-19T02:16:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_http_headers": "", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name_utc": "false", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_name_len": "0", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_size": "0", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-19T02:16:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_chunk_size": "4194304", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_listing_results": "1000", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_notify_retries": "10", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_param_size": "1048576", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_size": "5368709120", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_slo_entries": "1000", 2024-04-19T02:16:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_log_max_shards": "64", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mp_lock_max_time": "600", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-19T02:16:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_max_gc": "300", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-19T02:16:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_async_rados_threads": "32", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_control_oids": "8", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_numa_node": "-1", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_chunk_size": "100", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_gc_interval": "600", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_timeout": "600", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_tracing": "false", 2024-04-19T02:16:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_token": "", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_url": "", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_verify_ssl": "true", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_rados": "false", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_socket_path": "", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-19T02:16:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval": "2.000000", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_continue": "true", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_tracing": "false", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm": "", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_id": "", 2024-04-19T02:16:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region": "", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_request_uri": "", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_batch_size": "64", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_max_aio": "128", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_num_logs": "16", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_thread_interval": "600", 2024-04-19T02:16:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_resolve_cname": "false", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_run_sync_thread": "true", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-19T02:16:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_scheduler_type": "throttler", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_script_uri": "", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_service_provider_name": "", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_id": "", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_secret": "", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_entry": "sts", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_key": "sts", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_min_session_duration": "900", 2024-04-19T02:16:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_token_introspection_url": "", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_account_in_url": "false", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_entry": "auth", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_url": "", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_custom_header": "", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_need_stats": "true", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_tenant_name": "", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_token_expiration": "86400", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url": "", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url_prefix": "swift", 2024-04-19T02:16:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_lease_period": "120", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-19T02:16:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_thread_pool_size": "512", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_comment": "", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_createby": "", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_encoding": "", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_flag": "false", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_origin": "", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_tracker": "", 2024-04-19T02:16:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_trust_forwarded_https": "false", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_shards": "32", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_user_shards": "1", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_use_opa_authz": "false", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_max_buckets": "1000", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_policies_max_num": "100", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-19T02:16:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_unique_email": "true", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_verify_ssl": "true", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone": "", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_id": "", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup": "", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_id": "", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_auto_session_clear": "true", 2024-04-19T02:16:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_block_size": "4096", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_size": "536870912", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-19T02:16:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_index_type": "binary_search", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_partition_filters": "false", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_perf": "false", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-19T02:16:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "run_dir": "/var/run/ceph", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_block_create": "true", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cache_lru_size": "67108864", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_max_object_size": "16777216", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_device_size": "53687091200", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_capacity": "16", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_main_device_type": "SSD", 2024-04-19T02:16:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_segment_size": "67108864", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "set_keepcaps": "false", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "setgroup": "", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser": "", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser_match_path": "", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-19T02:16:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "thp": "false", 2024-04-19T02:16:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_default_timeout": "60", 2024-04-19T02:16:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-19T02:16:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "throttler_perf_counter": "true" 2024-04-19T02:16:44.208 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:16:44.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-19T02:16:44.353 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a: {} 2024-04-19T02:16:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:16:44.362 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b: {} 2024-04-19T02:16:44.362 INFO:teuthology.orchestra.run.smithi073.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:16:44.371 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c: {} 2024-04-19T02:16:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:16:44.387 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-19T02:16:44.388 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-19T02:16:44.413 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-19T02:16:44.413 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-19T02:16:44.414 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-19T02:16:44.414 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-19T02:16:44.414 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:44.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:44.414 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-19T02:16:44.415 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-19T02:16:44.415 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:44.415 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:44.415 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T02:16:44.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:16:44.416 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-19T02:16:44.416 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-19T02:16:44.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:44.417 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-19T02:16:44.417 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:44.417 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-19T02:16:44.417 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:16:44.419 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:44.417+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:44.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:44.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-19T02:16:44.478 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-04-19T02:16:44.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:16:44.479 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-19T02:16:44.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-19T02:16:44.518 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:44.518+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:44.549 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:44.549 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:44.549 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:16:44.549 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:44.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:44.619 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:44.617+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:44.685 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:44.685 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:44.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:44.721 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:44.722+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 18, 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "30a6d986-f196-4d3c-8512-6c6489722f8f", 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-19T02:16:03.364103+0000", 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-19T02:16:25.482999+0000", 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-19T02:16:13.982256+0000", 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-19T02:16:04.286795+0000", 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:16:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-19T02:16:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:14.248072+0000", 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-19T02:16:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:18.602050+0000", 2024-04-19T02:16:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-19T02:16:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-04-19T02:16:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:22.904068+0000", 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-19T02:16:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:23.465439+0000", 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-19T02:16:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:16:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-19T02:16:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:16:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "16c5fbec-2207-41d1-ae33-893b400fd3da", 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:16:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6800", 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6801", 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6802", 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6803", 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6806", 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6807", 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6804", 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6805", 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.116:6801/21424", 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.116:6803/21424", 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.116:6807/21424", 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.116:6805/21424", 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3211257a-5bd5-4a10-8d5f-c3dae1d504e7", 2024-04-19T02:16:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6800", 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6801", 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6802", 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6803", 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6806", 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6807", 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6804", 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6805", 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.136:6801/21483", 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.136:6803/21483", 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.136:6807/21483", 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.136:6805/21483", 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d", 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:16:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6800", 2024-04-19T02:16:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6801", 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6802", 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6803", 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6806", 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6807", 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6804", 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6805", 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.169:6801/21523", 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.169:6803/21523", 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.169:6807/21523", 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.169:6805/21523", 2024-04-19T02:16:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:16:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581115+0000", 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.639275+0000", 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:16:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581003+0000", 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-19T02:16:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:16:44.824 INFO:tasks.thrashosds.thrasher:j is {'epoch': 18, 'fsid': '30a6d986-f196-4d3c-8512-6c6489722f8f', 'created': '2024-04-19T02:16:03.364103+0000', 'modified': '2024-04-19T02:16:25.482999+0000', 'last_up_change': '2024-04-19T02:16:13.982256+0000', 'last_in_change': '2024-04-19T02:16:04.286795+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '16c5fbec-2207-41d1-ae33-893b400fd3da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 21424}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 21424}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 21424}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 21424}]}, 'public_addr': '172.21.15.116:6801/21424', 'cluster_addr': '172.21.15.116:6803/21424', 'heartbeat_back_addr': '172.21.15.116:6807/21424', 'heartbeat_front_addr': '172.21.15.116:6805/21424', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3211257a-5bd5-4a10-8d5f-c3dae1d504e7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6800', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6801', 'nonce': 21483}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6802', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6803', 'nonce': 21483}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6806', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6807', 'nonce': 21483}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6804', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6805', 'nonce': 21483}]}, 'public_addr': '172.21.15.136:6801/21483', 'cluster_addr': '172.21.15.136:6803/21483', 'heartbeat_back_addr': '172.21.15.136:6807/21483', 'heartbeat_front_addr': '172.21.15.136:6805/21483', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 21523}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 21523}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 21523}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 21523}]}, 'public_addr': '172.21.15.169:6801/21523', 'cluster_addr': '172.21.15.169:6803/21523', 'heartbeat_back_addr': '172.21.15.169:6807/21523', 'heartbeat_front_addr': '172.21.15.169:6805/21523', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581115+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.639275+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581003+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:16:44.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:44.825 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:44.826+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:44.841 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-19T02:16:44.859 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:44.860 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-19T02:16:44.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:44.907 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-19T02:16:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-19T02:16:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-19T02:16:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-19T02:16:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-19T02:16:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42526sec preferred_lft 42526sec 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:b8:c1:5f:ae brd ff:ff:ff:ff:ff:ff 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-19T02:16:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-19T02:16:44.910 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-19T02:16:44.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:44.910 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-19T02:16:44.911 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-19T02:16:44.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-04-19T02:16:44.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-04-19T02:16:44.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-04-19T02:16:44.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-19T02:16:44.911 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-19T02:16:44.926 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:44.930+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:44.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:44.980 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-19T02:16:45.005 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.005 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.019 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:45.026 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:45.030+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:45.034 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-19T02:16:45.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.038 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-19T02:16:45.106 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-19T02:16:45.106 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-19T02:16:45.106 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-19T02:16:45.106 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-19T02:16:45.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.108 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-19T02:16:45.108 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-19T02:16:45.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-19T02:16:45.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-19T02:16:45.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-19T02:16:45.108 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-19T02:16:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:45.119 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:45.127 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:45.125+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:45.134 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-19T02:16:44.178608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89900,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025620,"statfs":{"total":289910292480,"available":289818234880,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003897"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521326+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:24.521326+0000","last_peered":"2024-04-19T02:16:24.521326+0000","last_clean":"2024-04-19T02:16:24.521326+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:24.521326+0000","last_undegraded":"2024-04-19T02:16:24.521326+0000","last_fullsized":"2024-04-19T02:16:24.521326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519236+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:24.519236+0000","last_peered":"2024-04-19T02:16:24.519236+0000","last_clean":"2024-04-19T02:16:24.519236+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:24.519236+0000","last_undegraded":"2024-04-19T02:16:24.519236+0000","last_fullsized":"2024-04-19T02:16:24.519236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527393+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:24.527393+0000","last_peered":"2024-04-19T02:16:24.527393+0000","last_clean":"2024-04-19T02:16:24.527393+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:24.527393+0000","last_undegraded":"2024-04-19T02:16:24.527393+0000","last_fullsized":"2024-04-19T02:16:24.527393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521797+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:24.521797+0000","last_peered":"2024-04-19T02:16:24.521797+0000","last_clean":"2024-04-19T02:16:24.521797+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:24.521797+0000","last_undegraded":"2024-04-19T02:16:24.521797+0000","last_fullsized":"2024-04-19T02:16:24.521797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518437+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:24.518437+0000","last_peered":"2024-04-19T02:16:24.518437+0000","last_clean":"2024-04-19T02:16:24.518437+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:24.518437+0000","last_undegraded":"2024-04-19T02:16:24.518437+0000","last_fullsized":"2024-04-19T02:16:24.518437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519225+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:24.519225+0000","last_peered":"2024-04-19T02:16:24.519225+0000","last_clean":"2024-04-19T02:16:24.519225+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:24.519225+0000","last_undegraded":"2024-04-19T02:16:24.519225+0000","last_fullsized":"2024-04-19T02:16:24.519225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518975+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:24.518975+0000","last_peered":"2024-04-19T02:16:24.518975+0000","last_clean":"2024-04-19T02:16:24.518975+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:24.518975+0000","last_undegraded":"2024-04-19T02:16:24.518975+0000","last_fullsized":"2024-04-19T02:16:24.518975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519248+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:24.519248+0000","last_peered":"2024-04-19T02:16:24.519248+0000","last_clean":"2024-04-19T02:16:24.519248+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:24.519248+0000","last_undegraded":"2024-04-19T02:16:24.519248+0000","last_fullsized":"2024-04-19T02:16:24.519248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513937+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:24.513937+0000","last_peered":"2024-04-19T02:16:24.513937+0000","last_clean":"2024-04-19T02:16:24.513937+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:24.513937+0000","last_undegraded":"2024-04-19T02:16:24.513937+0000","last_fullsized":"2024-04-19T02:16:24.513937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521455+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:24.521455+0000","last_peered":"2024-04-19T02:16:24.521455+0000","last_clean":"2024-04-19T02:16:24.521455+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:24.521455+0000","last_undegraded":"2024-04-19T02:16:24.521455+0000","last_fullsized":"2024-04-19T02:16:24.521455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521791+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:24.521791+0000","last_peered":"2024-04-19T02:16:24.521791+0000","last_clean":"2024-04-19T02:16:24.521791+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:24.521791+0000","last_undegraded":"2024-04-19T02:16:24.521791+0000","last_fullsized":"2024-04-19T02:16:24.521791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525459+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:24.525459+0000","last_peered":"2024-04-19T02:16:24.525459+0000","last_clean":"2024-04-19T02:16:24.525459+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:24.525459+0000","last_undegraded":"2024-04-19T02:16:24.525459+0000","last_fullsized":"2024-04-19T02:16:24.525459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519126+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:24.519126+0000","last_peered":"2024-04-19T02:16:24.519126+0000","last_clean":"2024-04-19T02:16:24.519126+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:24.519126+0000","last_undegraded":"2024-04-19T02:16:24.519126+0000","last_fullsized":"2024-04-19T02:16:24.519126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520744+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:24.520744+0000","last_peered":"2024-04-19T02:16:24.520744+0000","last_clean":"2024-04-19T02:16:24.520744+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:24.520744+0000","last_undegraded":"2024-04-19T02:16:24.520744+0000","last_fullsized":"2024-04-19T02:16:24.520744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520230+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:24.520230+0000","last_peered":"2024-04-19T02:16:24.520230+0000","last_clean":"2024-04-19T02:16:24.520230+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:24.520230+0000","last_undegraded":"2024-04-19T02:16:24.520230+0000","last_fullsized":"2024-04-19T02:16:24.520230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520060+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:24.520060+0000","last_peered":"2024-04-19T02:16:24.520060+0000","last_clean":"2024-04-19T02:16:24.520060+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:24.520060+0000","last_undegraded":"2024-04-19T02:16:24.520060+0000","last_fullsized":"2024-04-19T02:16:24.520060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514988+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:24.514988+0000","last_peered":"2024-04-19T02:16:24.514988+0000","last_clean":"2024-04-19T02:16:24.514988+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:24.514988+0000","last_undegraded":"2024-04-19T02:16:24.514988+0000","last_fullsized":"2024-04-19T02:16:24.514988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519056+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:24.519056+0000","last_peered":"2024-04-19T02:16:24.519056+0000","last_clean":"2024-04-19T02:16:24.519056+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:24.519056+0000","last_undegraded":"2024-04-19T02:16:24.519056+0000","last_fullsized":"2024-04-19T02:16:24.519056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514210+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:24.514210+0000","last_peered":"2024-04-19T02:16:24.514210+0000","last_clean":"2024-04-19T02:16:24.514210+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:24.514210+0000","last_undegraded":"2024-04-19T02:16:24.514210+0000","last_fullsized":"2024-04-19T02:16:24.514210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521557+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:24.521557+0000","last_peered":"2024-04-19T02:16:24.521557+0000","last_clean":"2024-04-19T02:16:24.521557+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:24.521557+0000","last_undegraded":"2024-04-19T02:16:24.521557+0000","last_fullsized":"2024-04-19T02:16:24.521557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520111+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:24.520111+0000","last_peered":"2024-04-19T02:16:24.520111+0000","last_clean":"2024-04-19T02:16:24.520111+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:24.520111+0000","last_undegraded":"2024-04-19T02:16:24.520111+0000","last_fullsized":"2024-04-19T02:16:24.520111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524330+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:24.524330+0000","last_peered":"2024-04-19T02:16:24.524330+0000","last_clean":"2024-04-19T02:16:24.524330+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:24.524330+0000","last_undegraded":"2024-04-19T02:16:24.524330+0000","last_fullsized":"2024-04-19T02:16:24.524330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521993+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:24.521993+0000","last_peered":"2024-04-19T02:16:24.521993+0000","last_clean":"2024-04-19T02:16:24.521993+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:24.521993+0000","last_undegraded":"2024-04-19T02:16:24.521993+0000","last_fullsized":"2024-04-19T02:16:24.521993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519561+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:24.519561+0000","last_peered":"2024-04-19T02:16:24.519561+0000","last_clean":"2024-04-19T02:16:24.519561+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:24.519561+0000","last_undegraded":"2024-04-19T02:16:24.519561+0000","last_fullsized":"2024-04-19T02:16:24.519561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523521+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:24.523521+0000","last_peered":"2024-04-19T02:16:24.523521+0000","last_clean":"2024-04-19T02:16:24.523521+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:24.523521+0000","last_undegraded":"2024-04-19T02:16:24.523521+0000","last_fullsized":"2024-04-19T02:16:24.523521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526425+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:24.526425+0000","last_peered":"2024-04-19T02:16:24.526425+0000","last_clean":"2024-04-19T02:16:24.526425+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:24.526425+0000","last_undegraded":"2024-04-19T02:16:24.526425+0000","last_fullsized":"2024-04-19T02:16:24.526425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527334+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:24.527334+0000","last_peered":"2024-04-19T02:16:24.527334+0000","last_clean":"2024-04-19T02:16:24.527334+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:24.527334+0000","last_undegraded":"2024-04-19T02:16:24.527334+0000","last_fullsized":"2024-04-19T02:16:24.527334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525176+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:24.525176+0000","last_peered":"2024-04-19T02:16:24.525176+0000","last_clean":"2024-04-19T02:16:24.525176+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:24.525176+0000","last_undegraded":"2024-04-19T02:16:24.525176+0000","last_fullsized":"2024-04-19T02:16:24.525176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513429+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:24.513429+0000","last_peered":"2024-04-19T02:16:24.513429+0000","last_clean":"2024-04-19T02:16:24.513429+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:24.513429+0000","last_undegraded":"2024-04-19T02:16:24.513429+0000","last_fullsized":"2024-04-19T02:16:24.513429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522053+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:24.522053+0000","last_peered":"2024-04-19T02:16:24.522053+0000","last_clean":"2024-04-19T02:16:24.522053+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:24.522053+0000","last_undegraded":"2024-04-19T02:16:24.522053+0000","last_fullsized":"2024-04-19T02:16:24.522053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512827+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:24.512827+0000","last_peered":"2024-04-19T02:16:24.512827+0000","last_clean":"2024-04-19T02:16:24.512827+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:24.512827+0000","last_undegraded":"2024-04-19T02:16:24.512827+0000","last_fullsized":"2024-04-19T02:16:24.512827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515064+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:24.515064+0000","last_peered":"2024-04-19T02:16:24.515064+0000","last_clean":"2024-04-19T02:16:24.515064+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:24.515064+0000","last_undegraded":"2024-04-19T02:16:24.515064+0000","last_fullsized":"2024-04-19T02:16:24.515064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518921+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:24.518921+0000","last_peered":"2024-04-19T02:16:24.518921+0000","last_clean":"2024-04-19T02:16:24.518921+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:24.518921+0000","last_undegraded":"2024-04-19T02:16:24.518921+0000","last_fullsized":"2024-04-19T02:16:24.518921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.530969+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:24.530969+0000","last_peered":"2024-04-19T02:16:24.530969+0000","last_clean":"2024-04-19T02:16:24.530969+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:24.530969+0000","last_undegraded":"2024-04-19T02:16:24.530969+0000","last_fullsized":"2024-04-19T02:16:24.530969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522746+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:24.522746+0000","last_peered":"2024-04-19T02:16:24.522746+0000","last_clean":"2024-04-19T02:16:24.522746+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:24.522746+0000","last_undegraded":"2024-04-19T02:16:24.522746+0000","last_fullsized":"2024-04-19T02:16:24.522746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488581+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:24.488581+0000","last_peered":"2024-04-19T02:16:24.488581+0000","last_clean":"2024-04-19T02:16:24.488581+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:24.488581+0000","last_undegraded":"2024-04-19T02:16:24.488581+0000","last_fullsized":"2024-04-19T02:16:24.488581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526731+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:24.526731+0000","last_peered":"2024-04-19T02:16:24.526731+0000","last_clean":"2024-04-19T02:16:24.526731+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:24.526731+0000","last_undegraded":"2024-04-19T02:16:24.526731+0000","last_fullsized":"2024-04-19T02:16:24.526731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495683+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:24.495683+0000","last_peered":"2024-04-19T02:16:24.495683+0000","last_clean":"2024-04-19T02:16:24.495683+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:24.495683+0000","last_undegraded":"2024-04-19T02:16:24.495683+0000","last_fullsized":"2024-04-19T02:16:24.495683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526825+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:24.526825+0000","last_peered":"2024-04-19T02:16:24.526825+0000","last_clean":"2024-04-19T02:16:24.526825+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:24.526825+0000","last_undegraded":"2024-04-19T02:16:24.526825+0000","last_fullsized":"2024-04-19T02:16:24.526825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.529809+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:24.529809+0000","last_peered":"2024-04-19T02:16:24.529809+0000","last_clean":"2024-04-19T02:16:24.529809+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:24.529809+0000","last_undegraded":"2024-04-19T02:16:24.529809+0000","last_fullsized":"2024-04-19T02:16:24.529809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.516091+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:24.516091+0000","last_peered":"2024-04-19T02:16:24.516091+0000","last_clean":"2024-04-19T02:16:24.516091+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:24.516091+0000","last_undegraded":"2024-04-19T02:16:24.516091+0000","last_fullsized":"2024-04-19T02:16:24.516091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524969+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:24.524969+0000","last_peered":"2024-04-19T02:16:24.524969+0000","last_clean":"2024-04-19T02:16:24.524969+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:24.524969+0000","last_undegraded":"2024-04-19T02:16:24.524969+0000","last_fullsized":"2024-04-19T02:16:24.524969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519660+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:24.519660+0000","last_peered":"2024-04-19T02:16:24.519660+0000","last_clean":"2024-04-19T02:16:24.519660+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:24.519660+0000","last_undegraded":"2024-04-19T02:16:24.519660+0000","last_fullsized":"2024-04-19T02:16:24.519660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519536+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:24.519536+0000","last_peered":"2024-04-19T02:16:24.519536+0000","last_clean":"2024-04-19T02:16:24.519536+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:24.519536+0000","last_undegraded":"2024-04-19T02:16:24.519536+0000","last_fullsized":"2024-04-19T02:16:24.519536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521517+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:24.521517+0000","last_peered":"2024-04-19T02:16:24.521517+0000","last_clean":"2024-04-19T02:16:24.521517+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:24.521517+0000","last_undegraded":"2024-04-19T02:16:24.521517+0000","last_fullsized":"2024-04-19T02:16:24.521517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.509240+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:24.509240+0000","last_peered":"2024-04-19T02:16:24.509240+0000","last_clean":"2024-04-19T02:16:24.509240+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:24.509240+0000","last_undegraded":"2024-04-19T02:16:24.509240+0000","last_fullsized":"2024-04-19T02:16:24.509240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498902+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:24.498902+0000","last_peered":"2024-04-19T02:16:24.498902+0000","last_clean":"2024-04-19T02:16:24.498902+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:24.498902+0000","last_undegraded":"2024-04-19T02:16:24.498902+0000","last_fullsized":"2024-04-19T02:16:24.498902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524255+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:24.524255+0000","last_peered":"2024-04-19T02:16:24.524255+0000","last_clean":"2024-04-19T02:16:24.524255+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:24.524255+0000","last_undegraded":"2024-04-19T02:16:24.524255+0000","last_fullsized":"2024-04-19T02:16:24.524255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523741+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:24.523741+0000","last_peered":"2024-04-19T02:16:24.523741+0000","last_clean":"2024-04-19T02:16:24.523741+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:24.523741+0000","last_undegraded":"2024-04-19T02:16:24.523741+0000","last_fullsized":"2024-04-19T02:16:24.523741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521748+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:24.521748+0000","last_peered":"2024-04-19T02:16:24.521748+0000","last_clean":"2024-04-19T02:16:24.521748+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:24.521748+0000","last_undegraded":"2024-04-19T02:16:24.521748+0000","last_fullsized":"2024-04-19T02:16:24.521748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491382+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:24.491382+0000","last_peered":"2024-04-19T02:16:24.491382+0000","last_clean":"2024-04-19T02:16:24.491382+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:24.491382+0000","last_undegraded":"2024-04-19T02:16:24.491382+0000","last_fullsized":"2024-04-19T02:16:24.491382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526992+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:24.526992+0000","last_peered":"2024-04-19T02:16:24.526992+0000","last_clean":"2024-04-19T02:16:24.526992+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:24.526992+0000","last_undegraded":"2024-04-19T02:16:24.526992+0000","last_fullsized":"2024-04-19T02:16:24.526992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495981+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:24.495981+0000","last_peered":"2024-04-19T02:16:24.495981+0000","last_clean":"2024-04-19T02:16:24.495981+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:24.495981+0000","last_undegraded":"2024-04-19T02:16:24.495981+0000","last_fullsized":"2024-04-19T02:16:24.495981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521669+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:24.521669+0000","last_peered":"2024-04-19T02:16:24.521669+0000","last_clean":"2024-04-19T02:16:24.521669+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:24.521669+0000","last_undegraded":"2024-04-19T02:16:24.521669+0000","last_fullsized":"2024-04-19T02:16:24.521669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490556+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:24.490556+0000","last_peered":"2024-04-19T02:16:24.490556+0000","last_clean":"2024-04-19T02:16:24.490556+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:24.490556+0000","last_undegraded":"2024-04-19T02:16:24.490556+0000","last_fullsized":"2024-04-19T02:16:24.490556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514902+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:24.514902+0000","last_peered":"2024-04-19T02:16:24.514902+0000","last_clean":"2024-04-19T02:16:24.514902+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:24.514902+0000","last_undegraded":"2024-04-19T02:16:24.514902+0000","last_fullsized":"2024-04-19T02:16:24.514902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493180+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:24.493180+0000","last_peered":"2024-04-19T02:16:24.493180+0000","last_clean":"2024-04-19T02:16:24.493180+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:24.493180+0000","last_undegraded":"2024-04-19T02:16:24.493180+0000","last_fullsized":"2024-04-19T02:16:24.493180+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.496022+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:24.496022+0000","last_peered":"2024-04-19T02:16:24.496022+0000","last_clean":"2024-04-19T02:16:24.496022+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:24.496022+0000","last_undegraded":"2024-04-19T02:16:24.496022+0000","last_fullsized":"2024-04-19T02:16:24.496022+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488896+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:24.488896+0000","last_peered":"2024-04-19T02:16:24.488896+0000","last_clean":"2024-04-19T02:16:24.488896+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:24.488896+0000","last_undegraded":"2024-04-19T02:16:24.488896+0000","last_fullsized":"2024-04-19T02:16:24.488896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.527437+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:24.527437+0000","last_peered":"2024-04-19T02:16:24.527437+0000","last_clean":"2024-04-19T02:16:24.527437+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:24.527437+0000","last_undegraded":"2024-04-19T02:16:24.527437+0000","last_fullsized":"2024-04-19T02:16:24.527437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.493324+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:24.493324+0000","last_peered":"2024-04-19T02:16:24.493324+0000","last_clean":"2024-04-19T02:16:24.493324+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:24.493324+0000","last_undegraded":"2024-04-19T02:16:24.493324+0000","last_fullsized":"2024-04-19T02:16:24.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490067+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:24.490067+0000","last_peered":"2024-04-19T02:16:24.490067+0000","last_clean":"2024-04-19T02:16:24.490067+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:24.490067+0000","last_undegraded":"2024-04-19T02:16:24.490067+0000","last_fullsized":"2024-04-19T02:16:24.490067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.518949+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:24.518949+0000","last_peered":"2024-04-19T02:16:24.518949+0000","last_clean":"2024-04-19T02:16:24.518949+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:24.518949+0000","last_undegraded":"2024-04-19T02:16:24.518949+0000","last_fullsized":"2024-04-19T02:16:24.518949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490281+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:24.490281+0000","last_peered":"2024-04-19T02:16:24.490281+0000","last_clean":"2024-04-19T02:16:24.490281+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:24.490281+0000","last_undegraded":"2024-04-19T02:16:24.490281+0000","last_fullsized":"2024-04-19T02:16:24.490281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490834+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:24.490834+0000","last_peered":"2024-04-19T02:16:24.490834+0000","last_clean":"2024-04-19T02:16:24.490834+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:24.490834+0000","last_undegraded":"2024-04-19T02:16:24.490834+0000","last_fullsized":"2024-04-19T02:16:24.490834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514947+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:24.514947+0000","last_peered":"2024-04-19T02:16:24.514947+0000","last_clean":"2024-04-19T02:16:24.514947+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:24.514947+0000","last_undegraded":"2024-04-19T02:16:24.514947+0000","last_fullsized":"2024-04-19T02:16:24.514947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491655+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:24.491655+0000","last_peered":"2024-04-19T02:16:24.491655+0000","last_clean":"2024-04-19T02:16:24.491655+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:24.491655+0000","last_undegraded":"2024-04-19T02:16:24.491655+0000","last_fullsized":"2024-04-19T02:16:24.491655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.495064+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:24.495064+0000","last_peered":"2024-04-19T02:16:24.495064+0000","last_clean":"2024-04-19T02:16:24.495064+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:24.495064+0000","last_undegraded":"2024-04-19T02:16:24.495064+0000","last_fullsized":"2024-04-19T02:16:24.495064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513571+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:24.513571+0000","last_peered":"2024-04-19T02:16:24.513571+0000","last_clean":"2024-04-19T02:16:24.513571+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:24.513571+0000","last_undegraded":"2024-04-19T02:16:24.513571+0000","last_fullsized":"2024-04-19T02:16:24.513571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.500388+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:24.500388+0000","last_peered":"2024-04-19T02:16:24.500388+0000","last_clean":"2024-04-19T02:16:24.500388+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:24.500388+0000","last_undegraded":"2024-04-19T02:16:24.500388+0000","last_fullsized":"2024-04-19T02:16:24.500388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488762+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:24.488762+0000","last_peered":"2024-04-19T02:16:24.488762+0000","last_clean":"2024-04-19T02:16:24.488762+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:24.488762+0000","last_undegraded":"2024-04-19T02:16:24.488762+0000","last_fullsized":"2024-04-19T02:16:24.488762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522145+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:24.522145+0000","last_peered":"2024-04-19T02:16:24.522145+0000","last_clean":"2024-04-19T02:16:24.522145+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:24.522145+0000","last_undegraded":"2024-04-19T02:16:24.522145+0000","last_fullsized":"2024-04-19T02:16:24.522145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488841+0000","last_change":"2024-04-19T02:16:24.137063+0000","last_active":"2024-04-19T02:16:24.488841+0000","last_peered":"2024-04-19T02:16:24.488841+0000","last_clean":"2024-04-19T02:16:24.488841+0000","last_became_active":"2024-04-19T02:16:24.136084+0000","last_became_peered":"2024-04-19T02:16:24.136084+0000","last_unstale":"2024-04-19T02:16:24.488841+0000","last_undegraded":"2024-04-19T02:16:24.488841+0000","last_fullsized":"2024-04-19T02:16:24.488841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.498940+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:24.498940+0000","last_peered":"2024-04-19T02:16:24.498940+0000","last_clean":"2024-04-19T02:16:24.498940+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:24.498940+0000","last_undegraded":"2024-04-19T02:16:24.498940+0000","last_fullsized":"2024-04-19T02:16:24.498940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.525050+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:24.525050+0000","last_peered":"2024-04-19T02:16:24.525050+0000","last_clean":"2024-04-19T02:16:24.525050+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:24.525050+0000","last_undegraded":"2024-04-19T02:16:24.525050+0000","last_fullsized":"2024-04-19T02:16:24.525050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.513005+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:24.513005+0000","last_peered":"2024-04-19T02:16:24.513005+0000","last_clean":"2024-04-19T02:16:24.513005+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:24.513005+0000","last_undegraded":"2024-04-19T02:16:24.513005+0000","last_fullsized":"2024-04-19T02:16:24.513005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491847+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:24.491847+0000","last_peered":"2024-04-19T02:16:24.491847+0000","last_clean":"2024-04-19T02:16:24.491847+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:24.491847+0000","last_undegraded":"2024-04-19T02:16:24.491847+0000","last_fullsized":"2024-04-19T02:16:24.491847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526485+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:24.526485+0000","last_peered":"2024-04-19T02:16:24.526485+0000","last_clean":"2024-04-19T02:16:24.526485+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:24.526485+0000","last_undegraded":"2024-04-19T02:16:24.526485+0000","last_fullsized":"2024-04-19T02:16:24.526485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:16:28.399827+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:28.399827+0000","last_peered":"2024-04-19T02:16:28.399827+0000","last_clean":"2024-04-19T02:16:28.399827+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:28.399827+0000","last_undegraded":"2024-04-19T02:16:28.399827+0000","last_fullsized":"2024-04-19T02:16:28.399827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491493+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:24.491493+0000","last_peered":"2024-04-19T02:16:24.491493+0000","last_clean":"2024-04-19T02:16:24.491493+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:24.491493+0000","last_undegraded":"2024-04-19T02:16:24.491493+0000","last_fullsized":"2024-04-19T02:16:24.491493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522177+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:24.522177+0000","last_peered":"2024-04-19T02:16:24.522177+0000","last_clean":"2024-04-19T02:16:24.522177+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:24.522177+0000","last_undegraded":"2024-04-19T02:16:24.522177+0000","last_fullsized":"2024-04-19T02:16:24.522177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521806+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:24.521806+0000","last_peered":"2024-04-19T02:16:24.521806+0000","last_clean":"2024-04-19T02:16:24.521806+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:24.521806+0000","last_undegraded":"2024-04-19T02:16:24.521806+0000","last_fullsized":"2024-04-19T02:16:24.521806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.533109+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:24.533109+0000","last_peered":"2024-04-19T02:16:24.533109+0000","last_clean":"2024-04-19T02:16:24.533109+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:24.533109+0000","last_undegraded":"2024-04-19T02:16:24.533109+0000","last_fullsized":"2024-04-19T02:16:24.533109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514198+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:24.514198+0000","last_peered":"2024-04-19T02:16:24.514198+0000","last_clean":"2024-04-19T02:16:24.514198+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:24.514198+0000","last_undegraded":"2024-04-19T02:16:24.514198+0000","last_fullsized":"2024-04-19T02:16:24.514198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.524105+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:24.524105+0000","last_peered":"2024-04-19T02:16:24.524105+0000","last_clean":"2024-04-19T02:16:24.524105+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:24.524105+0000","last_undegraded":"2024-04-19T02:16:24.524105+0000","last_fullsized":"2024-04-19T02:16:24.524105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.491469+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:24.491469+0000","last_peered":"2024-04-19T02:16:24.491469+0000","last_clean":"2024-04-19T02:16:24.491469+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:24.491469+0000","last_undegraded":"2024-04-19T02:16:24.491469+0000","last_fullsized":"2024-04-19T02:16:24.491469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521373+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:24.521373+0000","last_peered":"2024-04-19T02:16:24.521373+0000","last_clean":"2024-04-19T02:16:24.521373+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:24.521373+0000","last_undegraded":"2024-04-19T02:16:24.521373+0000","last_fullsized":"2024-04-19T02:16:24.521373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.492272+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:24.492272+0000","last_peered":"2024-04-19T02:16:24.492272+0000","last_clean":"2024-04-19T02:16:24.492272+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:24.492272+0000","last_undegraded":"2024-04-19T02:16:24.492272+0000","last_fullsized":"2024-04-19T02:16:24.492272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.512722+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:24.512722+0000","last_peered":"2024-04-19T02:16:24.512722+0000","last_clean":"2024-04-19T02:16:24.512722+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:24.512722+0000","last_undegraded":"2024-04-19T02:16:24.512722+0000","last_fullsized":"2024-04-19T02:16:24.512722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.522303+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:24.522303+0000","last_peered":"2024-04-19T02:16:24.522303+0000","last_clean":"2024-04-19T02:16:24.522303+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:24.522303+0000","last_undegraded":"2024-04-19T02:16:24.522303+0000","last_fullsized":"2024-04-19T02:16:24.522303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.488585+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:24.488585+0000","last_peered":"2024-04-19T02:16:24.488585+0000","last_clean":"2024-04-19T02:16:24.488585+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:24.488585+0000","last_undegraded":"2024-04-19T02:16:24.488585+0000","last_fullsized":"2024-04-19T02:16:24.488585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.503371+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:24.503371+0000","last_peered":"2024-04-19T02:16:24.503371+0000","last_clean":"2024-04-19T02:16:24.503371+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:24.503371+0000","last_undegraded":"2024-04-19T02:16:24.503371+0000","last_fullsized":"2024-04-19T02:16:24.503371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.490145+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:24.490145+0000","last_peered":"2024-04-19T02:16:24.490145+0000","last_clean":"2024-04-19T02:16:24.490145+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:24.490145+0000","last_undegraded":"2024-04-19T02:16:24.490145+0000","last_fullsized":"2024-04-19T02:16:24.490145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.526148+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:24.526148+0000","last_peered":"2024-04-19T02:16:24.526148+0000","last_clean":"2024-04-19T02:16:24.526148+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:24.526148+0000","last_undegraded":"2024-04-19T02:16:24.526148+0000","last_fullsized":"2024-04-19T02:16:24.526148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514216+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:24.514216+0000","last_peered":"2024-04-19T02:16:24.514216+0000","last_clean":"2024-04-19T02:16:24.514216+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:24.514216+0000","last_undegraded":"2024-04-19T02:16:24.514216+0000","last_fullsized":"2024-04-19T02:16:24.514216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.521760+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:24.521760+0000","last_peered":"2024-04-19T02:16:24.521760+0000","last_clean":"2024-04-19T02:16:24.521760+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:24.521760+0000","last_undegraded":"2024-04-19T02:16:24.521760+0000","last_fullsized":"2024-04-19T02:16:24.521760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.520388+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:24.520388+0000","last_peered":"2024-04-19T02:16:24.520388+0000","last_clean":"2024-04-19T02:16:24.520388+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:24.520388+0000","last_undegraded":"2024-04-19T02:16:24.520388+0000","last_fullsized":"2024-04-19T02:16:24.520388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.514797+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:24.514797+0000","last_peered":"2024-04-19T02:16:24.514797+0000","last_clean":"2024-04-19T02:16:24.514797+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:24.514797+0000","last_undegraded":"2024-04-19T02:16:24.514797+0000","last_fullsized":"2024-04-19T02:16:24.514797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.531294+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:24.531294+0000","last_peered":"2024-04-19T02:16:24.531294+0000","last_clean":"2024-04-19T02:16:24.531294+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:24.531294+0000","last_undegraded":"2024-04-19T02:16:24.531294+0000","last_fullsized":"2024-04-19T02:16:24.531294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.511560+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:24.511560+0000","last_peered":"2024-04-19T02:16:24.511560+0000","last_clean":"2024-04-19T02:16:24.511560+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:24.511560+0000","last_undegraded":"2024-04-19T02:16:24.511560+0000","last_fullsized":"2024-04-19T02:16:24.511560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523814+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:24.523814+0000","last_peered":"2024-04-19T02:16:24.523814+0000","last_clean":"2024-04-19T02:16:24.523814+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:24.523814+0000","last_undegraded":"2024-04-19T02:16:24.523814+0000","last_fullsized":"2024-04-19T02:16:24.523814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.519363+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:24.519363+0000","last_peered":"2024-04-19T02:16:24.519363+0000","last_clean":"2024-04-19T02:16:24.519363+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:24.519363+0000","last_undegraded":"2024-04-19T02:16:24.519363+0000","last_fullsized":"2024-04-19T02:16:24.519363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.510268+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:24.510268+0000","last_peered":"2024-04-19T02:16:24.510268+0000","last_clean":"2024-04-19T02:16:24.510268+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:24.510268+0000","last_undegraded":"2024-04-19T02:16:24.510268+0000","last_fullsized":"2024-04-19T02:16:24.510268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.515136+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:24.515136+0000","last_peered":"2024-04-19T02:16:24.515136+0000","last_clean":"2024-04-19T02:16:24.515136+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:24.515136+0000","last_undegraded":"2024-04-19T02:16:24.515136+0000","last_fullsized":"2024-04-19T02:16:24.515136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-19T02:16:24.523813+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:24.523813+0000","last_peered":"2024-04-19T02:16:24.523813+0000","last_clean":"2024-04-19T02:16:24.523813+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:24.523813+0000","last_undegraded":"2024-04-19T02:16:24.523813+0000","last_fullsized":"2024-04-19T02:16:24.523813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:45.138 INFO:tasks.thrashosds.thrasher:Setting 3.4 to [0, 2] 2024-04-19T02:16:45.138 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.4', '0', '2'] 2024-04-19T02:16:45.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.4 0 2 2024-04-19T02:16:45.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.140 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-19T02:16:45.142 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.142 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.158 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:45.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.184 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-04-19T02:16:45.228 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:45.230+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:45.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.232 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-19T02:16:45.232 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-19T02:16:45.232 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-19T02:16:45.232 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-19T02:16:45.232 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-19T02:16:45.278 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.278 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.279 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:16:45.293 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:45.297 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-19T02:16:45.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.297 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-19T02:16:45.297 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-19T02:16:45.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-19T02:16:45.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-19T02:16:45.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-19T02:16:45.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-19T02:16:45.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-19T02:16:45.298 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-19T02:16:45.339 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:45.342+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.390 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-19T02:16:45.390 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-19T02:16:45.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-04-19T02:16:45.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-04-19T02:16:45.390 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-19T02:16:45.407 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-19T02:16:45.407 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.429 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:45.430+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:45.437 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-19T02:16:45.455 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:45.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-19T02:16:45.530 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:45.534+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:45.556 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-19T02:16:45.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-19T02:16:45.601 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.601 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-19T02:16:45.608 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-19T02:16:45.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.609 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-19T02:16:45.615 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:45.631 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:45.630+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:45.655 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-19T02:16:45.656 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-19T02:16:45.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-19T02:16:45.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-19T02:16:45.732 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:45.734+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:45.738 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.739 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.754 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:45.764 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-19T02:16:45.765 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-19T02:16:45.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:45.765 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-19T02:16:45.792 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-04-19T02:16:45.792+0000 7fb7f00bc580 -1 init, newargv = 0x5584a2df4b80 newargc=15 2024-04-19T02:16:45.792 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[22751]: starting ceph client 2024-04-19T02:16:45.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[22751]: starting fuse 2024-04-19T02:16:45.833 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:45.829+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:45.887 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.887 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.903 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:45.947 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:45.945+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:46.035 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:46.038+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:46.066 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.067 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.080 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:46.136 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:46.138+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:46.197 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.197 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.213 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:46.236 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:46.233+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:set 3.4 pg_upmap mapping to [0,2] 2024-04-19T02:16:46.338 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:46.342+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:46.345 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.345 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.360 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:46.439 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:46.442+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:46.481 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.481 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:46.540 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:46.541+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:46.616 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.616 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:46.630 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:46.675 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:46.678+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:46.741 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:46.742+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:46.759 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.759 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:46.781 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:16:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:46.802 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:16:46.802 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:46.820 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:16:46.820 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:46.842 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:46.837+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:46.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-19T02:16:46.912 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-19T02:16:46.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-19T02:16:46.942 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:46.942 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:46.942 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:16:46.942 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:16:46.942 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:46.942 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:46.946+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:46.956 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:46.968 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-19T02:16:46.968 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-19T02:16:46.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:46.969 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-19T02:16:47.015 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-04-19T02:16:47.016 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-19T02:16:47.016 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-19T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-04-19T02:16:47.018 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-04-19T02:16:47.043 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:47.041+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:47.125 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.635099726, 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:47.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:47.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:16:47.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.634981344, 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:16:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:16:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.634912344, 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:16:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.634782128000001, 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:16:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:16:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.634702575999999, 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:16:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:16:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.634607132999999, 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.634526226999998, 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:16:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.634058398000001, 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:16:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:16:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:47.170 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.633997691000001, 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:47.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.626845370000002, 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.616922590000001, 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:16:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:16:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.616571232999998, 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:16:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.616008313000002, 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:16:47.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.615908778000001, 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.190 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.605205313999999, 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:16:47.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:16:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.603572729, 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:47.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:16:47.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.602639549999999, 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:16:47.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.602513220999999, 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.206 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.210 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.602249736000001, 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:16:47.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.933152554999999, 2024-04-19T02:16:47.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.220 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:47.221 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:47.221 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:47.222 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.22751.asok 2024-04-19T02:16:47.223 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:47.223 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:47.221+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:47.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:16:47.317 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22751.asok 2024-04-19T02:16:47.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:47.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22751.asok status 2024-04-19T02:16:47.323 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:47.321+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:47.355 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:47.355 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:47.355 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:16:47.355 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:47.369 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:47.424 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:47.426+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:47.466 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "646b8c7d293d8ec31a40c69f7b3237b19c1be24d", 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)", 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "22751", 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4564, 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-04-19T02:16:47.467 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4564 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2500730957 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2500730957 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:47.468 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4564 192.168.0.1:0/2500730957", 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/2500730957", 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 5, 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 19, 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-04-19T02:16:47.469 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:16:47.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:47.481 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-04-19T02:16:47.481 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:47.486 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-04-19T02:16:47.486 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:47.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:16:47.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:47.525 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:47.526+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:47.538 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:47.539 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:47.539 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:16:47.539 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:16:47.539 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:47.546 INFO:teuthology.run_tasks:Running task workunit... 2024-04-19T02:16:47.563 INFO:tasks.workunit:Pulling workunits from ref 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:16:47.564 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-19T02:16:47.564 INFO:tasks.workunit:timeout=3h 2024-04-19T02:16:47.564 INFO:tasks.workunit:cleanup=True 2024-04-19T02:16:47.564 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:47.566 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:47.591 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:47.591 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-19T02:16:47.592 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-19T02:16:47.592 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:16:47.592 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-19T02:16:47.592 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-19 02:16:24.485122321 +0000 2024-04-19T02:16:47.592 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-19 02:16:47.548019757 +0000 2024-04-19T02:16:47.592 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-04-19T02:16:47.592 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-19T02:16:47.592 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-19T02:16:47.626 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:47.621+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:47.651 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:16:47.691 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:47.691 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:16:47.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:16:47.691 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:16:47.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.138989800000001, 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:16:47.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:16:47.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.138597531999999, 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:16:47.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:16:47.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:16:47.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:16:47.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:16:47.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:16:47.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:16:47.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:16:47.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.138127730000001, 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:47.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:16:47.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:16:47.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.137190669999999, 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:16:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:16:47.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.712 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:16:47.712 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:47.712 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.136875062000001, 2024-04-19T02:16:47.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:16:47.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.713 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:47.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:16:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.136426039, 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.722 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.723 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:16:47.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:47.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.135837183, 2024-04-19T02:16:47.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:16:47.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.201030754000001, 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.728 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:16:47.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:16:47.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:16:47.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.733 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200932267999999, 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.734 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:16:47.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:16:47.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:16:47.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200864612, 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:16:47.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:16:47.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:47.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200812656, 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:16:47.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:16:47.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:16:47.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:16:47.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:16:47.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:16:47.757 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.757 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.757 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.757 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200758659000002, 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:47.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:16:47.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.763 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200703953000001, 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:47.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:16:47.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:16:47.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:16:47.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.769 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.770 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.770 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:47.770 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200650393, 2024-04-19T02:16:47.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:16:47.771 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.771 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.771 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:47.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:47.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:16:47.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:16:47.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:16:47.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:16:47.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:16:47.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:16:47.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:16:47.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:47.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200594441, 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:16:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.783 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.200546043999999, 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:16:47.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.190409909, 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.186402863000001, 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:16:47.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.186344831, 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.185876286999999, 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:16:47.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:47.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:47.805 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:47.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:47.808 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:47.805+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:47.813 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-19T02:16:47.908 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:47.910+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:47.936 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:16:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-19T02:16:47.937 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:47.951 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:48.009 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:48.005+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:48.074 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:48.074 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:16:48.074 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-19T02:16:48.074 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-19T02:16:48.074 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:48.087 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:48.136 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:48.138+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:48.208 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 31.838895575999999, 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022228746000000001, 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:48.209 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 117 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:48.210 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370334+0000", 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370340+0000", 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370349+0000", 2024-04-19T02:16:48.211 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3300000000000005e-06 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370358+0000", 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4589999999999998e-06 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388807+0000", 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018449436999999999 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.212 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388930+0000", 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012235600000000001 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.389117+0000", 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186875 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.390381+0000", 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012640399999999999 2024-04-19T02:16:48.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392450+0000", 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020695269999999998 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392515+0000", 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4682000000000002e-05 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392563+0000", 2024-04-19T02:16:48.214 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8662999999999998e-05 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 31.483353611999998, 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021625360999999999, 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:48.215 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 164 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.216 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725875+0000", 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725991+0000", 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000115485 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726005+0000", 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4267000000000001e-05 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726014+0000", 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8400000000000001e-06 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740028+0000", 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014014039000000001 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740148+0000", 2024-04-19T02:16:48.218 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119533 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740351+0000", 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000203718 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.744482+0000", 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041303290000000003 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747346+0000", 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028647740000000001 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747431+0000", 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4393000000000003e-05 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747502+0000", 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1218999999999997e-05 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.220 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 31.483202942999998, 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021599448, 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 165 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.221 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726036+0000", 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1970000000000002e-06 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726049+0000", 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3273e-05 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726056+0000", 2024-04-19T02:16:48.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1729999999999998e-06 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743322+0000", 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017265692999999999 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743445+0000", 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012279500000000001 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743633+0000", 2024-04-19T02:16:48.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000188722 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.745654+0000", 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020209469999999999 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747516+0000", 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001861578 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747573+0000", 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7484000000000001e-05 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747627+0000", 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3458999999999998e-05 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.226 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717948629999999, 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026155528000000001, 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:48.227 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491279+0000", 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491296+0000", 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7110000000000001e-05 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491325+0000", 2024-04-19T02:16:48.228 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9070000000000001e-05 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491348+0000", 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2900000000000001e-05 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495290+0000", 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039419140000000004 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496920+0000", 2024-04-19T02:16:48.229 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016300959999999999 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497231+0000", 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000310568 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505316+0000", 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080857410000000005 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517073+0000", 2024-04-19T02:16:48.230 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011756691 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517255+0000", 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000181962 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517437+0000", 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000182299 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.231 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717859857000001, 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026727732000000001, 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:48.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491369+0000", 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491383+0000", 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4466e-05 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491403+0000", 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9473000000000001e-05 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491420+0000", 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7090000000000001e-05 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498831+0000", 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074110139999999996 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.234 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499047+0000", 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021572799999999999 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499345+0000", 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029797800000000001 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505423+0000", 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060781159999999997 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.235 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517860+0000", 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012436918999999999 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518004+0000", 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014407600000000001 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518098+0000", 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4362000000000002e-05 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717794168000001, 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027347060999999999, 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491435+0000", 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491442+0000", 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8369999999999999e-06 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491460+0000", 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7547e-05 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491473+0000", 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3446e-05 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499944+0000", 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084714009999999999 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500227+0000", 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000283045 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500561+0000", 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033363700000000002 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509743+0000", 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091819880000000003 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518208+0000", 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084647709999999994 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518680+0000", 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00047247000000000001 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518783+0000", 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010294900000000001 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717744948, 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027680531000000001, 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491484+0000", 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491492+0000", 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3860000000000001e-06 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.243 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491509+0000", 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.696e-05 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491522+0000", 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.322e-05 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501273+0000", 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097514639999999996 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501485+0000", 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021127200000000001 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501814+0000", 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032901700000000002 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509758+0000", 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007944329 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518935+0000", 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.009176745 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519073+0000", 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000138255 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519166+0000", 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3016000000000005e-05 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.246 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717669708999999, 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037163597999999999, 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.247 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491559+0000", 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491569+0000", 2024-04-19T02:16:48.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0176999999999999e-05 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491589+0000", 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9510000000000001e-05 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491607+0000", 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8533e-05 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502933+0000", 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011325408 2024-04-19T02:16:48.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503696+0000", 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00076329999999999996 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504054+0000", 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035819399999999999 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515030+0000", 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010975944 2024-04-19T02:16:48.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528254+0000", 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013223999 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528387+0000", 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000132652 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528724+0000", 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033722400000000001 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.251 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717609062000001, 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037472687999999997, 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.252 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491620+0000", 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491628+0000", 2024-04-19T02:16:48.253 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5229999999999998e-06 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491645+0000", 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7319000000000001e-05 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491659+0000", 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3864e-05 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511359+0000", 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019700583000000001 2024-04-19T02:16:48.254 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511590+0000", 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000231108 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511891+0000", 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030086499999999999 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519283+0000", 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073919019999999997 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.255 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528864+0000", 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0095805430000000004 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528990+0000", 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000126456 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529094+0000", 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103735 2024-04-19T02:16:48.256 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717558405999998, 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037857123999999999, 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491671+0000", 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491678+0000", 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9099999999999999e-06 2024-04-19T02:16:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491696+0000", 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7966999999999999e-05 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491709+0000", 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3356000000000001e-05 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513534+0000", 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021825223000000001 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513941+0000", 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00040700000000000003 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.514246+0000", 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000304364 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.520103+0000", 2024-04-19T02:16:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058571719999999999 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529229+0000", 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091263549999999992 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529430+0000", 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020086400000000001 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529529+0000", 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9069999999999998e-05 2024-04-19T02:16:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717478404000001, 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038136467, 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491751+0000", 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491758+0000", 2024-04-19T02:16:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3139999999999998e-06 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491776+0000", 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8012999999999998e-05 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491790+0000", 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4173e-05 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515076+0000", 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023285173999999999 2024-04-19T02:16:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515262+0000", 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186305 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516475+0000", 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012131170000000001 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521138+0000", 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046631550000000004 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529678+0000", 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085395709999999993 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529807+0000", 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012929200000000001 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529888+0000", 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1433000000000005e-05 2024-04-19T02:16:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717426980999999, 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024863728000000002, 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491809+0000", 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5540000000000003e-06 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491828+0000", 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9429999999999999e-05 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7416000000000001e-05 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497895+0000", 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060489469999999998 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498946+0000", 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001051129 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499220+0000", 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000273928 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509102+0000", 2024-04-19T02:16:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0098820690000000003 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516293+0000", 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071913020000000001 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516548+0000", 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025478799999999999 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516667+0000", 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119265 2024-04-19T02:16:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717359511000002, 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026983983999999999, 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491870+0000", 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491877+0000", 2024-04-19T02:16:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.447e-06 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491898+0000", 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0792999999999999e-05 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491912+0000", 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3740000000000001e-05 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499845+0000", 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079334190000000006 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502302+0000", 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024567069999999998 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502745+0000", 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000442822 2024-04-19T02:16:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509121+0000", 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063766650000000001 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518263+0000", 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091422090000000001 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518753+0000", 2024-04-19T02:16:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00048999600000000003 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518855+0000", 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101313 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.717295652000001, 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.039155085999999999, 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491934+0000", 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491941+0000", 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6830000000000008e-06 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491959+0000", 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7484000000000001e-05 2024-04-19T02:16:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492423+0000", 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000464399 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499801+0000", 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007378 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501517+0000", 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0017152789999999999 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501827+0000", 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031013200000000002 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509113+0000", 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007286346 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530913+0000", 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021800077000000001 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531004+0000", 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0799999999999998e-05 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531090+0000", 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5818999999999999e-05 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.716459114999999, 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038579016000000001, 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492797+0000", 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8059999999999999e-05 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492870+0000", 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2578999999999997e-05 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492898+0000", 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8394e-05 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503481+0000", 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010583169999999999 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503995+0000", 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00051340999999999995 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504343+0000", 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034785300000000002 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516750+0000", 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012407506 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531185+0000", 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014434565999999999 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531290+0000", 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010582900000000001 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531350+0000", 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9753000000000002e-05 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.714684905999999, 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034067229999999997, 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494556+0000", 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2679e-05 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494708+0000", 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000151416 2024-04-19T02:16:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494770+0000", 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2292999999999995e-05 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503657+0000", 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088874850000000005 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503946+0000", 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028820700000000001 2024-04-19T02:16:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504257+0000", 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031168400000000001 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516765+0000", 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012508244999999999 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528273+0000", 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011507167 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528491+0000", 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021798499999999999 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528613+0000", 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122049 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.714301333000002, 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034106006000000001, 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494928+0000", 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494938+0000", 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0156999999999999e-05 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495033+0000", 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5556000000000005e-05 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495050+0000", 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6356000000000001e-05 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505119+0000", 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010069896 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506334+0000", 2024-04-19T02:16:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00121423 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506662+0000", 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000328757 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516778+0000", 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010115928 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528709+0000", 2024-04-19T02:16:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011930685999999999 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528938+0000", 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022862100000000001 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529035+0000", 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7286000000000003e-05 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:26 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.714162371, 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.035948230999999997, 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495067+0000", 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495076+0000", 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5130000000000002e-06 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495131+0000", 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4583999999999998e-05 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495184+0000", 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3038999999999998e-05 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500428+0000", 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052442740000000002 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500785+0000", 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035727399999999998 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036842400000000001 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507385+0000", 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062313749999999999 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530895+0000", 2024-04-19T02:16:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023510029000000002 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530964+0000", 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8856999999999995e-05 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531016+0000", 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2182000000000003e-05 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:29 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.714021508999998, 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026450912, 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495207+0000", 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495234+0000", 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7076999999999998e-05 2024-04-19T02:16:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495945+0000", 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071182099999999996 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495968+0000", 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2855999999999999e-05 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498885+0000", 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029170730000000001 2024-04-19T02:16:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499136+0000", 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025015500000000001 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499457+0000", 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000321014 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508677+0000", 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092201249999999992 2024-04-19T02:16:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521389+0000", 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012712146000000001 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521514+0000", 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012532600000000001 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521660+0000", 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014555899999999999 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 23.713240337999999, 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.033370365999999999, 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495988+0000", 2024-04-19T02:16:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496001+0000", 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2999e-05 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496027+0000", 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6207000000000002e-05 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496043+0000", 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5605999999999999e-05 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507643+0000", 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011599553 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508710+0000", 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001067201 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529360+0000", 2024-04-19T02:16:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020650532999999999 2024-04-19T02:16:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:48.312 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:48.313 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:48.314 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:16:48.315 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:48.309+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:48.414 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:48.413+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:48.443 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:48.443 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:48.444 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:16:48.444 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:48.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:48.515 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:48.514+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:48.580 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:48.581 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:48.581 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:16:48.581 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:16:48.581 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:48.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:48.616 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:48.613+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:48.714 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:16:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:16:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.225483835999999, 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:16:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.225365453999999, 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:16:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:16:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.225296453999999, 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.225166238, 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.225086686000001, 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:16:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.224991243000002, 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.224910337000001, 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:16:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.224442507999999, 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:16:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.224381801, 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:48.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:16:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.21722948, 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.2073067, 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:16:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.206955343000001, 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.772 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.206392423, 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:16:48.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.206292888, 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:16:48.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.780 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.195589424000001, 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:48.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.784 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.193956838999998, 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:48.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:16:48.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.193023660000001, 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:16:48.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:16:48.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.192897331000001, 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:16:48.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:16:48.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.192633846, 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:16:48.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.801 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.523536665000002, 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:16:48.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:48.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:48.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:48.807 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:48.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:48.809 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:48.805+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:48.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:48.910 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:48.910+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:48.953 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:48.986 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:16:48.987 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:49.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:16:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:49.011 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:49.010+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:49.026 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:16:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:49.075 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:49.075 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:49.089 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:49.135 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:49.133+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:49.208 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:49.209 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:49.214 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:49.214+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:49.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:49.315 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:49.318+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:49.356 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:49.356 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:49.370 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:49.416 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:49.418+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:49.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:49.518 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:49.518+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:49.619 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:49.618+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:49.630 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:49.630 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:49.646 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:49.720 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:49.722+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:49.795 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:49.821 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:49.821+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:49.917 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:49.918 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:49.922 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:49.922+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:49.932 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:50.022 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:50.026+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:50.092 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.093 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:50.151 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:50.149+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:50.224 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:50.221+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.254 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:50.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:16:50.339 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:50.337+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:50.418 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.418 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.425 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:50.421+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:50.432 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:50.526 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:50.521+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:50.602 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.602 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.616 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:50.659 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:50.657+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:50.728 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:50.730+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:50.750 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.750 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.764 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:50.851 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:50.854+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:50.930 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:50.930+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:50.931 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.931 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.945 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:51.031 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:51.034+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:51.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:51.110 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:51.111 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:51.126 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:51.168 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:51.170+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:51.196 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:16:51.197 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:51.217 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:16:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:51.234 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:51.238+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:51.237 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:16:51.237 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:51.259 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:51.259 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:16:51.259 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:51.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:51.314 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:51.314 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:51.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:51.317 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:16:51.335 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:51.333+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:51.396 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:51.396 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:51.396 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:16:51.396 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:16:51.396 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:51.412 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:51.455 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:51.458+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.042409012, 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.533 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:16:51.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:16:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:51.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:16:51.538 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.04229063, 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.539 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.544 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.04222163, 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:16:51.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.550 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.042091414000001, 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:51.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:16:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:16:51.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.042011861999999, 2024-04-19T02:16:51.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:16:51.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:16:51.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.041916419, 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:16:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.567 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.041835512999999, 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:51.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:16:51.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.041367684000001, 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:16:51.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:16:51.575 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.041306977000001, 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:16:51.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.034154655999998, 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:16:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.024231876000002, 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.588 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.023880518999999, 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:16:51.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.023317598999999, 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:16:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.596 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.023218064000002, 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:51.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:16:51.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.012514599999999, 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:16:51.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:16:51.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.010882015, 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:16:51.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.009948836, 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:16:51.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:16:51.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.009822506999999, 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:16:51.613 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:16:51.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:16:51.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.009559022000001, 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:16:51.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.340461841, 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:51.622 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:51.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:16:51.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:51.628 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:51.628 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:51.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:51.637 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:16:51.638 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-19T02:16:51.320485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596004,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":251,"num_write_kb":3479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89988,"kb_used_data":728,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025532,"statfs":{"total":289910292480,"available":289818144768,"internally_reserved":0,"allocated":745472,"data_stored":1403911,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3274,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.141251"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304705+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:47.304705+0000","last_peered":"2024-04-19T02:16:47.304705+0000","last_clean":"2024-04-19T02:16:47.304705+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:47.304705+0000","last_undegraded":"2024-04-19T02:16:47.304705+0000","last_fullsized":"2024-04-19T02:16:47.304705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303702+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:47.303702+0000","last_peered":"2024-04-19T02:16:47.303702+0000","last_clean":"2024-04-19T02:16:47.303702+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:47.303702+0000","last_undegraded":"2024-04-19T02:16:47.303702+0000","last_fullsized":"2024-04-19T02:16:47.303702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321403+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:47.321403+0000","last_peered":"2024-04-19T02:16:47.321403+0000","last_clean":"2024-04-19T02:16:47.321403+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:47.321403+0000","last_undegraded":"2024-04-19T02:16:47.321403+0000","last_fullsized":"2024-04-19T02:16:47.321403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321203+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:47.321203+0000","last_peered":"2024-04-19T02:16:47.321203+0000","last_clean":"2024-04-19T02:16:47.321203+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:47.321203+0000","last_undegraded":"2024-04-19T02:16:47.321203+0000","last_fullsized":"2024-04-19T02:16:47.321203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303202+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:47.303202+0000","last_peered":"2024-04-19T02:16:47.303202+0000","last_clean":"2024-04-19T02:16:47.303202+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:47.303202+0000","last_undegraded":"2024-04-19T02:16:47.303202+0000","last_fullsized":"2024-04-19T02:16:47.303202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320149+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:47.320149+0000","last_peered":"2024-04-19T02:16:47.320149+0000","last_clean":"2024-04-19T02:16:47.320149+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:47.320149+0000","last_undegraded":"2024-04-19T02:16:47.320149+0000","last_fullsized":"2024-04-19T02:16:47.320149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320025+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:47.320025+0000","last_peered":"2024-04-19T02:16:47.320025+0000","last_clean":"2024-04-19T02:16:47.320025+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:47.320025+0000","last_undegraded":"2024-04-19T02:16:47.320025+0000","last_fullsized":"2024-04-19T02:16:47.320025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.319706+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:47.319706+0000","last_peered":"2024-04-19T02:16:47.319706+0000","last_clean":"2024-04-19T02:16:47.319706+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:47.319706+0000","last_undegraded":"2024-04-19T02:16:47.319706+0000","last_fullsized":"2024-04-19T02:16:47.319706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306631+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:47.306631+0000","last_peered":"2024-04-19T02:16:47.306631+0000","last_clean":"2024-04-19T02:16:47.306631+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:47.306631+0000","last_undegraded":"2024-04-19T02:16:47.306631+0000","last_fullsized":"2024-04-19T02:16:47.306631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303966+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:47.303966+0000","last_peered":"2024-04-19T02:16:47.303966+0000","last_clean":"2024-04-19T02:16:47.303966+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:47.303966+0000","last_undegraded":"2024-04-19T02:16:47.303966+0000","last_fullsized":"2024-04-19T02:16:47.303966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321417+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:47.321417+0000","last_peered":"2024-04-19T02:16:47.321417+0000","last_clean":"2024-04-19T02:16:47.321417+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:47.321417+0000","last_undegraded":"2024-04-19T02:16:47.321417+0000","last_fullsized":"2024-04-19T02:16:47.321417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303545+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:47.303545+0000","last_peered":"2024-04-19T02:16:47.303545+0000","last_clean":"2024-04-19T02:16:47.303545+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:47.303545+0000","last_undegraded":"2024-04-19T02:16:47.303545+0000","last_fullsized":"2024-04-19T02:16:47.303545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303051+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:47.303051+0000","last_peered":"2024-04-19T02:16:47.303051+0000","last_clean":"2024-04-19T02:16:47.303051+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:47.303051+0000","last_undegraded":"2024-04-19T02:16:47.303051+0000","last_fullsized":"2024-04-19T02:16:47.303051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320278+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:47.320278+0000","last_peered":"2024-04-19T02:16:47.320278+0000","last_clean":"2024-04-19T02:16:47.320278+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:47.320278+0000","last_undegraded":"2024-04-19T02:16:47.320278+0000","last_fullsized":"2024-04-19T02:16:47.320278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320105+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:47.320105+0000","last_peered":"2024-04-19T02:16:47.320105+0000","last_clean":"2024-04-19T02:16:47.320105+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:47.320105+0000","last_undegraded":"2024-04-19T02:16:47.320105+0000","last_fullsized":"2024-04-19T02:16:47.320105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.319706+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:47.319706+0000","last_peered":"2024-04-19T02:16:47.319706+0000","last_clean":"2024-04-19T02:16:47.319706+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:47.319706+0000","last_undegraded":"2024-04-19T02:16:47.319706+0000","last_fullsized":"2024-04-19T02:16:47.319706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307375+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:47.307375+0000","last_peered":"2024-04-19T02:16:47.307375+0000","last_clean":"2024-04-19T02:16:47.307375+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:47.307375+0000","last_undegraded":"2024-04-19T02:16:47.307375+0000","last_fullsized":"2024-04-19T02:16:47.307375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304119+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:47.304119+0000","last_peered":"2024-04-19T02:16:47.304119+0000","last_clean":"2024-04-19T02:16:47.304119+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:47.304119+0000","last_undegraded":"2024-04-19T02:16:47.304119+0000","last_fullsized":"2024-04-19T02:16:47.304119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306526+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:47.306526+0000","last_peered":"2024-04-19T02:16:47.306526+0000","last_clean":"2024-04-19T02:16:47.306526+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:47.306526+0000","last_undegraded":"2024-04-19T02:16:47.306526+0000","last_fullsized":"2024-04-19T02:16:47.306526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321203+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:47.321203+0000","last_peered":"2024-04-19T02:16:47.321203+0000","last_clean":"2024-04-19T02:16:47.321203+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:47.321203+0000","last_undegraded":"2024-04-19T02:16:47.321203+0000","last_fullsized":"2024-04-19T02:16:47.321203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320914+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:47.320914+0000","last_peered":"2024-04-19T02:16:47.320914+0000","last_clean":"2024-04-19T02:16:47.320914+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:47.320914+0000","last_undegraded":"2024-04-19T02:16:47.320914+0000","last_fullsized":"2024-04-19T02:16:47.320914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303105+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:47.303105+0000","last_peered":"2024-04-19T02:16:47.303105+0000","last_clean":"2024-04-19T02:16:47.303105+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:47.303105+0000","last_undegraded":"2024-04-19T02:16:47.303105+0000","last_fullsized":"2024-04-19T02:16:47.303105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305084+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:47.305084+0000","last_peered":"2024-04-19T02:16:47.305084+0000","last_clean":"2024-04-19T02:16:47.305084+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:47.305084+0000","last_undegraded":"2024-04-19T02:16:47.305084+0000","last_fullsized":"2024-04-19T02:16:47.305084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.302412+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:47.302412+0000","last_peered":"2024-04-19T02:16:47.302412+0000","last_clean":"2024-04-19T02:16:47.302412+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:47.302412+0000","last_undegraded":"2024-04-19T02:16:47.302412+0000","last_fullsized":"2024-04-19T02:16:47.302412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304817+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:47.304817+0000","last_peered":"2024-04-19T02:16:47.304817+0000","last_clean":"2024-04-19T02:16:47.304817+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:47.304817+0000","last_undegraded":"2024-04-19T02:16:47.304817+0000","last_fullsized":"2024-04-19T02:16:47.304817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307120+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:47.307120+0000","last_peered":"2024-04-19T02:16:47.307120+0000","last_clean":"2024-04-19T02:16:47.307120+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:47.307120+0000","last_undegraded":"2024-04-19T02:16:47.307120+0000","last_fullsized":"2024-04-19T02:16:47.307120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.322130+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:47.322130+0000","last_peered":"2024-04-19T02:16:47.322130+0000","last_clean":"2024-04-19T02:16:47.322130+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:47.322130+0000","last_undegraded":"2024-04-19T02:16:47.322130+0000","last_fullsized":"2024-04-19T02:16:47.322130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303877+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:47.303877+0000","last_peered":"2024-04-19T02:16:47.303877+0000","last_clean":"2024-04-19T02:16:47.303877+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:47.303877+0000","last_undegraded":"2024-04-19T02:16:47.303877+0000","last_fullsized":"2024-04-19T02:16:47.303877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306100+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:47.306100+0000","last_peered":"2024-04-19T02:16:47.306100+0000","last_clean":"2024-04-19T02:16:47.306100+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:47.306100+0000","last_undegraded":"2024-04-19T02:16:47.306100+0000","last_fullsized":"2024-04-19T02:16:47.306100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303316+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:47.303316+0000","last_peered":"2024-04-19T02:16:47.303316+0000","last_clean":"2024-04-19T02:16:47.303316+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:47.303316+0000","last_undegraded":"2024-04-19T02:16:47.303316+0000","last_fullsized":"2024-04-19T02:16:47.303316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305191+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:47.305191+0000","last_peered":"2024-04-19T02:16:47.305191+0000","last_clean":"2024-04-19T02:16:47.305191+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:47.305191+0000","last_undegraded":"2024-04-19T02:16:47.305191+0000","last_fullsized":"2024-04-19T02:16:47.305191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320075+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:47.320075+0000","last_peered":"2024-04-19T02:16:47.320075+0000","last_clean":"2024-04-19T02:16:47.320075+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:47.320075+0000","last_undegraded":"2024-04-19T02:16:47.320075+0000","last_fullsized":"2024-04-19T02:16:47.320075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303794+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:47.303794+0000","last_peered":"2024-04-19T02:16:47.303794+0000","last_clean":"2024-04-19T02:16:47.303794+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:47.303794+0000","last_undegraded":"2024-04-19T02:16:47.303794+0000","last_fullsized":"2024-04-19T02:16:47.303794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321361+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:47.321361+0000","last_peered":"2024-04-19T02:16:47.321361+0000","last_clean":"2024-04-19T02:16:47.321361+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:47.321361+0000","last_undegraded":"2024-04-19T02:16:47.321361+0000","last_fullsized":"2024-04-19T02:16:47.321361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304121+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:47.304121+0000","last_peered":"2024-04-19T02:16:47.304121+0000","last_clean":"2024-04-19T02:16:47.304121+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:47.304121+0000","last_undegraded":"2024-04-19T02:16:47.304121+0000","last_fullsized":"2024-04-19T02:16:47.304121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305530+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:47.305530+0000","last_peered":"2024-04-19T02:16:47.305530+0000","last_clean":"2024-04-19T02:16:47.305530+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:47.305530+0000","last_undegraded":"2024-04-19T02:16:47.305530+0000","last_fullsized":"2024-04-19T02:16:47.305530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307307+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:47.307307+0000","last_peered":"2024-04-19T02:16:47.307307+0000","last_clean":"2024-04-19T02:16:47.307307+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:47.307307+0000","last_undegraded":"2024-04-19T02:16:47.307307+0000","last_fullsized":"2024-04-19T02:16:47.307307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303087+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:47.303087+0000","last_peered":"2024-04-19T02:16:47.303087+0000","last_clean":"2024-04-19T02:16:47.303087+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:47.303087+0000","last_undegraded":"2024-04-19T02:16:47.303087+0000","last_fullsized":"2024-04-19T02:16:47.303087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306675+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:47.306675+0000","last_peered":"2024-04-19T02:16:47.306675+0000","last_clean":"2024-04-19T02:16:47.306675+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:47.306675+0000","last_undegraded":"2024-04-19T02:16:47.306675+0000","last_fullsized":"2024-04-19T02:16:47.306675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320275+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:47.320275+0000","last_peered":"2024-04-19T02:16:47.320275+0000","last_clean":"2024-04-19T02:16:47.320275+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:47.320275+0000","last_undegraded":"2024-04-19T02:16:47.320275+0000","last_fullsized":"2024-04-19T02:16:47.320275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.322246+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:47.322246+0000","last_peered":"2024-04-19T02:16:47.322246+0000","last_clean":"2024-04-19T02:16:47.322246+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:47.322246+0000","last_undegraded":"2024-04-19T02:16:47.322246+0000","last_fullsized":"2024-04-19T02:16:47.322246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.302459+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:47.302459+0000","last_peered":"2024-04-19T02:16:47.302459+0000","last_clean":"2024-04-19T02:16:47.302459+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:47.302459+0000","last_undegraded":"2024-04-19T02:16:47.302459+0000","last_fullsized":"2024-04-19T02:16:47.302459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304366+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:47.304366+0000","last_peered":"2024-04-19T02:16:47.304366+0000","last_clean":"2024-04-19T02:16:47.304366+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:47.304366+0000","last_undegraded":"2024-04-19T02:16:47.304366+0000","last_fullsized":"2024-04-19T02:16:47.304366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.302829+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:47.302829+0000","last_peered":"2024-04-19T02:16:47.302829+0000","last_clean":"2024-04-19T02:16:47.302829+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:47.302829+0000","last_undegraded":"2024-04-19T02:16:47.302829+0000","last_fullsized":"2024-04-19T02:16:47.302829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.322108+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:47.322108+0000","last_peered":"2024-04-19T02:16:47.322108+0000","last_clean":"2024-04-19T02:16:47.322108+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:47.322108+0000","last_undegraded":"2024-04-19T02:16:47.322108+0000","last_fullsized":"2024-04-19T02:16:47.322108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320486+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:47.320486+0000","last_peered":"2024-04-19T02:16:47.320486+0000","last_clean":"2024-04-19T02:16:47.320486+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:47.320486+0000","last_undegraded":"2024-04-19T02:16:47.320486+0000","last_fullsized":"2024-04-19T02:16:47.320486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321816+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:47.321816+0000","last_peered":"2024-04-19T02:16:47.321816+0000","last_clean":"2024-04-19T02:16:47.321816+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:47.321816+0000","last_undegraded":"2024-04-19T02:16:47.321816+0000","last_fullsized":"2024-04-19T02:16:47.321816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305802+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:47.305802+0000","last_peered":"2024-04-19T02:16:47.305802+0000","last_clean":"2024-04-19T02:16:47.305802+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:47.305802+0000","last_undegraded":"2024-04-19T02:16:47.305802+0000","last_fullsized":"2024-04-19T02:16:47.305802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306492+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:47.306492+0000","last_peered":"2024-04-19T02:16:47.306492+0000","last_clean":"2024-04-19T02:16:47.306492+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:47.306492+0000","last_undegraded":"2024-04-19T02:16:47.306492+0000","last_fullsized":"2024-04-19T02:16:47.306492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321476+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:47.321476+0000","last_peered":"2024-04-19T02:16:47.321476+0000","last_clean":"2024-04-19T02:16:47.321476+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:47.321476+0000","last_undegraded":"2024-04-19T02:16:47.321476+0000","last_fullsized":"2024-04-19T02:16:47.321476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320602+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:47.320602+0000","last_peered":"2024-04-19T02:16:47.320602+0000","last_clean":"2024-04-19T02:16:47.320602+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:47.320602+0000","last_undegraded":"2024-04-19T02:16:47.320602+0000","last_fullsized":"2024-04-19T02:16:47.320602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321689+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:47.321689+0000","last_peered":"2024-04-19T02:16:47.321689+0000","last_clean":"2024-04-19T02:16:47.321689+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:47.321689+0000","last_undegraded":"2024-04-19T02:16:47.321689+0000","last_fullsized":"2024-04-19T02:16:47.321689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303087+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:47.303087+0000","last_peered":"2024-04-19T02:16:47.303087+0000","last_clean":"2024-04-19T02:16:47.303087+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:47.303087+0000","last_undegraded":"2024-04-19T02:16:47.303087+0000","last_fullsized":"2024-04-19T02:16:47.303087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321723+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:47.321723+0000","last_peered":"2024-04-19T02:16:47.321723+0000","last_clean":"2024-04-19T02:16:47.321723+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:47.321723+0000","last_undegraded":"2024-04-19T02:16:47.321723+0000","last_fullsized":"2024-04-19T02:16:47.321723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.302564+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:47.302564+0000","last_peered":"2024-04-19T02:16:47.302564+0000","last_clean":"2024-04-19T02:16:47.302564+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:47.302564+0000","last_undegraded":"2024-04-19T02:16:47.302564+0000","last_fullsized":"2024-04-19T02:16:47.302564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306946+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:47.306946+0000","last_peered":"2024-04-19T02:16:47.306946+0000","last_clean":"2024-04-19T02:16:47.306946+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:47.306946+0000","last_undegraded":"2024-04-19T02:16:47.306946+0000","last_fullsized":"2024-04-19T02:16:47.306946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":217,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320525+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:47.320525+0000","last_peered":"2024-04-19T02:16:47.320525+0000","last_clean":"2024-04-19T02:16:47.320525+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:47.320525+0000","last_undegraded":"2024-04-19T02:16:47.320525+0000","last_fullsized":"2024-04-19T02:16:47.320525+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321558+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:47.321558+0000","last_peered":"2024-04-19T02:16:47.321558+0000","last_clean":"2024-04-19T02:16:47.321558+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:47.321558+0000","last_undegraded":"2024-04-19T02:16:47.321558+0000","last_fullsized":"2024-04-19T02:16:47.321558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305842+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:47.305842+0000","last_peered":"2024-04-19T02:16:47.305842+0000","last_clean":"2024-04-19T02:16:47.305842+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:47.305842+0000","last_undegraded":"2024-04-19T02:16:47.305842+0000","last_fullsized":"2024-04-19T02:16:47.305842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321960+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:47.321960+0000","last_peered":"2024-04-19T02:16:47.321960+0000","last_clean":"2024-04-19T02:16:47.321960+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:47.321960+0000","last_undegraded":"2024-04-19T02:16:47.321960+0000","last_fullsized":"2024-04-19T02:16:47.321960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320351+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:47.320351+0000","last_peered":"2024-04-19T02:16:47.320351+0000","last_clean":"2024-04-19T02:16:47.320351+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:47.320351+0000","last_undegraded":"2024-04-19T02:16:47.320351+0000","last_fullsized":"2024-04-19T02:16:47.320351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305624+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:47.305624+0000","last_peered":"2024-04-19T02:16:47.305624+0000","last_clean":"2024-04-19T02:16:47.305624+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:47.305624+0000","last_undegraded":"2024-04-19T02:16:47.305624+0000","last_fullsized":"2024-04-19T02:16:47.305624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304200+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:47.304200+0000","last_peered":"2024-04-19T02:16:47.304200+0000","last_clean":"2024-04-19T02:16:47.304200+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:47.304200+0000","last_undegraded":"2024-04-19T02:16:47.304200+0000","last_fullsized":"2024-04-19T02:16:47.304200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305839+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:47.305839+0000","last_peered":"2024-04-19T02:16:47.305839+0000","last_clean":"2024-04-19T02:16:47.305839+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:47.305839+0000","last_undegraded":"2024-04-19T02:16:47.305839+0000","last_fullsized":"2024-04-19T02:16:47.305839+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.302752+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:47.302752+0000","last_peered":"2024-04-19T02:16:47.302752+0000","last_clean":"2024-04-19T02:16:47.302752+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:47.302752+0000","last_undegraded":"2024-04-19T02:16:47.302752+0000","last_fullsized":"2024-04-19T02:16:47.302752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306902+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:47.306902+0000","last_peered":"2024-04-19T02:16:47.306902+0000","last_clean":"2024-04-19T02:16:47.306902+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:47.306902+0000","last_undegraded":"2024-04-19T02:16:47.306902+0000","last_fullsized":"2024-04-19T02:16:47.306902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320735+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:47.320735+0000","last_peered":"2024-04-19T02:16:47.320735+0000","last_clean":"2024-04-19T02:16:47.320735+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:47.320735+0000","last_undegraded":"2024-04-19T02:16:47.320735+0000","last_fullsized":"2024-04-19T02:16:47.320735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321391+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:47.321391+0000","last_peered":"2024-04-19T02:16:47.321391+0000","last_clean":"2024-04-19T02:16:47.321391+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:47.321391+0000","last_undegraded":"2024-04-19T02:16:47.321391+0000","last_fullsized":"2024-04-19T02:16:47.321391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306490+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:47.306490+0000","last_peered":"2024-04-19T02:16:47.306490+0000","last_clean":"2024-04-19T02:16:47.306490+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:47.306490+0000","last_undegraded":"2024-04-19T02:16:47.306490+0000","last_fullsized":"2024-04-19T02:16:47.306490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.322247+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:47.322247+0000","last_peered":"2024-04-19T02:16:47.322247+0000","last_clean":"2024-04-19T02:16:47.322247+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:47.322247+0000","last_undegraded":"2024-04-19T02:16:47.322247+0000","last_fullsized":"2024-04-19T02:16:47.322247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307070+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:47.307070+0000","last_peered":"2024-04-19T02:16:47.307070+0000","last_clean":"2024-04-19T02:16:47.307070+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:47.307070+0000","last_undegraded":"2024-04-19T02:16:47.307070+0000","last_fullsized":"2024-04-19T02:16:47.307070+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303197+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:47.303197+0000","last_peered":"2024-04-19T02:16:47.303197+0000","last_clean":"2024-04-19T02:16:47.303197+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:47.303197+0000","last_undegraded":"2024-04-19T02:16:47.303197+0000","last_fullsized":"2024-04-19T02:16:47.303197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-19T02:16:48.316763+0000","last_change":"2024-04-19T02:16:47.306583+0000","last_active":"2024-04-19T02:16:48.316763+0000","last_peered":"2024-04-19T02:16:48.316763+0000","last_clean":"2024-04-19T02:16:48.316763+0000","last_became_active":"2024-04-19T02:16:47.306228+0000","last_became_peered":"2024-04-19T02:16:47.306228+0000","last_unstale":"2024-04-19T02:16:48.316763+0000","last_undegraded":"2024-04-19T02:16:48.316763+0000","last_fullsized":"2024-04-19T02:16:48.316763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:07:53.741752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304912+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:47.304912+0000","last_peered":"2024-04-19T02:16:47.304912+0000","last_clean":"2024-04-19T02:16:47.304912+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:47.304912+0000","last_undegraded":"2024-04-19T02:16:47.304912+0000","last_fullsized":"2024-04-19T02:16:47.304912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303362+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:47.303362+0000","last_peered":"2024-04-19T02:16:47.303362+0000","last_clean":"2024-04-19T02:16:47.303362+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:47.303362+0000","last_undegraded":"2024-04-19T02:16:47.303362+0000","last_fullsized":"2024-04-19T02:16:47.303362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307629+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:47.307629+0000","last_peered":"2024-04-19T02:16:47.307629+0000","last_clean":"2024-04-19T02:16:47.307629+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:47.307629+0000","last_undegraded":"2024-04-19T02:16:47.307629+0000","last_fullsized":"2024-04-19T02:16:47.307629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307613+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:47.307613+0000","last_peered":"2024-04-19T02:16:47.307613+0000","last_clean":"2024-04-19T02:16:47.307613+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:47.307613+0000","last_undegraded":"2024-04-19T02:16:47.307613+0000","last_fullsized":"2024-04-19T02:16:47.307613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305249+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:47.305249+0000","last_peered":"2024-04-19T02:16:47.305249+0000","last_clean":"2024-04-19T02:16:47.305249+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:47.305249+0000","last_undegraded":"2024-04-19T02:16:47.305249+0000","last_fullsized":"2024-04-19T02:16:47.305249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307561+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:47.307561+0000","last_peered":"2024-04-19T02:16:47.307561+0000","last_clean":"2024-04-19T02:16:47.307561+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:47.307561+0000","last_undegraded":"2024-04-19T02:16:47.307561+0000","last_fullsized":"2024-04-19T02:16:47.307561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.322296+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:47.322296+0000","last_peered":"2024-04-19T02:16:47.322296+0000","last_clean":"2024-04-19T02:16:47.322296+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:47.322296+0000","last_undegraded":"2024-04-19T02:16:47.322296+0000","last_fullsized":"2024-04-19T02:16:47.322296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.302864+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:47.302864+0000","last_peered":"2024-04-19T02:16:47.302864+0000","last_clean":"2024-04-19T02:16:47.302864+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:47.302864+0000","last_undegraded":"2024-04-19T02:16:47.302864+0000","last_fullsized":"2024-04-19T02:16:47.302864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321179+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:47.321179+0000","last_peered":"2024-04-19T02:16:47.321179+0000","last_clean":"2024-04-19T02:16:47.321179+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:47.321179+0000","last_undegraded":"2024-04-19T02:16:47.321179+0000","last_fullsized":"2024-04-19T02:16:47.321179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'9","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.654377+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:47.654377+0000","last_peered":"2024-04-19T02:16:47.654377+0000","last_clean":"2024-04-19T02:16:47.654377+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:47.654377+0000","last_undegraded":"2024-04-19T02:16:47.654377+0000","last_fullsized":"2024-04-19T02:16:47.654377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4838,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305278+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:47.305278+0000","last_peered":"2024-04-19T02:16:47.305278+0000","last_clean":"2024-04-19T02:16:47.305278+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:47.305278+0000","last_undegraded":"2024-04-19T02:16:47.305278+0000","last_fullsized":"2024-04-19T02:16:47.305278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304787+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:47.304787+0000","last_peered":"2024-04-19T02:16:47.304787+0000","last_clean":"2024-04-19T02:16:47.304787+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:47.304787+0000","last_undegraded":"2024-04-19T02:16:47.304787+0000","last_fullsized":"2024-04-19T02:16:47.304787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.322163+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:47.322163+0000","last_peered":"2024-04-19T02:16:47.322163+0000","last_clean":"2024-04-19T02:16:47.322163+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:47.322163+0000","last_undegraded":"2024-04-19T02:16:47.322163+0000","last_fullsized":"2024-04-19T02:16:47.322163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305318+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:47.305318+0000","last_peered":"2024-04-19T02:16:47.305318+0000","last_clean":"2024-04-19T02:16:47.305318+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:47.305318+0000","last_undegraded":"2024-04-19T02:16:47.305318+0000","last_fullsized":"2024-04-19T02:16:47.305318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307379+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:47.307379+0000","last_peered":"2024-04-19T02:16:47.307379+0000","last_clean":"2024-04-19T02:16:47.307379+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:47.307379+0000","last_undegraded":"2024-04-19T02:16:47.307379+0000","last_fullsized":"2024-04-19T02:16:47.307379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305144+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:47.305144+0000","last_peered":"2024-04-19T02:16:47.305144+0000","last_clean":"2024-04-19T02:16:47.305144+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:47.305144+0000","last_undegraded":"2024-04-19T02:16:47.305144+0000","last_fullsized":"2024-04-19T02:16:47.305144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304915+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:47.304915+0000","last_peered":"2024-04-19T02:16:47.304915+0000","last_clean":"2024-04-19T02:16:47.304915+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:47.304915+0000","last_undegraded":"2024-04-19T02:16:47.304915+0000","last_fullsized":"2024-04-19T02:16:47.304915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305437+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:47.305437+0000","last_peered":"2024-04-19T02:16:47.305437+0000","last_clean":"2024-04-19T02:16:47.305437+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:47.305437+0000","last_undegraded":"2024-04-19T02:16:47.305437+0000","last_fullsized":"2024-04-19T02:16:47.305437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.306877+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:47.306877+0000","last_peered":"2024-04-19T02:16:47.306877+0000","last_clean":"2024-04-19T02:16:47.306877+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:47.306877+0000","last_undegraded":"2024-04-19T02:16:47.306877+0000","last_fullsized":"2024-04-19T02:16:47.306877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.305538+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:47.305538+0000","last_peered":"2024-04-19T02:16:47.305538+0000","last_clean":"2024-04-19T02:16:47.305538+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:47.305538+0000","last_undegraded":"2024-04-19T02:16:47.305538+0000","last_fullsized":"2024-04-19T02:16:47.305538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304013+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:47.304013+0000","last_peered":"2024-04-19T02:16:47.304013+0000","last_clean":"2024-04-19T02:16:47.304013+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:47.304013+0000","last_undegraded":"2024-04-19T02:16:47.304013+0000","last_fullsized":"2024-04-19T02:16:47.304013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303438+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:47.303438+0000","last_peered":"2024-04-19T02:16:47.303438+0000","last_clean":"2024-04-19T02:16:47.303438+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:47.303438+0000","last_undegraded":"2024-04-19T02:16:47.303438+0000","last_fullsized":"2024-04-19T02:16:47.303438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303706+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:47.303706+0000","last_peered":"2024-04-19T02:16:47.303706+0000","last_clean":"2024-04-19T02:16:47.303706+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:47.303706+0000","last_undegraded":"2024-04-19T02:16:47.303706+0000","last_fullsized":"2024-04-19T02:16:47.303706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303304+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:47.303304+0000","last_peered":"2024-04-19T02:16:47.303304+0000","last_clean":"2024-04-19T02:16:47.303304+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:47.303304+0000","last_undegraded":"2024-04-19T02:16:47.303304+0000","last_fullsized":"2024-04-19T02:16:47.303304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320914+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:47.320914+0000","last_peered":"2024-04-19T02:16:47.320914+0000","last_clean":"2024-04-19T02:16:47.320914+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:47.320914+0000","last_undegraded":"2024-04-19T02:16:47.320914+0000","last_fullsized":"2024-04-19T02:16:47.320914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.321557+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:47.321557+0000","last_peered":"2024-04-19T02:16:47.321557+0000","last_clean":"2024-04-19T02:16:47.321557+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:47.321557+0000","last_undegraded":"2024-04-19T02:16:47.321557+0000","last_fullsized":"2024-04-19T02:16:47.321557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320499+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:47.320499+0000","last_peered":"2024-04-19T02:16:47.320499+0000","last_clean":"2024-04-19T02:16:47.320499+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:47.320499+0000","last_undegraded":"2024-04-19T02:16:47.320499+0000","last_fullsized":"2024-04-19T02:16:47.320499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.304215+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:47.304215+0000","last_peered":"2024-04-19T02:16:47.304215+0000","last_clean":"2024-04-19T02:16:47.304215+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:47.304215+0000","last_undegraded":"2024-04-19T02:16:47.304215+0000","last_fullsized":"2024-04-19T02:16:47.304215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.303304+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:47.303304+0000","last_peered":"2024-04-19T02:16:47.303304+0000","last_clean":"2024-04-19T02:16:47.303304+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:47.303304+0000","last_undegraded":"2024-04-19T02:16:47.303304+0000","last_fullsized":"2024-04-19T02:16:47.303304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307377+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:47.307377+0000","last_peered":"2024-04-19T02:16:47.307377+0000","last_clean":"2024-04-19T02:16:47.307377+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:47.307377+0000","last_undegraded":"2024-04-19T02:16:47.307377+0000","last_fullsized":"2024-04-19T02:16:47.307377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.320227+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:47.320227+0000","last_peered":"2024-04-19T02:16:47.320227+0000","last_clean":"2024-04-19T02:16:47.320227+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:47.320227+0000","last_undegraded":"2024-04-19T02:16:47.320227+0000","last_fullsized":"2024-04-19T02:16:47.320227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.307125+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:47.307125+0000","last_peered":"2024-04-19T02:16:47.307125+0000","last_clean":"2024-04-19T02:16:47.307125+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:47.307125+0000","last_undegraded":"2024-04-19T02:16:47.307125+0000","last_fullsized":"2024-04-19T02:16:47.307125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":188416,"data_stored":68423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":668052,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":667436,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:51.643 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:51.630+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:51.730 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:51.725+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:51.772 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:51.772 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:51.772 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:16:51.772 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:51.785 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:51.831 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:51.834+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:51.932 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:51.929+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:51.942 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:16:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:16:51.942 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:51.956 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:52.033 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:52.038+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:52.127 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:52.127 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:16:52.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:16:52.127 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:16:52.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.127 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.575190431000003, 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.574798162999997, 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.132 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:16:52.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:16:52.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.574328360999999, 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:16:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.573391301000001, 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.141 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:16:52.145 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.573075693, 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:16:52.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:16:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.572626669999998, 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:16:52.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:16:52.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.154 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.572037813999998, 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:16:52.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.637231385, 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:16:52.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:16:52.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.164 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.637132899000001, 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:52.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:16:52.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:16:52.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.637065242999999, 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:16:52.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:16:52.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.637013286999998, 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:16:52.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:16:52.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:52.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.63695929, 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.181 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:16:52.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:16:52.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.636904584, 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:16:52.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:16:52.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.636851023999998, 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:52.197 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.636795071999998, 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:52.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.636746675000001, 2024-04-19T02:16:52.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:16:52.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:52.205 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.626610540000001, 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.209 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.622603494, 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:52.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:16:52.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.622545462000001, 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:16:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:16:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.218 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.622076918000001, 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:52.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:16:52.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:52.223 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:52.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:52.225 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:52.226+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:52.326 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:52.325+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:52.355 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:52.355 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:16:52.355 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-19T02:16:52.355 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:52.369 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:52.427 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:52.430+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:52.485 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:52.486 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:16:52.486 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-19T02:16:52.486 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-19T02:16:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:52.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:52.528 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:52.530+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:52.620 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:52.620 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-19T02:16:52.620 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-19T02:16:52.620 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.251105094000003, 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022228746000000001, 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 117 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.621 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370334+0000", 2024-04-19T02:16:52.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370340+0000", 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370349+0000", 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3300000000000005e-06 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.623 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370358+0000", 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4589999999999998e-06 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388807+0000", 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018449436999999999 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388930+0000", 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012235600000000001 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.389117+0000", 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186875 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.390381+0000", 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012640399999999999 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392450+0000", 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020695269999999998 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392515+0000", 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4682000000000002e-05 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392563+0000", 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8662999999999998e-05 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.895563129999999, 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021625360999999999, 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 164 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725875+0000", 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725991+0000", 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000115485 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726005+0000", 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4267000000000001e-05 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726014+0000", 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8400000000000001e-06 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740028+0000", 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014014039000000001 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740148+0000", 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119533 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740351+0000", 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000203718 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.744482+0000", 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041303290000000003 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747346+0000", 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028647740000000001 2024-04-19T02:16:52.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747431+0000", 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4393000000000003e-05 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747502+0000", 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1218999999999997e-05 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.895412460999999, 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021599448, 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 165 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726036+0000", 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1970000000000002e-06 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726049+0000", 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3273e-05 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726056+0000", 2024-04-19T02:16:52.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1729999999999998e-06 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743322+0000", 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017265692999999999 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743445+0000", 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012279500000000001 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743633+0000", 2024-04-19T02:16:52.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000188722 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.745654+0000", 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020209469999999999 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747516+0000", 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001861578 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747573+0000", 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7484000000000001e-05 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747627+0000", 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3458999999999998e-05 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.638 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.130158148, 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026155528000000001, 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491279+0000", 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491296+0000", 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7110000000000001e-05 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491325+0000", 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9070000000000001e-05 2024-04-19T02:16:52.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491348+0000", 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2900000000000001e-05 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495290+0000", 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039419140000000004 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496920+0000", 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016300959999999999 2024-04-19T02:16:52.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497231+0000", 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000310568 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505316+0000", 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080857410000000005 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517073+0000", 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011756691 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517255+0000", 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000181962 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517437+0000", 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000182299 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.643 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.130069375000001, 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026727732000000001, 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491369+0000", 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491383+0000", 2024-04-19T02:16:52.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4466e-05 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491403+0000", 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9473000000000001e-05 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491420+0000", 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7090000000000001e-05 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498831+0000", 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074110139999999996 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499047+0000", 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021572799999999999 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499345+0000", 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029797800000000001 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505423+0000", 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060781159999999997 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517860+0000", 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012436918999999999 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518004+0000", 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014407600000000001 2024-04-19T02:16:52.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518098+0000", 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4362000000000002e-05 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.130003685999998, 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027347060999999999, 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.649 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491435+0000", 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491442+0000", 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8369999999999999e-06 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491460+0000", 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7547e-05 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491473+0000", 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3446e-05 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499944+0000", 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084714009999999999 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500227+0000", 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000283045 2024-04-19T02:16:52.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500561+0000", 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033363700000000002 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509743+0000", 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091819880000000003 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518208+0000", 2024-04-19T02:16:52.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084647709999999994 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518680+0000", 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00047247000000000001 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518783+0000", 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010294900000000001 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.654 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129954466000001, 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027680531000000001, 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491484+0000", 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491492+0000", 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3860000000000001e-06 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491509+0000", 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.696e-05 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491522+0000", 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.322e-05 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501273+0000", 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097514639999999996 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501485+0000", 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021127200000000001 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501814+0000", 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032901700000000002 2024-04-19T02:16:52.658 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509758+0000", 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007944329 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518935+0000", 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.009176745 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519073+0000", 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000138255 2024-04-19T02:16:52.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519166+0000", 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3016000000000005e-05 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129879227, 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037163597999999999, 2024-04-19T02:16:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491559+0000", 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491569+0000", 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0176999999999999e-05 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491589+0000", 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9510000000000001e-05 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491607+0000", 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8533e-05 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502933+0000", 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011325408 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503696+0000", 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00076329999999999996 2024-04-19T02:16:52.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504054+0000", 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035819399999999999 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515030+0000", 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010975944 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528254+0000", 2024-04-19T02:16:52.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013223999 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528387+0000", 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000132652 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528724+0000", 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033722400000000001 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129818579999998, 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037472687999999997, 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491620+0000", 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491628+0000", 2024-04-19T02:16:52.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5229999999999998e-06 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491645+0000", 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7319000000000001e-05 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491659+0000", 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3864e-05 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511359+0000", 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019700583000000001 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511590+0000", 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000231108 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511891+0000", 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030086499999999999 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519283+0000", 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073919019999999997 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528864+0000", 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0095805430000000004 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528990+0000", 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000126456 2024-04-19T02:16:52.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529094+0000", 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103735 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129767923999999, 2024-04-19T02:16:52.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037857123999999999, 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491671+0000", 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491678+0000", 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9099999999999999e-06 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491696+0000", 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7966999999999999e-05 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491709+0000", 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3356000000000001e-05 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513534+0000", 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021825223000000001 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513941+0000", 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00040700000000000003 2024-04-19T02:16:52.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.514246+0000", 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000304364 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.520103+0000", 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058571719999999999 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529229+0000", 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091263549999999992 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529430+0000", 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020086400000000001 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529529+0000", 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9069999999999998e-05 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.679 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129687921999999, 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038136467, 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491751+0000", 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491758+0000", 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3139999999999998e-06 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491776+0000", 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8012999999999998e-05 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491790+0000", 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4173e-05 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515076+0000", 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023285173999999999 2024-04-19T02:16:52.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515262+0000", 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186305 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516475+0000", 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012131170000000001 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521138+0000", 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046631550000000004 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529678+0000", 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085395709999999993 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529807+0000", 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012929200000000001 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529888+0000", 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1433000000000005e-05 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129636499, 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024863728000000002, 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.685 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491809+0000", 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5540000000000003e-06 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491828+0000", 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9429999999999999e-05 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7416000000000001e-05 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497895+0000", 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060489469999999998 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498946+0000", 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001051129 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499220+0000", 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000273928 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509102+0000", 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0098820690000000003 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516293+0000", 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071913020000000001 2024-04-19T02:16:52.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516548+0000", 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025478799999999999 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516667+0000", 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119265 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129569028999999, 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026983983999999999, 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491870+0000", 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491877+0000", 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.447e-06 2024-04-19T02:16:52.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491898+0000", 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0792999999999999e-05 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491912+0000", 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3740000000000001e-05 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499845+0000", 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079334190000000006 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502302+0000", 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024567069999999998 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502745+0000", 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000442822 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509121+0000", 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063766650000000001 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518263+0000", 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091422090000000001 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518753+0000", 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00048999600000000003 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518855+0000", 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101313 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.129505170000002, 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.039155085999999999, 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.696 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491934+0000", 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491941+0000", 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6830000000000008e-06 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491959+0000", 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7484000000000001e-05 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492423+0000", 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000464399 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499801+0000", 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007378 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501517+0000", 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0017152789999999999 2024-04-19T02:16:52.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501827+0000", 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031013200000000002 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509113+0000", 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007286346 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530913+0000", 2024-04-19T02:16:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021800077000000001 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531004+0000", 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0799999999999998e-05 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531090+0000", 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5818999999999999e-05 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.128668633, 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038579016000000001, 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492797+0000", 2024-04-19T02:16:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8059999999999999e-05 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492870+0000", 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2578999999999997e-05 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492898+0000", 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8394e-05 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503481+0000", 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010583169999999999 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503995+0000", 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00051340999999999995 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504343+0000", 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034785300000000002 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516750+0000", 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012407506 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531185+0000", 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014434565999999999 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531290+0000", 2024-04-19T02:16:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010582900000000001 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531350+0000", 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9753000000000002e-05 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.126894424, 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034067229999999997, 2024-04-19T02:16:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494556+0000", 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2679e-05 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494708+0000", 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000151416 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494770+0000", 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2292999999999995e-05 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503657+0000", 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088874850000000005 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503946+0000", 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028820700000000001 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504257+0000", 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031168400000000001 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516765+0000", 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012508244999999999 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528273+0000", 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011507167 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528491+0000", 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021798499999999999 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528613+0000", 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122049 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.126510850999999, 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034106006000000001, 2024-04-19T02:16:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494928+0000", 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494938+0000", 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0156999999999999e-05 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495033+0000", 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5556000000000005e-05 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495050+0000", 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6356000000000001e-05 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505119+0000", 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010069896 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506334+0000", 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00121423 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506662+0000", 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000328757 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516778+0000", 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010115928 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528709+0000", 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011930685999999999 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528938+0000", 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022862100000000001 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529035+0000", 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7286000000000003e-05 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:26 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.126371889000001, 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.035948230999999997, 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495067+0000", 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495076+0000", 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5130000000000002e-06 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495131+0000", 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4583999999999998e-05 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495184+0000", 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3038999999999998e-05 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500428+0000", 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052442740000000002 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500785+0000", 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035727399999999998 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036842400000000001 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507385+0000", 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062313749999999999 2024-04-19T02:16:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530895+0000", 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023510029000000002 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530964+0000", 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8856999999999995e-05 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531016+0000", 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2182000000000003e-05 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:29 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.126231026999999, 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026450912, 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495207+0000", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495234+0000", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7076999999999998e-05 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495945+0000", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071182099999999996 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495968+0000", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2855999999999999e-05 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498885+0000", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029170730000000001 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499136+0000", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025015500000000001 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499457+0000", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000321014 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508677+0000", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092201249999999992 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521389+0000", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012712146000000001 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521514+0000", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012532600000000001 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521660+0000", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014555899999999999 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 28.125449855999999, 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.033370365999999999, 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495988+0000", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496001+0000", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2999e-05 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496027+0000", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6207000000000002e-05 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496043+0000", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5605999999999999e-05 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507643+0000", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011599553 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508710+0000", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001067201 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529360+0000", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020650532999999999 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:52.734 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:52.735 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:52.733+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:52.834 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:52.838+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:52.869 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:52.869 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:52.869 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:16:52.869 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:52.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:52.935 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:52.938+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:53.007 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:16:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:16:53.008 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:53.023 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:53.067 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:53.070+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:53.137 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:53.138+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:53.193 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.702835441000001, 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:53.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:53.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:53.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.199 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.702717059000001, 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:16:53.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:16:53.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.702648059000001, 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:16:53.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:53.210 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.702517842999999, 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:16:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:16:53.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:16:53.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.702438291, 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:53.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:16:53.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:16:53.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:16:53.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:53.221 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.702342848000001, 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:53.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:16:53.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.226 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.702261942, 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:16:53.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.701794112999998, 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.234 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.701733405999999, 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.694581084999999, 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.684658304999999, 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:53.243 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:16:53.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:16:53.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.684306948, 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:16:53.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:16:53.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.683744028, 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:16:53.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:16:53.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:16:53.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.683644492999999, 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:16:53.254 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.672941029, 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.671308444000001, 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:53.262 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:16:53.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:16:53.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.670375265000001, 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:16:53.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.670248936, 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:16:53.270 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:16:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:16:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.669985450999999, 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:16:53.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:16:53.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:16:53.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.000888270000001, 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:16:53.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:16:53.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:53.284 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:53.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:53.286 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:53.290+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:53.287 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:53.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:16:53.387 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:53.390+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:53.416 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:53.416 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:53.416 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:16:53.416 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:53.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:53.438 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:16:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:53.487 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:53.490+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:53.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:53.588 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:53.590+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:53.683 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:53.686 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:53.689 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:53.690+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:53.697 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:53.790 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:53.794+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:53.828 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:53.828 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:53.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:53.891 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:53.890+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:53.960 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:53.961 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:53.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:53.992 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:53.994+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:54.095 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:54.089+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:54.196 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:54.198+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:54.287 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.287 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.296 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:54.293+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:54.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:54.338 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:16:54.398 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:54.397+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.438 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:54.498 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:54.501+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:54.559 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.559 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:54.599 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:54.601+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:54.700 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:54.701+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:54.702 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.702 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:54.801 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:54.801+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:54.840 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.840 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:54.902 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:54.901+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:54.976 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.976 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:55.003 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:55.005+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:55.104 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:55.105+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:55.126 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.126 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.139 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:55.205 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:55.205+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:55.261 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.261 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.274 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:55.307 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:55.305+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:55.390 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.390 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.404 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:55.408 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:55.409+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:55.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:55.508 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:55.509+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:55.536 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.536 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:55.609 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:55.609+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:55.649 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:16:55.649 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:55.669 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:16:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:55.673 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.673 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.687 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:55.690 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:16:55.690 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:55.710 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:55.705+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:55.811 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:55.813+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:55.857 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:55.857 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:16:55.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:16:55.857 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.36663497, 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:55.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:55.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.863 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.366516588, 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:55.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.366447588, 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.870 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:16:55.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:16:55.875 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.366317372000001, 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:16:55.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:16:55.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.882 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.366237819999998, 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:16:55.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:16:55.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:16:55.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.366142376999999, 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:16:55.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:16:55.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.894 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.366061470999998, 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:16:55.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:16:55.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.365593642, 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:55.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.365532935000001, 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:16:55.903 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:16:55.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:55.907 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.358380614000001, 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:16:55.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:16:55.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.348457834000001, 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:16:55.912 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:16:55.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.348106477000002, 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:55.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:16:55.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:16:55.919 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.347543557000002, 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.347444022000001, 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.924 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:16:55.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.336740557999999, 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:16:55.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.335107973, 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:55.932 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:16:55.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.334174793999999, 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:16:55.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:16:55.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:16:55.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.334048464999999, 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.943 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:16:55.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.947 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.333784980000001, 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:55.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:16:55.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.952 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.664687798999999, 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:55.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:16:55.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:16:55.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.959 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:55.959 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:55.959 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:55.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:55.961 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:55.961+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:56.061 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:56.057+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:56.091 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:56.091 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:56.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:16:56.091 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:56.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:56.195 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:56.193+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:56.263 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:56.265+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:56.271 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:56.271 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:56.271 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:16:56.271 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:16:56.271 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:56.286 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:56.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:16:56.365 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:56.365+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:56.451 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.901402719000004, 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:16:56.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.901010450999998, 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:16:56.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:16:56.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.900540649, 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:56.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.899603589000002, 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:16:56.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:16:56.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:16:56.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:16:56.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.899287981000001, 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:16:56.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:16:56.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.898838957999999, 2024-04-19T02:16:56.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:16:56.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.898250101999999, 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963443673, 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.484 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:16:56.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963345187000002, 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:16:56.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:16:56.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963277530999999, 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.495 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:16:56.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:16:56.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963225574999999, 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:16:56.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:16:56.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:56.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963171578000001, 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:16:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963116872000001, 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:16:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:16:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963063311999999, 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:16:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.963007359999999, 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:16:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:16:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.962958962999998, 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:16:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.952822827999999, 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:16:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.948815782, 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:16:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:16:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.948757749999999, 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:16:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:16:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:16:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.948289205999998, 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:16:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:16:56.548 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:56.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:56.550 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:56.553+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:56.644 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:56.644 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:56.644 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T02:16:56.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:16:56.651 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:56.649+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:56.683 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:16:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-19T02:16:56.683 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:56.698 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:56.752 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:56.753+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:56.853 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:56.853+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:56.858 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:56.858 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:16:56.859 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-19T02:16:56.859 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-19T02:16:56.859 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:56.873 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:56.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:16:56.930 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:16:56.930 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 24, 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "30a6d986-f196-4d3c-8512-6c6489722f8f", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-19T02:16:03.364103+0000", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-19T02:16:54.326006+0000", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-19T02:16:13.982256+0000", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-19T02:16:04.286795+0000", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:56.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "luminous", 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-19T02:16:56.932 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:14.248072+0000", 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:56.933 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-19T02:16:56.937 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:56.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:18.602050+0000", 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:56.939 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:56.940 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:56.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:56.943 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-04-19T02:16:56.944 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:22.904068+0000", 2024-04-19T02:16:56.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-19T02:16:56.946 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:56.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:56.948 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:16:56.950 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.0299999713897705, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.0299999713897705, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-19T02:16:56.951 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:23.465439+0000", 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:16:56.952 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-19T02:16:56.953 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:16:56.954 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:16:56.955 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:56.956 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:56.958 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "16c5fbec-2207-41d1-ae33-893b400fd3da", 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 20, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:16:56.959 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6800", 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6801", 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.960 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6802", 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6803", 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6806", 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6807", 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6804", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6805", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.116:6801/21424", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.116:6803/21424", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.116:6807/21424", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.116:6805/21424", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3211257a-5bd5-4a10-8d5f-c3dae1d504e7", 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6800", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6801", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6802", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6803", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6806", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6807", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6804", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6805", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.136:6801/21483", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.136:6803/21483", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.136:6807/21483", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.136:6805/21483", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d", 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6800", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6801", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6802", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6803", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6806", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6807", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6804", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6805", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.169:6801/21523", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.169:6803/21523", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.169:6807/21523", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.169:6805/21523", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581115+0000", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.639275+0000", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581003+0000", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [ 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "3.4", 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:16:56.983 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': '30a6d986-f196-4d3c-8512-6c6489722f8f', 'created': '2024-04-19T02:16:03.364103+0000', 'modified': '2024-04-19T02:16:54.326006+0000', 'last_up_change': '2024-04-19T02:16:13.982256+0000', 'last_in_change': '2024-04-19T02:16:04.286795+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '16c5fbec-2207-41d1-ae33-893b400fd3da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 21424}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 21424}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 21424}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 21424}]}, 'public_addr': '172.21.15.116:6801/21424', 'cluster_addr': '172.21.15.116:6803/21424', 'heartbeat_back_addr': '172.21.15.116:6807/21424', 'heartbeat_front_addr': '172.21.15.116:6805/21424', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3211257a-5bd5-4a10-8d5f-c3dae1d504e7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6800', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6801', 'nonce': 21483}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6802', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6803', 'nonce': 21483}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6806', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6807', 'nonce': 21483}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6804', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6805', 'nonce': 21483}]}, 'public_addr': '172.21.15.136:6801/21483', 'cluster_addr': '172.21.15.136:6803/21483', 'heartbeat_back_addr': '172.21.15.136:6807/21483', 'heartbeat_front_addr': '172.21.15.136:6805/21483', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 21523}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 21523}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 21523}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 21523}]}, 'public_addr': '172.21.15.169:6801/21523', 'cluster_addr': '172.21.15.169:6803/21523', 'heartbeat_back_addr': '172.21.15.169:6807/21523', 'heartbeat_front_addr': '172.21.15.169:6805/21523', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581115+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.639275+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581003+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.4', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:16:56.983 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.4 2024-04-19T02:16:56.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.4 2024-04-19T02:16:56.984 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:56.981+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.622659282000001, 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022228746000000001, 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 117 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370334+0000", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370340+0000", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370349+0000", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3300000000000005e-06 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370358+0000", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4589999999999998e-06 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388807+0000", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018449436999999999 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388930+0000", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012235600000000001 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.389117+0000", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186875 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.390381+0000", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012640399999999999 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392450+0000", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020695269999999998 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392515+0000", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4682000000000002e-05 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392563+0000", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8662999999999998e-05 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.267117317999997, 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021625360999999999, 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 164 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725875+0000", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725991+0000", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000115485 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726005+0000", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4267000000000001e-05 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726014+0000", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8400000000000001e-06 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740028+0000", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014014039000000001 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740148+0000", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119533 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740351+0000", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000203718 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.744482+0000", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041303290000000003 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747346+0000", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028647740000000001 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747431+0000", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4393000000000003e-05 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747502+0000", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1218999999999997e-05 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.266966648999997, 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021599448, 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 165 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726036+0000", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1970000000000002e-06 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726049+0000", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3273e-05 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726056+0000", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1729999999999998e-06 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743322+0000", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017265692999999999 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743445+0000", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012279500000000001 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743633+0000", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000188722 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.745654+0000", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020209469999999999 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747516+0000", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001861578 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747573+0000", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7484000000000001e-05 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747627+0000", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3458999999999998e-05 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501712335999997, 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026155528000000001, 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491279+0000", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491296+0000", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7110000000000001e-05 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491325+0000", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9070000000000001e-05 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491348+0000", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2900000000000001e-05 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495290+0000", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039419140000000004 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496920+0000", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016300959999999999 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497231+0000", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000310568 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505316+0000", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080857410000000005 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517073+0000", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011756691 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517255+0000", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000181962 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517437+0000", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000182299 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501623563000003, 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026727732000000001, 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491369+0000", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491383+0000", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4466e-05 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491403+0000", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9473000000000001e-05 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491420+0000", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7090000000000001e-05 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498831+0000", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074110139999999996 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499047+0000", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021572799999999999 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499345+0000", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029797800000000001 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505423+0000", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060781159999999997 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517860+0000", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012436918999999999 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518004+0000", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014407600000000001 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518098+0000", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4362000000000002e-05 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501557874, 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027347060999999999, 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491435+0000", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491442+0000", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8369999999999999e-06 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491460+0000", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7547e-05 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491473+0000", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3446e-05 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499944+0000", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084714009999999999 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500227+0000", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000283045 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500561+0000", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033363700000000002 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509743+0000", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091819880000000003 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518208+0000", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084647709999999994 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518680+0000", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00047247000000000001 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518783+0000", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010294900000000001 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501508653999998, 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027680531000000001, 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491484+0000", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491492+0000", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3860000000000001e-06 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491509+0000", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.696e-05 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491522+0000", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.322e-05 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501273+0000", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097514639999999996 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501485+0000", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021127200000000001 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501814+0000", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032901700000000002 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509758+0000", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007944329 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518935+0000", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.009176745 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519073+0000", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000138255 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519166+0000", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3016000000000005e-05 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501433415000001, 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037163597999999999, 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491559+0000", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491569+0000", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0176999999999999e-05 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491589+0000", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9510000000000001e-05 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491607+0000", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8533e-05 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502933+0000", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011325408 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503696+0000", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00076329999999999996 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504054+0000", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035819399999999999 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515030+0000", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010975944 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528254+0000", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013223999 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528387+0000", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000132652 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528724+0000", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033722400000000001 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501372768000003, 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037472687999999997, 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491620+0000", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491628+0000", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5229999999999998e-06 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491645+0000", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7319000000000001e-05 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491659+0000", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3864e-05 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511359+0000", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019700583000000001 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511590+0000", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000231108 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511891+0000", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030086499999999999 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519283+0000", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073919019999999997 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528864+0000", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0095805430000000004 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528990+0000", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000126456 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529094+0000", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103735 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501322111999997, 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037857123999999999, 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491671+0000", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491678+0000", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9099999999999999e-06 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491696+0000", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7966999999999999e-05 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491709+0000", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3356000000000001e-05 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513534+0000", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021825223000000001 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513941+0000", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00040700000000000003 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.514246+0000", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000304364 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.520103+0000", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058571719999999999 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529229+0000", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091263549999999992 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529430+0000", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020086400000000001 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529529+0000", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9069999999999998e-05 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.50124211, 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038136467, 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491751+0000", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491758+0000", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3139999999999998e-06 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491776+0000", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8012999999999998e-05 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491790+0000", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4173e-05 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515076+0000", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023285173999999999 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515262+0000", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186305 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516475+0000", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012131170000000001 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521138+0000", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046631550000000004 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529678+0000", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085395709999999993 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529807+0000", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012929200000000001 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529888+0000", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1433000000000005e-05 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501190686999998, 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024863728000000002, 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491809+0000", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5540000000000003e-06 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491828+0000", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9429999999999999e-05 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7416000000000001e-05 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497895+0000", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060489469999999998 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498946+0000", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001051129 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499220+0000", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000273928 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509102+0000", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0098820690000000003 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516293+0000", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071913020000000001 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516548+0000", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025478799999999999 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516667+0000", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119265 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501123217, 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026983983999999999, 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491870+0000", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491877+0000", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.447e-06 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491898+0000", 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0792999999999999e-05 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491912+0000", 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3740000000000001e-05 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499845+0000", 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079334190000000006 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502302+0000", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024567069999999998 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502745+0000", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000442822 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509121+0000", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063766650000000001 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518263+0000", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091422090000000001 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518753+0000", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00048999600000000003 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518855+0000", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101313 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.501059357999999, 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.039155085999999999, 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491934+0000", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491941+0000", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6830000000000008e-06 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491959+0000", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7484000000000001e-05 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492423+0000", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000464399 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499801+0000", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007378 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501517+0000", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0017152789999999999 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501827+0000", 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031013200000000002 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509113+0000", 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007286346 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530913+0000", 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021800077000000001 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.068 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531004+0000", 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0799999999999998e-05 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531090+0000", 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5818999999999999e-05 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.500222821000001, 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038579016000000001, 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.070 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492797+0000", 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8059999999999999e-05 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.071 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492870+0000", 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2578999999999997e-05 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492898+0000", 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8394e-05 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503481+0000", 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010583169999999999 2024-04-19T02:16:57.072 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503995+0000", 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00051340999999999995 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504343+0000", 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034785300000000002 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516750+0000", 2024-04-19T02:16:57.073 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012407506 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531185+0000", 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014434565999999999 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531290+0000", 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010582900000000001 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.074 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531350+0000", 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9753000000000002e-05 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.498448611999997, 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034067229999999997, 2024-04-19T02:16:57.075 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.076 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494556+0000", 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2679e-05 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494708+0000", 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000151416 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.077 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494770+0000", 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2292999999999995e-05 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503657+0000", 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088874850000000005 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503946+0000", 2024-04-19T02:16:57.078 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028820700000000001 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504257+0000", 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031168400000000001 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516765+0000", 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012508244999999999 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528273+0000", 2024-04-19T02:16:57.079 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011507167 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528491+0000", 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021798499999999999 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528613+0000", 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122049 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.498065038999997, 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034106006000000001, 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.081 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494928+0000", 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494938+0000", 2024-04-19T02:16:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0156999999999999e-05 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495033+0000", 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5556000000000005e-05 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495050+0000", 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6356000000000001e-05 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.083 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505119+0000", 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010069896 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506334+0000", 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00121423 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506662+0000", 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000328757 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.084 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516778+0000", 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010115928 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528709+0000", 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011930685999999999 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528938+0000", 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022862100000000001 2024-04-19T02:16:57.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529035+0000", 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7286000000000003e-05 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:26 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.497926077000002, 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.035948230999999997, 2024-04-19T02:16:57.086 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.087 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495067+0000", 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495076+0000", 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5130000000000002e-06 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495131+0000", 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4583999999999998e-05 2024-04-19T02:16:57.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495184+0000", 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3038999999999998e-05 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500428+0000", 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052442740000000002 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500785+0000", 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035727399999999998 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036842400000000001 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507385+0000", 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062313749999999999 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530895+0000", 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023510029000000002 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530964+0000", 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8856999999999995e-05 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531016+0000", 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2182000000000003e-05 2024-04-19T02:16:57.091 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:29 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.497785215, 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026450912, 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.092 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495207+0000", 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:57.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495234+0000", 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7076999999999998e-05 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495945+0000", 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071182099999999996 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495968+0000", 2024-04-19T02:16:57.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2855999999999999e-05 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498885+0000", 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029170730000000001 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499136+0000", 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025015500000000001 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499457+0000", 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000321014 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508677+0000", 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092201249999999992 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521389+0000", 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012712146000000001 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.096 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521514+0000", 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012532600000000001 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521660+0000", 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014555899999999999 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.097 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 32.497004044000001, 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.033370365999999999, 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495988+0000", 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496001+0000", 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2999e-05 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496027+0000", 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6207000000000002e-05 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496043+0000", 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5605999999999999e-05 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507643+0000", 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011599553 2024-04-19T02:16:57.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508710+0000", 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001067201 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529360+0000", 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020650532999999999 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:16:57.101 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:16:57.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:57.104 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:57.105+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:57.203 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:57.205+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:57.248 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:57.304 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:57.305+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:57.352 INFO:teuthology.orchestra.run.smithi073.stderr:clear 3.4 pg_upmap mapping 2024-04-19T02:16:57.353 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:16:57.405 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:57.405+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:57.416 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:16:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:16:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:16:57.416 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:57.430 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:57.515 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:57.517+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.103559549000003, 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.595 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:16:57.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.600 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.103441167, 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:57.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:16:57.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.103372167000003, 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.103241951000001, 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.103162398999999, 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.103066955999999, 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.102986049999998, 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.102518220999997, 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.102457514000001, 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.095305193000002, 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.085382412999998, 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.085031055999998, 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.084468135999998, 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.084368601000001, 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.073665136999999, 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.072032552000003, 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.071099373000003, 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.070973043999999, 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.070709559000001, 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.401612377999999, 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:16:57.688 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:57.688 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:57.689+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:57.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:57.789 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:57.789+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:57.820 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:16:57.820 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:16:57.820 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:16:57.820 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:16:57.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:57.864 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:16:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:16:57.885 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:57.890 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:57.889+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:57.955 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:57.955 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:57.971 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:57.991 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:57.993+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:58.092 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:58.089+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:58.094 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:58.094 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:58.108 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:58.194 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:58.193+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:58.239 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:58.240 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:58.255 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:58.295 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:58.297+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:58.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:58.395 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:58.397+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:58.496 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:58.497+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:58.510 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:58.510 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:58.524 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:58.597 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:58.597+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:58.654 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:58.654 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:58.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:58.698 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:58.697+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:58.792 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:58.792 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:58.799 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:58.801+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:58.810 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:58.900 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:58.901+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:58.930 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:58.930 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:58.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:59.001 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:59.001+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:59.075 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.076 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.092 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:59.135 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:59.137+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:59.202 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:16:59.205+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:16:59.213 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.213 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:59.315 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:59.317+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:59.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:16:59.393 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.393 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.404 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:59.405+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:59.407 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:59.505 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:59.505+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:59.539 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.539 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:59.606 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:59.609+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:59.676 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.676 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:59.706 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:16:59.705+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:16:59.805 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.806 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.807 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:59.809+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:59.821 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:59.908 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:16:59.909+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:16:59.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:59.952 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.953 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.967 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:00.009 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:00.009+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:00.077 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:00.077 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:00.085 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:00.085 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:00.097 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:17:00.097 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:00.099 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:00.110 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:00.109+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:00.115 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:00.211 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:00.213+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.724140802999997, 2024-04-19T02:17:00.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:00.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.724022421000001, 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:00.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:00.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.723953420999997, 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:00.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:00.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:00.230 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.723823205000002, 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:00.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:00.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.723743653, 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:00.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.72364821, 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.241 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:00.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:00.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.723567303999999, 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.250 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.723099474999998, 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:00.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:00.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:00.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.723038768000002, 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:00.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.715886447000003, 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.260 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.705963666999999, 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.705612309999999, 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.705049389999999, 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:00.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:00.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.704949855000002, 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:00.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:00.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.694246391, 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:00.279 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.692613805999997, 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:00.283 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:00.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:00.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.691680626999997, 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:00.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:00.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:00.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.691554298, 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.691290813000002, 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.295 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.022193632, 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:00.305 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:00.306 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:00.311 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:00.313+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:17:00.412 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:00.413+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:00.439 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:00.440 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:00.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:00.512 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:00.513+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:00.572 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:00.573 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:00.586 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:00.613 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:00.613+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:00.710 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.158235920000003, 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:00.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.157843651999997, 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:00.715 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:00.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.157373849999999, 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:00.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:00.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.156436790000001, 2024-04-19T02:17:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:00.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.156121182, 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.155672158999998, 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.733 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:00.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.155083302999998, 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:00.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.220276874, 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.742 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:00.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.747 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.220178388000001, 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:00.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:00.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:00.753 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.220110732000002, 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:00.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:00.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.220058776000002, 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:00.759 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:00.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.220004779, 2024-04-19T02:17:00.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:00.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:00.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.219950073, 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.771 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:00.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.219896513000002, 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:00.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.219840560999998, 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:00.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:00.786 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.219792163999998, 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:00.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.209656029000001, 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:00.791 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:00.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.205648983000003, 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.796 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:00.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.205590950999998, 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:00.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:00.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:00.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.205122406999998, 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:00.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:00.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:00.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:00.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:00.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:00.810 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:00.812 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:00.812 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:00.813+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:00.912 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:00.913+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:00.943 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:17:00.943 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:17:00.943 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-19T02:17:00.943 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:17:00.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:01.013 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:01.013+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:01.074 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:17:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:17:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-19T02:17:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-19T02:17:01.075 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:17:01.090 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:01.114 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:01.113+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:01.215 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:01.217+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.846295978000001, 2024-04-19T02:17:01.216 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022228746000000001, 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 117 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370334+0000", 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.218 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370340+0000", 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370349+0000", 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3300000000000005e-06 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370358+0000", 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4589999999999998e-06 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388807+0000", 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018449436999999999 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388930+0000", 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012235600000000001 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.389117+0000", 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186875 2024-04-19T02:17:01.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.390381+0000", 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012640399999999999 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392450+0000", 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020695269999999998 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392515+0000", 2024-04-19T02:17:01.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4682000000000002e-05 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392563+0000", 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8662999999999998e-05 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:17:01.222 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.490754013999997, 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021625360999999999, 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 164 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:17:01.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725875+0000", 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725991+0000", 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000115485 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726005+0000", 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4267000000000001e-05 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726014+0000", 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8400000000000001e-06 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740028+0000", 2024-04-19T02:17:01.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014014039000000001 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740148+0000", 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119533 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740351+0000", 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000203718 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.744482+0000", 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041303290000000003 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747346+0000", 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028647740000000001 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747431+0000", 2024-04-19T02:17:01.227 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4393000000000003e-05 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747502+0000", 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1218999999999997e-05 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:01.228 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.490603344999997, 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021599448, 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 165 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726036+0000", 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1970000000000002e-06 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726049+0000", 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3273e-05 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726056+0000", 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1729999999999998e-06 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743322+0000", 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017265692999999999 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743445+0000", 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012279500000000001 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743633+0000", 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000188722 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.745654+0000", 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020209469999999999 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747516+0000", 2024-04-19T02:17:01.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001861578 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747573+0000", 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7484000000000001e-05 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747627+0000", 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3458999999999998e-05 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.234 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.725349031999997, 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026155528000000001, 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491279+0000", 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491296+0000", 2024-04-19T02:17:01.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7110000000000001e-05 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491325+0000", 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9070000000000001e-05 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491348+0000", 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2900000000000001e-05 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495290+0000", 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039419140000000004 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496920+0000", 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016300959999999999 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497231+0000", 2024-04-19T02:17:01.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000310568 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505316+0000", 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080857410000000005 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517073+0000", 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011756691 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517255+0000", 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000181962 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517437+0000", 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000182299 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.725260259000002, 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026727732000000001, 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:17:01.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491369+0000", 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491383+0000", 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4466e-05 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491403+0000", 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9473000000000001e-05 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491420+0000", 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7090000000000001e-05 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498831+0000", 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074110139999999996 2024-04-19T02:17:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499047+0000", 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021572799999999999 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499345+0000", 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029797800000000001 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505423+0000", 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060781159999999997 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517860+0000", 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012436918999999999 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518004+0000", 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014407600000000001 2024-04-19T02:17:01.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518098+0000", 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4362000000000002e-05 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.725194569999999, 2024-04-19T02:17:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027347060999999999, 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.247 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491435+0000", 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491442+0000", 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8369999999999999e-06 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491460+0000", 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7547e-05 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491473+0000", 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3446e-05 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499944+0000", 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084714009999999999 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500227+0000", 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000283045 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.249 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500561+0000", 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033363700000000002 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509743+0000", 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091819880000000003 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518208+0000", 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084647709999999994 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.250 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.251 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.251 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518680+0000", 2024-04-19T02:17:01.251 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00047247000000000001 2024-04-19T02:17:01.251 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.251 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.251 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.251 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518783+0000", 2024-04-19T02:17:01.253 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010294900000000001 2024-04-19T02:17:01.253 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.725145349999998, 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027680531000000001, 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.254 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491484+0000", 2024-04-19T02:17:01.255 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491492+0000", 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3860000000000001e-06 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491509+0000", 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.696e-05 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.256 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491522+0000", 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.322e-05 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501273+0000", 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097514639999999996 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501485+0000", 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021127200000000001 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501814+0000", 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032901700000000002 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509758+0000", 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007944329 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518935+0000", 2024-04-19T02:17:01.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.009176745 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519073+0000", 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000138255 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519166+0000", 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3016000000000005e-05 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.725070111000001, 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037163597999999999, 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491559+0000", 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491569+0000", 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0176999999999999e-05 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491589+0000", 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9510000000000001e-05 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491607+0000", 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8533e-05 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502933+0000", 2024-04-19T02:17:01.262 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011325408 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503696+0000", 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00076329999999999996 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504054+0000", 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035819399999999999 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515030+0000", 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010975944 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528254+0000", 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013223999 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528387+0000", 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000132652 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528724+0000", 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033722400000000001 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.725009464000003, 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037472687999999997, 2024-04-19T02:17:01.265 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491620+0000", 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491628+0000", 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5229999999999998e-06 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.267 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491645+0000", 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7319000000000001e-05 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491659+0000", 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3864e-05 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511359+0000", 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019700583000000001 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511590+0000", 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000231108 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511891+0000", 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030086499999999999 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519283+0000", 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073919019999999997 2024-04-19T02:17:01.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528864+0000", 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0095805430000000004 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528990+0000", 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000126456 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529094+0000", 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103735 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.724958807999997, 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037857123999999999, 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.271 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.272 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:17:01.272 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.272 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.272 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.272 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491671+0000", 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491678+0000", 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9099999999999999e-06 2024-04-19T02:17:01.273 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491696+0000", 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7966999999999999e-05 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491709+0000", 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3356000000000001e-05 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.274 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513534+0000", 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021825223000000001 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513941+0000", 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00040700000000000003 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.514246+0000", 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000304364 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.520103+0000", 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058571719999999999 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529229+0000", 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091263549999999992 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529430+0000", 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020086400000000001 2024-04-19T02:17:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529529+0000", 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9069999999999998e-05 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:17:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.724878806, 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038136467, 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.278 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491751+0000", 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491758+0000", 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3139999999999998e-06 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491776+0000", 2024-04-19T02:17:01.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8012999999999998e-05 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491790+0000", 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4173e-05 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515076+0000", 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023285173999999999 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515262+0000", 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186305 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516475+0000", 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012131170000000001 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521138+0000", 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046631550000000004 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529678+0000", 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085395709999999993 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529807+0000", 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012929200000000001 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529888+0000", 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1433000000000005e-05 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.724827382999997, 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024863728000000002, 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.283 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491809+0000", 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5540000000000003e-06 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491828+0000", 2024-04-19T02:17:01.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9429999999999999e-05 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7416000000000001e-05 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497895+0000", 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060489469999999998 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498946+0000", 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001051129 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499220+0000", 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000273928 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509102+0000", 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0098820690000000003 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516293+0000", 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071913020000000001 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516548+0000", 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025478799999999999 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516667+0000", 2024-04-19T02:17:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119265 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.724759913, 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026983983999999999, 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491870+0000", 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491877+0000", 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.447e-06 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491898+0000", 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0792999999999999e-05 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491912+0000", 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3740000000000001e-05 2024-04-19T02:17:01.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499845+0000", 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079334190000000006 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502302+0000", 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024567069999999998 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502745+0000", 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000442822 2024-04-19T02:17:01.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509121+0000", 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063766650000000001 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518263+0000", 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091422090000000001 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518753+0000", 2024-04-19T02:17:01.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00048999600000000003 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518855+0000", 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101313 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:17:01.294 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.724696053999999, 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.039155085999999999, 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491934+0000", 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491941+0000", 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6830000000000008e-06 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491959+0000", 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7484000000000001e-05 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492423+0000", 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000464399 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499801+0000", 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007378 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501517+0000", 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0017152789999999999 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501827+0000", 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031013200000000002 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509113+0000", 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007286346 2024-04-19T02:17:01.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530913+0000", 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021800077000000001 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531004+0000", 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0799999999999998e-05 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531090+0000", 2024-04-19T02:17:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5818999999999999e-05 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.723859517000001, 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038579016000000001, 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492797+0000", 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8059999999999999e-05 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492870+0000", 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2578999999999997e-05 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492898+0000", 2024-04-19T02:17:01.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8394e-05 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503481+0000", 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010583169999999999 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503995+0000", 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00051340999999999995 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504343+0000", 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034785300000000002 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516750+0000", 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012407506 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531185+0000", 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014434565999999999 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531290+0000", 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010582900000000001 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531350+0000", 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9753000000000002e-05 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.722085307999997, 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034067229999999997, 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494556+0000", 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2679e-05 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494708+0000", 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000151416 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494770+0000", 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2292999999999995e-05 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503657+0000", 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088874850000000005 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503946+0000", 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028820700000000001 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504257+0000", 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031168400000000001 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516765+0000", 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012508244999999999 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528273+0000", 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011507167 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528491+0000", 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021798499999999999 2024-04-19T02:17:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528613+0000", 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122049 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.721701735000003, 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034106006000000001, 2024-04-19T02:17:01.311 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494928+0000", 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494938+0000", 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0156999999999999e-05 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495033+0000", 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5556000000000005e-05 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495050+0000", 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6356000000000001e-05 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505119+0000", 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010069896 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506334+0000", 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00121423 2024-04-19T02:17:01.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506662+0000", 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000328757 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516778+0000", 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010115928 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528709+0000", 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011930685999999999 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528938+0000", 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022862100000000001 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529035+0000", 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7286000000000003e-05 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.316 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:26 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.721562773000002, 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.035948230999999997, 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495067+0000", 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495076+0000", 2024-04-19T02:17:01.321 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5130000000000002e-06 2024-04-19T02:17:01.321 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495131+0000", 2024-04-19T02:17:01.321 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4583999999999998e-05 2024-04-19T02:17:01.321 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495184+0000", 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3038999999999998e-05 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500428+0000", 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052442740000000002 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500785+0000", 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035727399999999998 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036842400000000001 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507385+0000", 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062313749999999999 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530895+0000", 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023510029000000002 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530964+0000", 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8856999999999995e-05 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531016+0000", 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2182000000000003e-05 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.324 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.333 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.334 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:29 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.334 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:17:01.334 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.721421911, 2024-04-19T02:17:01.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026450912, 2024-04-19T02:17:01.335 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.335 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.335 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:17:01.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:17:01.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495207+0000", 2024-04-19T02:17:01.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:01.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495234+0000", 2024-04-19T02:17:01.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7076999999999998e-05 2024-04-19T02:17:01.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495945+0000", 2024-04-19T02:17:01.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071182099999999996 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495968+0000", 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2855999999999999e-05 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498885+0000", 2024-04-19T02:17:01.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029170730000000001 2024-04-19T02:17:01.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499136+0000", 2024-04-19T02:17:01.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025015500000000001 2024-04-19T02:17:01.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499457+0000", 2024-04-19T02:17:01.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000321014 2024-04-19T02:17:01.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:01.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508677+0000", 2024-04-19T02:17:01.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092201249999999992 2024-04-19T02:17:01.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521389+0000", 2024-04-19T02:17:01.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012712146000000001 2024-04-19T02:17:01.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:01.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521514+0000", 2024-04-19T02:17:01.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012532600000000001 2024-04-19T02:17:01.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521660+0000", 2024-04-19T02:17:01.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014555899999999999 2024-04-19T02:17:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.72064074, 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.033370365999999999, 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:01.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495988+0000", 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496001+0000", 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2999e-05 2024-04-19T02:17:01.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:01.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496027+0000", 2024-04-19T02:17:01.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6207000000000002e-05 2024-04-19T02:17:01.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496043+0000", 2024-04-19T02:17:01.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5605999999999999e-05 2024-04-19T02:17:01.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:01.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507643+0000", 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011599553 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508710+0000", 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001067201 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529360+0000", 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020650532999999999 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.353 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.353 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:01.353 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:01.353 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:17:01.354 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:01.355 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:01.353+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:01.455 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:01.457+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:01.484 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:01.485 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:01.498 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:01.556 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:01.557+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:01.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:01.657 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:01.657+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.257501683000001, 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:01.749 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:01.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:01.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.257383300999997, 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:01.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.257314301000001, 2024-04-19T02:17:01.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:01.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:01.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:01.765 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.257184084999999, 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:01.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:01.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.257104533000003, 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:01.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.257009089999997, 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:01.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:01.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.782 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.256928184000003, 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:01.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:01.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.786 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.256460355000002, 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:01.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:01.790 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.256399647999999, 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:01.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:01.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.249247326999999, 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.239324547000002, 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.238973190000003, 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.238410270000003, 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.238310734999999, 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.227607270999997, 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.225974686000001, 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.225041507, 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.224915178000003, 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.224651692999998, 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:01.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.555554512, 2024-04-19T02:17:01.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:01.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.840 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.841 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:01.841 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:01.841 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:01.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:01.843 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:01.841+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:01.944 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:01.945+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:01.973 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:01.973 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:01.973 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:01.973 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:01.987 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:02.045 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:02.045+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:02.104 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:02.104 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:02.104 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:02.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:02.104 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:02.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:02.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:02.146 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:02.145+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:02.247 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:02.249+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:02.249 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:02.249 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:02.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:02.250 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:02.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.250 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:02.250 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:02.250 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.696911548000003, 2024-04-19T02:17:02.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:02.250 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.696519279999997, 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.255 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:02.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.696049477999999, 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:02.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:02.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:02.264 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.695112418000001, 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:02.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:02.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:02.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.69479681, 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.694347786999998, 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.693758930999998, 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758952502, 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758854016000001, 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758786360000002, 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758734404000002, 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758680407, 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758625701, 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758572141000002, 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758516188999998, 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.758467791999998, 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.748331657000001, 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.744324611000003, 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.744266578999998, 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.743798034999998, 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:02.351 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:02.351 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:02.349+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:02.379 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:17:02.379 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:02.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:17:02.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:02.450 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:02.449+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:02.485 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:02.485 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:02.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:02.551 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:02.553+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:02.634 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:02.652 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:02.653+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:02.666 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:17:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:17:02.682 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-19T02:17:02.184887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90096,"kb_used_data":832,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025424,"statfs":{"total":289910292480,"available":289818034176,"internally_reserved":0,"allocated":851968,"data_stored":1462283,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002133"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355562+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:16:57.355562+0000","last_peered":"2024-04-19T02:16:57.355562+0000","last_clean":"2024-04-19T02:16:57.355562+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:16:57.355562+0000","last_undegraded":"2024-04-19T02:16:57.355562+0000","last_fullsized":"2024-04-19T02:16:57.355562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354751+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:16:57.354751+0000","last_peered":"2024-04-19T02:16:57.354751+0000","last_clean":"2024-04-19T02:16:57.354751+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:16:57.354751+0000","last_undegraded":"2024-04-19T02:16:57.354751+0000","last_fullsized":"2024-04-19T02:16:57.354751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357031+0000","last_change":"2024-04-19T02:16:24.522003+0000","last_active":"2024-04-19T02:16:57.357031+0000","last_peered":"2024-04-19T02:16:57.357031+0000","last_clean":"2024-04-19T02:16:57.357031+0000","last_became_active":"2024-04-19T02:16:24.520464+0000","last_became_peered":"2024-04-19T02:16:24.520464+0000","last_unstale":"2024-04-19T02:16:57.357031+0000","last_undegraded":"2024-04-19T02:16:57.357031+0000","last_fullsized":"2024-04-19T02:16:57.357031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:44:43.238799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356468+0000","last_change":"2024-04-19T02:16:24.519476+0000","last_active":"2024-04-19T02:16:57.356468+0000","last_peered":"2024-04-19T02:16:57.356468+0000","last_clean":"2024-04-19T02:16:57.356468+0000","last_became_active":"2024-04-19T02:16:24.518241+0000","last_became_peered":"2024-04-19T02:16:24.518241+0000","last_unstale":"2024-04-19T02:16:57.356468+0000","last_undegraded":"2024-04-19T02:16:57.356468+0000","last_fullsized":"2024-04-19T02:16:57.356468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:17.160770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354187+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:16:57.354187+0000","last_peered":"2024-04-19T02:16:57.354187+0000","last_clean":"2024-04-19T02:16:57.354187+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:16:57.354187+0000","last_undegraded":"2024-04-19T02:16:57.354187+0000","last_fullsized":"2024-04-19T02:16:57.354187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355817+0000","last_change":"2024-04-19T02:16:24.511817+0000","last_active":"2024-04-19T02:16:57.355817+0000","last_peered":"2024-04-19T02:16:57.355817+0000","last_clean":"2024-04-19T02:16:57.355817+0000","last_became_active":"2024-04-19T02:16:24.509830+0000","last_became_peered":"2024-04-19T02:16:24.509830+0000","last_unstale":"2024-04-19T02:16:57.355817+0000","last_undegraded":"2024-04-19T02:16:57.355817+0000","last_fullsized":"2024-04-19T02:16:57.355817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:37.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355653+0000","last_change":"2024-04-19T02:16:24.511267+0000","last_active":"2024-04-19T02:16:57.355653+0000","last_peered":"2024-04-19T02:16:57.355653+0000","last_clean":"2024-04-19T02:16:57.355653+0000","last_became_active":"2024-04-19T02:16:24.510011+0000","last_became_peered":"2024-04-19T02:16:24.510011+0000","last_unstale":"2024-04-19T02:16:57.355653+0000","last_undegraded":"2024-04-19T02:16:57.355653+0000","last_fullsized":"2024-04-19T02:16:57.355653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355287+0000","last_change":"2024-04-19T02:16:24.511244+0000","last_active":"2024-04-19T02:16:57.355287+0000","last_peered":"2024-04-19T02:16:57.355287+0000","last_clean":"2024-04-19T02:16:57.355287+0000","last_became_active":"2024-04-19T02:16:24.507133+0000","last_became_peered":"2024-04-19T02:16:24.507133+0000","last_unstale":"2024-04-19T02:16:57.355287+0000","last_undegraded":"2024-04-19T02:16:57.355287+0000","last_fullsized":"2024-04-19T02:16:57.355287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:30.290499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362170+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:16:57.362170+0000","last_peered":"2024-04-19T02:16:57.362170+0000","last_clean":"2024-04-19T02:16:57.362170+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:16:57.362170+0000","last_undegraded":"2024-04-19T02:16:57.362170+0000","last_fullsized":"2024-04-19T02:16:57.362170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354884+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:16:57.354884+0000","last_peered":"2024-04-19T02:16:57.354884+0000","last_clean":"2024-04-19T02:16:57.354884+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:16:57.354884+0000","last_undegraded":"2024-04-19T02:16:57.354884+0000","last_fullsized":"2024-04-19T02:16:57.354884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357189+0000","last_change":"2024-04-19T02:16:24.514685+0000","last_active":"2024-04-19T02:16:57.357189+0000","last_peered":"2024-04-19T02:16:57.357189+0000","last_clean":"2024-04-19T02:16:57.357189+0000","last_became_active":"2024-04-19T02:16:24.513952+0000","last_became_peered":"2024-04-19T02:16:24.513952+0000","last_unstale":"2024-04-19T02:16:57.357189+0000","last_undegraded":"2024-04-19T02:16:57.357189+0000","last_fullsized":"2024-04-19T02:16:57.357189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354243+0000","last_change":"2024-04-19T02:16:24.523682+0000","last_active":"2024-04-19T02:16:57.354243+0000","last_peered":"2024-04-19T02:16:57.354243+0000","last_clean":"2024-04-19T02:16:57.354243+0000","last_became_active":"2024-04-19T02:16:24.522753+0000","last_became_peered":"2024-04-19T02:16:24.522753+0000","last_unstale":"2024-04-19T02:16:57.354243+0000","last_undegraded":"2024-04-19T02:16:57.354243+0000","last_fullsized":"2024-04-19T02:16:57.354243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:15:07.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353786+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:16:57.353786+0000","last_peered":"2024-04-19T02:16:57.353786+0000","last_clean":"2024-04-19T02:16:57.353786+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:16:57.353786+0000","last_undegraded":"2024-04-19T02:16:57.353786+0000","last_fullsized":"2024-04-19T02:16:57.353786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355894+0000","last_change":"2024-04-19T02:16:24.515807+0000","last_active":"2024-04-19T02:16:57.355894+0000","last_peered":"2024-04-19T02:16:57.355894+0000","last_clean":"2024-04-19T02:16:57.355894+0000","last_became_active":"2024-04-19T02:16:24.514665+0000","last_became_peered":"2024-04-19T02:16:24.514665+0000","last_unstale":"2024-04-19T02:16:57.355894+0000","last_undegraded":"2024-04-19T02:16:57.355894+0000","last_fullsized":"2024-04-19T02:16:57.355894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355742+0000","last_change":"2024-04-19T02:16:24.515084+0000","last_active":"2024-04-19T02:16:57.355742+0000","last_peered":"2024-04-19T02:16:57.355742+0000","last_clean":"2024-04-19T02:16:57.355742+0000","last_became_active":"2024-04-19T02:16:24.513877+0000","last_became_peered":"2024-04-19T02:16:24.513877+0000","last_unstale":"2024-04-19T02:16:57.355742+0000","last_undegraded":"2024-04-19T02:16:57.355742+0000","last_fullsized":"2024-04-19T02:16:57.355742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:17.793701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355316+0000","last_change":"2024-04-19T02:16:24.514515+0000","last_active":"2024-04-19T02:16:57.355316+0000","last_peered":"2024-04-19T02:16:57.355316+0000","last_clean":"2024-04-19T02:16:57.355316+0000","last_became_active":"2024-04-19T02:16:24.513548+0000","last_became_peered":"2024-04-19T02:16:24.513548+0000","last_unstale":"2024-04-19T02:16:57.355316+0000","last_undegraded":"2024-04-19T02:16:57.355316+0000","last_fullsized":"2024-04-19T02:16:57.355316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.363000+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:16:57.363000+0000","last_peered":"2024-04-19T02:16:57.363000+0000","last_clean":"2024-04-19T02:16:57.363000+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:16:57.363000+0000","last_undegraded":"2024-04-19T02:16:57.363000+0000","last_fullsized":"2024-04-19T02:16:57.363000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355174+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:16:57.355174+0000","last_peered":"2024-04-19T02:16:57.355174+0000","last_clean":"2024-04-19T02:16:57.355174+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:16:57.355174+0000","last_undegraded":"2024-04-19T02:16:57.355174+0000","last_fullsized":"2024-04-19T02:16:57.355174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361845+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:16:57.361845+0000","last_peered":"2024-04-19T02:16:57.361845+0000","last_clean":"2024-04-19T02:16:57.361845+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:16:57.361845+0000","last_undegraded":"2024-04-19T02:16:57.361845+0000","last_fullsized":"2024-04-19T02:16:57.361845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356707+0000","last_change":"2024-04-19T02:16:24.517034+0000","last_active":"2024-04-19T02:16:57.356707+0000","last_peered":"2024-04-19T02:16:57.356707+0000","last_clean":"2024-04-19T02:16:57.356707+0000","last_became_active":"2024-04-19T02:16:24.516285+0000","last_became_peered":"2024-04-19T02:16:24.516285+0000","last_unstale":"2024-04-19T02:16:57.356707+0000","last_undegraded":"2024-04-19T02:16:57.356707+0000","last_fullsized":"2024-04-19T02:16:57.356707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356243+0000","last_change":"2024-04-19T02:16:24.514469+0000","last_active":"2024-04-19T02:16:57.356243+0000","last_peered":"2024-04-19T02:16:57.356243+0000","last_clean":"2024-04-19T02:16:57.356243+0000","last_became_active":"2024-04-19T02:16:24.509956+0000","last_became_peered":"2024-04-19T02:16:24.509956+0000","last_unstale":"2024-04-19T02:16:57.356243+0000","last_undegraded":"2024-04-19T02:16:57.356243+0000","last_fullsized":"2024-04-19T02:16:57.356243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353668+0000","last_change":"2024-04-19T02:16:24.521133+0000","last_active":"2024-04-19T02:16:57.353668+0000","last_peered":"2024-04-19T02:16:57.353668+0000","last_clean":"2024-04-19T02:16:57.353668+0000","last_became_active":"2024-04-19T02:16:24.519965+0000","last_became_peered":"2024-04-19T02:16:24.519965+0000","last_unstale":"2024-04-19T02:16:57.353668+0000","last_undegraded":"2024-04-19T02:16:57.353668+0000","last_fullsized":"2024-04-19T02:16:57.353668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:42.778813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.360604+0000","last_change":"2024-04-19T02:16:24.518967+0000","last_active":"2024-04-19T02:16:57.360604+0000","last_peered":"2024-04-19T02:16:57.360604+0000","last_clean":"2024-04-19T02:16:57.360604+0000","last_became_active":"2024-04-19T02:16:24.518148+0000","last_became_peered":"2024-04-19T02:16:24.518148+0000","last_unstale":"2024-04-19T02:16:57.360604+0000","last_undegraded":"2024-04-19T02:16:57.360604+0000","last_fullsized":"2024-04-19T02:16:57.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.352923+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:16:57.352923+0000","last_peered":"2024-04-19T02:16:57.352923+0000","last_clean":"2024-04-19T02:16:57.352923+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:16:57.352923+0000","last_undegraded":"2024-04-19T02:16:57.352923+0000","last_fullsized":"2024-04-19T02:16:57.352923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355767+0000","last_change":"2024-04-19T02:16:24.519546+0000","last_active":"2024-04-19T02:16:57.355767+0000","last_peered":"2024-04-19T02:16:57.355767+0000","last_clean":"2024-04-19T02:16:57.355767+0000","last_became_active":"2024-04-19T02:16:24.518867+0000","last_became_peered":"2024-04-19T02:16:24.518867+0000","last_unstale":"2024-04-19T02:16:57.355767+0000","last_undegraded":"2024-04-19T02:16:57.355767+0000","last_fullsized":"2024-04-19T02:16:57.355767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362120+0000","last_change":"2024-04-19T02:16:24.522548+0000","last_active":"2024-04-19T02:16:57.362120+0000","last_peered":"2024-04-19T02:16:57.362120+0000","last_clean":"2024-04-19T02:16:57.362120+0000","last_became_active":"2024-04-19T02:16:24.521698+0000","last_became_peered":"2024-04-19T02:16:24.521698+0000","last_unstale":"2024-04-19T02:16:57.362120+0000","last_undegraded":"2024-04-19T02:16:57.362120+0000","last_fullsized":"2024-04-19T02:16:57.362120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357281+0000","last_change":"2024-04-19T02:16:24.521952+0000","last_active":"2024-04-19T02:16:57.357281+0000","last_peered":"2024-04-19T02:16:57.357281+0000","last_clean":"2024-04-19T02:16:57.357281+0000","last_became_active":"2024-04-19T02:16:24.519648+0000","last_became_peered":"2024-04-19T02:16:24.519648+0000","last_unstale":"2024-04-19T02:16:57.357281+0000","last_undegraded":"2024-04-19T02:16:57.357281+0000","last_fullsized":"2024-04-19T02:16:57.357281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:37.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355217+0000","last_change":"2024-04-19T02:16:24.521997+0000","last_active":"2024-04-19T02:16:57.355217+0000","last_peered":"2024-04-19T02:16:57.355217+0000","last_clean":"2024-04-19T02:16:57.355217+0000","last_became_active":"2024-04-19T02:16:24.521041+0000","last_became_peered":"2024-04-19T02:16:24.521041+0000","last_unstale":"2024-04-19T02:16:57.355217+0000","last_undegraded":"2024-04-19T02:16:57.355217+0000","last_fullsized":"2024-04-19T02:16:57.355217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361607+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:16:57.361607+0000","last_peered":"2024-04-19T02:16:57.361607+0000","last_clean":"2024-04-19T02:16:57.361607+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:16:57.361607+0000","last_undegraded":"2024-04-19T02:16:57.361607+0000","last_fullsized":"2024-04-19T02:16:57.361607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353930+0000","last_change":"2024-04-19T02:16:24.516889+0000","last_active":"2024-04-19T02:16:57.353930+0000","last_peered":"2024-04-19T02:16:57.353930+0000","last_clean":"2024-04-19T02:16:57.353930+0000","last_became_active":"2024-04-19T02:16:24.515900+0000","last_became_peered":"2024-04-19T02:16:24.515900+0000","last_unstale":"2024-04-19T02:16:57.353930+0000","last_undegraded":"2024-04-19T02:16:57.353930+0000","last_fullsized":"2024-04-19T02:16:57.353930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.360739+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:16:57.360739+0000","last_peered":"2024-04-19T02:16:57.360739+0000","last_clean":"2024-04-19T02:16:57.360739+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:16:57.360739+0000","last_undegraded":"2024-04-19T02:16:57.360739+0000","last_fullsized":"2024-04-19T02:16:57.360739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355556+0000","last_change":"2024-04-19T02:16:24.506453+0000","last_active":"2024-04-19T02:16:57.355556+0000","last_peered":"2024-04-19T02:16:57.355556+0000","last_clean":"2024-04-19T02:16:57.355556+0000","last_became_active":"2024-04-19T02:16:24.504031+0000","last_became_peered":"2024-04-19T02:16:24.504031+0000","last_unstale":"2024-04-19T02:16:57.355556+0000","last_undegraded":"2024-04-19T02:16:57.355556+0000","last_fullsized":"2024-04-19T02:16:57.355556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354955+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:16:57.354955+0000","last_peered":"2024-04-19T02:16:57.354955+0000","last_clean":"2024-04-19T02:16:57.354955+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:16:57.354955+0000","last_undegraded":"2024-04-19T02:16:57.354955+0000","last_fullsized":"2024-04-19T02:16:57.354955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356614+0000","last_change":"2024-04-19T02:16:24.142637+0000","last_active":"2024-04-19T02:16:57.356614+0000","last_peered":"2024-04-19T02:16:57.356614+0000","last_clean":"2024-04-19T02:16:57.356614+0000","last_became_active":"2024-04-19T02:16:24.141889+0000","last_became_peered":"2024-04-19T02:16:24.141889+0000","last_unstale":"2024-04-19T02:16:57.356614+0000","last_undegraded":"2024-04-19T02:16:57.356614+0000","last_fullsized":"2024-04-19T02:16:57.356614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:05.628633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354878+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:16:57.354878+0000","last_peered":"2024-04-19T02:16:57.354878+0000","last_clean":"2024-04-19T02:16:57.354878+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:16:57.354878+0000","last_undegraded":"2024-04-19T02:16:57.354878+0000","last_fullsized":"2024-04-19T02:16:57.354878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361061+0000","last_change":"2024-04-19T02:16:24.140912+0000","last_active":"2024-04-19T02:16:57.361061+0000","last_peered":"2024-04-19T02:16:57.361061+0000","last_clean":"2024-04-19T02:16:57.361061+0000","last_became_active":"2024-04-19T02:16:24.139976+0000","last_became_peered":"2024-04-19T02:16:24.139976+0000","last_unstale":"2024-04-19T02:16:57.361061+0000","last_undegraded":"2024-04-19T02:16:57.361061+0000","last_fullsized":"2024-04-19T02:16:57.361061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362376+0000","last_change":"2024-04-19T02:16:24.523226+0000","last_active":"2024-04-19T02:16:57.362376+0000","last_peered":"2024-04-19T02:16:57.362376+0000","last_clean":"2024-04-19T02:16:57.362376+0000","last_became_active":"2024-04-19T02:16:24.522509+0000","last_became_peered":"2024-04-19T02:16:24.522509+0000","last_unstale":"2024-04-19T02:16:57.362376+0000","last_undegraded":"2024-04-19T02:16:57.362376+0000","last_fullsized":"2024-04-19T02:16:57.362376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353576+0000","last_change":"2024-04-19T02:16:24.126138+0000","last_active":"2024-04-19T02:16:57.353576+0000","last_peered":"2024-04-19T02:16:57.353576+0000","last_clean":"2024-04-19T02:16:57.353576+0000","last_became_active":"2024-04-19T02:16:24.125013+0000","last_became_peered":"2024-04-19T02:16:24.125013+0000","last_unstale":"2024-04-19T02:16:57.353576+0000","last_undegraded":"2024-04-19T02:16:57.353576+0000","last_fullsized":"2024-04-19T02:16:57.353576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362310+0000","last_change":"2024-04-19T02:16:24.523574+0000","last_active":"2024-04-19T02:16:57.362310+0000","last_peered":"2024-04-19T02:16:57.362310+0000","last_clean":"2024-04-19T02:16:57.362310+0000","last_became_active":"2024-04-19T02:16:24.522900+0000","last_became_peered":"2024-04-19T02:16:24.522900+0000","last_unstale":"2024-04-19T02:16:57.362310+0000","last_undegraded":"2024-04-19T02:16:57.362310+0000","last_fullsized":"2024-04-19T02:16:57.362310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355854+0000","last_change":"2024-04-19T02:16:24.133305+0000","last_active":"2024-04-19T02:16:57.355854+0000","last_peered":"2024-04-19T02:16:57.355854+0000","last_clean":"2024-04-19T02:16:57.355854+0000","last_became_active":"2024-04-19T02:16:24.132280+0000","last_became_peered":"2024-04-19T02:16:24.132280+0000","last_unstale":"2024-04-19T02:16:57.355854+0000","last_undegraded":"2024-04-19T02:16:57.355854+0000","last_fullsized":"2024-04-19T02:16:57.355854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357781+0000","last_change":"2024-04-19T02:16:24.134254+0000","last_active":"2024-04-19T02:16:57.357781+0000","last_peered":"2024-04-19T02:16:57.357781+0000","last_clean":"2024-04-19T02:16:57.357781+0000","last_became_active":"2024-04-19T02:16:24.132192+0000","last_became_peered":"2024-04-19T02:16:24.132192+0000","last_unstale":"2024-04-19T02:16:57.357781+0000","last_undegraded":"2024-04-19T02:16:57.357781+0000","last_fullsized":"2024-04-19T02:16:57.357781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353090+0000","last_change":"2024-04-19T02:16:24.521826+0000","last_active":"2024-04-19T02:16:57.353090+0000","last_peered":"2024-04-19T02:16:57.353090+0000","last_clean":"2024-04-19T02:16:57.353090+0000","last_became_active":"2024-04-19T02:16:24.520328+0000","last_became_peered":"2024-04-19T02:16:24.520328+0000","last_unstale":"2024-04-19T02:16:57.353090+0000","last_undegraded":"2024-04-19T02:16:57.353090+0000","last_fullsized":"2024-04-19T02:16:57.353090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:30.799375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355621+0000","last_change":"2024-04-19T02:16:24.122852+0000","last_active":"2024-04-19T02:16:57.355621+0000","last_peered":"2024-04-19T02:16:57.355621+0000","last_clean":"2024-04-19T02:16:57.355621+0000","last_became_active":"2024-04-19T02:16:24.119392+0000","last_became_peered":"2024-04-19T02:16:24.119392+0000","last_unstale":"2024-04-19T02:16:57.355621+0000","last_undegraded":"2024-04-19T02:16:57.355621+0000","last_fullsized":"2024-04-19T02:16:57.355621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353340+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:16:57.353340+0000","last_peered":"2024-04-19T02:16:57.353340+0000","last_clean":"2024-04-19T02:16:57.353340+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:16:57.353340+0000","last_undegraded":"2024-04-19T02:16:57.353340+0000","last_fullsized":"2024-04-19T02:16:57.353340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357645+0000","last_change":"2024-04-19T02:16:24.140028+0000","last_active":"2024-04-19T02:16:57.357645+0000","last_peered":"2024-04-19T02:16:57.357645+0000","last_clean":"2024-04-19T02:16:57.357645+0000","last_became_active":"2024-04-19T02:16:24.137593+0000","last_became_peered":"2024-04-19T02:16:24.137593+0000","last_unstale":"2024-04-19T02:16:57.357645+0000","last_undegraded":"2024-04-19T02:16:57.357645+0000","last_fullsized":"2024-04-19T02:16:57.357645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356220+0000","last_change":"2024-04-19T02:16:24.502677+0000","last_active":"2024-04-19T02:16:57.356220+0000","last_peered":"2024-04-19T02:16:57.356220+0000","last_clean":"2024-04-19T02:16:57.356220+0000","last_became_active":"2024-04-19T02:16:24.501931+0000","last_became_peered":"2024-04-19T02:16:24.501931+0000","last_unstale":"2024-04-19T02:16:57.356220+0000","last_undegraded":"2024-04-19T02:16:57.356220+0000","last_fullsized":"2024-04-19T02:16:57.356220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357039+0000","last_change":"2024-04-19T02:16:24.140120+0000","last_active":"2024-04-19T02:16:57.357039+0000","last_peered":"2024-04-19T02:16:57.357039+0000","last_clean":"2024-04-19T02:16:57.357039+0000","last_became_active":"2024-04-19T02:16:24.139426+0000","last_became_peered":"2024-04-19T02:16:24.139426+0000","last_unstale":"2024-04-19T02:16:57.357039+0000","last_undegraded":"2024-04-19T02:16:57.357039+0000","last_fullsized":"2024-04-19T02:16:57.357039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.360800+0000","last_change":"2024-04-19T02:16:24.519638+0000","last_active":"2024-04-19T02:16:57.360800+0000","last_peered":"2024-04-19T02:16:57.360800+0000","last_clean":"2024-04-19T02:16:57.360800+0000","last_became_active":"2024-04-19T02:16:24.518426+0000","last_became_peered":"2024-04-19T02:16:24.518426+0000","last_unstale":"2024-04-19T02:16:57.360800+0000","last_undegraded":"2024-04-19T02:16:57.360800+0000","last_fullsized":"2024-04-19T02:16:57.360800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361693+0000","last_change":"2024-04-19T02:16:24.140999+0000","last_active":"2024-04-19T02:16:57.361693+0000","last_peered":"2024-04-19T02:16:57.361693+0000","last_clean":"2024-04-19T02:16:57.361693+0000","last_became_active":"2024-04-19T02:16:24.140090+0000","last_became_peered":"2024-04-19T02:16:24.140090+0000","last_unstale":"2024-04-19T02:16:57.361693+0000","last_undegraded":"2024-04-19T02:16:57.361693+0000","last_fullsized":"2024-04-19T02:16:57.361693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:32.742743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356769+0000","last_change":"2024-04-19T02:16:24.519206+0000","last_active":"2024-04-19T02:16:57.356769+0000","last_peered":"2024-04-19T02:16:57.356769+0000","last_clean":"2024-04-19T02:16:57.356769+0000","last_became_active":"2024-04-19T02:16:24.517729+0000","last_became_peered":"2024-04-19T02:16:24.517729+0000","last_unstale":"2024-04-19T02:16:57.356769+0000","last_undegraded":"2024-04-19T02:16:57.356769+0000","last_fullsized":"2024-04-19T02:16:57.356769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356429+0000","last_change":"2024-04-19T02:16:24.141215+0000","last_active":"2024-04-19T02:16:57.356429+0000","last_peered":"2024-04-19T02:16:57.356429+0000","last_clean":"2024-04-19T02:16:57.356429+0000","last_became_active":"2024-04-19T02:16:24.139687+0000","last_became_peered":"2024-04-19T02:16:24.139687+0000","last_unstale":"2024-04-19T02:16:57.356429+0000","last_undegraded":"2024-04-19T02:16:57.356429+0000","last_fullsized":"2024-04-19T02:16:57.356429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:07.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357433+0000","last_change":"2024-04-19T02:16:24.521586+0000","last_active":"2024-04-19T02:16:57.357433+0000","last_peered":"2024-04-19T02:16:57.357433+0000","last_clean":"2024-04-19T02:16:57.357433+0000","last_became_active":"2024-04-19T02:16:24.519546+0000","last_became_peered":"2024-04-19T02:16:24.519546+0000","last_unstale":"2024-04-19T02:16:57.357433+0000","last_undegraded":"2024-04-19T02:16:57.357433+0000","last_fullsized":"2024-04-19T02:16:57.357433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353696+0000","last_change":"2024-04-19T02:16:24.125846+0000","last_active":"2024-04-19T02:16:57.353696+0000","last_peered":"2024-04-19T02:16:57.353696+0000","last_clean":"2024-04-19T02:16:57.353696+0000","last_became_active":"2024-04-19T02:16:24.124042+0000","last_became_peered":"2024-04-19T02:16:24.124042+0000","last_unstale":"2024-04-19T02:16:57.353696+0000","last_undegraded":"2024-04-19T02:16:57.353696+0000","last_fullsized":"2024-04-19T02:16:57.353696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:50.121766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357356+0000","last_change":"2024-04-19T02:16:24.518011+0000","last_active":"2024-04-19T02:16:57.357356+0000","last_peered":"2024-04-19T02:16:57.357356+0000","last_clean":"2024-04-19T02:16:57.357356+0000","last_became_active":"2024-04-19T02:16:24.516902+0000","last_became_peered":"2024-04-19T02:16:24.516902+0000","last_unstale":"2024-04-19T02:16:57.357356+0000","last_undegraded":"2024-04-19T02:16:57.357356+0000","last_fullsized":"2024-04-19T02:16:57.357356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353314+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:16:57.353314+0000","last_peered":"2024-04-19T02:16:57.353314+0000","last_clean":"2024-04-19T02:16:57.353314+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:16:57.353314+0000","last_undegraded":"2024-04-19T02:16:57.353314+0000","last_fullsized":"2024-04-19T02:16:57.353314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362372+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:16:57.362372+0000","last_peered":"2024-04-19T02:16:57.362372+0000","last_clean":"2024-04-19T02:16:57.362372+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:16:57.362372+0000","last_undegraded":"2024-04-19T02:16:57.362372+0000","last_fullsized":"2024-04-19T02:16:57.362372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":221,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356264+0000","last_change":"2024-04-19T02:16:16.001893+0000","last_active":"2024-04-19T02:16:57.356264+0000","last_peered":"2024-04-19T02:16:57.356264+0000","last_clean":"2024-04-19T02:16:57.356264+0000","last_became_active":"2024-04-19T02:16:16.001328+0000","last_became_peered":"2024-04-19T02:16:16.001328+0000","last_unstale":"2024-04-19T02:16:57.356264+0000","last_undegraded":"2024-04-19T02:16:57.356264+0000","last_fullsized":"2024-04-19T02:16:57.356264+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:14.043725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356783+0000","last_change":"2024-04-19T02:16:20.085518+0000","last_active":"2024-04-19T02:16:57.356783+0000","last_peered":"2024-04-19T02:16:57.356783+0000","last_clean":"2024-04-19T02:16:57.356783+0000","last_became_active":"2024-04-19T02:16:20.084881+0000","last_became_peered":"2024-04-19T02:16:20.084881+0000","last_unstale":"2024-04-19T02:16:57.356783+0000","last_undegraded":"2024-04-19T02:16:57.356783+0000","last_fullsized":"2024-04-19T02:16:57.356783+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:36.395082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361023+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:16:57.361023+0000","last_peered":"2024-04-19T02:16:57.361023+0000","last_clean":"2024-04-19T02:16:57.361023+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:16:57.361023+0000","last_undegraded":"2024-04-19T02:16:57.361023+0000","last_fullsized":"2024-04-19T02:16:57.361023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357688+0000","last_change":"2024-04-19T02:16:24.522227+0000","last_active":"2024-04-19T02:16:57.357688+0000","last_peered":"2024-04-19T02:16:57.357688+0000","last_clean":"2024-04-19T02:16:57.357688+0000","last_became_active":"2024-04-19T02:16:24.520497+0000","last_became_peered":"2024-04-19T02:16:24.520497+0000","last_unstale":"2024-04-19T02:16:57.357688+0000","last_undegraded":"2024-04-19T02:16:57.357688+0000","last_fullsized":"2024-04-19T02:16:57.357688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356111+0000","last_change":"2024-04-19T02:16:20.081049+0000","last_active":"2024-04-19T02:16:57.356111+0000","last_peered":"2024-04-19T02:16:57.356111+0000","last_clean":"2024-04-19T02:16:57.356111+0000","last_became_active":"2024-04-19T02:16:20.080565+0000","last_became_peered":"2024-04-19T02:16:20.080565+0000","last_unstale":"2024-04-19T02:16:57.356111+0000","last_undegraded":"2024-04-19T02:16:57.356111+0000","last_fullsized":"2024-04-19T02:16:57.356111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:31.339382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361104+0000","last_change":"2024-04-19T02:16:24.140739+0000","last_active":"2024-04-19T02:16:57.361104+0000","last_peered":"2024-04-19T02:16:57.361104+0000","last_clean":"2024-04-19T02:16:57.361104+0000","last_became_active":"2024-04-19T02:16:24.139619+0000","last_became_peered":"2024-04-19T02:16:24.139619+0000","last_unstale":"2024-04-19T02:16:57.361104+0000","last_undegraded":"2024-04-19T02:16:57.361104+0000","last_fullsized":"2024-04-19T02:16:57.361104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355339+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:16:57.355339+0000","last_peered":"2024-04-19T02:16:57.355339+0000","last_clean":"2024-04-19T02:16:57.355339+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:16:57.355339+0000","last_undegraded":"2024-04-19T02:16:57.355339+0000","last_fullsized":"2024-04-19T02:16:57.355339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361360+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:16:57.361360+0000","last_peered":"2024-04-19T02:16:57.361360+0000","last_clean":"2024-04-19T02:16:57.361360+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:16:57.361360+0000","last_undegraded":"2024-04-19T02:16:57.361360+0000","last_fullsized":"2024-04-19T02:16:57.361360+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353383+0000","last_change":"2024-04-19T02:16:24.127079+0000","last_active":"2024-04-19T02:16:57.353383+0000","last_peered":"2024-04-19T02:16:57.353383+0000","last_clean":"2024-04-19T02:16:57.353383+0000","last_became_active":"2024-04-19T02:16:24.126289+0000","last_became_peered":"2024-04-19T02:16:24.126289+0000","last_unstale":"2024-04-19T02:16:57.353383+0000","last_undegraded":"2024-04-19T02:16:57.353383+0000","last_fullsized":"2024-04-19T02:16:57.353383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:57.933704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362582+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:16:57.362582+0000","last_peered":"2024-04-19T02:16:57.362582+0000","last_clean":"2024-04-19T02:16:57.362582+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:16:57.362582+0000","last_undegraded":"2024-04-19T02:16:57.362582+0000","last_fullsized":"2024-04-19T02:16:57.362582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356480+0000","last_change":"2024-04-19T02:16:20.084551+0000","last_active":"2024-04-19T02:16:57.356480+0000","last_peered":"2024-04-19T02:16:57.356480+0000","last_clean":"2024-04-19T02:16:57.356480+0000","last_became_active":"2024-04-19T02:16:20.083956+0000","last_became_peered":"2024-04-19T02:16:20.083956+0000","last_unstale":"2024-04-19T02:16:57.356480+0000","last_undegraded":"2024-04-19T02:16:57.356480+0000","last_fullsized":"2024-04-19T02:16:57.356480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:52:31.126406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356614+0000","last_change":"2024-04-19T02:16:24.141387+0000","last_active":"2024-04-19T02:16:57.356614+0000","last_peered":"2024-04-19T02:16:57.356614+0000","last_clean":"2024-04-19T02:16:57.356614+0000","last_became_active":"2024-04-19T02:16:24.138202+0000","last_became_peered":"2024-04-19T02:16:24.138202+0000","last_unstale":"2024-04-19T02:16:57.356614+0000","last_undegraded":"2024-04-19T02:16:57.356614+0000","last_fullsized":"2024-04-19T02:16:57.356614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362374+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:16:57.362374+0000","last_peered":"2024-04-19T02:16:57.362374+0000","last_clean":"2024-04-19T02:16:57.362374+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:16:57.362374+0000","last_undegraded":"2024-04-19T02:16:57.362374+0000","last_fullsized":"2024-04-19T02:16:57.362374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357785+0000","last_change":"2024-04-19T02:16:24.142288+0000","last_active":"2024-04-19T02:16:57.357785+0000","last_peered":"2024-04-19T02:16:57.357785+0000","last_clean":"2024-04-19T02:16:57.357785+0000","last_became_active":"2024-04-19T02:16:24.138576+0000","last_became_peered":"2024-04-19T02:16:24.138576+0000","last_unstale":"2024-04-19T02:16:57.357785+0000","last_undegraded":"2024-04-19T02:16:57.357785+0000","last_fullsized":"2024-04-19T02:16:57.357785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362879+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:16:57.362879+0000","last_peered":"2024-04-19T02:16:57.362879+0000","last_clean":"2024-04-19T02:16:57.362879+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:16:57.362879+0000","last_undegraded":"2024-04-19T02:16:57.362879+0000","last_fullsized":"2024-04-19T02:16:57.362879+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353757+0000","last_change":"2024-04-19T02:16:24.517097+0000","last_active":"2024-04-19T02:16:57.353757+0000","last_peered":"2024-04-19T02:16:57.353757+0000","last_clean":"2024-04-19T02:16:57.353757+0000","last_became_active":"2024-04-19T02:16:24.516084+0000","last_became_peered":"2024-04-19T02:16:24.516084+0000","last_unstale":"2024-04-19T02:16:57.353757+0000","last_undegraded":"2024-04-19T02:16:57.353757+0000","last_fullsized":"2024-04-19T02:16:57.353757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:58.382927+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:16:58.382927+0000","last_peered":"2024-04-19T02:16:58.382927+0000","last_clean":"2024-04-19T02:16:58.382927+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:16:58.382927+0000","last_undegraded":"2024-04-19T02:16:58.382927+0000","last_fullsized":"2024-04-19T02:16:58.382927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355514+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:16:57.355514+0000","last_peered":"2024-04-19T02:16:57.355514+0000","last_clean":"2024-04-19T02:16:57.355514+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:16:57.355514+0000","last_undegraded":"2024-04-19T02:16:57.355514+0000","last_fullsized":"2024-04-19T02:16:57.355514+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354024+0000","last_change":"2024-04-19T02:16:24.522361+0000","last_active":"2024-04-19T02:16:57.354024+0000","last_peered":"2024-04-19T02:16:57.354024+0000","last_clean":"2024-04-19T02:16:57.354024+0000","last_became_active":"2024-04-19T02:16:24.521522+0000","last_became_peered":"2024-04-19T02:16:24.521522+0000","last_unstale":"2024-04-19T02:16:57.354024+0000","last_undegraded":"2024-04-19T02:16:57.354024+0000","last_fullsized":"2024-04-19T02:16:57.354024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362987+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:16:57.362987+0000","last_peered":"2024-04-19T02:16:57.362987+0000","last_clean":"2024-04-19T02:16:57.362987+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:16:57.362987+0000","last_undegraded":"2024-04-19T02:16:57.362987+0000","last_fullsized":"2024-04-19T02:16:57.362987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362499+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:16:57.362499+0000","last_peered":"2024-04-19T02:16:57.362499+0000","last_clean":"2024-04-19T02:16:57.362499+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:16:57.362499+0000","last_undegraded":"2024-04-19T02:16:57.362499+0000","last_fullsized":"2024-04-19T02:16:57.362499+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361248+0000","last_change":"2024-04-19T02:16:24.522568+0000","last_active":"2024-04-19T02:16:57.361248+0000","last_peered":"2024-04-19T02:16:57.361248+0000","last_clean":"2024-04-19T02:16:57.361248+0000","last_became_active":"2024-04-19T02:16:24.522173+0000","last_became_peered":"2024-04-19T02:16:24.522173+0000","last_unstale":"2024-04-19T02:16:57.361248+0000","last_undegraded":"2024-04-19T02:16:57.361248+0000","last_fullsized":"2024-04-19T02:16:57.361248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362479+0000","last_change":"2024-04-19T02:16:24.142378+0000","last_active":"2024-04-19T02:16:57.362479+0000","last_peered":"2024-04-19T02:16:57.362479+0000","last_clean":"2024-04-19T02:16:57.362479+0000","last_became_active":"2024-04-19T02:16:24.141647+0000","last_became_peered":"2024-04-19T02:16:24.141647+0000","last_unstale":"2024-04-19T02:16:57.362479+0000","last_undegraded":"2024-04-19T02:16:57.362479+0000","last_fullsized":"2024-04-19T02:16:57.362479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357721+0000","last_change":"2024-04-19T02:16:20.081900+0000","last_active":"2024-04-19T02:16:57.357721+0000","last_peered":"2024-04-19T02:16:57.357721+0000","last_clean":"2024-04-19T02:16:57.357721+0000","last_became_active":"2024-04-19T02:16:20.081264+0000","last_became_peered":"2024-04-19T02:16:20.081264+0000","last_unstale":"2024-04-19T02:16:57.357721+0000","last_undegraded":"2024-04-19T02:16:57.357721+0000","last_fullsized":"2024-04-19T02:16:57.357721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:33.496277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353343+0000","last_change":"2024-04-19T02:16:24.517115+0000","last_active":"2024-04-19T02:16:57.353343+0000","last_peered":"2024-04-19T02:16:57.353343+0000","last_clean":"2024-04-19T02:16:57.353343+0000","last_became_active":"2024-04-19T02:16:24.516104+0000","last_became_peered":"2024-04-19T02:16:24.516104+0000","last_unstale":"2024-04-19T02:16:57.353343+0000","last_undegraded":"2024-04-19T02:16:57.353343+0000","last_fullsized":"2024-04-19T02:16:57.353343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356369+0000","last_change":"2024-04-19T02:16:24.519396+0000","last_active":"2024-04-19T02:16:57.356369+0000","last_peered":"2024-04-19T02:16:57.356369+0000","last_clean":"2024-04-19T02:16:57.356369+0000","last_became_active":"2024-04-19T02:16:24.515977+0000","last_became_peered":"2024-04-19T02:16:24.515977+0000","last_unstale":"2024-04-19T02:16:57.356369+0000","last_undegraded":"2024-04-19T02:16:57.356369+0000","last_fullsized":"2024-04-19T02:16:57.356369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357013+0000","last_change":"2024-04-19T02:16:24.135077+0000","last_active":"2024-04-19T02:16:57.357013+0000","last_peered":"2024-04-19T02:16:57.357013+0000","last_clean":"2024-04-19T02:16:57.357013+0000","last_became_active":"2024-04-19T02:16:24.133311+0000","last_became_peered":"2024-04-19T02:16:24.133311+0000","last_unstale":"2024-04-19T02:16:57.357013+0000","last_undegraded":"2024-04-19T02:16:57.357013+0000","last_fullsized":"2024-04-19T02:16:57.357013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.360666+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:16:57.360666+0000","last_peered":"2024-04-19T02:16:57.360666+0000","last_clean":"2024-04-19T02:16:57.360666+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:16:57.360666+0000","last_undegraded":"2024-04-19T02:16:57.360666+0000","last_fullsized":"2024-04-19T02:16:57.360666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355335+0000","last_change":"2024-04-19T02:16:24.126783+0000","last_active":"2024-04-19T02:16:57.355335+0000","last_peered":"2024-04-19T02:16:57.355335+0000","last_clean":"2024-04-19T02:16:57.355335+0000","last_became_active":"2024-04-19T02:16:24.126065+0000","last_became_peered":"2024-04-19T02:16:24.126065+0000","last_unstale":"2024-04-19T02:16:57.355335+0000","last_undegraded":"2024-04-19T02:16:57.355335+0000","last_fullsized":"2024-04-19T02:16:57.355335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:16.425108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.357783+0000","last_change":"2024-04-19T02:16:24.138968+0000","last_active":"2024-04-19T02:16:57.357783+0000","last_peered":"2024-04-19T02:16:57.357783+0000","last_clean":"2024-04-19T02:16:57.357783+0000","last_became_active":"2024-04-19T02:16:24.137775+0000","last_became_peered":"2024-04-19T02:16:24.137775+0000","last_unstale":"2024-04-19T02:16:57.357783+0000","last_undegraded":"2024-04-19T02:16:57.357783+0000","last_fullsized":"2024-04-19T02:16:57.357783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:23.590862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.360842+0000","last_change":"2024-04-19T02:16:24.518367+0000","last_active":"2024-04-19T02:16:57.360842+0000","last_peered":"2024-04-19T02:16:57.360842+0000","last_clean":"2024-04-19T02:16:57.360842+0000","last_became_active":"2024-04-19T02:16:24.517607+0000","last_became_peered":"2024-04-19T02:16:24.517607+0000","last_unstale":"2024-04-19T02:16:57.360842+0000","last_undegraded":"2024-04-19T02:16:57.360842+0000","last_fullsized":"2024-04-19T02:16:57.360842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362809+0000","last_change":"2024-04-19T02:16:24.145883+0000","last_active":"2024-04-19T02:16:57.362809+0000","last_peered":"2024-04-19T02:16:57.362809+0000","last_clean":"2024-04-19T02:16:57.362809+0000","last_became_active":"2024-04-19T02:16:24.145281+0000","last_became_peered":"2024-04-19T02:16:24.145281+0000","last_unstale":"2024-04-19T02:16:57.362809+0000","last_undegraded":"2024-04-19T02:16:57.362809+0000","last_fullsized":"2024-04-19T02:16:57.362809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:53.149815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361209+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:16:57.361209+0000","last_peered":"2024-04-19T02:16:57.361209+0000","last_clean":"2024-04-19T02:16:57.361209+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:16:57.361209+0000","last_undegraded":"2024-04-19T02:16:57.361209+0000","last_fullsized":"2024-04-19T02:16:57.361209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355748+0000","last_change":"2024-04-19T02:16:24.517364+0000","last_active":"2024-04-19T02:16:57.355748+0000","last_peered":"2024-04-19T02:16:57.355748+0000","last_clean":"2024-04-19T02:16:57.355748+0000","last_became_active":"2024-04-19T02:16:24.515803+0000","last_became_peered":"2024-04-19T02:16:24.515803+0000","last_unstale":"2024-04-19T02:16:57.355748+0000","last_undegraded":"2024-04-19T02:16:57.355748+0000","last_fullsized":"2024-04-19T02:16:57.355748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361310+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:16:57.361310+0000","last_peered":"2024-04-19T02:16:57.361310+0000","last_clean":"2024-04-19T02:16:57.361310+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:16:57.361310+0000","last_undegraded":"2024-04-19T02:16:57.361310+0000","last_fullsized":"2024-04-19T02:16:57.361310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362030+0000","last_change":"2024-04-19T02:16:24.500884+0000","last_active":"2024-04-19T02:16:57.362030+0000","last_peered":"2024-04-19T02:16:57.362030+0000","last_clean":"2024-04-19T02:16:57.362030+0000","last_became_active":"2024-04-19T02:16:24.500046+0000","last_became_peered":"2024-04-19T02:16:24.500046+0000","last_unstale":"2024-04-19T02:16:57.362030+0000","last_undegraded":"2024-04-19T02:16:57.362030+0000","last_fullsized":"2024-04-19T02:16:57.362030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.361080+0000","last_change":"2024-04-19T02:16:24.141762+0000","last_active":"2024-04-19T02:16:57.361080+0000","last_peered":"2024-04-19T02:16:57.361080+0000","last_clean":"2024-04-19T02:16:57.361080+0000","last_became_active":"2024-04-19T02:16:24.140032+0000","last_became_peered":"2024-04-19T02:16:24.140032+0000","last_unstale":"2024-04-19T02:16:57.361080+0000","last_undegraded":"2024-04-19T02:16:57.361080+0000","last_fullsized":"2024-04-19T02:16:57.361080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354559+0000","last_change":"2024-04-19T02:16:24.525107+0000","last_active":"2024-04-19T02:16:57.354559+0000","last_peered":"2024-04-19T02:16:57.354559+0000","last_clean":"2024-04-19T02:16:57.354559+0000","last_became_active":"2024-04-19T02:16:24.524572+0000","last_became_peered":"2024-04-19T02:16:24.524572+0000","last_unstale":"2024-04-19T02:16:57.354559+0000","last_undegraded":"2024-04-19T02:16:57.354559+0000","last_fullsized":"2024-04-19T02:16:57.354559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:58.297082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353971+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:16:57.353971+0000","last_peered":"2024-04-19T02:16:57.353971+0000","last_clean":"2024-04-19T02:16:57.353971+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:16:57.353971+0000","last_undegraded":"2024-04-19T02:16:57.353971+0000","last_fullsized":"2024-04-19T02:16:57.353971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354715+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:16:57.354715+0000","last_peered":"2024-04-19T02:16:57.354715+0000","last_clean":"2024-04-19T02:16:57.354715+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:16:57.354715+0000","last_undegraded":"2024-04-19T02:16:57.354715+0000","last_fullsized":"2024-04-19T02:16:57.354715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.354275+0000","last_change":"2024-04-19T02:16:24.119956+0000","last_active":"2024-04-19T02:16:57.354275+0000","last_peered":"2024-04-19T02:16:57.354275+0000","last_clean":"2024-04-19T02:16:57.354275+0000","last_became_active":"2024-04-19T02:16:24.119189+0000","last_became_peered":"2024-04-19T02:16:24.119189+0000","last_unstale":"2024-04-19T02:16:57.354275+0000","last_undegraded":"2024-04-19T02:16:57.354275+0000","last_fullsized":"2024-04-19T02:16:57.354275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:09.590585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356346+0000","last_change":"2024-04-19T02:16:24.507695+0000","last_active":"2024-04-19T02:16:57.356346+0000","last_peered":"2024-04-19T02:16:57.356346+0000","last_clean":"2024-04-19T02:16:57.356346+0000","last_became_active":"2024-04-19T02:16:24.506897+0000","last_became_peered":"2024-04-19T02:16:24.506897+0000","last_unstale":"2024-04-19T02:16:57.356346+0000","last_undegraded":"2024-04-19T02:16:57.356346+0000","last_fullsized":"2024-04-19T02:16:57.356346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356852+0000","last_change":"2024-04-19T02:16:24.139864+0000","last_active":"2024-04-19T02:16:57.356852+0000","last_peered":"2024-04-19T02:16:57.356852+0000","last_clean":"2024-04-19T02:16:57.356852+0000","last_became_active":"2024-04-19T02:16:24.138846+0000","last_became_peered":"2024-04-19T02:16:24.138846+0000","last_unstale":"2024-04-19T02:16:57.356852+0000","last_undegraded":"2024-04-19T02:16:57.356852+0000","last_fullsized":"2024-04-19T02:16:57.356852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:08.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.356204+0000","last_change":"2024-04-19T02:16:24.504867+0000","last_active":"2024-04-19T02:16:57.356204+0000","last_peered":"2024-04-19T02:16:57.356204+0000","last_clean":"2024-04-19T02:16:57.356204+0000","last_became_active":"2024-04-19T02:16:24.504074+0000","last_became_peered":"2024-04-19T02:16:24.504074+0000","last_unstale":"2024-04-19T02:16:57.356204+0000","last_undegraded":"2024-04-19T02:16:57.356204+0000","last_fullsized":"2024-04-19T02:16:57.356204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355033+0000","last_change":"2024-04-19T02:16:24.142300+0000","last_active":"2024-04-19T02:16:57.355033+0000","last_peered":"2024-04-19T02:16:57.355033+0000","last_clean":"2024-04-19T02:16:57.355033+0000","last_became_active":"2024-04-19T02:16:24.141636+0000","last_became_peered":"2024-04-19T02:16:24.141636+0000","last_unstale":"2024-04-19T02:16:57.355033+0000","last_undegraded":"2024-04-19T02:16:57.355033+0000","last_fullsized":"2024-04-19T02:16:57.355033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:12.008941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.353795+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:16:57.353795+0000","last_peered":"2024-04-19T02:16:57.353795+0000","last_clean":"2024-04-19T02:16:57.353795+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:16:57.353795+0000","last_undegraded":"2024-04-19T02:16:57.353795+0000","last_fullsized":"2024-04-19T02:16:57.353795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362400+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:16:57.362400+0000","last_peered":"2024-04-19T02:16:57.362400+0000","last_clean":"2024-04-19T02:16:57.362400+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:16:57.362400+0000","last_undegraded":"2024-04-19T02:16:57.362400+0000","last_fullsized":"2024-04-19T02:16:57.362400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.355953+0000","last_change":"2024-04-19T02:16:24.509537+0000","last_active":"2024-04-19T02:16:57.355953+0000","last_peered":"2024-04-19T02:16:57.355953+0000","last_clean":"2024-04-19T02:16:57.355953+0000","last_became_active":"2024-04-19T02:16:24.505129+0000","last_became_peered":"2024-04-19T02:16:24.505129+0000","last_unstale":"2024-04-19T02:16:57.355953+0000","last_undegraded":"2024-04-19T02:16:57.355953+0000","last_fullsized":"2024-04-19T02:16:57.355953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.362603+0000","last_change":"2024-04-19T02:16:24.142413+0000","last_active":"2024-04-19T02:16:57.362603+0000","last_peered":"2024-04-19T02:16:57.362603+0000","last_clean":"2024-04-19T02:16:57.362603+0000","last_became_active":"2024-04-19T02:16:24.141620+0000","last_became_peered":"2024-04-19T02:16:24.141620+0000","last_unstale":"2024-04-19T02:16:57.362603+0000","last_undegraded":"2024-04-19T02:16:57.362603+0000","last_fullsized":"2024-04-19T02:16:57.362603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:37.539234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":89595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":315392,"data_stored":686652,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":307200,"data_stored":686036,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:17:02.750 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:02.750 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:02.752 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:02.753+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:02.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:02.853 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:02.853+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:02.895 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:02.896 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:02.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:02.954 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:02.953+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.049 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:03.096 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:03.097+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:03.155 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:03.156+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:03.170 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.170 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:03.256 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:03.257+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:03.316 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.316 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:03.357 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:03.360+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:03.412 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:17:03.458 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:03.460+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:03.496 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.496 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:03.559 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:03.561+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:03.638 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.639 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:03.660 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:03.661+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:03.761 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:03.761+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:03.785 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.785 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.799 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:03.862 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:03.860+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:03.915 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.916 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:03.972 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:03.972+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:04.065 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:04.065+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:04.094 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.094 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:04.165 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:04.165+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:04.241 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.241 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.255 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:04.300 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:04.301+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:04.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:04.367 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:04.369+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:04.370 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.371 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:04.472 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:04.473+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:04.511 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:04.530 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:17:04.530 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:04.547 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.547 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.550 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:04.550 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:04.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:04.569 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:04.568+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:04.671 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:04.673+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:04.688 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:04.688 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:04.688 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:04.688 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:04.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:04.771 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:04.772+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:04.820 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:04.820 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:04.820 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:04.820 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:04.820 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:04.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:04.883 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:04.885+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:04.961 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.409806260000003, 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:04.962 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:04.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.409413991999998, 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:04.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:04.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.40894419, 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:04.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:04.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:04.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:04.977 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.408007130000001, 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:04.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:04.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.407691522, 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.982 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:04.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.407242498999999, 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.987 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:04.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.406653642999999, 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:04.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:04.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:04.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471847214, 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:04.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:04.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:04.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471748728000001, 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:05.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:05.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:05.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.007 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471681072000003, 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:05.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:05.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:05.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471629116000003, 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:05.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471575119000001, 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:05.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471520413, 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:05.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:05.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471466853000003, 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:05.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:05.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.036 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471410900999999, 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.471362503999998, 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:05.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.461226369000002, 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:05.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.457219322999997, 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.457161290999998, 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.456692746999998, 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:05.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:05.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:05.063 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:05.065 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:05.065 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:05.064+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:05.166 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:05.168+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:05.196 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:17:05.196 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:17:05.196 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-19T02:17:05.196 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:17:05.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:05.267 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:05.264+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:05.331 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:17:05.331 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:17:05.331 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-19T02:17:05.331 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-19T02:17:05.332 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:17:05.345 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:05.389 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:05.388+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:05.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:05.464 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.094599981000002, 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022228746000000001, 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.465 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 117 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370335+0000", 2024-04-19T02:17:05.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370334+0000", 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370340+0000", 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370349+0000", 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3300000000000005e-06 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.370358+0000", 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4589999999999998e-06 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388807+0000", 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018449436999999999 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.388930+0000", 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012235600000000001 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.389117+0000", 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186875 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.390381+0000", 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012640399999999999 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.469 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392450+0000", 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020695269999999998 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392515+0000", 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4682000000000002e-05 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.392563+0000", 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8662999999999998e-05 2024-04-19T02:17:05.470 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 48.739058016999998, 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021625360999999999, 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:17:05.471 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 164 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725877+0000", 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725875+0000", 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.725991+0000", 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000115485 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726005+0000", 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4267000000000001e-05 2024-04-19T02:17:05.473 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726014+0000", 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8400000000000001e-06 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740028+0000", 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014014039000000001 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740148+0000", 2024-04-19T02:17:05.474 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119533 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.740351+0000", 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000203718 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.744482+0000", 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041303290000000003 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747346+0000", 2024-04-19T02:17:05.475 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028647740000000001 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747431+0000", 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4393000000000003e-05 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747502+0000", 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1218999999999997e-05 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.476 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4148.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 48.738907347999998, 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021599448, 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4148", 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.73:0/2155200545", 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 165 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.477 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.478 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726027+0000", 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726036+0000", 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1970000000000002e-06 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726049+0000", 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3273e-05 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.479 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.726056+0000", 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1729999999999998e-06 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743322+0000", 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017265692999999999 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743445+0000", 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012279500000000001 2024-04-19T02:17:05.480 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.743633+0000", 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000188722 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.745654+0000", 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020209469999999999 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747516+0000", 2024-04-19T02:17:05.481 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001861578 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747573+0000", 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7484000000000001e-05 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:16.747627+0000", 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3458999999999998e-05 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.482 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973653034999998, 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026155528000000001, 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.483 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491282+0000", 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491279+0000", 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491296+0000", 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7110000000000001e-05 2024-04-19T02:17:05.484 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491325+0000", 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9070000000000001e-05 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491348+0000", 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2900000000000001e-05 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495290+0000", 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039419140000000004 2024-04-19T02:17:05.485 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496920+0000", 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016300959999999999 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497231+0000", 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000310568 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505316+0000", 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080857410000000005 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517073+0000", 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011756691 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517255+0000", 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000181962 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.487 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517437+0000", 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000182299 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973564261999996, 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026727732000000001, 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.488 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491370+0000", 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491369+0000", 2024-04-19T02:17:05.489 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491383+0000", 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4466e-05 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491403+0000", 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9473000000000001e-05 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.490 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491420+0000", 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7090000000000001e-05 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498831+0000", 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074110139999999996 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499047+0000", 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021572799999999999 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.491 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499345+0000", 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029797800000000001 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505423+0000", 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060781159999999997 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.517860+0000", 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012436918999999999 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.492 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518004+0000", 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014407600000000001 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518098+0000", 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4362000000000002e-05 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.493 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973498573000001, 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027347060999999999, 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491436+0000", 2024-04-19T02:17:05.494 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491435+0000", 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491442+0000", 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8369999999999999e-06 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.495 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491460+0000", 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7547e-05 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491473+0000", 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3446e-05 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499944+0000", 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084714009999999999 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.496 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500227+0000", 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000283045 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500561+0000", 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033363700000000002 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509743+0000", 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091819880000000003 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.497 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518208+0000", 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084647709999999994 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518680+0000", 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00047247000000000001 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518783+0000", 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010294900000000001 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.498 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973449352999999, 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027680531000000001, 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.499 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491485+0000", 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491484+0000", 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491492+0000", 2024-04-19T02:17:05.500 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3860000000000001e-06 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491509+0000", 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.696e-05 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491522+0000", 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.322e-05 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.501 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501273+0000", 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097514639999999996 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501485+0000", 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021127200000000001 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501814+0000", 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032901700000000002 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.502 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509758+0000", 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007944329 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518935+0000", 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.009176745 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519073+0000", 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000138255 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.503 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519166+0000", 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3016000000000005e-05 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973374114000002, 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037163597999999999, 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.504 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491561+0000", 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491559+0000", 2024-04-19T02:17:05.505 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491569+0000", 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0176999999999999e-05 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491589+0000", 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9510000000000001e-05 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.506 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491607+0000", 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8533e-05 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502933+0000", 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011325408 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503696+0000", 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00076329999999999996 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.507 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504054+0000", 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035819399999999999 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515030+0000", 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010975944 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528254+0000", 2024-04-19T02:17:05.508 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013223999 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528387+0000", 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000132652 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528724+0000", 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033722400000000001 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.509 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973313466999997, 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037472687999999997, 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.510 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491621+0000", 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491620+0000", 2024-04-19T02:17:05.511 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491628+0000", 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5229999999999998e-06 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.512 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491645+0000", 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7319000000000001e-05 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491659+0000", 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3864e-05 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511359+0000", 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019700583000000001 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.513 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511590+0000", 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000231108 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.511891+0000", 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030086499999999999 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.519283+0000", 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073919019999999997 2024-04-19T02:17:05.514 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528864+0000", 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0095805430000000004 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528990+0000", 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000126456 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529094+0000", 2024-04-19T02:17:05.515 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103735 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973262810999998, 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037857123999999999, 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.516 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491672+0000", 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491671+0000", 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.517 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491678+0000", 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9099999999999999e-06 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491696+0000", 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7966999999999999e-05 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491709+0000", 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3356000000000001e-05 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.518 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513534+0000", 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021825223000000001 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.513941+0000", 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00040700000000000003 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.514246+0000", 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000304364 2024-04-19T02:17:05.519 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.520103+0000", 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058571719999999999 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529229+0000", 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091263549999999992 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529430+0000", 2024-04-19T02:17:05.520 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020086400000000001 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529529+0000", 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9069999999999998e-05 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.521 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973182809000001, 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038136467, 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.522 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491752+0000", 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491751+0000", 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491758+0000", 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3139999999999998e-06 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.523 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491776+0000", 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8012999999999998e-05 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491790+0000", 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4173e-05 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515076+0000", 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023285173999999999 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.524 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.515262+0000", 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186305 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516475+0000", 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0012131170000000001 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521138+0000", 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046631550000000004 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.525 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529678+0000", 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085395709999999993 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529807+0000", 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012929200000000001 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529888+0000", 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1433000000000005e-05 2024-04-19T02:17:05.526 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973131385999999, 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024863728000000002, 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491803+0000", 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.528 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491809+0000", 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5540000000000003e-06 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491828+0000", 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9429999999999999e-05 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7416000000000001e-05 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.529 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.497895+0000", 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060489469999999998 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498946+0000", 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001051129 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499220+0000", 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000273928 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.530 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509102+0000", 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0098820690000000003 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516293+0000", 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071913020000000001 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516548+0000", 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025478799999999999 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.531 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516667+0000", 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119265 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973063916000001, 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026983983999999999, 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.532 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491871+0000", 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491870+0000", 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491877+0000", 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.447e-06 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491898+0000", 2024-04-19T02:17:05.534 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0792999999999999e-05 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491912+0000", 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3740000000000001e-05 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499845+0000", 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079334190000000006 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.535 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502302+0000", 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024567069999999998 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.502745+0000", 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000442822 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509121+0000", 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063766650000000001 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.536 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518263+0000", 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091422090000000001 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518753+0000", 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00048999600000000003 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.518855+0000", 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101313 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.537 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.973000057, 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.039155085999999999, 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:17:05.538 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491935+0000", 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491934+0000", 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491941+0000", 2024-04-19T02:17:05.539 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6830000000000008e-06 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.491959+0000", 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7484000000000001e-05 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492423+0000", 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000464399 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.540 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499801+0000", 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007378 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501517+0000", 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0017152789999999999 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501827+0000", 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031013200000000002 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.509113+0000", 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007286346 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530913+0000", 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021800077000000001 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531004+0000", 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0799999999999998e-05 2024-04-19T02:17:05.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531090+0000", 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5818999999999999e-05 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.972163520000002, 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.038579016000000001, 2024-04-19T02:17:05.543 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492771+0000", 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492797+0000", 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8059999999999999e-05 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492870+0000", 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2578999999999997e-05 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.492898+0000", 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8394e-05 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503481+0000", 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010583169999999999 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503995+0000", 2024-04-19T02:17:05.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00051340999999999995 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504343+0000", 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034785300000000002 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516750+0000", 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012407506 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531185+0000", 2024-04-19T02:17:05.547 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014434565999999999 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531290+0000", 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010582900000000001 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531350+0000", 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9753000000000002e-05 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.970389310999998, 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034067229999999997, 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.549 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494545+0000", 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494556+0000", 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2679e-05 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494708+0000", 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000151416 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494770+0000", 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2292999999999995e-05 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503657+0000", 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088874850000000005 2024-04-19T02:17:05.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.503946+0000", 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028820700000000001 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.504257+0000", 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031168400000000001 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516765+0000", 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012508244999999999 2024-04-19T02:17:05.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528273+0000", 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011507167 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528491+0000", 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021798499999999999 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528613+0000", 2024-04-19T02:17:05.553 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122049 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.970005737999998, 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.034106006000000001, 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.554 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494929+0000", 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494928+0000", 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:05.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.494938+0000", 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0156999999999999e-05 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495033+0000", 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5556000000000005e-05 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495050+0000", 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6356000000000001e-05 2024-04-19T02:17:05.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.505119+0000", 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010069896 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506334+0000", 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00121423 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.506662+0000", 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000328757 2024-04-19T02:17:05.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.516778+0000", 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010115928 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528709+0000", 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011930685999999999 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.558 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.528938+0000", 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022862100000000001 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529035+0000", 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7286000000000003e-05 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:26 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.969866776000003, 2024-04-19T02:17:05.559 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.035948230999999997, 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495068+0000", 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495067+0000", 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495076+0000", 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5130000000000002e-06 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495131+0000", 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4583999999999998e-05 2024-04-19T02:17:05.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495184+0000", 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3038999999999998e-05 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500428+0000", 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052442740000000002 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.500785+0000", 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035727399999999998 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036842400000000001 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507385+0000", 2024-04-19T02:17:05.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062313749999999999 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530895+0000", 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.023510029000000002 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.530964+0000", 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8856999999999995e-05 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.531016+0000", 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2182000000000003e-05 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:29 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.969725914000001, 2024-04-19T02:17:05.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.026450912, 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495209+0000", 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495207+0000", 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495234+0000", 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7076999999999998e-05 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495945+0000", 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071182099999999996 2024-04-19T02:17:05.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495968+0000", 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2855999999999999e-05 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.498885+0000", 2024-04-19T02:17:05.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029170730000000001 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499136+0000", 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025015500000000001 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.499457+0000", 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000321014 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508677+0000", 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092201249999999992 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521389+0000", 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012712146000000001 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521514+0000", 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012532600000000001 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.521660+0000", 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014555899999999999 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.968944743000002, 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.033370365999999999, 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-19T02:17:05.572 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495990+0000", 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-19T02:17:05.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.495988+0000", 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496001+0000", 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2999e-05 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496027+0000", 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6207000000000002e-05 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.496043+0000", 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5605999999999999e-05 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.507643+0000", 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011599553 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.508710+0000", 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001067201 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-19T02:17:05.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-19T02:16:24.529360+0000", 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020650532999999999 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-19T02:17:05.576 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:17:05.578 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:05.579 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:05.577+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:05.678 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:05.680+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:05.704 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:05.704 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:05.704 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:05.705 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:05.718 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:05.779 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:05.776+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:05.826 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:05.826 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:05.826 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:05.827 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:05.827 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:05.839 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:05.880 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:05.880+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:05.981 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:05.980+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.508715672999998, 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.508597291000001, 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.508528290999998, 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.508398075000002, 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.508318523, 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.50822308, 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.508142174, 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.507674344999998, 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.507613638000002, 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.500461317000003, 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.047 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:06.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.490538536999999, 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.49018718, 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.489624259999999, 2024-04-19T02:17:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.489524725000003, 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.478821261, 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.477188675999997, 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.476255496999997, 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.476129168, 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.475865683000002, 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.806768501999997, 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:06.096 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:06.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:06.098 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:06.097+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:06.198 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:06.200+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:06.244 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:06.299 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:06.296+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:06.366 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:06.366 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:06.366 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:06.366 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:06.366 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:06.381 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:06.400 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:06.400+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:06.426 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:17:06.501 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:06.504+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.955035821000003, 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:06.507 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:06.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.954643552999997, 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:06.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.954173750999999, 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:06.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.953236691000001, 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:06.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.952921083, 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.952472059999998, 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.951883203999998, 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.017076775, 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.016978289000001, 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.016910633000002, 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.016858677000002, 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.01680468, 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.016749974, 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.016696414000002, 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.016640461999998, 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.016592064999998, 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.006455930000001, 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.002448884000003, 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.002390851999998, 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.001922307999997, 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:06.603 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:06.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:06.606 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:06.606 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:06.605+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:06.707 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:06.705+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:17:06.752 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:06.796 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:06.807 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:06.804+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:06.873 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:06.874 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:06.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:06.908 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:06.909+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:07.009 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:07.009+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:07.010 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.010 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.024 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:07.110 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:17:07.112+0000 7f2e984c6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21481) UID: 0 2024-04-19T02:17:07.150 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.150 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:07.211 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:07.208+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:07.271 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.271 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.285 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:07.328 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:07.328+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:07.413 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:07.413+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:07.515 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:07.512+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:07.616 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:07.616+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:07.687 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:17:07.687 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:07.688 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-19T02:17:07.688 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:17:07.688 INFO:teuthology.orchestra.console.smithi136:Power off 2024-04-19T02:17:07.688 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T02:17:07.710 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-04-19T02:17:07.710 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:07.720 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:07.720+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:07.727 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.727 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.733 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-19T02:17:07.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:07.821 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:07.820+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:07.863 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.863 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.879 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:07.922 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:07.921+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:08.009 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.009 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.023 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:08.023 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:08.020+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:08.124 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:08.124+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:08.185 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.186 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.201 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:08.227 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:08.229+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:08.327 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:08.329+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:08.366 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.366 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.380 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:08.431 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:08.433+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:08.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:08.512 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.512 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:08.571 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:08.573+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:08.633 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:08.632+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:08.691 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.691 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.705 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:08.733 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:08.732+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:08.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:08.826 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.827 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.834 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:08.836+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:08.840 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:08.935 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:08.933+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:08.961 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:08.972 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.972 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.981 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:17:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:08.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:08.999 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:09.000 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:09.036 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:09.037+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:09.110 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:09.110 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:09.111 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:09.111 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:09.111 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:09.124 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:09.136 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:09.137+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:09.237 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:09.236+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:09.248 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:09.248 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.757954073000001, 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:09.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:09.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:09.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.254 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.255 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:09.255 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.757835690999997, 2024-04-19T02:17:09.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:09.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:09.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.757766691, 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:09.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:09.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:09.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.757636474999998, 2024-04-19T02:17:09.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:09.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:09.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.757556923000003, 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:09.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.757461480000003, 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.279 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:09.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.757380574000003, 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:09.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.756912745000001, 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.756852037999998, 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.749699716999999, 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.739776937000002, 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:09.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.739425580000002, 2024-04-19T02:17:09.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:09.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:09.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.738862660000002, 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.738763124999998, 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.728059661000003, 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.726427076, 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:09.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:09.323 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.725493897, 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:09.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:09.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.725367568000003, 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:09.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.725104082999998, 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.332 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:09.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.056006902, 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:09.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:09.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:09.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:09.342 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:09.344 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:09.340+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:09.344 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:09.443 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:17:09.444 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:09.444+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:09.476 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:09.477 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:09.477 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:09.477 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:09.491 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:09.545 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:09.545+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:09.611 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:09.611 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:09.612 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:09.612 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:09.612 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:09.627 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:09.646 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:09.644+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:09.748 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:09.749+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:09.804 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 53.252569067000003, 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:09.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:09.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 53.252176798999997, 2024-04-19T02:17:09.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:09.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:09.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 53.251706996999999, 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:09.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 53.250769937000001, 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.818 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:09.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 53.250454329, 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:09.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 53.250005305999998, 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.827 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:09.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:09.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:09.831 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 53.249416449999998, 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314610021, 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.836 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:09.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:09.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314511535000001, 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:09.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:09.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314443879000002, 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314391923000002, 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.858 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314337926, 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:09.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:09.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.31428322, 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:09.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:09.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:09.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:09.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:09.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:09.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:09.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314229660000002, 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:09.878 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314173707999998, 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:09.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.314125310999998, 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:09.883 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:09.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.303989176000002, 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:09.887 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:09.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.299982129999997, 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.892 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:09.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:09.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:09.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.897 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.299924097999998, 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:09.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.299455553999998, 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:09.902 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:09.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:09.906 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:09.907 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:09.908 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:09.909 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:09.909+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:10.009 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:10.009+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:10.040 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:10.040 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:10.040 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:10.040 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:10.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:10.110 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:10.108+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:10.170 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:10.170 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:10.170 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:10.170 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:10.170 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:10.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:10.210 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:10.209+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:10.311 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:10.308+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.855259193999999, 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.855140812000002, 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.855071811999998, 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.854941596000003, 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.854862044000001, 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.854766601000001, 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.854685695000001, 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.854217865999999, 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.854157159000003, 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.847004837999997, 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.837082058, 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.836730701, 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.836167781, 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.836068245999996, 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.825364782000001, 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:10.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:10.412 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.823732196999998, 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.822799017999998, 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:10.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:10.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:10.420 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.822672689000001, 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:10.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:10.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.822409204000003, 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:10.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:10.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.153312022999998, 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:10.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:10.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:10.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:10.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:10.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:10.434 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:10.436 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:10.436+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:10.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:10.536 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:10.537+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:10.567 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:10.567 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:10.567 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:10.567 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:10.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:10.671 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:10.673+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:10.738 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:10.737+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:10.748 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:10.749 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:10.764 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:10.839 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:10.836+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:10.932 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:10.932 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:10.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:10.932 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:10.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.932 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:10.932 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.379989143000003, 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:10.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.379596874999997, 2024-04-19T02:17:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:10.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:10.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.379127072999999, 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:10.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:10.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:10.946 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.378190013000001, 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:10.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:10.950 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.377874405, 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:10.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:10.955 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.377425381999998, 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:10.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:10.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.376836525999998, 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:10.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:10.964 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.442030097, 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:10.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:10.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:10.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:10.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441931611000001, 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:10.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.975 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441863955000002, 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:10.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:10.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441811999000002, 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.981 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:10.986 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441758002, 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:10.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:10.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441703296, 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:10.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:10.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:10.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441649736000002, 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.998 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:11.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:11.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441593783999998, 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:11.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.007 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.441545386999998, 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:11.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:11.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:11.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.431409252000002, 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:11.016 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.427402205999996, 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:11.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:11.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:11.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.427344173999998, 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:11.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:11.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.426875629999998, 2024-04-19T02:17:11.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:11.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:11.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:11.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:11.029 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:11.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:11.032 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:11.032+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:11.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:11.132 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:11.132+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:11.179 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:11.204 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-19T02:17:11.204 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:11.223 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:11.224 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:11.233 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:11.233+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:11.334 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:11.333+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:11.336 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:11.336 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:11.350 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:11.435 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:11.432+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:11.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:11.474 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:11.474 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:11.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:11.537 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:11.536+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:11.619 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:11.620 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:11.634 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:11.637 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:11.637+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:11.733 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:11.744 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:11.744+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:11.752 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:11.752 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:11.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:11.844 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-19T02:17:11.845 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:11.844+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:11.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:11.946 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:11.945+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:12.034 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.034 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.046 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:12.045+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:12.047 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:12.148 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:12.149+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:12.164 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.164 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.179 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:12.249 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:12.248+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:12.304 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.304 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:12.360 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:12.360+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.450 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:12.449+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:12.464 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:17:12.551 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:12.548+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:12.628 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.629 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:12.652 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:12.652+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:12.752 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:12.753+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:12.760 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.760 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.774 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:12.854 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:12.853+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:12.905 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.905 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.919 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:12.955 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:12.957+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:13.035 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:13.036 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:13.049 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:13.096 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:13.096+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:13.157 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:13.157+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:13.170 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:13.171 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:13.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:13.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:13.258 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:13.256+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:13.319 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:13.319 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:13.334 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:13.379 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:13.381+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:13.395 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:13.415 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:13.415 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:13.418 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:13.418 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:13.451 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:13.451 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:13.459 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:13.460+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:13.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:13.560 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:13.561+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:13.634 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 57.082093532000002, 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 57.081701264000003, 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 57.081231461999998, 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 57.080294402, 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 57.079978793999999, 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 57.079529770999997, 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 57.078940914999997, 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.144134485999999, 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.144036, 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143968344000001, 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143916388000001, 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143862390999999, 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143807684999999, 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143754125000001, 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143698172999997, 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143649775999997, 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.133513641, 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.129506595000002, 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.129448562999997, 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.128980018999997, 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:13.731 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:13.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:13.733 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:13.733+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:13.833 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:13.832+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:13.862 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:13.862 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:13.862 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:13.862 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:13.876 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:13.965 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:13.964+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:14.034 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:14.032+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:14.037 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:14.037 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:14.037 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:14.038 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:14.038 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:14.053 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:14.140 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:14.140+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:14.218 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:14.218 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:14.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.727871561000001, 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:14.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:14.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:14.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.727753178999997, 2024-04-19T02:17:14.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:14.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.727684179000001, 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:14.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:14.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:14.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.727553962999998, 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:14.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:14.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:14.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.240 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.727474411000003, 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:14.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.727378967999996, 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:14.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.727298062000003, 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:14.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:14.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.255 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.726830233000001, 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:14.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.259 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.726769525999998, 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:14.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.719617204999999, 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:14.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:14.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.709694425000002, 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:14.268 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:14.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.709343068000003, 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:14.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:14.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.708780148000002, 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:14.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:14.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:14.279 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.708680612999999, 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:14.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:14.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.697977149000003, 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:14.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.696344564, 2024-04-19T02:17:14.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:14.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.695411385, 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.695285056000003, 2024-04-19T02:17:14.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:14.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.299 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.695021570999998, 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:14.303 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.02592439, 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:14.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:14.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:14.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:14.309 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:14.311 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:14.308+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:14.311 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:14.411 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:14.413+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:14.442 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:14.442 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:14.457 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:14.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:14.548 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:14.549+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:14.613 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:14.612+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:14.622 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:14.622 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:14.622 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:14.622 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:14.623 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:14.636 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:14.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-19T02:17:14.723 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:14.725+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:14.806 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:14.806 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.254364482, 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:14.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:14.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.253972214000001, 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:14.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.253502412000003, 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.252565351999998, 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:14.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.252249743999997, 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:14.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:14.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.251800721000002, 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.833 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.251211865000002, 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:14.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:14.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.316405435999997, 2024-04-19T02:17:14.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.843 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.316306949999998, 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:14.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:14.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.316239293999999, 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.849 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:14.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:14.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.316187337999999, 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.316133340999997, 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:14.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:14.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.865 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.316078634999997, 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:14.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.870 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.316025074999999, 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:14.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:14.875 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.315969123000002, 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:14.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:14.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.315920726000002, 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:14.883 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.305784590999998, 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:14.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.301777545, 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:14.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:14.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.301719513000002, 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.301250969000002, 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:14.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:14.900 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:14.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:14.902 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:14.904+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:15.002 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:15.001+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:15.032 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:15.032 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:15.032 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:15.032 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:15.047 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:15.103 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:15.100+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:15.181 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:15.225 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:15.224+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:15.305 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:15.305+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:15.344 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.852616030999997, 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:15.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:15.350 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.852497649, 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:15.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:15.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:15.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.852428648999997, 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:15.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:15.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:15.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:15.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:15.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:15.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.852298433000001, 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:15.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:15.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.852218880999999, 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.368 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:15.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:15.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.852123438, 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:15.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:15.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:15.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.852042531999999, 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:15.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.851574702999997, 2024-04-19T02:17:15.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.851513996000001, 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:15.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.844361675000002, 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:15.393 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:15.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:15.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:15.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:15.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.834438894999998, 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.834087537999999, 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.833524617999998, 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.833425083000002, 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.822721618999999, 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.821089034000003, 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.820155855000003, 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.820029525999999, 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.819766041000001, 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.150668860000003, 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:15.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:15.445 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:15.445+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:15.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:15.487 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:17:15.546 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:15.545+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:15.578 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:15.578 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:15.592 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:15.600 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:15.600 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:15.601 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:15.620 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:15.623 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:15.624 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:15.646 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:15.648+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:15.747 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:15.748+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:15.755 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:15.755 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:15.769 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:15.845 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:15.855 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:15.856+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:15.907 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:15.955 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-19T02:17:15.956 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:15.956+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:16.038 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.038 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:16.056 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-04-19T02:17:16.057 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:16.057+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:16.158 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:16.157+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:16.219 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.219 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:16.276 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:16.276+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:16.350 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.350 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.360 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:16.361+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:16.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:16.461 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:16.460+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:16.496 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.496 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.510 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:16.561 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:16.561+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:16.631 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.632 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:16.687 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:16.689+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:16.762 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:16.761+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:16.811 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.811 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.825 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:16.873 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:16.872+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:16.956 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.956 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.964 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:16.965+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:16.971 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:17.066 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:17.065+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:17.133 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.133 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.147 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:17.166 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:17.165+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:17.263 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.264 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.267 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:17.269+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:17.277 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:17.368 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:17.368+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:17.410 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.410 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:17.475 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:17.477+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:17.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:17.548 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.548 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:17.604 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:17.605+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:17.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:17.671 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:17.673+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:17.726 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.727 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.742 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:17.768 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:17.768 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:17.786 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:17.786 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:17.789 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:17.789 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:17.790 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:17.788+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:17.873 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:17.872+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:17.873 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:17.873 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:17.873 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:17.873 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:17.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:17.976 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:17.976+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:18.048 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:18.048 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:18.048 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:18.062 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:18.075 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:18.077+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:18.176 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:18.177+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.739440432999999, 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:18.232 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:18.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:18.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.739322051000002, 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:18.238 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:18.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.739253050999999, 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:18.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:18.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.739122835000003, 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:18.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:18.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:18.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.739043283000001, 2024-04-19T02:17:18.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:18.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.738947840000002, 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.261 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:18.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.738866934000001, 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:18.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.271 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:18.273 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.738399104999999, 2024-04-19T02:17:18.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:18.273 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.273 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:18.273 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:18.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.738338398000003, 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:18.277 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:18.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.281 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.731186076999997, 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:18.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.721263297, 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.286 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:18.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.720911940000001, 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.72034902, 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:18.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:18.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.720249484999997, 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:18.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:18.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.709546021000001, 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:18.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:18.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:18.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.707913435999998, 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.706980256999998, 2024-04-19T02:17:18.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:18.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.706853928000001, 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:18.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:18.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.706590443000003, 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:18.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.037493261999998, 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.324 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:18.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:18.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:18.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.330 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:18.330 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:18.330 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:18.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:18.332 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:18.333+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:18.433 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:18.432+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:18.463 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:18.463 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:18.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:18.487 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:17:18.533 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:18.532+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:18.603 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:18.603 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:18.603 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:18.603 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:18.603 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:18.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:18.635 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:18.636+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:18.736 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:18.736+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:18.786 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:18.786 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.234001468999999, 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:18.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:18.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.233609201, 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:18.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.233139399000002, 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.796 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:18.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.232202338999997, 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:18.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.231886731000003, 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.231437708000001, 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.230848852000001, 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.296042423000003, 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295943936999997, 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295876280999998, 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295824324999998, 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295770328000003, 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295715622000003, 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295662061999998, 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:18.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.859 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295606110000001, 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:18.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.864 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.295557713000001, 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:18.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.285421577999998, 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:18.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.281414531999999, 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:18.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:18.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.281356500000001, 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:18.881 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.280887956000001, 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:18.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:18.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:18.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:18.887 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:18.889 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:18.889 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:18.888+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:18.990 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:18.988+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:19.021 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:19.021 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:19.021 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:19.021 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:19.035 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:19.091 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:19.092+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:19.192 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:19.192+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:19.198 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:19.199 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:19.199 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:19.199 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:19.199 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:19.213 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:19.300 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:19.300+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:19.379 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.887443908000002, 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:19.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:19.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:19.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:19.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.887325525999998, 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:19.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:19.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:19.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:19.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:19.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:19.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:19.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:19.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.887256526000002, 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:19.395 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:19.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:19.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.401 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.887126309999999, 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.402 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:19.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:19.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:19.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:19.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:19.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:19.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.409 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.887046757999997, 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:19.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:19.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:19.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:19.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:19.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:19.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:19.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.418 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.418 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:19.418 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.886951314999997, 2024-04-19T02:17:19.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:19.418 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.418 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.419 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:19.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:19.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:19.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.886870408999997, 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:19.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:19.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:19.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:19.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:19.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:19.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:19.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:19.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:19.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:19.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:19.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.886402580000002, 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:19.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:19.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:19.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:19.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:19.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:19.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:19.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:19.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:19.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:19.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.441 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.886341872999999, 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:19.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:19.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:19.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:19.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.879189552, 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:19.452 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.869266772000003, 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:19.453 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:19.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:19.457 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.868915415000004, 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.462 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.868352495000003, 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:19.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:19.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:19.467 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.86825296, 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:19.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:19.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:19.472 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.857549495999997, 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:19.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.855916911000001, 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:19.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.854983732000001, 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:19.482 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:19.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:19.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:19.487 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.854857402999997, 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:19.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:19.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:19.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:19.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:19.493 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.854593917999999, 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:19.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.185496737000001, 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:19.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:19.508 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:19.508+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:19.608 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:19.608+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:19.639 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:19.639 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:19.639 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:19.639 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:19.652 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:19.709 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:19.712+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:19.769 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:19.769 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:19.769 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:19.769 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:19.769 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:19.783 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:19.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:19.810 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:19.812+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.352057492999997, 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:19.904 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:19.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:19.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:19.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.909 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351665224999998, 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:19.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:19.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:19.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:19.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:19.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:19.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.916 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351195423, 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.917 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:19.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:19.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.350258363000002, 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:19.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:19.926 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.349942755000001, 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:19.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:19.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.349493731999999, 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:19.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.348904875999999, 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:19.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:19.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.940 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.414098447000001, 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:19.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:19.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413999961000002, 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.946 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:19.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413932305000003, 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:19.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:19.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413880349000003, 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:19.957 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:19.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:19.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413826352000001, 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:19.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:19.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413771646000001, 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:19.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:19.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413718086000003, 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:19.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:19.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:19.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413662133999999, 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.979 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:19.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.413613736999999, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.403477602000002, 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.399470555999997, 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.399412523999999, 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.398943979999999, 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:20.008 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:20.009 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:20.009 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:20.010 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:20.004+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:20.109 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:20.108+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:20.139 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:20.139 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:20.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:20.208 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:20.208+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:20.274 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:20.274 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:20.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:20.329 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:20.328+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:20.411 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:20.408+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:20.450 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:20.450 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:20.464 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:20.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:20.515 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:20.516+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:20.594 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:20.594 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:20.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:20.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-19T02:17:20.612 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:20.611+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:20.713 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:20.715+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:20.791 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:20.814 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:20.815+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:20.913 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:20.913 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:20.914 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:20.912+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:20.929 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:21.015 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:21.016+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:21.059 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.059 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.073 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:21.116 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:21.116+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:21.158 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:17:21.158 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:21.158 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-19T02:17:21.158 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:17:21.158 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:17:21.159 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-19T02:17:21.195 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.195 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.210 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:21.253 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:21.251+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:21.275 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:21.275 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T02:17:21.275 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:21.318 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:21.316+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:21.370 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.370 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.384 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:21.419 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:21.415+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:21.514 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.514 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.516 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:17:21.521 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:21.520+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:21.529 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:21.622 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:21.619+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:21.698 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.698 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:21.759 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:21.760+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:21.823 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:21.824+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:21.827 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.827 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.842 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:21.924 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:21.924+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:21.973 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.974 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.989 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:22.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:22.025 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:22.024+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:22.111 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:22.111 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:22.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:22.127 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:22.123+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:22.159 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:22.159 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:22.176 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:22.176 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:22.178 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:22.179 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:22.227 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:22.228+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:22.246 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.246 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.754082027999999, 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:22.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:22.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:22.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.753963646000003, 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:22.252 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:22.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:22.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:22.257 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.753894645999999, 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.753764429999997, 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:22.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.269 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.753684878000001, 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:22.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:22.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.753589435000002, 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.275 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:22.280 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.753508529000001, 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:22.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.7530407, 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:22.285 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.752979992999997, 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.745827671999997, 2024-04-19T02:17:22.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:22.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:22.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.735904892000001, 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.735553535000001, 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:22.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.734990615000001, 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:22.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.734891079999997, 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:22.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.724187616000002, 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.722555030999999, 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.318 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:22.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.721621851999998, 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.322 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:22.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.326 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.721495523000002, 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:22.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.721232037999997, 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.335 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.052134856999999, 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:22.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:22.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:22.341 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:22.343 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:22.339+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:22.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:22.443 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:22.443+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:22.474 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:22.474 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:22.474 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:22.474 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:22.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:22.544 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:22.544+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:22.603 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:22.603 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:22.603 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:22.604 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:22.604 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:22.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:22.659 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:22.660+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:22.745 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:22.744+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:22.784 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:22.784 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:22.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:22.784 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:22.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.784 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:22.784 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 66.231889311000003, 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:22.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:22.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 66.231497043000005, 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:22.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:22.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.793 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 66.231027241000007, 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:22.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:22.798 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 66.230090180999994, 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:22.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 66.229774573, 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:22.803 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:22.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 66.229325549999999, 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:22.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:22.812 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 66.228736694000006, 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:22.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:22.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293930265, 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.817 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:22.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293831779000001, 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.828 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293764123000003, 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:22.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:22.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:22.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:22.834 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293712167000002, 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:22.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:22.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.29365817, 2024-04-19T02:17:22.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:22.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293603464, 2024-04-19T02:17:22.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:22.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293549904000002, 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:22.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:22.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293493951999999, 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:22.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.293445554999998, 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:22.862 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:22.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.283309420000002, 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:22.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.279302373999997, 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.871 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:22.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.875 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.279244341999998, 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:22.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.278775797999998, 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:22.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:22.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:22.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:22.885 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:22.887 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:22.887 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:22.884+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:22.987 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:22.988+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:23.018 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:23.018 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:23.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:23.018 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:23.033 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:23.088 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:23.088+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:23.148 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:23.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:23.148 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:23.148 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:23.148 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:23.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:23.212 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:23.211+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:23.289 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:23.287+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:23.290 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:23.290 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:23.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:23.290 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.798178831000001, 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:23.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:23.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:23.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:23.296 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.798060448999998, 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:23.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.797991449000001, 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:23.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:23.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.797861232999999, 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.307 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:23.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.797781681000004, 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:23.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.318 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.797686237999997, 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:23.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.797605332000003, 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.324 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.797137503000002, 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:23.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.797076795999999, 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:23.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.789924474999999, 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.336 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:23.340 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.780001695000003, 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:23.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:23.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.779650338000003, 2024-04-19T02:17:23.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:23.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.779087418000003, 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:23.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.778987882999999, 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:23.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:23.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.768284418999997, 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.766651834000001, 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:23.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:23.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.765718655000001, 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:23.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:23.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.765592325999997, 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.367 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:23.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.765328840999999, 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:23.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:23.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.096231660000001, 2024-04-19T02:17:23.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:23.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:23.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.382 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:23.383 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:23.383 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:23.384 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:23.432 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:23.432+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:23.490 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:23.488+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:23.529 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:23.536 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:23.592 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:23.591+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:23.692 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:23.693 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:23.693 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:23.691+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:23.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:23.794 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:23.792+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:23.824 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:23.824 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:23.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:23.824 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:23.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.273667230000001, 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.273274962000002, 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.272805160000004, 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.271868100000006, 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.271552491999998, 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.271103468999996, 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.270514613000003, 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335708183999998, 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335609697999999, 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335542042, 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335490086, 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335436088999998, 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335381382999998, 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335327823, 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335271871000003, 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.335223474000003, 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.325087339, 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.321080293000001, 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.321022261000003, 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.320553717000003, 2024-04-19T02:17:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.919 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:23.919 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:23.919 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:23.921 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:17:23.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:23.922 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:23.920+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:24.022 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:24.020+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:24.051 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:24.051 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:24.051 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:24.051 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:24.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:24.122 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:24.119+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:24.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:24.183 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:24.183 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:24.183 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:24.183 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:24.183 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:24.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:24.223 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:24.220+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:24.324 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:24.319+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:24.336 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:24.337 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:24.337 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:24.356 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:24.359 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:24.359 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:24.361 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:24.361 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:24.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:24.424 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:24.424+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:24.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:24.525 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:24.527+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:24.626 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:24.624+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:24.682 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:24.682 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:24.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:24.740 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:24.740+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:24.829 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:24.828+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:24.861 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:24.861 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:24.875 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:24.930 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:24.928+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.023 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:25.069 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:25.067+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:25.131 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:25.127+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:25.138 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.138 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.152 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:25.232 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:25.232+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:25.321 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.321 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.333 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:25.332+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:25.336 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:25.434 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:25.435+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:25.467 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.468 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:25.535 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:25.536+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:25.602 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.602 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:25.637 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:25.635+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:25.737 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:25.735+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:25.783 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.783 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.797 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:25.845 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:25.843+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:25.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:25.928 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.928 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.938 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:25.935+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:25.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:26.039 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:26.035+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:26.108 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.109 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.123 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:26.165 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:26.163+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:26.240 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:26.239+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:26.288 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.288 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:17:26.290 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:17:26.291 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:26.291 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T02:17:26.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:17:26.303 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:26.351 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:26.352+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:26.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:26.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-19T02:17:26.432 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.432 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.442 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:26.443+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:26.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:26.492 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:26.493 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:26.513 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:26.514 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:26.516 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:26.516 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:26.543 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:26.544+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:26.576 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:17:26.576 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:17:26.576 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 37, 2024-04-19T02:17:26.576 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "30a6d986-f196-4d3c-8512-6c6489722f8f", 2024-04-19T02:17:26.576 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-19T02:16:03.364103+0000", 2024-04-19T02:17:26.576 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-19T02:17:26.280336+0000", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-19T02:17:11.442750+0000", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-19T02:16:04.286795+0000", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5804032, 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-19T02:17:26.577 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.578 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:14.248072+0000", 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:26.579 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:26.580 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:26.581 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:26.582 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:26.583 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 3.0299999713897705, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 3.0299999713897705, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.33000001311302185, 2024-04-19T02:17:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:18.602050+0000", 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-19T02:17:26.586 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:26.587 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:26.588 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.8700000047683716, 2024-04-19T02:17:26.590 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.8700000047683716, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.25, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.25, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:22.904068+0000", 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:26.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-19T02:17:26.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:26.593 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:26.594 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.595 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.596 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.7799999713897705, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.7799999713897705, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.190000057220459, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.190000057220459, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:26.597 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:23.465439+0000", 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:26.598 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:26.599 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:26.600 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:26.601 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:26.602 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:26.603 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4900000095367432, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4900000095367432, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "16c5fbec-2207-41d1-ae33-893b400fd3da", 2024-04-19T02:17:26.604 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 31, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:17:26.605 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6800", 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6801", 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6802", 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6803", 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6806", 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6807", 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.608 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6804", 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6805", 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.609 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.116:6801/21424", 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.116:6803/21424", 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.116:6807/21424", 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.116:6805/21424", 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3211257a-5bd5-4a10-8d5f-c3dae1d504e7", 2024-04-19T02:17:26.610 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 0, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 31, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.611 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6800", 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6801", 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6802", 2024-04-19T02:17:26.612 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6803", 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.613 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6806", 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6807", 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6804", 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6805", 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.136:6801/21483", 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.136:6803/21483", 2024-04-19T02:17:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.136:6807/21483", 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.136:6805/21483", 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "exists" 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d", 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:17:26.616 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 31, 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6800", 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.617 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6801", 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6802", 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.618 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6803", 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6806", 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6807", 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6804", 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6805", 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.169:6801/21523", 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.169:6803/21523", 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.169:6807/21523", 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.169:6805/21523", 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:17:26.621 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581115+0000", 2024-04-19T02:17:26.622 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.639275+0000", 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 30 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581003+0000", 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-19T02:17:26.624 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:26.625 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:26.626 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:17:26.627 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:26.627 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:26.627 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:26.627 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:26.627 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:26.628 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': '30a6d986-f196-4d3c-8512-6c6489722f8f', 'created': '2024-04-19T02:16:03.364103+0000', 'modified': '2024-04-19T02:17:26.280336+0000', 'last_up_change': '2024-04-19T02:17:11.442750+0000', 'last_in_change': '2024-04-19T02:16:04.286795+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '16c5fbec-2207-41d1-ae33-893b400fd3da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 21424}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 21424}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 21424}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 21424}]}, 'public_addr': '172.21.15.116:6801/21424', 'cluster_addr': '172.21.15.116:6803/21424', 'heartbeat_back_addr': '172.21.15.116:6807/21424', 'heartbeat_front_addr': '172.21.15.116:6805/21424', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3211257a-5bd5-4a10-8d5f-c3dae1d504e7', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 31, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6800', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6801', 'nonce': 21483}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6802', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6803', 'nonce': 21483}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6806', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6807', 'nonce': 21483}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6804', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6805', 'nonce': 21483}]}, 'public_addr': '172.21.15.136:6801/21483', 'cluster_addr': '172.21.15.136:6803/21483', 'heartbeat_back_addr': '172.21.15.136:6807/21483', 'heartbeat_front_addr': '172.21.15.136:6805/21483', 'state': ['exists']}, {'osd': 2, 'uuid': '1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 21523}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 21523}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 21523}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 21523}]}, 'public_addr': '172.21.15.169:6801/21523', 'cluster_addr': '172.21.15.169:6803/21523', 'heartbeat_back_addr': '172.21.15.169:6807/21523', 'heartbeat_front_addr': '172.21.15.169:6805/21523', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581115+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.639275+0000', 'dead_epoch': 30}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581003+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:17:26.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:17:26.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:26.644 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:26.643+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:26.745 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:26.744+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:26.797 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.245484590000004, 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:26.802 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.245092322000005, 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:26.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.244622519999993, 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:26.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:26.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.243685459999995, 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.814 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.243369852000001, 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.242920828999999, 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.242331973000006, 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:26.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:26.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307525544000001, 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.833 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307427058000002, 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:26.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307359402000003, 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307307446000003, 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:26.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307253449000001, 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:26.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:26.855 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307198743000001, 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.861 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307145183000003, 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:26.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307089230999999, 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:26.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:26.871 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.307040833999999, 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:26.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:26.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.296904699000002, 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:26.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.292897652999997, 2024-04-19T02:17:26.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:26.884 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.292839620999999, 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:26.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.292371076999999, 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.893 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:26.894 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:26.894 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:26.896 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:26.896 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:26.896+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:17:26.922 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:17:26.936 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-04-19T02:17:26.288335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90260,"kb_used_data":1008,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025260,"statfs":{"total":289910292480,"available":289817866240,"internally_reserved":0,"allocated":1032192,"data_stored":1558077,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.097578"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519739+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:17:21.519739+0000","last_peered":"2024-04-19T02:17:21.519739+0000","last_clean":"2024-04-19T02:17:21.519739+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:17:21.519739+0000","last_undegraded":"2024-04-19T02:17:21.519739+0000","last_fullsized":"2024-04-19T02:17:21.519739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519208+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:17:21.519208+0000","last_peered":"2024-04-19T02:17:21.519208+0000","last_clean":"2024-04-19T02:17:21.519208+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:17:21.519208+0000","last_undegraded":"2024-04-19T02:17:21.519208+0000","last_fullsized":"2024-04-19T02:17:21.519208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518930+0000","last_change":"2024-04-19T02:17:12.471662+0000","last_active":"2024-04-19T02:17:21.518930+0000","last_peered":"2024-04-19T02:17:21.518930+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.471662+0000","last_became_peered":"2024-04-19T02:17:12.471662+0000","last_unstale":"2024-04-19T02:17:21.518930+0000","last_undegraded":"2024-04-19T02:17:21.518930+0000","last_fullsized":"2024-04-19T02:17:12.466748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:12:27.269263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518272+0000","last_change":"2024-04-19T02:17:12.474963+0000","last_active":"2024-04-19T02:17:21.518272+0000","last_peered":"2024-04-19T02:17:21.518272+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.474963+0000","last_became_peered":"2024-04-19T02:17:12.474963+0000","last_unstale":"2024-04-19T02:17:21.518272+0000","last_undegraded":"2024-04-19T02:17:21.518272+0000","last_fullsized":"2024-04-19T02:17:12.467385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:44:45.962189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518436+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:17:21.518436+0000","last_peered":"2024-04-19T02:17:21.518436+0000","last_clean":"2024-04-19T02:17:21.518436+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:17:21.518436+0000","last_undegraded":"2024-04-19T02:17:21.518436+0000","last_fullsized":"2024-04-19T02:17:21.518436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517499+0000","last_change":"2024-04-19T02:17:12.470649+0000","last_active":"2024-04-19T02:17:21.517499+0000","last_peered":"2024-04-19T02:17:21.517499+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.470649+0000","last_became_peered":"2024-04-19T02:17:12.470649+0000","last_unstale":"2024-04-19T02:17:21.517499+0000","last_undegraded":"2024-04-19T02:17:21.517499+0000","last_fullsized":"2024-04-19T02:17:12.465660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:20.734374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517193+0000","last_change":"2024-04-19T02:17:12.472721+0000","last_active":"2024-04-19T02:17:21.517193+0000","last_peered":"2024-04-19T02:17:21.517193+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472721+0000","last_became_peered":"2024-04-19T02:17:12.472721+0000","last_unstale":"2024-04-19T02:17:21.517193+0000","last_undegraded":"2024-04-19T02:17:21.517193+0000","last_fullsized":"2024-04-19T02:17:12.465429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:34.422792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517184+0000","last_change":"2024-04-19T02:17:12.473034+0000","last_active":"2024-04-19T02:17:21.517184+0000","last_peered":"2024-04-19T02:17:21.517184+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473034+0000","last_became_peered":"2024-04-19T02:17:12.473034+0000","last_unstale":"2024-04-19T02:17:21.517184+0000","last_undegraded":"2024-04-19T02:17:21.517184+0000","last_fullsized":"2024-04-19T02:17:12.465552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:56.103189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519196+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:17:21.519196+0000","last_peered":"2024-04-19T02:17:21.519196+0000","last_clean":"2024-04-19T02:17:21.519196+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:17:21.519196+0000","last_undegraded":"2024-04-19T02:17:21.519196+0000","last_fullsized":"2024-04-19T02:17:21.519196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519657+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:17:21.519657+0000","last_peered":"2024-04-19T02:17:21.519657+0000","last_clean":"2024-04-19T02:17:21.519657+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:17:21.519657+0000","last_undegraded":"2024-04-19T02:17:21.519657+0000","last_fullsized":"2024-04-19T02:17:21.519657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520714+0000","last_change":"2024-04-19T02:17:12.475019+0000","last_active":"2024-04-19T02:17:21.520714+0000","last_peered":"2024-04-19T02:17:21.520714+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475019+0000","last_became_peered":"2024-04-19T02:17:12.475019+0000","last_unstale":"2024-04-19T02:17:21.520714+0000","last_undegraded":"2024-04-19T02:17:21.520714+0000","last_fullsized":"2024-04-19T02:17:12.467690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:36.724293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517746+0000","last_change":"2024-04-19T02:17:12.468033+0000","last_active":"2024-04-19T02:17:21.517746+0000","last_peered":"2024-04-19T02:17:21.517746+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:17:12.468033+0000","last_became_peered":"2024-04-19T02:17:12.468033+0000","last_unstale":"2024-04-19T02:17:21.517746+0000","last_undegraded":"2024-04-19T02:17:21.517746+0000","last_fullsized":"2024-04-19T02:17:12.466169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:02.369844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.517879+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:17:21.517879+0000","last_peered":"2024-04-19T02:17:21.517879+0000","last_clean":"2024-04-19T02:17:21.517879+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:17:21.517879+0000","last_undegraded":"2024-04-19T02:17:21.517879+0000","last_fullsized":"2024-04-19T02:17:21.517879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517674+0000","last_change":"2024-04-19T02:17:12.468218+0000","last_active":"2024-04-19T02:17:21.517674+0000","last_peered":"2024-04-19T02:17:21.517674+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468218+0000","last_became_peered":"2024-04-19T02:17:12.468218+0000","last_unstale":"2024-04-19T02:17:21.517674+0000","last_undegraded":"2024-04-19T02:17:21.517674+0000","last_fullsized":"2024-04-19T02:17:12.466471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:13.637115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517058+0000","last_change":"2024-04-19T02:17:12.468646+0000","last_active":"2024-04-19T02:17:21.517058+0000","last_peered":"2024-04-19T02:17:21.517058+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468646+0000","last_became_peered":"2024-04-19T02:17:12.468646+0000","last_unstale":"2024-04-19T02:17:21.517058+0000","last_undegraded":"2024-04-19T02:17:21.517058+0000","last_fullsized":"2024-04-19T02:17:12.465162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:56.960161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517108+0000","last_change":"2024-04-19T02:17:12.467658+0000","last_active":"2024-04-19T02:17:21.517108+0000","last_peered":"2024-04-19T02:17:21.517108+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.467658+0000","last_became_peered":"2024-04-19T02:17:12.467658+0000","last_unstale":"2024-04-19T02:17:21.517108+0000","last_undegraded":"2024-04-19T02:17:21.517108+0000","last_fullsized":"2024-04-19T02:17:12.465360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:49.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.520631+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:17:21.520631+0000","last_peered":"2024-04-19T02:17:21.520631+0000","last_clean":"2024-04-19T02:17:21.520631+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:17:21.520631+0000","last_undegraded":"2024-04-19T02:17:21.520631+0000","last_fullsized":"2024-04-19T02:17:21.520631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519879+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:17:21.519879+0000","last_peered":"2024-04-19T02:17:21.519879+0000","last_clean":"2024-04-19T02:17:21.519879+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:17:21.519879+0000","last_undegraded":"2024-04-19T02:17:21.519879+0000","last_fullsized":"2024-04-19T02:17:21.519879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519187+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:17:21.519187+0000","last_peered":"2024-04-19T02:17:21.519187+0000","last_clean":"2024-04-19T02:17:21.519187+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:17:21.519187+0000","last_undegraded":"2024-04-19T02:17:21.519187+0000","last_fullsized":"2024-04-19T02:17:21.519187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518613+0000","last_change":"2024-04-19T02:17:12.475684+0000","last_active":"2024-04-19T02:17:21.518613+0000","last_peered":"2024-04-19T02:17:21.518613+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475684+0000","last_became_peered":"2024-04-19T02:17:12.475684+0000","last_unstale":"2024-04-19T02:17:21.518613+0000","last_undegraded":"2024-04-19T02:17:21.518613+0000","last_fullsized":"2024-04-19T02:17:12.468218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:38.530185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519709+0000","last_change":"2024-04-19T02:17:12.482521+0000","last_active":"2024-04-19T02:17:21.519709+0000","last_peered":"2024-04-19T02:17:21.519709+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.482521+0000","last_became_peered":"2024-04-19T02:17:12.482521+0000","last_unstale":"2024-04-19T02:17:21.519709+0000","last_undegraded":"2024-04-19T02:17:21.519709+0000","last_fullsized":"2024-04-19T02:17:12.470413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:43.318373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517789+0000","last_change":"2024-04-19T02:17:12.469825+0000","last_active":"2024-04-19T02:17:21.517789+0000","last_peered":"2024-04-19T02:17:21.517789+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:17:12.469825+0000","last_became_peered":"2024-04-19T02:17:12.469825+0000","last_unstale":"2024-04-19T02:17:21.517789+0000","last_undegraded":"2024-04-19T02:17:21.517789+0000","last_fullsized":"2024-04-19T02:17:12.466905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:55:14.059675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517349+0000","last_change":"2024-04-19T02:17:12.470766+0000","last_active":"2024-04-19T02:17:21.517349+0000","last_peered":"2024-04-19T02:17:21.517349+0000","last_clean":"2024-04-19T02:17:07.001190+0000","last_became_active":"2024-04-19T02:17:12.470766+0000","last_became_peered":"2024-04-19T02:17:12.470766+0000","last_unstale":"2024-04-19T02:17:21.517349+0000","last_undegraded":"2024-04-19T02:17:21.517349+0000","last_fullsized":"2024-04-19T02:17:12.465417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:41.307510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.517005+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:17:21.517005+0000","last_peered":"2024-04-19T02:17:21.517005+0000","last_clean":"2024-04-19T02:17:21.517005+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:17:21.517005+0000","last_undegraded":"2024-04-19T02:17:21.517005+0000","last_fullsized":"2024-04-19T02:17:21.517005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519731+0000","last_change":"2024-04-19T02:17:12.472985+0000","last_active":"2024-04-19T02:17:21.519731+0000","last_peered":"2024-04-19T02:17:21.519731+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:17:12.472985+0000","last_became_peered":"2024-04-19T02:17:12.472985+0000","last_unstale":"2024-04-19T02:17:21.519731+0000","last_undegraded":"2024-04-19T02:17:21.519731+0000","last_fullsized":"2024-04-19T02:17:12.470041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:29.004931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520624+0000","last_change":"2024-04-19T02:17:12.475928+0000","last_active":"2024-04-19T02:17:21.520624+0000","last_peered":"2024-04-19T02:17:21.520624+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:17:12.475928+0000","last_became_peered":"2024-04-19T02:17:12.475928+0000","last_unstale":"2024-04-19T02:17:21.520624+0000","last_undegraded":"2024-04-19T02:17:21.520624+0000","last_fullsized":"2024-04-19T02:17:12.468138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:08.735898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520381+0000","last_change":"2024-04-19T02:17:12.472908+0000","last_active":"2024-04-19T02:17:21.520381+0000","last_peered":"2024-04-19T02:17:21.520381+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472908+0000","last_became_peered":"2024-04-19T02:17:12.472908+0000","last_unstale":"2024-04-19T02:17:21.520381+0000","last_undegraded":"2024-04-19T02:17:21.520381+0000","last_fullsized":"2024-04-19T02:17:12.468312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:43.318373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519041+0000","last_change":"2024-04-19T02:17:12.470809+0000","last_active":"2024-04-19T02:17:21.519041+0000","last_peered":"2024-04-19T02:17:21.519041+0000","last_clean":"2024-04-19T02:17:09.445020+0000","last_became_active":"2024-04-19T02:17:12.470809+0000","last_became_peered":"2024-04-19T02:17:12.470809+0000","last_unstale":"2024-04-19T02:17:21.519041+0000","last_undegraded":"2024-04-19T02:17:21.519041+0000","last_fullsized":"2024-04-19T02:17:12.467256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:47.544283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518864+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:17:21.518864+0000","last_peered":"2024-04-19T02:17:21.518864+0000","last_clean":"2024-04-19T02:17:21.518864+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:17:21.518864+0000","last_undegraded":"2024-04-19T02:17:21.518864+0000","last_fullsized":"2024-04-19T02:17:21.518864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518115+0000","last_change":"2024-04-19T02:17:12.472579+0000","last_active":"2024-04-19T02:17:21.518115+0000","last_peered":"2024-04-19T02:17:21.518115+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:17:12.472579+0000","last_became_peered":"2024-04-19T02:17:12.472579+0000","last_unstale":"2024-04-19T02:17:21.518115+0000","last_undegraded":"2024-04-19T02:17:21.518115+0000","last_fullsized":"2024-04-19T02:17:12.467577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.053477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.517327+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:17:21.517327+0000","last_peered":"2024-04-19T02:17:21.517327+0000","last_clean":"2024-04-19T02:17:21.517327+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:17:21.517327+0000","last_undegraded":"2024-04-19T02:17:21.517327+0000","last_fullsized":"2024-04-19T02:17:21.517327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517349+0000","last_change":"2024-04-19T02:17:12.477517+0000","last_active":"2024-04-19T02:17:21.517349+0000","last_peered":"2024-04-19T02:17:21.517349+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.477517+0000","last_became_peered":"2024-04-19T02:17:12.477517+0000","last_unstale":"2024-04-19T02:17:21.517349+0000","last_undegraded":"2024-04-19T02:17:21.517349+0000","last_fullsized":"2024-04-19T02:17:12.466619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:06.010745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518853+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:17:21.518853+0000","last_peered":"2024-04-19T02:17:21.518853+0000","last_clean":"2024-04-19T02:17:21.518853+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:17:21.518853+0000","last_undegraded":"2024-04-19T02:17:21.518853+0000","last_fullsized":"2024-04-19T02:17:21.518853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":21,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.518829+0000","last_change":"2024-04-19T02:17:12.480865+0000","last_active":"2024-04-19T02:17:21.518829+0000","last_peered":"2024-04-19T02:17:21.518829+0000","last_clean":"2024-04-19T02:16:24.494994+0000","last_became_active":"2024-04-19T02:17:12.480865+0000","last_became_peered":"2024-04-19T02:17:12.480865+0000","last_unstale":"2024-04-19T02:17:21.518829+0000","last_undegraded":"2024-04-19T02:17:12.469727+0000","last_fullsized":"2024-04-19T02:17:12.469514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:39.449809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519820+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:17:21.519820+0000","last_peered":"2024-04-19T02:17:21.519820+0000","last_clean":"2024-04-19T02:17:21.519820+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:17:21.519820+0000","last_undegraded":"2024-04-19T02:17:21.519820+0000","last_fullsized":"2024-04-19T02:17:21.519820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518189+0000","last_change":"2024-04-19T02:17:12.475504+0000","last_active":"2024-04-19T02:17:21.518189+0000","last_peered":"2024-04-19T02:17:21.518189+0000","last_clean":"2024-04-19T02:17:07.001751+0000","last_became_active":"2024-04-19T02:17:12.475504+0000","last_became_peered":"2024-04-19T02:17:12.475504+0000","last_unstale":"2024-04-19T02:17:21.518189+0000","last_undegraded":"2024-04-19T02:17:21.518189+0000","last_fullsized":"2024-04-19T02:17:12.466749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:16.631966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.521287+0000","last_change":"2024-04-19T02:17:12.480599+0000","last_active":"2024-04-19T02:17:21.521287+0000","last_peered":"2024-04-19T02:17:21.521287+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:17:12.480599+0000","last_became_peered":"2024-04-19T02:17:12.480599+0000","last_unstale":"2024-04-19T02:17:21.521287+0000","last_undegraded":"2024-04-19T02:17:21.521287+0000","last_fullsized":"2024-04-19T02:17:12.472079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:39.186907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517843+0000","last_change":"2024-04-19T02:17:12.470087+0000","last_active":"2024-04-19T02:17:21.517843+0000","last_peered":"2024-04-19T02:17:21.517843+0000","last_clean":"2024-04-19T02:17:09.444294+0000","last_became_active":"2024-04-19T02:17:12.470087+0000","last_became_peered":"2024-04-19T02:17:12.470087+0000","last_unstale":"2024-04-19T02:17:21.517843+0000","last_undegraded":"2024-04-19T02:17:21.517843+0000","last_fullsized":"2024-04-19T02:17:12.465651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:08.686889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519198+0000","last_change":"2024-04-19T02:17:12.477502+0000","last_active":"2024-04-19T02:17:21.519198+0000","last_peered":"2024-04-19T02:17:21.519198+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:17:12.477502+0000","last_became_peered":"2024-04-19T02:17:12.477502+0000","last_unstale":"2024-04-19T02:17:21.519198+0000","last_undegraded":"2024-04-19T02:17:21.519198+0000","last_fullsized":"2024-04-19T02:17:12.468662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:42.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":21,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.517308+0000","last_change":"2024-04-19T02:17:12.468566+0000","last_active":"2024-04-19T02:17:21.517308+0000","last_peered":"2024-04-19T02:17:21.517308+0000","last_clean":"2024-04-19T02:16:24.492774+0000","last_became_active":"2024-04-19T02:17:12.468566+0000","last_became_peered":"2024-04-19T02:17:12.468566+0000","last_unstale":"2024-04-19T02:17:21.517308+0000","last_undegraded":"2024-04-19T02:17:12.465406+0000","last_fullsized":"2024-04-19T02:17:12.465206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:35.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":21,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.520086+0000","last_change":"2024-04-19T02:17:12.473559+0000","last_active":"2024-04-19T02:17:21.520086+0000","last_peered":"2024-04-19T02:17:21.520086+0000","last_clean":"2024-04-19T02:16:24.491281+0000","last_became_active":"2024-04-19T02:17:12.473559+0000","last_became_peered":"2024-04-19T02:17:12.473559+0000","last_unstale":"2024-04-19T02:17:21.520086+0000","last_undegraded":"2024-04-19T02:17:12.470889+0000","last_fullsized":"2024-04-19T02:17:12.470812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:47.633899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517122+0000","last_change":"2024-04-19T02:17:12.468086+0000","last_active":"2024-04-19T02:17:21.517122+0000","last_peered":"2024-04-19T02:17:21.517122+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:17:12.468086+0000","last_became_peered":"2024-04-19T02:17:12.468086+0000","last_unstale":"2024-04-19T02:17:21.517122+0000","last_undegraded":"2024-04-19T02:17:21.517122+0000","last_fullsized":"2024-04-19T02:17:12.465179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:25:37.098688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":36,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.520169+0000","last_change":"2024-04-19T02:17:12.471922+0000","last_active":"2024-04-19T02:17:21.520169+0000","last_peered":"2024-04-19T02:17:21.520169+0000","last_clean":"2024-04-19T02:17:09.445356+0000","last_became_active":"2024-04-19T02:17:12.471922+0000","last_became_peered":"2024-04-19T02:17:12.471922+0000","last_unstale":"2024-04-19T02:17:21.520169+0000","last_undegraded":"2024-04-19T02:17:12.469493+0000","last_fullsized":"2024-04-19T02:17:12.469410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:44.093452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.517189+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:17:21.517189+0000","last_peered":"2024-04-19T02:17:21.517189+0000","last_clean":"2024-04-19T02:17:21.517189+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:17:21.517189+0000","last_undegraded":"2024-04-19T02:17:21.517189+0000","last_fullsized":"2024-04-19T02:17:21.517189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":21,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.519396+0000","last_change":"2024-04-19T02:17:12.471586+0000","last_active":"2024-04-19T02:17:21.519396+0000","last_peered":"2024-04-19T02:17:21.519396+0000","last_clean":"2024-04-19T02:16:24.498760+0000","last_became_active":"2024-04-19T02:17:12.471586+0000","last_became_peered":"2024-04-19T02:17:12.471586+0000","last_unstale":"2024-04-19T02:17:21.519396+0000","last_undegraded":"2024-04-19T02:17:12.467226+0000","last_fullsized":"2024-04-19T02:17:12.467144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:30.560862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518390+0000","last_change":"2024-04-19T02:17:12.476188+0000","last_active":"2024-04-19T02:17:21.518390+0000","last_peered":"2024-04-19T02:17:21.518390+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.476188+0000","last_became_peered":"2024-04-19T02:17:12.476188+0000","last_unstale":"2024-04-19T02:17:21.518390+0000","last_undegraded":"2024-04-19T02:17:21.518390+0000","last_fullsized":"2024-04-19T02:17:12.467463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:08.617493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519056+0000","last_change":"2024-04-19T02:17:12.481086+0000","last_active":"2024-04-19T02:17:21.519056+0000","last_peered":"2024-04-19T02:17:21.519056+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.481086+0000","last_became_peered":"2024-04-19T02:17:12.481086+0000","last_unstale":"2024-04-19T02:17:21.519056+0000","last_undegraded":"2024-04-19T02:17:21.519056+0000","last_fullsized":"2024-04-19T02:17:12.468898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:34.809946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518395+0000","last_change":"2024-04-19T02:17:12.477363+0000","last_active":"2024-04-19T02:17:21.518395+0000","last_peered":"2024-04-19T02:17:21.518395+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:17:12.477363+0000","last_became_peered":"2024-04-19T02:17:12.477363+0000","last_unstale":"2024-04-19T02:17:21.518395+0000","last_undegraded":"2024-04-19T02:17:21.518395+0000","last_fullsized":"2024-04-19T02:17:12.466956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:06.485415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":35,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.520668+0000","last_change":"2024-04-19T02:17:12.482776+0000","last_active":"2024-04-19T02:17:21.520668+0000","last_peered":"2024-04-19T02:17:21.520668+0000","last_clean":"2024-04-19T02:17:07.002985+0000","last_became_active":"2024-04-19T02:17:12.482776+0000","last_became_peered":"2024-04-19T02:17:12.482776+0000","last_unstale":"2024-04-19T02:17:21.520668+0000","last_undegraded":"2024-04-19T02:17:12.473078+0000","last_fullsized":"2024-04-19T02:17:12.472919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:09.109279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518517+0000","last_change":"2024-04-19T02:17:12.475123+0000","last_active":"2024-04-19T02:17:21.518517+0000","last_peered":"2024-04-19T02:17:21.518517+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475123+0000","last_became_peered":"2024-04-19T02:17:12.475123+0000","last_unstale":"2024-04-19T02:17:21.518517+0000","last_undegraded":"2024-04-19T02:17:21.518517+0000","last_fullsized":"2024-04-19T02:17:12.468098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:38:10.412991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517693+0000","last_change":"2024-04-19T02:17:12.470775+0000","last_active":"2024-04-19T02:17:21.517693+0000","last_peered":"2024-04-19T02:17:21.517693+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.470775+0000","last_became_peered":"2024-04-19T02:17:12.470775+0000","last_unstale":"2024-04-19T02:17:21.517693+0000","last_undegraded":"2024-04-19T02:17:21.517693+0000","last_fullsized":"2024-04-19T02:17:12.466015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:58.235807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520080+0000","last_change":"2024-04-19T02:17:12.472954+0000","last_active":"2024-04-19T02:17:21.520080+0000","last_peered":"2024-04-19T02:17:21.520080+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472954+0000","last_became_peered":"2024-04-19T02:17:12.472954+0000","last_unstale":"2024-04-19T02:17:21.520080+0000","last_undegraded":"2024-04-19T02:17:21.520080+0000","last_fullsized":"2024-04-19T02:17:12.467712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:33.854311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517959+0000","last_change":"2024-04-19T02:17:12.468621+0000","last_active":"2024-04-19T02:17:21.517959+0000","last_peered":"2024-04-19T02:17:21.517959+0000","last_clean":"2024-04-19T02:17:09.444347+0000","last_became_active":"2024-04-19T02:17:12.468621+0000","last_became_peered":"2024-04-19T02:17:12.468621+0000","last_unstale":"2024-04-19T02:17:21.517959+0000","last_undegraded":"2024-04-19T02:17:21.517959+0000","last_fullsized":"2024-04-19T02:17:12.466195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:31:45.463358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519233+0000","last_change":"2024-04-19T02:17:12.469283+0000","last_active":"2024-04-19T02:17:21.519233+0000","last_peered":"2024-04-19T02:17:21.519233+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.469283+0000","last_became_peered":"2024-04-19T02:17:12.469283+0000","last_unstale":"2024-04-19T02:17:21.519233+0000","last_undegraded":"2024-04-19T02:17:21.519233+0000","last_fullsized":"2024-04-19T02:17:12.466315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:49.268315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.517392+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:17:21.517392+0000","last_peered":"2024-04-19T02:17:21.517392+0000","last_clean":"2024-04-19T02:17:21.517392+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:17:21.517392+0000","last_undegraded":"2024-04-19T02:17:21.517392+0000","last_fullsized":"2024-04-19T02:17:21.517392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519463+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:17:21.519463+0000","last_peered":"2024-04-19T02:17:21.519463+0000","last_clean":"2024-04-19T02:17:21.519463+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:17:21.519463+0000","last_undegraded":"2024-04-19T02:17:21.519463+0000","last_fullsized":"2024-04-19T02:17:21.519463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.518208+0000","last_change":"2024-04-19T02:17:12.471328+0000","last_active":"2024-04-19T02:17:21.518208+0000","last_peered":"2024-04-19T02:17:21.518208+0000","last_clean":"2024-04-19T02:16:17.202941+0000","last_became_active":"2024-04-19T02:17:12.471328+0000","last_became_peered":"2024-04-19T02:17:12.471328+0000","last_unstale":"2024-04-19T02:17:21.518208+0000","last_undegraded":"2024-04-19T02:17:12.467139+0000","last_fullsized":"2024-04-19T02:17:12.466916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:00.591621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520914+0000","last_change":"2024-04-19T02:17:12.483202+0000","last_active":"2024-04-19T02:17:21.520914+0000","last_peered":"2024-04-19T02:17:21.520914+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.483202+0000","last_became_peered":"2024-04-19T02:17:12.483202+0000","last_unstale":"2024-04-19T02:17:21.520914+0000","last_undegraded":"2024-04-19T02:17:21.520914+0000","last_fullsized":"2024-04-19T02:17:12.473235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:45.677177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518655+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:17:21.518655+0000","last_peered":"2024-04-19T02:17:21.518655+0000","last_clean":"2024-04-19T02:17:21.518655+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:17:21.518655+0000","last_undegraded":"2024-04-19T02:17:21.518655+0000","last_fullsized":"2024-04-19T02:17:21.518655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519322+0000","last_change":"2024-04-19T02:17:12.472439+0000","last_active":"2024-04-19T02:17:21.519322+0000","last_peered":"2024-04-19T02:17:21.519322+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472439+0000","last_became_peered":"2024-04-19T02:17:12.472439+0000","last_unstale":"2024-04-19T02:17:21.519322+0000","last_undegraded":"2024-04-19T02:17:21.519322+0000","last_fullsized":"2024-04-19T02:17:12.467077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:38:10.412991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517929+0000","last_change":"2024-04-19T02:17:12.470205+0000","last_active":"2024-04-19T02:17:21.517929+0000","last_peered":"2024-04-19T02:17:21.517929+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.470205+0000","last_became_peered":"2024-04-19T02:17:12.470205+0000","last_unstale":"2024-04-19T02:17:21.517929+0000","last_undegraded":"2024-04-19T02:17:21.517929+0000","last_fullsized":"2024-04-19T02:17:12.466126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:18.817011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517934+0000","last_change":"2024-04-19T02:17:12.477549+0000","last_active":"2024-04-19T02:17:21.517934+0000","last_peered":"2024-04-19T02:17:21.517934+0000","last_clean":"2024-04-19T02:17:07.001902+0000","last_became_active":"2024-04-19T02:17:12.477549+0000","last_became_peered":"2024-04-19T02:17:12.477549+0000","last_unstale":"2024-04-19T02:17:21.517934+0000","last_undegraded":"2024-04-19T02:17:21.517934+0000","last_fullsized":"2024-04-19T02:17:12.468541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:55:13.051324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519904+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:17:21.519904+0000","last_peered":"2024-04-19T02:17:21.519904+0000","last_clean":"2024-04-19T02:17:21.519904+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:17:21.519904+0000","last_undegraded":"2024-04-19T02:17:21.519904+0000","last_fullsized":"2024-04-19T02:17:21.519904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518298+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:17:21.518298+0000","last_peered":"2024-04-19T02:17:21.518298+0000","last_clean":"2024-04-19T02:17:21.518298+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:17:21.518298+0000","last_undegraded":"2024-04-19T02:17:21.518298+0000","last_fullsized":"2024-04-19T02:17:21.518298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517689+0000","last_change":"2024-04-19T02:17:12.470093+0000","last_active":"2024-04-19T02:17:21.517689+0000","last_peered":"2024-04-19T02:17:21.517689+0000","last_clean":"2024-04-19T02:17:09.444286+0000","last_became_active":"2024-04-19T02:17:12.470093+0000","last_became_peered":"2024-04-19T02:17:12.470093+0000","last_unstale":"2024-04-19T02:17:21.517689+0000","last_undegraded":"2024-04-19T02:17:21.517689+0000","last_fullsized":"2024-04-19T02:17:12.466037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:28.739646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519525+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:17:21.519525+0000","last_peered":"2024-04-19T02:17:21.519525+0000","last_clean":"2024-04-19T02:17:21.519525+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:17:21.519525+0000","last_undegraded":"2024-04-19T02:17:21.519525+0000","last_fullsized":"2024-04-19T02:17:21.519525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518922+0000","last_change":"2024-04-19T02:17:12.478551+0000","last_active":"2024-04-19T02:17:21.518922+0000","last_peered":"2024-04-19T02:17:21.518922+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.478551+0000","last_became_peered":"2024-04-19T02:17:12.478551+0000","last_unstale":"2024-04-19T02:17:21.518922+0000","last_undegraded":"2024-04-19T02:17:21.518922+0000","last_fullsized":"2024-04-19T02:17:12.468490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:54.966067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520559+0000","last_change":"2024-04-19T02:17:12.480849+0000","last_active":"2024-04-19T02:17:21.520559+0000","last_peered":"2024-04-19T02:17:21.520559+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480849+0000","last_became_peered":"2024-04-19T02:17:12.480849+0000","last_unstale":"2024-04-19T02:17:21.520559+0000","last_undegraded":"2024-04-19T02:17:21.520559+0000","last_fullsized":"2024-04-19T02:17:12.469891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:28:21.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518815+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:17:21.518815+0000","last_peered":"2024-04-19T02:17:21.518815+0000","last_clean":"2024-04-19T02:17:21.518815+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:17:21.518815+0000","last_undegraded":"2024-04-19T02:17:21.518815+0000","last_fullsized":"2024-04-19T02:17:21.518815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519689+0000","last_change":"2024-04-19T02:17:12.475695+0000","last_active":"2024-04-19T02:17:21.519689+0000","last_peered":"2024-04-19T02:17:21.519689+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.475695+0000","last_became_peered":"2024-04-19T02:17:12.475695+0000","last_unstale":"2024-04-19T02:17:21.519689+0000","last_undegraded":"2024-04-19T02:17:21.519689+0000","last_fullsized":"2024-04-19T02:17:12.468442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:02.799871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519459+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:17:21.519459+0000","last_peered":"2024-04-19T02:17:21.519459+0000","last_clean":"2024-04-19T02:17:21.519459+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:17:21.519459+0000","last_undegraded":"2024-04-19T02:17:21.519459+0000","last_fullsized":"2024-04-19T02:17:21.519459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518029+0000","last_change":"2024-04-19T02:17:12.471310+0000","last_active":"2024-04-19T02:17:21.518029+0000","last_peered":"2024-04-19T02:17:21.518029+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:17:12.471310+0000","last_became_peered":"2024-04-19T02:17:12.471310+0000","last_unstale":"2024-04-19T02:17:21.518029+0000","last_undegraded":"2024-04-19T02:17:21.518029+0000","last_fullsized":"2024-04-19T02:17:12.467496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:34.756376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.519378+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:17:21.519378+0000","last_peered":"2024-04-19T02:17:21.519378+0000","last_clean":"2024-04-19T02:17:21.519378+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:17:21.519378+0000","last_undegraded":"2024-04-19T02:17:21.519378+0000","last_fullsized":"2024-04-19T02:17:21.519378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.520521+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:17:21.520521+0000","last_peered":"2024-04-19T02:17:21.520521+0000","last_clean":"2024-04-19T02:17:21.520521+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:17:21.520521+0000","last_undegraded":"2024-04-19T02:17:21.520521+0000","last_fullsized":"2024-04-19T02:17:21.520521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518140+0000","last_change":"2024-04-19T02:17:12.469898+0000","last_active":"2024-04-19T02:17:21.518140+0000","last_peered":"2024-04-19T02:17:21.518140+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:17:12.469898+0000","last_became_peered":"2024-04-19T02:17:12.469898+0000","last_unstale":"2024-04-19T02:17:21.518140+0000","last_undegraded":"2024-04-19T02:17:21.518140+0000","last_fullsized":"2024-04-19T02:17:12.465728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:42.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.520877+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:17:21.520877+0000","last_peered":"2024-04-19T02:17:21.520877+0000","last_clean":"2024-04-19T02:17:21.520877+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:17:21.520877+0000","last_undegraded":"2024-04-19T02:17:21.520877+0000","last_fullsized":"2024-04-19T02:17:21.520877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.521433+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:17:21.521433+0000","last_peered":"2024-04-19T02:17:21.521433+0000","last_clean":"2024-04-19T02:17:21.521433+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:17:21.521433+0000","last_undegraded":"2024-04-19T02:17:21.521433+0000","last_fullsized":"2024-04-19T02:17:21.521433+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517732+0000","last_change":"2024-04-19T02:17:12.478207+0000","last_active":"2024-04-19T02:17:21.517732+0000","last_peered":"2024-04-19T02:17:21.517732+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:17:12.478207+0000","last_became_peered":"2024-04-19T02:17:12.478207+0000","last_unstale":"2024-04-19T02:17:21.517732+0000","last_undegraded":"2024-04-19T02:17:21.517732+0000","last_fullsized":"2024-04-19T02:17:12.467111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:58.269726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":36,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.521345+0000","last_change":"2024-04-19T02:17:12.481269+0000","last_active":"2024-04-19T02:17:21.521345+0000","last_peered":"2024-04-19T02:17:21.521345+0000","last_clean":"2024-04-19T02:17:07.003468+0000","last_became_active":"2024-04-19T02:17:12.481269+0000","last_became_peered":"2024-04-19T02:17:12.481269+0000","last_unstale":"2024-04-19T02:17:21.521345+0000","last_undegraded":"2024-04-19T02:17:12.472467+0000","last_fullsized":"2024-04-19T02:17:12.472256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:25.797971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520157+0000","last_change":"2024-04-19T02:17:12.473583+0000","last_active":"2024-04-19T02:17:21.520157+0000","last_peered":"2024-04-19T02:17:21.520157+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.473583+0000","last_became_peered":"2024-04-19T02:17:12.473583+0000","last_unstale":"2024-04-19T02:17:21.520157+0000","last_undegraded":"2024-04-19T02:17:21.520157+0000","last_fullsized":"2024-04-19T02:17:12.470880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:08.436045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517311+0000","last_change":"2024-04-19T02:17:12.467356+0000","last_active":"2024-04-19T02:17:21.517311+0000","last_peered":"2024-04-19T02:17:21.517311+0000","last_clean":"2024-04-19T02:17:09.444120+0000","last_became_active":"2024-04-19T02:17:12.467356+0000","last_became_peered":"2024-04-19T02:17:12.467356+0000","last_unstale":"2024-04-19T02:17:21.517311+0000","last_undegraded":"2024-04-19T02:17:21.517311+0000","last_fullsized":"2024-04-19T02:17:12.465315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:13.336689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518189+0000","last_change":"2024-04-19T02:17:12.468034+0000","last_active":"2024-04-19T02:17:21.518189+0000","last_peered":"2024-04-19T02:17:21.518189+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468034+0000","last_became_peered":"2024-04-19T02:17:12.468034+0000","last_unstale":"2024-04-19T02:17:21.518189+0000","last_undegraded":"2024-04-19T02:17:21.518189+0000","last_fullsized":"2024-04-19T02:17:12.465388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:52.858745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":37,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.518725+0000","last_change":"2024-04-19T02:17:12.468266+0000","last_active":"2024-04-19T02:17:21.518725+0000","last_peered":"2024-04-19T02:17:21.518725+0000","last_clean":"2024-04-19T02:16:54.341172+0000","last_became_active":"2024-04-19T02:17:12.468266+0000","last_became_peered":"2024-04-19T02:17:12.468266+0000","last_unstale":"2024-04-19T02:17:21.518725+0000","last_undegraded":"2024-04-19T02:17:12.466295+0000","last_fullsized":"2024-04-19T02:17:12.466215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:20.170934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.517435+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:17:21.517435+0000","last_peered":"2024-04-19T02:17:21.517435+0000","last_clean":"2024-04-19T02:17:21.517435+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:17:21.517435+0000","last_undegraded":"2024-04-19T02:17:21.517435+0000","last_fullsized":"2024-04-19T02:17:21.517435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":37,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.520377+0000","last_change":"2024-04-19T02:17:12.472711+0000","last_active":"2024-04-19T02:17:21.520377+0000","last_peered":"2024-04-19T02:17:21.520377+0000","last_clean":"2024-04-19T02:17:09.446243+0000","last_became_active":"2024-04-19T02:17:12.472711+0000","last_became_peered":"2024-04-19T02:17:12.472711+0000","last_unstale":"2024-04-19T02:17:21.520377+0000","last_undegraded":"2024-04-19T02:17:12.468046+0000","last_fullsized":"2024-04-19T02:17:12.467939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:45.500367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520956+0000","last_change":"2024-04-19T02:17:12.480946+0000","last_active":"2024-04-19T02:17:21.520956+0000","last_peered":"2024-04-19T02:17:21.520956+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480946+0000","last_became_peered":"2024-04-19T02:17:12.480946+0000","last_unstale":"2024-04-19T02:17:21.520956+0000","last_undegraded":"2024-04-19T02:17:21.520956+0000","last_fullsized":"2024-04-19T02:17:12.469729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:30.560862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517560+0000","last_change":"2024-04-19T02:17:12.474936+0000","last_active":"2024-04-19T02:17:21.517560+0000","last_peered":"2024-04-19T02:17:21.517560+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:17:12.474936+0000","last_became_peered":"2024-04-19T02:17:12.474936+0000","last_unstale":"2024-04-19T02:17:21.517560+0000","last_undegraded":"2024-04-19T02:17:21.517560+0000","last_fullsized":"2024-04-19T02:17:12.466173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:56.771899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520685+0000","last_change":"2024-04-19T02:17:12.478595+0000","last_active":"2024-04-19T02:17:21.520685+0000","last_peered":"2024-04-19T02:17:21.520685+0000","last_clean":"2024-04-19T02:17:07.003624+0000","last_became_active":"2024-04-19T02:17:12.478595+0000","last_became_peered":"2024-04-19T02:17:12.478595+0000","last_unstale":"2024-04-19T02:17:21.520685+0000","last_undegraded":"2024-04-19T02:17:21.520685+0000","last_fullsized":"2024-04-19T02:17:12.470773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:17.045125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.517624+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:17:21.517624+0000","last_peered":"2024-04-19T02:17:21.517624+0000","last_clean":"2024-04-19T02:17:21.517624+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:17:21.517624+0000","last_undegraded":"2024-04-19T02:17:21.517624+0000","last_fullsized":"2024-04-19T02:17:21.517624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519901+0000","last_change":"2024-04-19T02:17:12.472045+0000","last_active":"2024-04-19T02:17:21.519901+0000","last_peered":"2024-04-19T02:17:21.519901+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:17:12.472045+0000","last_became_peered":"2024-04-19T02:17:12.472045+0000","last_unstale":"2024-04-19T02:17:21.519901+0000","last_undegraded":"2024-04-19T02:17:21.519901+0000","last_fullsized":"2024-04-19T02:17:12.469938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:07.174450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518057+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:17:21.518057+0000","last_peered":"2024-04-19T02:17:21.518057+0000","last_clean":"2024-04-19T02:17:21.518057+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:17:21.518057+0000","last_undegraded":"2024-04-19T02:17:21.518057+0000","last_fullsized":"2024-04-19T02:17:21.518057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.520647+0000","last_change":"2024-04-19T02:17:12.478635+0000","last_active":"2024-04-19T02:17:21.520647+0000","last_peered":"2024-04-19T02:17:21.520647+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:17:12.478635+0000","last_became_peered":"2024-04-19T02:17:12.478635+0000","last_unstale":"2024-04-19T02:17:21.520647+0000","last_undegraded":"2024-04-19T02:17:21.520647+0000","last_fullsized":"2024-04-19T02:17:12.469417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:56.699515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517929+0000","last_change":"2024-04-19T02:17:12.474967+0000","last_active":"2024-04-19T02:17:21.517929+0000","last_peered":"2024-04-19T02:17:21.517929+0000","last_clean":"2024-04-19T02:17:07.001688+0000","last_became_active":"2024-04-19T02:17:12.474967+0000","last_became_peered":"2024-04-19T02:17:12.474967+0000","last_unstale":"2024-04-19T02:17:21.517929+0000","last_undegraded":"2024-04-19T02:17:21.517929+0000","last_fullsized":"2024-04-19T02:17:12.468046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:12.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.519156+0000","last_change":"2024-04-19T02:17:12.468686+0000","last_active":"2024-04-19T02:17:21.519156+0000","last_peered":"2024-04-19T02:17:21.519156+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:17:12.468686+0000","last_became_peered":"2024-04-19T02:17:12.468686+0000","last_unstale":"2024-04-19T02:17:21.519156+0000","last_undegraded":"2024-04-19T02:17:21.519156+0000","last_fullsized":"2024-04-19T02:17:12.466095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:25:22.162660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518454+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:17:21.518454+0000","last_peered":"2024-04-19T02:17:21.518454+0000","last_clean":"2024-04-19T02:17:21.518454+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:17:21.518454+0000","last_undegraded":"2024-04-19T02:17:21.518454+0000","last_fullsized":"2024-04-19T02:17:21.518454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518797+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:17:21.518797+0000","last_peered":"2024-04-19T02:17:21.518797+0000","last_clean":"2024-04-19T02:17:21.518797+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:17:21.518797+0000","last_undegraded":"2024-04-19T02:17:21.518797+0000","last_fullsized":"2024-04-19T02:17:21.518797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":35,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.518519+0000","last_change":"2024-04-19T02:17:12.470743+0000","last_active":"2024-04-19T02:17:21.518519+0000","last_peered":"2024-04-19T02:17:21.518519+0000","last_clean":"2024-04-19T02:17:09.445171+0000","last_became_active":"2024-04-19T02:17:12.470743+0000","last_became_peered":"2024-04-19T02:17:12.470743+0000","last_unstale":"2024-04-19T02:17:21.518519+0000","last_undegraded":"2024-04-19T02:17:21.518519+0000","last_fullsized":"2024-04-19T02:17:12.466575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:40.205694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517987+0000","last_change":"2024-04-19T02:17:12.473792+0000","last_active":"2024-04-19T02:17:21.517987+0000","last_peered":"2024-04-19T02:17:21.517987+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473792+0000","last_became_peered":"2024-04-19T02:17:12.473792+0000","last_unstale":"2024-04-19T02:17:21.517987+0000","last_undegraded":"2024-04-19T02:17:21.517987+0000","last_fullsized":"2024-04-19T02:17:12.465913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:38.124985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":21,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.519094+0000","last_change":"2024-04-19T02:17:12.478521+0000","last_active":"2024-04-19T02:17:21.519094+0000","last_peered":"2024-04-19T02:17:21.519094+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:17:12.478521+0000","last_became_peered":"2024-04-19T02:17:12.478521+0000","last_unstale":"2024-04-19T02:17:21.519094+0000","last_undegraded":"2024-04-19T02:17:12.469719+0000","last_fullsized":"2024-04-19T02:17:12.469506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:31.073165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517898+0000","last_change":"2024-04-19T02:17:12.475828+0000","last_active":"2024-04-19T02:17:21.517898+0000","last_peered":"2024-04-19T02:17:21.517898+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475828+0000","last_became_peered":"2024-04-19T02:17:12.475828+0000","last_unstale":"2024-04-19T02:17:21.517898+0000","last_undegraded":"2024-04-19T02:17:21.517898+0000","last_fullsized":"2024-04-19T02:17:12.466404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:19.851029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":36,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.520010+0000","last_change":"2024-04-19T02:17:12.472468+0000","last_active":"2024-04-19T02:17:21.520010+0000","last_peered":"2024-04-19T02:17:21.520010+0000","last_clean":"2024-04-19T02:17:09.446016+0000","last_became_active":"2024-04-19T02:17:12.472468+0000","last_became_peered":"2024-04-19T02:17:12.472468+0000","last_unstale":"2024-04-19T02:17:21.520010+0000","last_undegraded":"2024-04-19T02:17:12.467641+0000","last_fullsized":"2024-04-19T02:17:12.467537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:19.904265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.518177+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:17:21.518177+0000","last_peered":"2024-04-19T02:17:21.518177+0000","last_clean":"2024-04-19T02:17:21.518177+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:17:21.518177+0000","last_undegraded":"2024-04-19T02:17:21.518177+0000","last_fullsized":"2024-04-19T02:17:21.518177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-19T02:17:21.521143+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:17:21.521143+0000","last_peered":"2024-04-19T02:17:21.521143+0000","last_clean":"2024-04-19T02:17:21.521143+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:17:21.521143+0000","last_undegraded":"2024-04-19T02:17:21.521143+0000","last_fullsized":"2024-04-19T02:17:21.521143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+undersized","last_fresh":"2024-04-19T02:17:21.517278+0000","last_change":"2024-04-19T02:17:12.473290+0000","last_active":"2024-04-19T02:17:21.517278+0000","last_peered":"2024-04-19T02:17:21.517278+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473290+0000","last_became_peered":"2024-04-19T02:17:12.473290+0000","last_unstale":"2024-04-19T02:17:21.517278+0000","last_undegraded":"2024-04-19T02:17:21.517278+0000","last_fullsized":"2024-04-19T02:17:12.466109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:51.600518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":37,"reported_epoch":35,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:21.519713+0000","last_change":"2024-04-19T02:17:12.477858+0000","last_active":"2024-04-19T02:17:21.519713+0000","last_peered":"2024-04-19T02:17:21.519713+0000","last_clean":"2024-04-19T02:17:07.003600+0000","last_became_active":"2024-04-19T02:17:12.477858+0000","last_became_peered":"2024-04-19T02:17:12.477858+0000","last_unstale":"2024-04-19T02:17:21.519713+0000","last_undegraded":"2024-04-19T02:17:12.470203+0000","last_fullsized":"2024-04-19T02:17:12.469946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.701657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":87,"acting":87,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":129068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":339968,"data_stored":699288,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":389120,"data_stored":729721,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:17:26.940 INFO:tasks.thrashosds.thrasher:Setting 4.1 to [2, 0] 2024-04-19T02:17:26.940 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.1', '2', '0'] 2024-04-19T02:17:26.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.1 2 0 2024-04-19T02:17:26.996 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:26.996+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:27.026 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:27.026 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:27.026 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:27.026 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:27.040 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:27.096 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:27.091+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:27.158 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:27.158 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:27.158 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:27.158 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:27.158 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:27.173 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:27.197 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:27.196+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:27.294 INFO:teuthology.orchestra.run.smithi073.stderr:set 4.1 pg_upmap mapping to [2,0] 2024-04-19T02:17:27.298 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:27.295+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.845203914999999, 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:27.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:27.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:27.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:27.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:27.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:27.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:27.343 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.845085533000002, 2024-04-19T02:17:27.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.349 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.845016532999999, 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:27.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:27.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.844886316999997, 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.356 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:27.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:27.361 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.844806765000001, 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:27.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.367 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.844711322000002, 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:27.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:27.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:27.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.844630416000001, 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:27.373 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:27.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.844162587, 2024-04-19T02:17:27.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:27.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.844101879999997, 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:27.381 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:27.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.836949558999997, 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:27.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:27.389 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.827026779000001, 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.826675422000001, 2024-04-19T02:17:27.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:27.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:27.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.826112502000001, 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:27.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:27.400 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.826012966999997, 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:27.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:27.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.815309503000002, 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:27.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:27.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.813676917999999, 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.812743738999998, 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.413 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:27.417 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.812617410000001, 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:27.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:27.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.421 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.812353924999996, 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:27.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:27.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.143256743999999, 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:27.427 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:27.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:27.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:27.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:27.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:27.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.433 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:27.433 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:27.433 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:27.435 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:27.431+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:27.435 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:27.535 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:27.535+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:27.564 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:27.564 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:27.564 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:27.565 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:27.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:27.636 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:27.631+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:27.700 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:27.701 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:27.701 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:27.701 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:27.701 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:27.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:27.763 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:27.764+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:27.839 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:27.836+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:27.842 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.289790862000004, 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:27.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:27.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.289398594000005, 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:27.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:27.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.288928791999993, 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:27.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:27.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:27.855 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.287991731999995, 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:27.859 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.287676124000001, 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.287227100999999, 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.286638245000006, 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351831816000001, 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351733330000002, 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351665674000003, 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351613718000003, 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351559721000001, 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351505015000001, 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351451455000003, 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351395502999999, 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.351347105999999, 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.341210971000002, 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.337203924999997, 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.337145892999999, 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.336677348999999, 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:27.941 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:27.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:27.943 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:27.939+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.043 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:28.039+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.074 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:28.074 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:28.074 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:28.074 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:28.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:28.177 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:28.175+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.244 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:28.244+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:28.249 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:28.250 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:28.250 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:28.250 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:28.250 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:28.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:28.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:28.353 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:28.351+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.943289149999998, 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.943170768000002, 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.943101767999998, 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.942971552000003, 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.942892000000001, 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.942796557000001, 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:28.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:28.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.942715651, 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:28.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.942247821999999, 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:28.474 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:28.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:28.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.942187115000003, 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:28.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.482 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.935034794000003, 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:28.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:28.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.925112014, 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:28.487 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:28.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.924760657, 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:28.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.924197737, 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:28.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:28.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.499 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:28.499 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:28.501 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.924098202000003, 2024-04-19T02:17:28.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:28.505 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.913394738000001, 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:28.509 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.911762152999998, 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:28.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.910828973999998, 2024-04-19T02:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:28.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:28.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.910702645000001, 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:28.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:28.521 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 63.910439160000003, 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:28.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.241341978999998, 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:28.526 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:28.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:28.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:28.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.531 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.532 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.532 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:28.532 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:28.532 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:28.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:28.534 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:28.535+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:28.635 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:28.632+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:28.670 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:28.671 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:28.671 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:28.680 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:28.691 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:28.691 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:28.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:28.694 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:28.735 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:28.731+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.837 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:28.835+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.838 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:28.838 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:28.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:28.938 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:28.939+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:28.974 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:28.974 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:28.988 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:29.038 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.036+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:29.133 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:29.139 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.140+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.240 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.240+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.250 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:29.250 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:29.265 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:29.317 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:17:29.341 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.340+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:29.403 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:29.451 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.452+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.535 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:29.535 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:29.542 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.540+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:29.642 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.640+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.711 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:29.711 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:29.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:29.767 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:29.768+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:29.845 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:29.843+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:29.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:29.946 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:29.943+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:30.031 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.031 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.045 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:30.089 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:30.087+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:30.149 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:30.148+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:30.212 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.212 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.226 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:30.251 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:30.252+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:30.342 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.342 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.354 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:30.351+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:30.356 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:30.455 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:30.452+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:30.486 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.487 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:30.557 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:30.555+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:30.657 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:30.655+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:30.664 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.664 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.678 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:30.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:30.758 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:30.759+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:30.800 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.800 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.814 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:30.845 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:30.861 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:30.859+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:30.864 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:30.868 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:30.868 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:30.945 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:30.946 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:30.946 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:30.946 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:30.959 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:30.960+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:30.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:31.060 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:31.060+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:31.125 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:31.125 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:31.125 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:31.125 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:31.125 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:31.139 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:31.189 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:31.187+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:31.261 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:31.260+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.771833541999996, 2024-04-19T02:17:31.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:31.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.771715159999999, 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:31.270 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:31.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.771646160000003, 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:31.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:31.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:31.281 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.771515944000001, 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.286 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.771436391999998, 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:31.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:31.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.771340949000006, 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:31.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:31.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.771260042999998, 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.770792213999997, 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.770731506999994, 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:31.309 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.763579186000001, 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:31.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.753656406000005, 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.753305049000005, 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:31.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.320 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.752742128999998, 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:31.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:31.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.752642593999994, 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:31.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.741939130000006, 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:31.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:31.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.740306544999996, 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:31.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:31.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.739373365999995, 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.336 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:31.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:31.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.739247036999998, 2024-04-19T02:17:31.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:31.344 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 66.738983551999993, 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:31.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:31.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 61.069886371000003, 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:31.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:31.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:31.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:31.353 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.354 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.354 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.354 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:31.354 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:31.354 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:31.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:31.356 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:31.397 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:31.395+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:31.464 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:31.459+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:31.489 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:31.489 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:31.489 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:31.489 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:31.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:31.564 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:31.563+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:31.618 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:31.634 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:31.665 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:31.663+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:31.758 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 75.206265053999999, 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 75.205872786, 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:31.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 75.205402984000003, 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.771 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 75.204465924000004, 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:31.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:31.775 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 75.204150315999996, 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:31.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 75.203701292999995, 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:31.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 75.203112437000001, 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:31.788 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.268306007999996, 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:31.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:31.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:31.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.268207521999997, 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:31.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:31.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:31.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:31.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:31.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.268139865999999, 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:31.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.268087910000006, 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:31.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.268033912999996, 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:31.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:31.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:31.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.267979206999996, 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.821 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.267925646999998, 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:31.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:31.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:31.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.267869695000002, 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:31.827 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:31.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.267821298000001, 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.831 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:31.835 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.257685163000005, 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:31.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.253678117000007, 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:31.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.253620084999994, 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:31.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:31.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:31.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.253151540999994, 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:31.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:31.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:31.853 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:31.855 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:31.856 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:31.851+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:31.956 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:31.956+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:31.986 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:31.986 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:31.986 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:31.986 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:32.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:32.057 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:32.056+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:32.122 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:32.123 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:32.123 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:32.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:32.158 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:32.156+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:32.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-19T02:17:32.259 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:32.260+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.770544379, 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.263 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:32.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:32.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.770425997000004, 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:32.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.274 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.770356996999993, 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:32.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.770226781000005, 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.770147229000003, 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:32.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:32.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.770051785999996, 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:32.291 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:32.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.296 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.769970880000002, 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:32.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.769503051000001, 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:32.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.769442343999998, 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:32.305 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:32.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.762290023000006, 2024-04-19T02:17:32.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:32.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.752367242999995, 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.752015885999995, 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:32.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:32.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.751452966000002, 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:32.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.325 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.751353430999998, 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:32.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:32.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.740649966999996, 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:32.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.739017382, 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:32.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:32.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.738084203, 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:32.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.737957874000003, 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.342 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:32.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.737694388999998, 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:32.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:32.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 62.068597208, 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:32.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:32.356 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:32.357 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:17:32.357 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:32.357 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T02:17:32.357 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:17:32.357 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:17:32.357 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T02:17:32.358 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:17:32.359 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:32.361 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:32.360+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:32.461 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:32.459+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:32.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:32.591 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:32.592+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:32.662 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:32.660+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:32.669 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:32.669 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:32.669 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:32.669 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:32.669 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:32.683 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:32.771 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:32.772+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:32.853 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.301196626000007, 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:32.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.300804357999993, 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:32.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.863 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.300334555999996, 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:32.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.299397495999997, 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:32.868 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:32.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.872 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.299081888000003, 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:32.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:32.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.298632865000002, 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:32.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.298044008999995, 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.363237580000003, 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.363139094000005, 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.363071438000006, 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:32.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:32.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:32.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.903 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.363019481999999, 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:32.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.362965485000004, 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:32.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.914 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.362910779000003, 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:32.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:32.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.362857219000006, 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:32.920 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:32.925 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.362801266999995, 2024-04-19T02:17:32.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:32.927 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.927 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:32.927 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:32.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.362752869999994, 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.931 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:32.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:32.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.352616734999998, 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:32.940 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.348609689, 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:32.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:32.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:32.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.348551657000002, 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.945 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:32.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:32.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.949 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.348083113000001, 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:32.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:32.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:32.954 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:32.955 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:32.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:32.956 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:32.955+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:32.957 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:33.057 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:33.056+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:33.088 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:33.088 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:33.102 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:33.133 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:33.133 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:33.133 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:33.153 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:33.153 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:33.158 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:33.156+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:33.232 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:33.277 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:33.275+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:33.350 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:33.350 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:33.360 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:33.360+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:33.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:33.461 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:33.460+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:33.493 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:33.494 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:33.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:33.561 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:33.563+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:33.662 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:33.663+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:33.673 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:33.673 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:33.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:33.763 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:33.760+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:33.805 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:33.805 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:33.819 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:33.863 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:33.864+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:33.964 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:33.965 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:33.964+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:34.066 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:34.064+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:34.086 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.086 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.100 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:34.167 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:34.167+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:34.217 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.217 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:34.279 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:34.280+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:34.361 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.361 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.361 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:34.368 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:34.368+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:34.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:34.469 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:34.468+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:34.534 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.534 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:34.591 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:34.592+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:34.671 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:34.672+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:34.714 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.715 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.730 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:34.777 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:34.779+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:34.860 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.860 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.873 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:34.875+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:34.874 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:34.974 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:34.972+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:35.038 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.038 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.052 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:35.101 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:35.103+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:35.154 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:35.172 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.173 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.176 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:35.175+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:35.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:35.277 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:35.276+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:35.316 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.316 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.327 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:35.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:35.345 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:17:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:35.353 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:35.355 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:35.356 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:35.378 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:35.379+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:35.479 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:35.479+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:35.499 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:35.500 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:35.500 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:35.500 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:35.500 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:35.513 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:35.579 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:35.579+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:35.641 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 79.089526925000001, 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:35.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:35.646 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 79.089134657000002, 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:35.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:35.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 79.088664855000005, 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:35.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 79.087727795000006, 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:35.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 79.087412186999998, 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:35.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:35.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 79.086963163999997, 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:35.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 79.086374308000003, 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:35.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:35.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151567878999998, 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:35.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:35.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151469392999999, 2024-04-19T02:17:35.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:35.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:35.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151401737, 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:35.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151349780999993, 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.689 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.694 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151295783999998, 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:35.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151241077999998, 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:35.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151187518, 2024-04-19T02:17:35.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:35.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:35.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:35.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151131566000004, 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.714 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.151083169000003, 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:35.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.140947034000007, 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:35.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.136939987999995, 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:35.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.136881955999996, 2024-04-19T02:17:35.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:35.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 71.136413411999996, 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:35.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:35.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:35.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:35.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.736 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:35.736 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:35.736 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:35.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:35.738 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:35.739+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:35.839 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:35.840+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:35.868 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:35.868 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:35.868 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:35.868 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:35.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:35.939 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:35.939+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:36.006 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:36.007 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:36.007 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:36.007 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:36.007 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:36.022 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:36.065 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:36.067+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:36.141 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:36.140+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:36.188 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.695621494999997, 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.695503113000001, 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.695434113000005, 2024-04-19T02:17:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.695303897000002, 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.695224345, 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.212 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:36.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.217 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.695128901999993, 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:36.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:36.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:36.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.695047996, 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.694580166999998, 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:36.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.694519459999995, 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:36.233 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.687367139000003, 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.237 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:36.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:36.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.241 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.677444359000006, 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:36.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:36.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.677093002000007, 2024-04-19T02:17:36.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:36.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:36.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.676530081999999, 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.676430546999995, 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:36.254 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:36.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.665727082999993, 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.664094497999997, 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:36.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.663161318999997, 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:36.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:36.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.66303499, 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.271 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:36.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.662771504999995, 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:36.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:36.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:36.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 65.993674323999997, 2024-04-19T02:17:36.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:36.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:36.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:36.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:36.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:36.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:36.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:36.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:36.288 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:36.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:36.291 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:36.288+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:36.391 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:36.392+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:36.419 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:36.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:36.419 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:36.419 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:36.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:36.493 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:36.495+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:36.592 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:36.593 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:36.595 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:36.595+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:36.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:36.696 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:36.696+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:36.733 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:36.733 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:36.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:36.733 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:36.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.733 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:36.733 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.180660259999996, 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.737 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.180267991999997, 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.738 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:36.742 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.17979819, 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:36.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:36.747 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.178861130000001, 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:36.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:36.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.178545521999993, 2024-04-19T02:17:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:36.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.757 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:36.757 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:36.757 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.178096499000006, 2024-04-19T02:17:36.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:36.757 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.757 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:36.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:36.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.177507642999998, 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:36.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242701213999993, 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:36.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:36.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:36.772 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242602727999994, 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:36.777 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242535071999995, 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:36.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.783 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242483116000002, 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242429118999993, 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242374412999993, 2024-04-19T02:17:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242320852999995, 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242264900999999, 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.242216503999998, 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.232080369000002, 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.228073323000004, 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.228015291000006, 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.227546747000005, 2024-04-19T02:17:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:36.834 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:36.835 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:36.836 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:36.836+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:36.936 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:36.935+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:36.966 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:36.966 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:36.966 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:36.966 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:36.980 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:37.037 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:37.036+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:37.138 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:37.136+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:37.151 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:37.238 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:37.239+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:37.270 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:37.270 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:37.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:37.270 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:37.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.270 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.270 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.777744862000006, 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:37.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:37.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.777626479999995, 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:37.276 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:37.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:37.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.777557479999999, 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.282 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:37.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:37.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.777427263999996, 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:37.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:37.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.777347711999994, 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:37.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.777252269000002, 2024-04-19T02:17:37.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:37.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:37.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:37.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.777171362999994, 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:37.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.776703534000006, 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:37.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.776642827000003, 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:37.315 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:37.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.769490505999997, 2024-04-19T02:17:37.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:37.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.759567726, 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.324 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:37.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.759216369000001, 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:37.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.331 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.758653448999993, 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.335 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.758553914000004, 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:37.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:37.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.747850450000001, 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:37.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.343 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.746217865000006, 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:37.347 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.745284686000005, 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:37.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.745158356999994, 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:37.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:37.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.744894872000003, 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:37.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:37.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 67.075797691000005, 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:37.361 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:37.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:37.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:37.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:37.367 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:37.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:37.369 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:37.368+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:37.369 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:37.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:37.469 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:37.468+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:37.500 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:17:37.500 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:37.500 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-19T02:17:37.500 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:17:37.500 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:17:37.501 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-19T02:17:37.501 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:37.501 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:37.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:37.563 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:37.563 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:37.563 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:37.571 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:37.571+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:37.593 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:37.593 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:37.597 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:37.597 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:37.630 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:37.630 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "" 2024-04-19T02:17:37.630 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:37.671 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:37.672 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:37.685 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:37.686 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:37.687+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:37.773 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:37.772+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:37.802 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:37.802 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:37.815 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:37.874 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:37.872+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:37.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:37.974 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:37.976+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:38.070 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.070 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-04-19T02:17:38.075 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:38.075+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:38.084 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:38.177 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:38.179+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:38.244 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.244 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.259 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:38.301 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:38.303+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:17:38.379 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:38.379+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:38.389 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.389 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.403 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:38.479 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:38.480+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:38.509 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.509 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:38.580 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:38.579+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:38.682 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:38.680+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:38.688 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.688 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.704 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:38.783 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:38.784+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:38.836 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.836 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.850 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:38.897 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:38.899+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:38.966 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.966 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.980 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:38.984 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:38.984+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:39.085 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:39.087+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:39.144 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.144 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:39.204 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:39.204+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:39.287 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.287 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.288 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:39.287+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:39.300 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:39.388 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:39.387+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:39.461 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.462 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.476 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:39.489 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:39.491+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:39.590 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:39.591+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:39.597 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.597 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:39.612 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:39.691 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:39.692+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:39.742 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.742 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:39.794 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:39.794 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:39.794 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:39.801 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:39.803+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:39.824 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:39.824 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:39.828 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:39.828 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:39.878 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:39.878 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:39.878 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:39.878 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:39.878 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:39.893 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:39.895 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:39.896+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:39.996 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:39.996+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:40.063 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.571385977000006, 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:40.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:40.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:40.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.571267594999995, 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:40.069 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.571198594999998, 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:40.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:40.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.571068378999996, 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:40.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:40.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.570988826999994, 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:40.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.570893384000001, 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.091 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:40.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:40.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.570812477999993, 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.100 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.570344649000006, 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:40.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:40.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:40.104 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.570283942000003, 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:40.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.563131620999997, 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.553208841, 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.552857484, 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.552294563999993, 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.552195029000004, 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:40.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:40.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.541491565000001, 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:40.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.539858980000005, 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:40.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.538925801000005, 2024-04-19T02:17:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:40.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.538799471999994, 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:40.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.538535987000003, 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.144 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:40.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.148 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 69.869438806000005, 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:40.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:40.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:40.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.154 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:40.154 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:40.154 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:40.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:40.156 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:40.156+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:40.256 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:40.255+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:40.287 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:40.288 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:40.288 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:40.288 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:40.304 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:40.357 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:40.356+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:40.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:40.483 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:40.483 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:40.483 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:40.483 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:40.483 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:40.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:40.485 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:40.483+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:40.586 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:40.583+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.102809241000003, 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.102416973000004, 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.101947171000006, 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.101010110999994, 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.100694503, 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.100245479999998, 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.099656624000005, 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164850195, 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164751709000001, 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164684053000002, 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164632096999995, 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.1645781, 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164523394, 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164469834000002, 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164413882000005, 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.164365485000005, 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.735 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.154229349999994, 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:40.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.150222303999996, 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.150164271999998, 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.745 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:40.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:40.749 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.149695727999998, 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:40.750 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:40.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:40.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:40.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.755 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:40.755 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:40.755 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:40.757 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:40.757 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:40.755+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:40.858 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:40.856+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:40.888 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:40.888 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:40.888 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:40.888 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:40.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:40.959 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:40.960+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:41.024 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:41.024 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:41.025 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:41.025 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:41.039 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:41.085 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:41.087+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:41.161 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:41.163+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.671378619999999, 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.671260238000002, 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.671191238000006, 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.671061022000004, 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.670981470000001, 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.670886026999995, 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.670805121000001, 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:41.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:41.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.670337291999999, 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.670276584999996, 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.663124264000004, 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.653201483999993, 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.652850126999994, 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.652287207000001, 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.652187671999997, 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.641484207999994, 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.639851622999998, 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.638918443999998, 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.638792115000001, 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:41.248 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.638528629999996, 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:41.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.969431448999998, 2024-04-19T02:17:41.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:41.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:41.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:41.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:41.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:41.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:41.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:41.260 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:41.262 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:41.263+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:41.262 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:41.362 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:41.363+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:41.374 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:17:41.394 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:41.395 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:41.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:41.463 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:41.460+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:41.531 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:41.532 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:41.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:41.564 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:41.563+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:41.665 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:41.667+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:41.709 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.158698716000004, 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.714 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.158306448000005, 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:41.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.157836646000007, 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:41.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:41.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:41.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.156899585999994, 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:41.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:41.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.156583978, 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:41.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:41.732 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.156134954999999, 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.736 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.155546099000006, 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:41.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:41.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:41.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.22073967, 2024-04-19T02:17:41.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:41.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.746 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220641184000002, 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:41.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220573528000003, 2024-04-19T02:17:41.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:41.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.757 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220521571999996, 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:41.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:41.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.763 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220467575000001, 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:41.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:41.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.769 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220412869, 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:41.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:41.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220359309000003, 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.775 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:41.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:41.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220303357000006, 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:41.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.784 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.220254960000005, 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:41.788 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.210118824999995, 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:41.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:41.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:41.793 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.206111778999997, 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.797 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.206053746999999, 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.205585202999998, 2024-04-19T02:17:41.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:41.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:41.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:41.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.806 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:41.807 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:41.807 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:41.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:41.809 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:41.807+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:41.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:41.909 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:41.908+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:41.952 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:42.010 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:42.011+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:42.025 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:42.025 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:42.025 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:42.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:42.056 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:42.059 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:42.060 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:42.070 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:42.070 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:42.086 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:42.129 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:42.131+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:42.212 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:42.212+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:42.240 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:42.240 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:42.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:42.313 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:42.315+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:42.383 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:42.383 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:42.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:42.414 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:42.415+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:42.514 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:42.514 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:42.515 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:42.516+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:42.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:42.616 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:42.615+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:42.644 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:17:42.644 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:42.644 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T02:17:42.644 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:17:42.644 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:17:42.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:42.709 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:42.716 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:42.716+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "" 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:42.819 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:42.819+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:42.837 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:42.837 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:42.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:42.920 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:42.920+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.020 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:43.019+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:43.026 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:43.121 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:43.123+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:43.186 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.187 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:43.247 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:43.248+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:43.324 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:43.323+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:43.334 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.334 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.348 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:43.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:43.425 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:43.427+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:43.513 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.513 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.525 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:43.524+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:43.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:43.627 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:43.624+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:43.692 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.692 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.706 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:43.753 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:43.755+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:43.828 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:43.828+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:43.837 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.837 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:43.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-19T02:17:43.937 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:43.939+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:44.017 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:44.017 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:44.031 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:44.032 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:44.028+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:44.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:44.131 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:44.131+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:44.193 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:44.194 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:44.209 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:44.253 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:44.255+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:44.257 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:44.258 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:44.258 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:44.289 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:44.289 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:44.293 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:44.293 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:44.332 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:44.331+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:44.338 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:44.338 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:44.338 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:44.338 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:44.353 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:44.386 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:17:44.433 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:44.432+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:44.479 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:44.479 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:44.479 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:44.479 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:44.480 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:44.490 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:44.534 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:44.535+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:44.635 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:44.635+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:44.659 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:44.659 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:44.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:44.659 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:44.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.106466366000006, 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:44.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:44.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:44.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:44.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:44.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.667 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.106074097999993, 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:44.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:44.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.105604295999996, 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.675 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:44.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:44.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:44.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.104667235999997, 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:44.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.104351628000003, 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:44.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:44.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.103902605000002, 2024-04-19T02:17:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.103313748999994, 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:44.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:44.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.705 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168507320000003, 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:44.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:44.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:44.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:44.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:44.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:44.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:44.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:44.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:44.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168408834000005, 2024-04-19T02:17:44.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:44.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168341178000006, 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.718 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:44.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168289221999999, 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:44.724 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:44.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:44.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:44.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168235225000004, 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:44.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:44.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.735 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168180519000003, 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:44.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:44.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:44.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:44.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:44.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:44.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:44.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:44.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:44.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:44.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:44.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:44.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:44.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:44.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:44.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:44.744 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.745 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.745 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.745 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:44.745 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168126959000006, 2024-04-19T02:17:44.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:44.746 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.746 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.746 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:44.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:44.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:44.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:44.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:44.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:44.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:44.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:44.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:44.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:44.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:44.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:44.753 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.753 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168071006999995, 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:44.754 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:44.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:44.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:44.758 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.168022609999994, 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:44.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:44.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.157886474999998, 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:44.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:44.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.767 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.153879429, 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.153821397000002, 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.772 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:44.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.776 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 80.153352853000001, 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:44.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:44.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:44.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.781 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:44.782 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:44.782 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:44.784 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:44.784 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:44.784+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:44.888 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:44.888+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:44.914 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:44.914 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:44.928 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:44.989 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:44.991+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:45.050 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:45.051 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:45.051 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:45.066 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:45.090 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:45.088+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:45.191 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:45.191+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:45.230 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:45.230 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:45.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:45.230 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.739458451000004, 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:45.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:45.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.236 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.739340068999994, 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:45.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.739271068999997, 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:45.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:45.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.739140852999995, 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:45.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.253 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.739061301000007, 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:45.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:45.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:45.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.738965858, 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:45.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.264 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.738884952000006, 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.268 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.738417123000005, 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.272 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.738356416000002, 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:45.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.731204094999995, 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:45.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:45.281 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.721281314999999, 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:45.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.720929957999999, 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:45.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.720367038000006, 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:45.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:45.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.293 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:45.293 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:45.293 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.720267503000002, 2024-04-19T02:17:45.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:45.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.297 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.709564039, 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:45.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.707931454000004, 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:45.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:45.305 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.706998275000004, 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:45.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.706871946000007, 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:45.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:45.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.706608461000002, 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.037511280000004, 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:45.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:45.327 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:45.324+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:45.427 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:45.427+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:45.455 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:45.455 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:45.455 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:45.455 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:45.469 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:45.528 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:45.527+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:45.593 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:45.593 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:45.594 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:45.594 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:45.594 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:45.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:45.629 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:45.631+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:45.730 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:45.728+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:45.737 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:45.738 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:45.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:45.738 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:45.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.739 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:45.739 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:45.739 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.183581885999999, 2024-04-19T02:17:45.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:45.739 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.740 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.740 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:45.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:45.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:45.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:45.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.183189618, 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:45.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:45.750 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.182719816000002, 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:45.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.181782756000004, 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:45.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.181467147999996, 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:45.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.181018124999994, 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:45.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:45.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.180429269000001, 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.772 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245622839999996, 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:45.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:45.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245524353999997, 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:45.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:45.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:45.783 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245456697999998, 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:45.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245404742000005, 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:45.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:45.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:45.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:45.794 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245350744999996, 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:45.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.799 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245296038999996, 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:45.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:45.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245242478999998, 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.805 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:45.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245186527000001, 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:45.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.245138130000001, 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:45.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.235001995000005, 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:45.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.230994949000006, 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.230936916999994, 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.230468372999994, 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:45.836 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:45.838 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:45.838 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:45.839+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:45.939 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:45.939+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:45.968 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:45.969 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:45.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:46.073 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:46.075+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:46.141 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:46.143+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:46.147 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:46.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:46.148 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:46.148 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:46.148 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:46.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:46.242 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:46.240+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:46.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.839130960999995, 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.839012578999998, 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.838943579000002, 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.838813363, 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.838733810999997, 2024-04-19T02:17:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.838638368000005, 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.838557461999997, 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.838089632999996, 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.838028926000007, 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.830876605, 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.820953825000004, 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.820602468000004, 2024-04-19T02:17:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.820039547999997, 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.819940012999993, 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.809236549000005, 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.807603963999995, 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:46.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:46.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.806670784999994, 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:46.402 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.406 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.806544455999997, 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.410 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.806280971000007, 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:46.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:46.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.137183789999995, 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.415 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:46.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:46.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:46.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:46.420 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:46.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:46.422 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:46.420+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:46.423 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:46.497 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:46.497 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:46.497 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:46.525 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:46.520+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:46.529 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:46.529 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:46.533 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:46.533 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:46.556 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:46.556 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:46.571 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:46.659 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:46.660+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:46.724 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:46.724+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:46.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:46.825 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:46.826+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:46.920 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:46.920 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:46.925 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:46.926+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:46.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:47.026 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:47.024+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:47.068 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.068 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:47.128 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:47.128+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:47.204 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.204 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.218 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:47.265 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:47.266+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:47.330 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:47.328+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:47.333 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.333 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:47.392 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:17:47.431 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:47.432+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:47.483 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.483 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.497 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:47.532 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:47.530+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:47.633 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:47.632+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:47.661 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.661 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:47.763 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:47.764+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:47.788 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:17:47.788 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:47.788 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T02:17:47.788 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:17:47.834 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:47.832+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:47.843 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.843 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:47.935 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:47.934+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:47.986 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.986 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:48.041 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:48.042+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:48.138 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:48.138+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:48.163 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.163 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.177 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:48.265 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:48.266+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:17:48.271 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:17:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 46, 2024-04-19T02:17:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "30a6d986-f196-4d3c-8512-6c6489722f8f", 2024-04-19T02:17:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-19T02:16:03.364103+0000", 2024-04-19T02:17:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-19T02:17:47.380077+0000", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-19T02:17:11.442750+0000", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-19T02:16:04.286795+0000", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5806080, 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-19T02:17:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "luminous", 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-19T02:17:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:14.248072+0000", 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:48.274 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:48.275 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:48.277 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.278 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-19T02:17:48.279 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 3.0299999713897705, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 3.0299999713897705, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.33000001311302185, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:48.280 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:18.602050+0000", 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:48.281 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-19T02:17:48.282 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:48.283 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:48.284 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.285 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:48.286 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.8700000047683716, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.8700000047683716, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.25, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.25, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:22.904068+0000", 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:48.288 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-19T02:17:48.289 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:48.290 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:48.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.292 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:17:48.293 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.7799999713897705, 2024-04-19T02:17:48.294 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.7799999713897705, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.190000057220459, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.190000057220459, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:23.465439+0000", 2024-04-19T02:17:48.295 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:48.296 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:17:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:48.298 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:48.300 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5399999618530273, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5399999618530273, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.302 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "16c5fbec-2207-41d1-ae33-893b400fd3da", 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:17:48.303 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 31, 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6800", 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6801", 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6802", 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6803", 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6806", 2024-04-19T02:17:48.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6807", 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6804", 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6805", 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.116:6801/21424", 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.116:6803/21424", 2024-04-19T02:17:48.308 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.116:6807/21424", 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.116:6805/21424", 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3211257a-5bd5-4a10-8d5f-c3dae1d504e7", 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 0, 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:17:48.309 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 31, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.310 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6800", 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6801", 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:17:48.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6802", 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6803", 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6806", 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6807", 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6804", 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6805", 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.136:6801/21483", 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.136:6803/21483", 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.136:6807/21483", 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.136:6805/21483", 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: "exists" 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d", 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 38, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:17:48.316 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6800", 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6801", 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.317 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6802", 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.318 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6803", 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6806", 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6807", 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6804", 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6805", 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.169:6801/21523", 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.169:6803/21523", 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.169:6807/21523", 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.169:6805/21523", 2024-04-19T02:17:48.321 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:17:48.322 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581115+0000", 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:17:48.323 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.639275+0000", 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 30 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:17:48.324 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581003+0000", 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [ 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "4.1", 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-04-19T02:17:48.325 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-19T02:17:48.326 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-19T02:17:48.327 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-19T02:17:48.328 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-19T02:17:48.328 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-19T02:17:48.328 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:17:48.328 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:17:48.328 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-19T02:17:48.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:17:48.328 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:17:48.330 INFO:tasks.thrashosds.thrasher:j is {'epoch': 46, 'fsid': '30a6d986-f196-4d3c-8512-6c6489722f8f', 'created': '2024-04-19T02:16:03.364103+0000', 'modified': '2024-04-19T02:17:47.380077+0000', 'last_up_change': '2024-04-19T02:17:11.442750+0000', 'last_in_change': '2024-04-19T02:16:04.286795+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '16c5fbec-2207-41d1-ae33-893b400fd3da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 21424}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 21424}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 21424}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 21424}]}, 'public_addr': '172.21.15.116:6801/21424', 'cluster_addr': '172.21.15.116:6803/21424', 'heartbeat_back_addr': '172.21.15.116:6807/21424', 'heartbeat_front_addr': '172.21.15.116:6805/21424', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3211257a-5bd5-4a10-8d5f-c3dae1d504e7', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 31, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6800', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6801', 'nonce': 21483}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6802', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6803', 'nonce': 21483}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6806', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6807', 'nonce': 21483}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6804', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6805', 'nonce': 21483}]}, 'public_addr': '172.21.15.136:6801/21483', 'cluster_addr': '172.21.15.136:6803/21483', 'heartbeat_back_addr': '172.21.15.136:6807/21483', 'heartbeat_front_addr': '172.21.15.136:6805/21483', 'state': ['exists']}, {'osd': 2, 'uuid': '1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 21523}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 21523}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 21523}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 21523}]}, 'public_addr': '172.21.15.169:6801/21523', 'cluster_addr': '172.21.15.169:6803/21523', 'heartbeat_back_addr': '172.21.15.169:6807/21523', 'heartbeat_front_addr': '172.21.15.169:6805/21523', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581115+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.639275+0000', 'dead_epoch': 30}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581003+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.1', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:17:48.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:17:48.340 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:48.338+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:48.344 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.345 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.359 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:48.442 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:48.442+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:48.488 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.488 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.503 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:48.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:48.547 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:48.548+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:48.624 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.624 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.640 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:48.644 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:48.642+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:48.727 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:48.744 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:48.742+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:48.760 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:48.760 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:48.763 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:48.764 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:48.808 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.256515476999994, 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.809 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:48.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.256123208999995, 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:48.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:48.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.255653406999997, 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:48.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:48.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:48.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.254716346999999, 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:48.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.254400739000005, 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:48.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:48.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:48.831 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.253951716000003, 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:48.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:48.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.253362859999996, 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:48.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318556431000005, 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:48.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:48.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.846 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318457945000006, 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:48.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:48.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:48.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318390289000007, 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:48.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318338333, 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:48.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:48.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.864 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318284336000005, 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:48.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:48.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318229630000005, 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:48.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:48.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318176070000007, 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:48.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318120117999996, 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.882 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.318071720999995, 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.886 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:48.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:48.890 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.307935585999999, 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:48.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.894 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.303928540000001, 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:48.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:48.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.303870508000003, 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:48.899 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:48.903 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 84.303401964000003, 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:48.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:48.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.907 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.908 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.908 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:48.908 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:48.908 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:48.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:48.912 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:48.908+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:17:48.915 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:17:48.916 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-19T02:17:48.199338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90396,"kb_used_data":1144,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025124,"statfs":{"total":289910292480,"available":289817726976,"internally_reserved":0,"allocated":1171456,"data_stored":1630161,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.823717"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366782+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:17:38.366782+0000","last_peered":"2024-04-19T02:17:38.366782+0000","last_clean":"2024-04-19T02:17:38.366782+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:17:38.366782+0000","last_undegraded":"2024-04-19T02:17:38.366782+0000","last_fullsized":"2024-04-19T02:17:38.366782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365708+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:17:38.365708+0000","last_peered":"2024-04-19T02:17:38.365708+0000","last_clean":"2024-04-19T02:17:38.365708+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:17:38.365708+0000","last_undegraded":"2024-04-19T02:17:38.365708+0000","last_fullsized":"2024-04-19T02:17:38.365708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365107+0000","last_change":"2024-04-19T02:17:12.471662+0000","last_active":"2024-04-19T02:17:38.365107+0000","last_peered":"2024-04-19T02:17:38.365107+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.471662+0000","last_became_peered":"2024-04-19T02:17:12.471662+0000","last_unstale":"2024-04-19T02:17:38.365107+0000","last_undegraded":"2024-04-19T02:17:38.365107+0000","last_fullsized":"2024-04-19T02:17:12.466748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:12:27.269263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367037+0000","last_change":"2024-04-19T02:17:12.474963+0000","last_active":"2024-04-19T02:17:38.367037+0000","last_peered":"2024-04-19T02:17:38.367037+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.474963+0000","last_became_peered":"2024-04-19T02:17:12.474963+0000","last_unstale":"2024-04-19T02:17:38.367037+0000","last_undegraded":"2024-04-19T02:17:38.367037+0000","last_fullsized":"2024-04-19T02:17:12.467385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:44:45.962189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365647+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:17:38.365647+0000","last_peered":"2024-04-19T02:17:38.365647+0000","last_clean":"2024-04-19T02:17:38.365647+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:17:38.365647+0000","last_undegraded":"2024-04-19T02:17:38.365647+0000","last_fullsized":"2024-04-19T02:17:38.365647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365589+0000","last_change":"2024-04-19T02:17:12.470649+0000","last_active":"2024-04-19T02:17:38.365589+0000","last_peered":"2024-04-19T02:17:38.365589+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.470649+0000","last_became_peered":"2024-04-19T02:17:12.470649+0000","last_unstale":"2024-04-19T02:17:38.365589+0000","last_undegraded":"2024-04-19T02:17:38.365589+0000","last_fullsized":"2024-04-19T02:17:12.465660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:20.734374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365334+0000","last_change":"2024-04-19T02:17:12.472721+0000","last_active":"2024-04-19T02:17:38.365334+0000","last_peered":"2024-04-19T02:17:38.365334+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472721+0000","last_became_peered":"2024-04-19T02:17:12.472721+0000","last_unstale":"2024-04-19T02:17:38.365334+0000","last_undegraded":"2024-04-19T02:17:38.365334+0000","last_fullsized":"2024-04-19T02:17:12.465429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:34.422792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365390+0000","last_change":"2024-04-19T02:17:12.473034+0000","last_active":"2024-04-19T02:17:38.365390+0000","last_peered":"2024-04-19T02:17:38.365390+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473034+0000","last_became_peered":"2024-04-19T02:17:12.473034+0000","last_unstale":"2024-04-19T02:17:38.365390+0000","last_undegraded":"2024-04-19T02:17:38.365390+0000","last_fullsized":"2024-04-19T02:17:12.465552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:56.103189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.367807+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:17:38.367807+0000","last_peered":"2024-04-19T02:17:38.367807+0000","last_clean":"2024-04-19T02:17:38.367807+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:17:38.367807+0000","last_undegraded":"2024-04-19T02:17:38.367807+0000","last_fullsized":"2024-04-19T02:17:38.367807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365755+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:17:38.365755+0000","last_peered":"2024-04-19T02:17:38.365755+0000","last_clean":"2024-04-19T02:17:38.365755+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:17:38.365755+0000","last_undegraded":"2024-04-19T02:17:38.365755+0000","last_fullsized":"2024-04-19T02:17:38.365755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367867+0000","last_change":"2024-04-19T02:17:12.475019+0000","last_active":"2024-04-19T02:17:38.367867+0000","last_peered":"2024-04-19T02:17:38.367867+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475019+0000","last_became_peered":"2024-04-19T02:17:12.475019+0000","last_unstale":"2024-04-19T02:17:38.367867+0000","last_undegraded":"2024-04-19T02:17:38.367867+0000","last_fullsized":"2024-04-19T02:17:12.467690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:36.724293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366510+0000","last_change":"2024-04-19T02:17:12.468033+0000","last_active":"2024-04-19T02:17:38.366510+0000","last_peered":"2024-04-19T02:17:38.366510+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:17:12.468033+0000","last_became_peered":"2024-04-19T02:17:12.468033+0000","last_unstale":"2024-04-19T02:17:38.366510+0000","last_undegraded":"2024-04-19T02:17:38.366510+0000","last_fullsized":"2024-04-19T02:17:12.466169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:02.369844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365423+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:17:38.365423+0000","last_peered":"2024-04-19T02:17:38.365423+0000","last_clean":"2024-04-19T02:17:38.365423+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:17:38.365423+0000","last_undegraded":"2024-04-19T02:17:38.365423+0000","last_fullsized":"2024-04-19T02:17:38.365423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.364586+0000","last_change":"2024-04-19T02:17:12.468218+0000","last_active":"2024-04-19T02:17:38.364586+0000","last_peered":"2024-04-19T02:17:38.364586+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468218+0000","last_became_peered":"2024-04-19T02:17:12.468218+0000","last_unstale":"2024-04-19T02:17:38.364586+0000","last_undegraded":"2024-04-19T02:17:38.364586+0000","last_fullsized":"2024-04-19T02:17:12.466471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:13.637115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.364556+0000","last_change":"2024-04-19T02:17:12.468646+0000","last_active":"2024-04-19T02:17:38.364556+0000","last_peered":"2024-04-19T02:17:38.364556+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468646+0000","last_became_peered":"2024-04-19T02:17:12.468646+0000","last_unstale":"2024-04-19T02:17:38.364556+0000","last_undegraded":"2024-04-19T02:17:38.364556+0000","last_fullsized":"2024-04-19T02:17:12.465162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:56.960161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365128+0000","last_change":"2024-04-19T02:17:12.467658+0000","last_active":"2024-04-19T02:17:38.365128+0000","last_peered":"2024-04-19T02:17:38.365128+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.467658+0000","last_became_peered":"2024-04-19T02:17:12.467658+0000","last_unstale":"2024-04-19T02:17:38.365128+0000","last_undegraded":"2024-04-19T02:17:38.365128+0000","last_fullsized":"2024-04-19T02:17:12.465360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:49.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.369484+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:17:38.369484+0000","last_peered":"2024-04-19T02:17:38.369484+0000","last_clean":"2024-04-19T02:17:38.369484+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:17:38.369484+0000","last_undegraded":"2024-04-19T02:17:38.369484+0000","last_fullsized":"2024-04-19T02:17:38.369484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365950+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:17:38.365950+0000","last_peered":"2024-04-19T02:17:38.365950+0000","last_clean":"2024-04-19T02:17:38.365950+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:17:38.365950+0000","last_undegraded":"2024-04-19T02:17:38.365950+0000","last_fullsized":"2024-04-19T02:17:38.365950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.367334+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:17:38.367334+0000","last_peered":"2024-04-19T02:17:38.367334+0000","last_clean":"2024-04-19T02:17:38.367334+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:17:38.367334+0000","last_undegraded":"2024-04-19T02:17:38.367334+0000","last_fullsized":"2024-04-19T02:17:38.367334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367890+0000","last_change":"2024-04-19T02:17:12.475684+0000","last_active":"2024-04-19T02:17:38.367890+0000","last_peered":"2024-04-19T02:17:38.367890+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475684+0000","last_became_peered":"2024-04-19T02:17:12.475684+0000","last_unstale":"2024-04-19T02:17:38.367890+0000","last_undegraded":"2024-04-19T02:17:38.367890+0000","last_fullsized":"2024-04-19T02:17:12.468218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:38.530185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367966+0000","last_change":"2024-04-19T02:17:12.482521+0000","last_active":"2024-04-19T02:17:38.367966+0000","last_peered":"2024-04-19T02:17:38.367966+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.482521+0000","last_became_peered":"2024-04-19T02:17:12.482521+0000","last_unstale":"2024-04-19T02:17:38.367966+0000","last_undegraded":"2024-04-19T02:17:38.367966+0000","last_fullsized":"2024-04-19T02:17:12.470413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:43.318373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.364934+0000","last_change":"2024-04-19T02:17:12.469825+0000","last_active":"2024-04-19T02:17:38.364934+0000","last_peered":"2024-04-19T02:17:38.364934+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:17:12.469825+0000","last_became_peered":"2024-04-19T02:17:12.469825+0000","last_unstale":"2024-04-19T02:17:38.364934+0000","last_undegraded":"2024-04-19T02:17:38.364934+0000","last_fullsized":"2024-04-19T02:17:12.466905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:55:14.059675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365692+0000","last_change":"2024-04-19T02:17:12.470766+0000","last_active":"2024-04-19T02:17:38.365692+0000","last_peered":"2024-04-19T02:17:38.365692+0000","last_clean":"2024-04-19T02:17:07.001190+0000","last_became_active":"2024-04-19T02:17:12.470766+0000","last_became_peered":"2024-04-19T02:17:12.470766+0000","last_unstale":"2024-04-19T02:17:38.365692+0000","last_undegraded":"2024-04-19T02:17:38.365692+0000","last_fullsized":"2024-04-19T02:17:12.465417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:41.307510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.364146+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:17:38.364146+0000","last_peered":"2024-04-19T02:17:38.364146+0000","last_clean":"2024-04-19T02:17:38.364146+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:17:38.364146+0000","last_undegraded":"2024-04-19T02:17:38.364146+0000","last_fullsized":"2024-04-19T02:17:38.364146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366914+0000","last_change":"2024-04-19T02:17:12.472985+0000","last_active":"2024-04-19T02:17:38.366914+0000","last_peered":"2024-04-19T02:17:38.366914+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:17:12.472985+0000","last_became_peered":"2024-04-19T02:17:12.472985+0000","last_unstale":"2024-04-19T02:17:38.366914+0000","last_undegraded":"2024-04-19T02:17:38.366914+0000","last_fullsized":"2024-04-19T02:17:12.470041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:29.004931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.368984+0000","last_change":"2024-04-19T02:17:12.475928+0000","last_active":"2024-04-19T02:17:38.368984+0000","last_peered":"2024-04-19T02:17:38.368984+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:17:12.475928+0000","last_became_peered":"2024-04-19T02:17:12.475928+0000","last_unstale":"2024-04-19T02:17:38.368984+0000","last_undegraded":"2024-04-19T02:17:38.368984+0000","last_fullsized":"2024-04-19T02:17:12.468138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:08.735898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.368241+0000","last_change":"2024-04-19T02:17:12.472908+0000","last_active":"2024-04-19T02:17:38.368241+0000","last_peered":"2024-04-19T02:17:38.368241+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472908+0000","last_became_peered":"2024-04-19T02:17:12.472908+0000","last_unstale":"2024-04-19T02:17:38.368241+0000","last_undegraded":"2024-04-19T02:17:38.368241+0000","last_fullsized":"2024-04-19T02:17:12.468312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:43.318373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366617+0000","last_change":"2024-04-19T02:17:12.470809+0000","last_active":"2024-04-19T02:17:38.366617+0000","last_peered":"2024-04-19T02:17:38.366617+0000","last_clean":"2024-04-19T02:17:09.445020+0000","last_became_active":"2024-04-19T02:17:12.470809+0000","last_became_peered":"2024-04-19T02:17:12.470809+0000","last_unstale":"2024-04-19T02:17:38.366617+0000","last_undegraded":"2024-04-19T02:17:38.366617+0000","last_fullsized":"2024-04-19T02:17:12.467256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:47.544283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366874+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:17:38.366874+0000","last_peered":"2024-04-19T02:17:38.366874+0000","last_clean":"2024-04-19T02:17:38.366874+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:17:38.366874+0000","last_undegraded":"2024-04-19T02:17:38.366874+0000","last_fullsized":"2024-04-19T02:17:38.366874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366283+0000","last_change":"2024-04-19T02:17:12.472579+0000","last_active":"2024-04-19T02:17:38.366283+0000","last_peered":"2024-04-19T02:17:38.366283+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:17:12.472579+0000","last_became_peered":"2024-04-19T02:17:12.472579+0000","last_unstale":"2024-04-19T02:17:38.366283+0000","last_undegraded":"2024-04-19T02:17:38.366283+0000","last_fullsized":"2024-04-19T02:17:12.467577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.053477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365660+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:17:38.365660+0000","last_peered":"2024-04-19T02:17:38.365660+0000","last_clean":"2024-04-19T02:17:38.365660+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:17:38.365660+0000","last_undegraded":"2024-04-19T02:17:38.365660+0000","last_fullsized":"2024-04-19T02:17:38.365660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365798+0000","last_change":"2024-04-19T02:17:12.477517+0000","last_active":"2024-04-19T02:17:38.365798+0000","last_peered":"2024-04-19T02:17:38.365798+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.477517+0000","last_became_peered":"2024-04-19T02:17:12.477517+0000","last_unstale":"2024-04-19T02:17:38.365798+0000","last_undegraded":"2024-04-19T02:17:38.365798+0000","last_fullsized":"2024-04-19T02:17:12.466619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:06.010745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366385+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:17:38.366385+0000","last_peered":"2024-04-19T02:17:38.366385+0000","last_clean":"2024-04-19T02:17:38.366385+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:17:38.366385+0000","last_undegraded":"2024-04-19T02:17:38.366385+0000","last_fullsized":"2024-04-19T02:17:38.366385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":29,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.366861+0000","last_change":"2024-04-19T02:17:12.480865+0000","last_active":"2024-04-19T02:17:38.366861+0000","last_peered":"2024-04-19T02:17:38.366861+0000","last_clean":"2024-04-19T02:16:24.494994+0000","last_became_active":"2024-04-19T02:17:12.480865+0000","last_became_peered":"2024-04-19T02:17:12.480865+0000","last_unstale":"2024-04-19T02:17:38.366861+0000","last_undegraded":"2024-04-19T02:17:12.469727+0000","last_fullsized":"2024-04-19T02:17:12.469514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:39.449809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.367732+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:17:38.367732+0000","last_peered":"2024-04-19T02:17:38.367732+0000","last_clean":"2024-04-19T02:17:38.367732+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:17:38.367732+0000","last_undegraded":"2024-04-19T02:17:38.367732+0000","last_fullsized":"2024-04-19T02:17:38.367732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366194+0000","last_change":"2024-04-19T02:17:12.475504+0000","last_active":"2024-04-19T02:17:38.366194+0000","last_peered":"2024-04-19T02:17:38.366194+0000","last_clean":"2024-04-19T02:17:07.001751+0000","last_became_active":"2024-04-19T02:17:12.475504+0000","last_became_peered":"2024-04-19T02:17:12.475504+0000","last_unstale":"2024-04-19T02:17:38.366194+0000","last_undegraded":"2024-04-19T02:17:38.366194+0000","last_fullsized":"2024-04-19T02:17:12.466749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:16.631966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.369531+0000","last_change":"2024-04-19T02:17:12.480599+0000","last_active":"2024-04-19T02:17:38.369531+0000","last_peered":"2024-04-19T02:17:38.369531+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:17:12.480599+0000","last_became_peered":"2024-04-19T02:17:12.480599+0000","last_unstale":"2024-04-19T02:17:38.369531+0000","last_undegraded":"2024-04-19T02:17:38.369531+0000","last_fullsized":"2024-04-19T02:17:12.472079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:39.186907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.364885+0000","last_change":"2024-04-19T02:17:12.470087+0000","last_active":"2024-04-19T02:17:38.364885+0000","last_peered":"2024-04-19T02:17:38.364885+0000","last_clean":"2024-04-19T02:17:09.444294+0000","last_became_active":"2024-04-19T02:17:12.470087+0000","last_became_peered":"2024-04-19T02:17:12.470087+0000","last_unstale":"2024-04-19T02:17:38.364885+0000","last_undegraded":"2024-04-19T02:17:38.364885+0000","last_fullsized":"2024-04-19T02:17:12.465651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:08.686889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.369004+0000","last_change":"2024-04-19T02:17:12.477502+0000","last_active":"2024-04-19T02:17:38.369004+0000","last_peered":"2024-04-19T02:17:38.369004+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:17:12.477502+0000","last_became_peered":"2024-04-19T02:17:12.477502+0000","last_unstale":"2024-04-19T02:17:38.369004+0000","last_undegraded":"2024-04-19T02:17:38.369004+0000","last_fullsized":"2024-04-19T02:17:12.468662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:42.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":29,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.364339+0000","last_change":"2024-04-19T02:17:12.468566+0000","last_active":"2024-04-19T02:17:38.364339+0000","last_peered":"2024-04-19T02:17:38.364339+0000","last_clean":"2024-04-19T02:16:24.492774+0000","last_became_active":"2024-04-19T02:17:12.468566+0000","last_became_peered":"2024-04-19T02:17:12.468566+0000","last_unstale":"2024-04-19T02:17:38.364339+0000","last_undegraded":"2024-04-19T02:17:12.465406+0000","last_fullsized":"2024-04-19T02:17:12.465206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:35.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":29,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.367317+0000","last_change":"2024-04-19T02:17:12.473559+0000","last_active":"2024-04-19T02:17:38.367317+0000","last_peered":"2024-04-19T02:17:38.367317+0000","last_clean":"2024-04-19T02:16:24.491281+0000","last_became_active":"2024-04-19T02:17:12.473559+0000","last_became_peered":"2024-04-19T02:17:12.473559+0000","last_unstale":"2024-04-19T02:17:38.367317+0000","last_undegraded":"2024-04-19T02:17:12.470889+0000","last_fullsized":"2024-04-19T02:17:12.470812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:47.633899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.364357+0000","last_change":"2024-04-19T02:17:12.468086+0000","last_active":"2024-04-19T02:17:38.364357+0000","last_peered":"2024-04-19T02:17:38.364357+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:17:12.468086+0000","last_became_peered":"2024-04-19T02:17:12.468086+0000","last_unstale":"2024-04-19T02:17:38.364357+0000","last_undegraded":"2024-04-19T02:17:38.364357+0000","last_fullsized":"2024-04-19T02:17:12.465179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:25:37.098688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":44,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.366200+0000","last_change":"2024-04-19T02:17:12.471922+0000","last_active":"2024-04-19T02:17:38.366200+0000","last_peered":"2024-04-19T02:17:38.366200+0000","last_clean":"2024-04-19T02:17:09.445356+0000","last_became_active":"2024-04-19T02:17:12.471922+0000","last_became_peered":"2024-04-19T02:17:12.471922+0000","last_unstale":"2024-04-19T02:17:38.366200+0000","last_undegraded":"2024-04-19T02:17:12.469493+0000","last_fullsized":"2024-04-19T02:17:12.469410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:44.093452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.364583+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:17:38.364583+0000","last_peered":"2024-04-19T02:17:38.364583+0000","last_clean":"2024-04-19T02:17:38.364583+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:17:38.364583+0000","last_undegraded":"2024-04-19T02:17:38.364583+0000","last_fullsized":"2024-04-19T02:17:38.364583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":29,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.365986+0000","last_change":"2024-04-19T02:17:12.471586+0000","last_active":"2024-04-19T02:17:38.365986+0000","last_peered":"2024-04-19T02:17:38.365986+0000","last_clean":"2024-04-19T02:16:24.498760+0000","last_became_active":"2024-04-19T02:17:12.471586+0000","last_became_peered":"2024-04-19T02:17:12.471586+0000","last_unstale":"2024-04-19T02:17:38.365986+0000","last_undegraded":"2024-04-19T02:17:12.467226+0000","last_fullsized":"2024-04-19T02:17:12.467144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:30.560862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366185+0000","last_change":"2024-04-19T02:17:12.476188+0000","last_active":"2024-04-19T02:17:38.366185+0000","last_peered":"2024-04-19T02:17:38.366185+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.476188+0000","last_became_peered":"2024-04-19T02:17:12.476188+0000","last_unstale":"2024-04-19T02:17:38.366185+0000","last_undegraded":"2024-04-19T02:17:38.366185+0000","last_fullsized":"2024-04-19T02:17:12.467463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:08.617493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367988+0000","last_change":"2024-04-19T02:17:12.481086+0000","last_active":"2024-04-19T02:17:38.367988+0000","last_peered":"2024-04-19T02:17:38.367988+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.481086+0000","last_became_peered":"2024-04-19T02:17:12.481086+0000","last_unstale":"2024-04-19T02:17:38.367988+0000","last_undegraded":"2024-04-19T02:17:38.367988+0000","last_fullsized":"2024-04-19T02:17:12.468898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:34.809946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366566+0000","last_change":"2024-04-19T02:17:12.477363+0000","last_active":"2024-04-19T02:17:38.366566+0000","last_peered":"2024-04-19T02:17:38.366566+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:17:12.477363+0000","last_became_peered":"2024-04-19T02:17:12.477363+0000","last_unstale":"2024-04-19T02:17:38.366566+0000","last_undegraded":"2024-04-19T02:17:38.366566+0000","last_fullsized":"2024-04-19T02:17:12.466956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:06.485415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":43,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.368129+0000","last_change":"2024-04-19T02:17:12.482776+0000","last_active":"2024-04-19T02:17:38.368129+0000","last_peered":"2024-04-19T02:17:38.368129+0000","last_clean":"2024-04-19T02:17:07.002985+0000","last_became_active":"2024-04-19T02:17:12.482776+0000","last_became_peered":"2024-04-19T02:17:12.482776+0000","last_unstale":"2024-04-19T02:17:38.368129+0000","last_undegraded":"2024-04-19T02:17:12.473078+0000","last_fullsized":"2024-04-19T02:17:12.472919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:09.109279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367144+0000","last_change":"2024-04-19T02:17:12.475123+0000","last_active":"2024-04-19T02:17:38.367144+0000","last_peered":"2024-04-19T02:17:38.367144+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475123+0000","last_became_peered":"2024-04-19T02:17:12.475123+0000","last_unstale":"2024-04-19T02:17:38.367144+0000","last_undegraded":"2024-04-19T02:17:38.367144+0000","last_fullsized":"2024-04-19T02:17:12.468098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:38:10.412991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365858+0000","last_change":"2024-04-19T02:17:12.470775+0000","last_active":"2024-04-19T02:17:38.365858+0000","last_peered":"2024-04-19T02:17:38.365858+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.470775+0000","last_became_peered":"2024-04-19T02:17:12.470775+0000","last_unstale":"2024-04-19T02:17:38.365858+0000","last_undegraded":"2024-04-19T02:17:38.365858+0000","last_fullsized":"2024-04-19T02:17:12.466015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:58.235807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367865+0000","last_change":"2024-04-19T02:17:12.472954+0000","last_active":"2024-04-19T02:17:38.367865+0000","last_peered":"2024-04-19T02:17:38.367865+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472954+0000","last_became_peered":"2024-04-19T02:17:12.472954+0000","last_unstale":"2024-04-19T02:17:38.367865+0000","last_undegraded":"2024-04-19T02:17:38.367865+0000","last_fullsized":"2024-04-19T02:17:12.467712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:33.854311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366520+0000","last_change":"2024-04-19T02:17:12.468621+0000","last_active":"2024-04-19T02:17:38.366520+0000","last_peered":"2024-04-19T02:17:38.366520+0000","last_clean":"2024-04-19T02:17:09.444347+0000","last_became_active":"2024-04-19T02:17:12.468621+0000","last_became_peered":"2024-04-19T02:17:12.468621+0000","last_unstale":"2024-04-19T02:17:38.366520+0000","last_undegraded":"2024-04-19T02:17:38.366520+0000","last_fullsized":"2024-04-19T02:17:12.466195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:31:45.463358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365357+0000","last_change":"2024-04-19T02:17:12.469283+0000","last_active":"2024-04-19T02:17:38.365357+0000","last_peered":"2024-04-19T02:17:38.365357+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.469283+0000","last_became_peered":"2024-04-19T02:17:12.469283+0000","last_unstale":"2024-04-19T02:17:38.365357+0000","last_undegraded":"2024-04-19T02:17:38.365357+0000","last_fullsized":"2024-04-19T02:17:12.466315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:49.268315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.364689+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:17:38.364689+0000","last_peered":"2024-04-19T02:17:38.364689+0000","last_clean":"2024-04-19T02:17:38.364689+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:17:38.364689+0000","last_undegraded":"2024-04-19T02:17:38.364689+0000","last_fullsized":"2024-04-19T02:17:38.364689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.368008+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:17:38.368008+0000","last_peered":"2024-04-19T02:17:38.368008+0000","last_clean":"2024-04-19T02:17:38.368008+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:17:38.368008+0000","last_undegraded":"2024-04-19T02:17:38.368008+0000","last_fullsized":"2024-04-19T02:17:38.368008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":223,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.369075+0000","last_change":"2024-04-19T02:17:12.471328+0000","last_active":"2024-04-19T02:17:38.369075+0000","last_peered":"2024-04-19T02:17:38.369075+0000","last_clean":"2024-04-19T02:16:17.202941+0000","last_became_active":"2024-04-19T02:17:12.471328+0000","last_became_peered":"2024-04-19T02:17:12.471328+0000","last_unstale":"2024-04-19T02:17:38.369075+0000","last_undegraded":"2024-04-19T02:17:12.467139+0000","last_fullsized":"2024-04-19T02:17:12.466916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:00.591621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.368761+0000","last_change":"2024-04-19T02:17:12.483202+0000","last_active":"2024-04-19T02:17:38.368761+0000","last_peered":"2024-04-19T02:17:38.368761+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.483202+0000","last_became_peered":"2024-04-19T02:17:12.483202+0000","last_unstale":"2024-04-19T02:17:38.368761+0000","last_undegraded":"2024-04-19T02:17:38.368761+0000","last_fullsized":"2024-04-19T02:17:12.473235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:45.677177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366498+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:17:38.366498+0000","last_peered":"2024-04-19T02:17:38.366498+0000","last_clean":"2024-04-19T02:17:38.366498+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:17:38.366498+0000","last_undegraded":"2024-04-19T02:17:38.366498+0000","last_fullsized":"2024-04-19T02:17:38.366498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365675+0000","last_change":"2024-04-19T02:17:12.472439+0000","last_active":"2024-04-19T02:17:38.365675+0000","last_peered":"2024-04-19T02:17:38.365675+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472439+0000","last_became_peered":"2024-04-19T02:17:12.472439+0000","last_unstale":"2024-04-19T02:17:38.365675+0000","last_undegraded":"2024-04-19T02:17:38.365675+0000","last_fullsized":"2024-04-19T02:17:12.467077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:38:10.412991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.368923+0000","last_change":"2024-04-19T02:17:12.470205+0000","last_active":"2024-04-19T02:17:38.368923+0000","last_peered":"2024-04-19T02:17:38.368923+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.470205+0000","last_became_peered":"2024-04-19T02:17:12.470205+0000","last_unstale":"2024-04-19T02:17:38.368923+0000","last_undegraded":"2024-04-19T02:17:38.368923+0000","last_fullsized":"2024-04-19T02:17:12.466126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:18.817011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366243+0000","last_change":"2024-04-19T02:17:12.477549+0000","last_active":"2024-04-19T02:17:38.366243+0000","last_peered":"2024-04-19T02:17:38.366243+0000","last_clean":"2024-04-19T02:17:07.001902+0000","last_became_active":"2024-04-19T02:17:12.477549+0000","last_became_peered":"2024-04-19T02:17:12.477549+0000","last_unstale":"2024-04-19T02:17:38.366243+0000","last_undegraded":"2024-04-19T02:17:38.366243+0000","last_fullsized":"2024-04-19T02:17:12.468541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:55:13.051324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366066+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:17:38.366066+0000","last_peered":"2024-04-19T02:17:38.366066+0000","last_clean":"2024-04-19T02:17:38.366066+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:17:38.366066+0000","last_undegraded":"2024-04-19T02:17:38.366066+0000","last_fullsized":"2024-04-19T02:17:38.366066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366683+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:17:38.366683+0000","last_peered":"2024-04-19T02:17:38.366683+0000","last_clean":"2024-04-19T02:17:38.366683+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:17:38.366683+0000","last_undegraded":"2024-04-19T02:17:38.366683+0000","last_fullsized":"2024-04-19T02:17:38.366683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.368789+0000","last_change":"2024-04-19T02:17:12.470093+0000","last_active":"2024-04-19T02:17:38.368789+0000","last_peered":"2024-04-19T02:17:38.368789+0000","last_clean":"2024-04-19T02:17:09.444286+0000","last_became_active":"2024-04-19T02:17:12.470093+0000","last_became_peered":"2024-04-19T02:17:12.470093+0000","last_unstale":"2024-04-19T02:17:38.368789+0000","last_undegraded":"2024-04-19T02:17:38.368789+0000","last_fullsized":"2024-04-19T02:17:12.466037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:28.739646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.368230+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:17:38.368230+0000","last_peered":"2024-04-19T02:17:38.368230+0000","last_clean":"2024-04-19T02:17:38.368230+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:17:38.368230+0000","last_undegraded":"2024-04-19T02:17:38.368230+0000","last_fullsized":"2024-04-19T02:17:38.368230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367053+0000","last_change":"2024-04-19T02:17:12.478551+0000","last_active":"2024-04-19T02:17:38.367053+0000","last_peered":"2024-04-19T02:17:38.367053+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.478551+0000","last_became_peered":"2024-04-19T02:17:12.478551+0000","last_unstale":"2024-04-19T02:17:38.367053+0000","last_undegraded":"2024-04-19T02:17:38.367053+0000","last_fullsized":"2024-04-19T02:17:12.468490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:54.966067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367825+0000","last_change":"2024-04-19T02:17:12.480849+0000","last_active":"2024-04-19T02:17:38.367825+0000","last_peered":"2024-04-19T02:17:38.367825+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480849+0000","last_became_peered":"2024-04-19T02:17:12.480849+0000","last_unstale":"2024-04-19T02:17:38.367825+0000","last_undegraded":"2024-04-19T02:17:38.367825+0000","last_fullsized":"2024-04-19T02:17:12.469891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:28:21.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.367439+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:17:38.367439+0000","last_peered":"2024-04-19T02:17:38.367439+0000","last_clean":"2024-04-19T02:17:38.367439+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:17:38.367439+0000","last_undegraded":"2024-04-19T02:17:38.367439+0000","last_fullsized":"2024-04-19T02:17:38.367439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367948+0000","last_change":"2024-04-19T02:17:12.475695+0000","last_active":"2024-04-19T02:17:38.367948+0000","last_peered":"2024-04-19T02:17:38.367948+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.475695+0000","last_became_peered":"2024-04-19T02:17:12.475695+0000","last_unstale":"2024-04-19T02:17:38.367948+0000","last_undegraded":"2024-04-19T02:17:38.367948+0000","last_fullsized":"2024-04-19T02:17:12.468442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:02.799871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.368993+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:17:38.368993+0000","last_peered":"2024-04-19T02:17:38.368993+0000","last_clean":"2024-04-19T02:17:38.368993+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:17:38.368993+0000","last_undegraded":"2024-04-19T02:17:38.368993+0000","last_fullsized":"2024-04-19T02:17:38.368993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365009+0000","last_change":"2024-04-19T02:17:12.471310+0000","last_active":"2024-04-19T02:17:38.365009+0000","last_peered":"2024-04-19T02:17:38.365009+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:17:12.471310+0000","last_became_peered":"2024-04-19T02:17:12.471310+0000","last_unstale":"2024-04-19T02:17:38.365009+0000","last_undegraded":"2024-04-19T02:17:38.365009+0000","last_fullsized":"2024-04-19T02:17:12.467496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:34.756376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.368748+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:17:38.368748+0000","last_peered":"2024-04-19T02:17:38.368748+0000","last_clean":"2024-04-19T02:17:38.368748+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:17:38.368748+0000","last_undegraded":"2024-04-19T02:17:38.368748+0000","last_fullsized":"2024-04-19T02:17:38.368748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.368389+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:17:38.368389+0000","last_peered":"2024-04-19T02:17:38.368389+0000","last_clean":"2024-04-19T02:17:38.368389+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:17:38.368389+0000","last_undegraded":"2024-04-19T02:17:38.368389+0000","last_fullsized":"2024-04-19T02:17:38.368389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366014+0000","last_change":"2024-04-19T02:17:12.469898+0000","last_active":"2024-04-19T02:17:38.366014+0000","last_peered":"2024-04-19T02:17:38.366014+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:17:12.469898+0000","last_became_peered":"2024-04-19T02:17:12.469898+0000","last_unstale":"2024-04-19T02:17:38.366014+0000","last_undegraded":"2024-04-19T02:17:38.366014+0000","last_fullsized":"2024-04-19T02:17:12.465728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:42.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.369706+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:17:38.369706+0000","last_peered":"2024-04-19T02:17:38.369706+0000","last_clean":"2024-04-19T02:17:38.369706+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:17:38.369706+0000","last_undegraded":"2024-04-19T02:17:38.369706+0000","last_fullsized":"2024-04-19T02:17:38.369706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.369782+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:17:38.369782+0000","last_peered":"2024-04-19T02:17:38.369782+0000","last_clean":"2024-04-19T02:17:38.369782+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:17:38.369782+0000","last_undegraded":"2024-04-19T02:17:38.369782+0000","last_fullsized":"2024-04-19T02:17:38.369782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366124+0000","last_change":"2024-04-19T02:17:12.478207+0000","last_active":"2024-04-19T02:17:38.366124+0000","last_peered":"2024-04-19T02:17:38.366124+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:17:12.478207+0000","last_became_peered":"2024-04-19T02:17:12.478207+0000","last_unstale":"2024-04-19T02:17:38.366124+0000","last_undegraded":"2024-04-19T02:17:38.366124+0000","last_fullsized":"2024-04-19T02:17:12.467111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:58.269726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":44,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.369745+0000","last_change":"2024-04-19T02:17:12.481269+0000","last_active":"2024-04-19T02:17:38.369745+0000","last_peered":"2024-04-19T02:17:38.369745+0000","last_clean":"2024-04-19T02:17:07.003468+0000","last_became_active":"2024-04-19T02:17:12.481269+0000","last_became_peered":"2024-04-19T02:17:12.481269+0000","last_unstale":"2024-04-19T02:17:38.369745+0000","last_undegraded":"2024-04-19T02:17:12.472467+0000","last_fullsized":"2024-04-19T02:17:12.472256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:25.797971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367492+0000","last_change":"2024-04-19T02:17:12.473583+0000","last_active":"2024-04-19T02:17:38.367492+0000","last_peered":"2024-04-19T02:17:38.367492+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.473583+0000","last_became_peered":"2024-04-19T02:17:12.473583+0000","last_unstale":"2024-04-19T02:17:38.367492+0000","last_undegraded":"2024-04-19T02:17:38.367492+0000","last_fullsized":"2024-04-19T02:17:12.470880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:08.436045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365319+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:17:38.365319+0000","last_peered":"2024-04-19T02:17:38.365319+0000","last_clean":"2024-04-19T02:17:38.365319+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:17:38.365319+0000","last_undegraded":"2024-04-19T02:17:38.365319+0000","last_fullsized":"2024-04-19T02:17:38.365319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:15.829506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.364966+0000","last_change":"2024-04-19T02:17:12.468034+0000","last_active":"2024-04-19T02:17:38.364966+0000","last_peered":"2024-04-19T02:17:38.364966+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468034+0000","last_became_peered":"2024-04-19T02:17:12.468034+0000","last_unstale":"2024-04-19T02:17:38.364966+0000","last_undegraded":"2024-04-19T02:17:38.364966+0000","last_fullsized":"2024-04-19T02:17:12.465388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:52.858745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":45,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.365828+0000","last_change":"2024-04-19T02:17:12.468266+0000","last_active":"2024-04-19T02:17:38.365828+0000","last_peered":"2024-04-19T02:17:38.365828+0000","last_clean":"2024-04-19T02:16:54.341172+0000","last_became_active":"2024-04-19T02:17:12.468266+0000","last_became_peered":"2024-04-19T02:17:12.468266+0000","last_unstale":"2024-04-19T02:17:38.365828+0000","last_undegraded":"2024-04-19T02:17:12.466295+0000","last_fullsized":"2024-04-19T02:17:12.466215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:20.170934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365550+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:17:38.365550+0000","last_peered":"2024-04-19T02:17:38.365550+0000","last_clean":"2024-04-19T02:17:38.365550+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:17:38.365550+0000","last_undegraded":"2024-04-19T02:17:38.365550+0000","last_fullsized":"2024-04-19T02:17:38.365550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":45,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.368057+0000","last_change":"2024-04-19T02:17:12.472711+0000","last_active":"2024-04-19T02:17:38.368057+0000","last_peered":"2024-04-19T02:17:38.368057+0000","last_clean":"2024-04-19T02:17:09.446243+0000","last_became_active":"2024-04-19T02:17:12.472711+0000","last_became_peered":"2024-04-19T02:17:12.472711+0000","last_unstale":"2024-04-19T02:17:38.368057+0000","last_undegraded":"2024-04-19T02:17:12.468046+0000","last_fullsized":"2024-04-19T02:17:12.467939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:45.500367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.369211+0000","last_change":"2024-04-19T02:17:12.480946+0000","last_active":"2024-04-19T02:17:38.369211+0000","last_peered":"2024-04-19T02:17:38.369211+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480946+0000","last_became_peered":"2024-04-19T02:17:12.480946+0000","last_unstale":"2024-04-19T02:17:38.369211+0000","last_undegraded":"2024-04-19T02:17:38.369211+0000","last_fullsized":"2024-04-19T02:17:12.469729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:30.560862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365908+0000","last_change":"2024-04-19T02:17:12.474936+0000","last_active":"2024-04-19T02:17:38.365908+0000","last_peered":"2024-04-19T02:17:38.365908+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:17:12.474936+0000","last_became_peered":"2024-04-19T02:17:12.474936+0000","last_unstale":"2024-04-19T02:17:38.365908+0000","last_undegraded":"2024-04-19T02:17:38.365908+0000","last_fullsized":"2024-04-19T02:17:12.466173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:56.771899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.369372+0000","last_change":"2024-04-19T02:17:12.478595+0000","last_active":"2024-04-19T02:17:38.369372+0000","last_peered":"2024-04-19T02:17:38.369372+0000","last_clean":"2024-04-19T02:17:07.003624+0000","last_became_active":"2024-04-19T02:17:12.478595+0000","last_became_peered":"2024-04-19T02:17:12.478595+0000","last_unstale":"2024-04-19T02:17:38.369372+0000","last_undegraded":"2024-04-19T02:17:38.369372+0000","last_fullsized":"2024-04-19T02:17:12.470773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:17.045125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365958+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:17:38.365958+0000","last_peered":"2024-04-19T02:17:38.365958+0000","last_clean":"2024-04-19T02:17:38.365958+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:17:38.365958+0000","last_undegraded":"2024-04-19T02:17:38.365958+0000","last_fullsized":"2024-04-19T02:17:38.365958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.367063+0000","last_change":"2024-04-19T02:17:12.472045+0000","last_active":"2024-04-19T02:17:38.367063+0000","last_peered":"2024-04-19T02:17:38.367063+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:17:12.472045+0000","last_became_peered":"2024-04-19T02:17:12.472045+0000","last_unstale":"2024-04-19T02:17:38.367063+0000","last_undegraded":"2024-04-19T02:17:38.367063+0000","last_fullsized":"2024-04-19T02:17:12.469938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:07.174450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366170+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:17:38.366170+0000","last_peered":"2024-04-19T02:17:38.366170+0000","last_clean":"2024-04-19T02:17:38.366170+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:17:38.366170+0000","last_undegraded":"2024-04-19T02:17:38.366170+0000","last_fullsized":"2024-04-19T02:17:38.366170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.368744+0000","last_change":"2024-04-19T02:17:12.478635+0000","last_active":"2024-04-19T02:17:38.368744+0000","last_peered":"2024-04-19T02:17:38.368744+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:17:12.478635+0000","last_became_peered":"2024-04-19T02:17:12.478635+0000","last_unstale":"2024-04-19T02:17:38.368744+0000","last_undegraded":"2024-04-19T02:17:38.368744+0000","last_fullsized":"2024-04-19T02:17:12.469417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:56.699515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.366181+0000","last_change":"2024-04-19T02:17:12.474967+0000","last_active":"2024-04-19T02:17:38.366181+0000","last_peered":"2024-04-19T02:17:38.366181+0000","last_clean":"2024-04-19T02:17:07.001688+0000","last_became_active":"2024-04-19T02:17:12.474967+0000","last_became_peered":"2024-04-19T02:17:12.474967+0000","last_unstale":"2024-04-19T02:17:38.366181+0000","last_undegraded":"2024-04-19T02:17:38.366181+0000","last_fullsized":"2024-04-19T02:17:12.468046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:12.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365620+0000","last_change":"2024-04-19T02:17:12.468686+0000","last_active":"2024-04-19T02:17:38.365620+0000","last_peered":"2024-04-19T02:17:38.365620+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:17:12.468686+0000","last_became_peered":"2024-04-19T02:17:12.468686+0000","last_unstale":"2024-04-19T02:17:38.365620+0000","last_undegraded":"2024-04-19T02:17:38.365620+0000","last_fullsized":"2024-04-19T02:17:12.466095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:25:22.162660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365314+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:17:38.365314+0000","last_peered":"2024-04-19T02:17:38.365314+0000","last_clean":"2024-04-19T02:17:38.365314+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:17:38.365314+0000","last_undegraded":"2024-04-19T02:17:38.365314+0000","last_fullsized":"2024-04-19T02:17:38.365314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.366152+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:17:38.366152+0000","last_peered":"2024-04-19T02:17:38.366152+0000","last_clean":"2024-04-19T02:17:38.366152+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:17:38.366152+0000","last_undegraded":"2024-04-19T02:17:38.366152+0000","last_fullsized":"2024-04-19T02:17:38.366152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":43,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365896+0000","last_change":"2024-04-19T02:17:12.470743+0000","last_active":"2024-04-19T02:17:38.365896+0000","last_peered":"2024-04-19T02:17:38.365896+0000","last_clean":"2024-04-19T02:17:09.445171+0000","last_became_active":"2024-04-19T02:17:12.470743+0000","last_became_peered":"2024-04-19T02:17:12.470743+0000","last_unstale":"2024-04-19T02:17:38.365896+0000","last_undegraded":"2024-04-19T02:17:38.365896+0000","last_fullsized":"2024-04-19T02:17:12.466575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:40.205694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365783+0000","last_change":"2024-04-19T02:17:12.473792+0000","last_active":"2024-04-19T02:17:38.365783+0000","last_peered":"2024-04-19T02:17:38.365783+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473792+0000","last_became_peered":"2024-04-19T02:17:12.473792+0000","last_unstale":"2024-04-19T02:17:38.365783+0000","last_undegraded":"2024-04-19T02:17:38.365783+0000","last_fullsized":"2024-04-19T02:17:12.465913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:38.124985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":29,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.368239+0000","last_change":"2024-04-19T02:17:12.478521+0000","last_active":"2024-04-19T02:17:38.368239+0000","last_peered":"2024-04-19T02:17:38.368239+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:17:12.478521+0000","last_became_peered":"2024-04-19T02:17:12.478521+0000","last_unstale":"2024-04-19T02:17:38.368239+0000","last_undegraded":"2024-04-19T02:17:12.469719+0000","last_fullsized":"2024-04-19T02:17:12.469506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:31.073165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365947+0000","last_change":"2024-04-19T02:17:12.475828+0000","last_active":"2024-04-19T02:17:38.365947+0000","last_peered":"2024-04-19T02:17:38.365947+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475828+0000","last_became_peered":"2024-04-19T02:17:12.475828+0000","last_unstale":"2024-04-19T02:17:38.365947+0000","last_undegraded":"2024-04-19T02:17:38.365947+0000","last_fullsized":"2024-04-19T02:17:12.466404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:19.851029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":44,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.368717+0000","last_change":"2024-04-19T02:17:12.472468+0000","last_active":"2024-04-19T02:17:38.368717+0000","last_peered":"2024-04-19T02:17:38.368717+0000","last_clean":"2024-04-19T02:17:09.446016+0000","last_became_active":"2024-04-19T02:17:12.472468+0000","last_became_peered":"2024-04-19T02:17:12.472468+0000","last_unstale":"2024-04-19T02:17:38.368717+0000","last_undegraded":"2024-04-19T02:17:12.467641+0000","last_fullsized":"2024-04-19T02:17:12.467537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:19.904265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.365181+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:17:38.365181+0000","last_peered":"2024-04-19T02:17:38.365181+0000","last_clean":"2024-04-19T02:17:38.365181+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:17:38.365181+0000","last_undegraded":"2024-04-19T02:17:38.365181+0000","last_fullsized":"2024-04-19T02:17:38.365181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":37,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:17:38.369472+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:17:38.369472+0000","last_peered":"2024-04-19T02:17:38.369472+0000","last_clean":"2024-04-19T02:17:38.369472+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:17:38.369472+0000","last_undegraded":"2024-04-19T02:17:38.369472+0000","last_fullsized":"2024-04-19T02:17:38.369472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2024-04-19T02:17:38.365398+0000","last_change":"2024-04-19T02:17:12.473290+0000","last_active":"2024-04-19T02:17:38.365398+0000","last_peered":"2024-04-19T02:17:38.365398+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473290+0000","last_became_peered":"2024-04-19T02:17:12.473290+0000","last_unstale":"2024-04-19T02:17:38.365398+0000","last_undegraded":"2024-04-19T02:17:38.365398+0000","last_fullsized":"2024-04-19T02:17:12.466109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:51.600518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":45,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:38.369015+0000","last_change":"2024-04-19T02:17:12.477858+0000","last_active":"2024-04-19T02:17:38.369015+0000","last_peered":"2024-04-19T02:17:38.369015+0000","last_clean":"2024-04-19T02:17:07.003600+0000","last_became_active":"2024-04-19T02:17:12.477858+0000","last_became_peered":"2024-04-19T02:17:12.477858+0000","last_unstale":"2024-04-19T02:17:38.369015+0000","last_undegraded":"2024-04-19T02:17:12.470203+0000","last_fullsized":"2024-04-19T02:17:12.469946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.701657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":88,"acting":88,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738391,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":167216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":339968,"data_stored":699288,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738392,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":454656,"data_stored":763657,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:17:48.920 INFO:tasks.thrashosds.thrasher:Setting 4.3a to [1, 0] 2024-04-19T02:17:48.920 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.3a', '1', '0'] 2024-04-19T02:17:48.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.3a 1 0 2024-04-19T02:17:49.010 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:49.010+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:49.050 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:49.050 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:49.050 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:49.050 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:49.064 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:49.149 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:49.150+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:49.211 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:49.210+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:49.221 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:49.221 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:49.221 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:49.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:49.313 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:49.312+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.910193062000005, 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.402 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.403 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:49.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:49.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:49.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.410 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.910074679999994, 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.411 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:49.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.910005679999998, 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:49.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:49.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.909875463999995, 2024-04-19T02:17:49.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:49.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:49.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.909795912000007, 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:49.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:49.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:49.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:49.433 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.909700469000001, 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:49.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:49.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.909619563000007, 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.439 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.909151734000005, 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.443 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:49.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.909091027000002, 2024-04-19T02:17:49.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:49.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:49.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.901938705999996, 2024-04-19T02:17:49.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:49.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.455 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.892015925999999, 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:49.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.459 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.891664569, 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:49.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.891101649000007, 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:49.463 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:49.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.891002114000003, 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:49.467 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:49.471 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.88029865, 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:49.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:49.475 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.878666065000004, 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:49.479 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.877732886000004, 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:49.483 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.877606557000007, 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:49.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:49.488 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.877343072000002, 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:49.492 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.208245891000004, 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:49.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:49.498 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:49.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:49.501 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:49.500+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:49.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:49.601 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:49.600+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:49.634 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:49.634 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:49.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:49.701 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:49.702+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:49.801 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-19T02:17:49.802 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:49.802+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:49.813 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:49.814 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:49.826 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:49.903 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:49.902+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.392849846000004, 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.392457578000005, 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.391987775999993, 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.391050715999995, 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.390735108000001, 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.390286085, 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.389697229000006, 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454890800000001, 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454792314000002, 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454724658000004, 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454672701999996, 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454618705000001, 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454563999000001, 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454510439000003, 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454454487000007, 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.454406090000006, 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.444269954999996, 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.440262908999998, 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:50.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:50.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:50.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:50.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:50.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:50.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:50.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:50.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:50.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:50.048 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.048 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.048 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.049 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:50.049 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:50.049 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.440204876999999, 2024-04-19T02:17:50.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:50.050 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.050 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.050 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:50.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 85.439736332999999, 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:50.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:50.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:50.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:50.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:50.059 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.060 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:50.060 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:50.060 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:50.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:50.062 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:50.062+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:50.162 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:50.164+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:50.190 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:50.190 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:50.191 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:50.191 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:50.206 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:50.263 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:50.264+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:50.328 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:50.328 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:50.329 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:50.329 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:50.329 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:50.342 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:50.389 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:50.390+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:50.408 INFO:teuthology.orchestra.run.smithi073.stderr:set 4.3a pg_upmap mapping to [1,0] 2024-04-19T02:17:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:17:50.465 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.971520850999994, 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:50.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:50.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:50.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:50.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:50.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:50.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:50.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:50.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:50.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:50.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:50.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:50.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:50.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:50.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:50.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:50.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:50.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:50.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:50.477 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.477 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.477 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.971402468999997, 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:50.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.483 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.971333469000001, 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:50.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:50.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:50.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:50.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:50.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:50.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:50.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:50.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:50.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.492 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.492 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.492 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.492 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.971203252999999, 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:50.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:50.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:50.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:50.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:50.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:50.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:50.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:50.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:50.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:50.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:50.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:50.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:50.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:50.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:50.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:50.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:50.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:50.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:50.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:50.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:50.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:50.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:50.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:50.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.504 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.505 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.505 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:50.505 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.971123700999996, 2024-04-19T02:17:50.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:50.506 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.506 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.506 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:50.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:50.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:50.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:50.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:50.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:50.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:50.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:50.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:50.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:50.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:50.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:50.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:50.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:50.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:50.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:50.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:50.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:50.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:50.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:50.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:50.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.516 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.517 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.517 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:50.518 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.971028258000004, 2024-04-19T02:17:50.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:50.518 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.518 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.518 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:50.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:50.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:50.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:50.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:50.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:50.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.526 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.970947351999996, 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.970479522999995, 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.970418816000006, 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.963266494999999, 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.953343715000003, 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.952992358000003, 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.952429437999996, 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.952329903000006, 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.941626439000004, 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.939993853999994, 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.939060674999993, 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.938934345999996, 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.938670861000006, 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.269573679999993, 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:50.590 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:50.590+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:50.590 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:50.691 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:50.688+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:50.720 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:50.720 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:50.720 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:50.720 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:50.734 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:50.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:50.823 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:50.824+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:50.893 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:50.894+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:50.898 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:50.898 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:50.898 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:50.898 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:50.898 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:50.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:50.959 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:50.992 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:50.992 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:50.996 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:50.996 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:50.999 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:51.000+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:51.080 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.080 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:51.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:51.096 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:51.094+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:51.195 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:51.196+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:51.226 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.227 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:51.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:51.296 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:51.294+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:51.358 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.359 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:51.373 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:51.418 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:51.418+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:51.498 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:51.496+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:51.539 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.539 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:51.554 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:51.603 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:51.604+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:51.699 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:51.700+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:51.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:51.800 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:51.800+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:51.870 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.870 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:51.882 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:51.901 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:51.902+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:52.001 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:52.000+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:52.045 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.045 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:52.103 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:52.104+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:52.193 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.193 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.203 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:52.204+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:52.207 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:52.304 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:52.302+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:52.323 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.323 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:52.406 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:52.404+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:52.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:52.507 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:52.506+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:52.511 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.511 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:52.608 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:52.606+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:52.656 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.657 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:52.715 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:52.716+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:52.794 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.795 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.807 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:52.851 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:52.852+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:52.910 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:52.908+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:52.974 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.974 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.988 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:52.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:53.037 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:53.038+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:53.112 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:53.112+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:53.120 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:53.120 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:53.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:53.193 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:53.194 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:53.194 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:53.223 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:53.223 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:53.225 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:53.226+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:53.226 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:53.227 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:53.298 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:53.298 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:53.298 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:53.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:53.314 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:53.312+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:53.415 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:53.416+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:17:53.478 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:53.478 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:53.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:53.478 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:53.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.478 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.478 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.986538717000002, 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:53.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:53.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.986420335000005, 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:53.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:53.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.490 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.986351334999995, 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.986221119000007, 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.496 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:53.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:53.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:53.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.986141567000004, 2024-04-19T02:17:53.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:53.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:53.509 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.986046123999998, 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:53.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:53.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.985965218000004, 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:53.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:53.519 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.985497389000002, 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:53.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:53.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:53.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:53.524 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.985436682, 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:53.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:53.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.978284360999993, 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.529 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:53.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.968361580999996, 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:53.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.537 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.968010223999997, 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:53.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.967447304000004, 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:53.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.967347769, 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.546 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:53.550 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.956644304999998, 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.554 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.955011720000002, 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.954078541000001, 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:53.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:53.563 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.953952212000004, 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:53.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:53.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.953688726999999, 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:53.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:53.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 83.284591546000001, 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:53.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:53.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:53.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:53.578 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:53.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:53.580 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:53.580+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:53.681 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:53.678+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:53.708 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:53.708 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:53.708 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:53.708 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:53.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:53.782 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:53.782+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:53.846 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:53.846 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:53.846 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:53.846 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:53.846 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:53.860 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:53.903 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:53.904+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:53.980 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.428023738999997, 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.427631470999998, 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.427161669, 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.426224609000002, 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.425909000999994, 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.425459978000006, 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.424871121999999, 2024-04-19T02:17:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.490064692999994, 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489966206999995, 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489898550999996, 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489846595000003, 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489792597999994, 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489737891999994, 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.041 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:54.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:54.046 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489684331999996, 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:54.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.052 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489628379999999, 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:54.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.489579982999999, 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:54.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:54.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.479443848000003, 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:54.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.475436802000004, 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.475378770000006, 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:54.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:54.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:54.074 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 89.474910226000006, 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:54.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:54.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:54.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.079 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:54.079 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:54.079 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:54.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:54.081 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:54.080+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:54.182 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:54.182+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:54.211 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:54.211 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:54.211 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:54.211 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:54.225 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:54.313 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:54.314+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:54.383 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:54.382+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:54.390 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:54.390 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:54.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:54.493 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:54.494+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:54.571 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:54.571 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:54.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:54.571 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:54.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.571 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.077565867999994, 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:54.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:54.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.077447485999997, 2024-04-19T02:17:54.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:54.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:54.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:54.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.585 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.585 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:54.585 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.077378486000001, 2024-04-19T02:17:54.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:54.585 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.586 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.586 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:54.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:54.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:54.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:54.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:54.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.077248269999998, 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.593 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.594 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:54.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:54.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.077168717999996, 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:54.600 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:54.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:54.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:54.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:54.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:54.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.077073275000004, 2024-04-19T02:17:54.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:54.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:54.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:54.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.614 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.076992368999996, 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:54.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.619 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.076524539999994, 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:54.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:54.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.624 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.076463833000005, 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:54.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:54.629 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.069311511999999, 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:54.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.634 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.059388732000002, 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:54.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.638 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.059037375000003, 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:54.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.058474454999995, 2024-04-19T02:17:54.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:54.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:54.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.058374920000006, 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:54.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.047671456000003, 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:54.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.046038870999993, 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:54.657 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:54.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.661 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.045105692000007, 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:54.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.666 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.044979362999996, 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:54.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.671 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.044715878000005, 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:54.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:54.676 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.375618696999993, 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:54.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:54.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:54.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:54.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:54.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:54.683 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:54.685 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:54.682+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:54.685 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:54.785 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:54.786+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:54.818 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:54.818 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:54.818 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:54.818 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:54.834 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:54.886 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:54.884+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:54.956 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:54.957 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:54.970 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:54.988 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:54.986+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:55.089 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:55.088+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.584496451000007, 2024-04-19T02:17:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.584104182999994, 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.583634380999996, 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.582697320999998, 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:55.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.582381713000004, 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.155 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.156 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:55.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:55.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.581932690000002, 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:55.161 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:55.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.165 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.581343833999995, 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646537405000004, 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646438919000005, 2024-04-19T02:17:55.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646371263000006, 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:55.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:55.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646319306999999, 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:55.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.191 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646265310000004, 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:55.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:55.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:55.197 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646210604000004, 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.202 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646157044000006, 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:55.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:55.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:55.208 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646101091999995, 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:55.212 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.646052694999995, 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:55.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.635916559999998, 2024-04-19T02:17:55.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:55.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.631909514, 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:55.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:55.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:55.225 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.631851482000002, 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:55.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:55.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.631382938000002, 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:55.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:55.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:55.234 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:55.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:55.236 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:55.234+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:55.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:55.337 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:55.334+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:55.369 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:55.369 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:55.371 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:55.371 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:55.371 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:55.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:55.390 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:55.391 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:55.393 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:55.393 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:55.438 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:17:55.439 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:55.439 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T02:17:55.439 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:17:55.439 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:17:55.439 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T02:17:55.457 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:55.473 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:55.474+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:55.538 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:55.538+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:55.548 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:55.548 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:55.562 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:55.569 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "" 2024-04-19T02:17:55.569 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:55.600 INFO:tasks.workunit.client.0.smithi073.stderr:Updating files: 97% (12206/12484) Updating files: 98% (12235/12484) Updating files: 99% (12360/12484) Updating files: 100% (12484/12484) Updating files: 100% (12484/12484), done. 2024-04-19T02:17:55.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-19T02:17:55.639 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:55.640+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:55.728 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:55.728 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:55.740 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:55.740+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:55.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:55.841 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:55.838+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:55.868 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:55.868 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:55.882 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:55.941 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:55.940+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:55.998 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:55.999 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:56.014 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:56.055 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:56.056+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:56.142 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:56.140+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:56.177 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:56.177 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:56.191 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:56.243 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:56.242+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:56.321 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:56.321 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:56.335 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:56.344 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:56.344+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:56.393 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'. 2024-04-19T02:17:56.393 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-19T02:17:56.394 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-04-19T02:17:56.395 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-19T02:17:56.395 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-19T02:17:56.395 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-19T02:17:56.395 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 646b8c7d293 Merge pull request #56968 from zdover23/wip-doc-2024-04-18-backport-56879-to-reef 2024-04-19T02:17:56.401 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-19T02:17:56.407 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-19T02:17:56.411 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-19T02:17:56.411 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-19T02:17:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:17:56.444 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:56.442+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:56.500 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:56.500 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:56.515 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:56.557 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:56.558+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:56.649 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:56.646+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:56.680 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:56.680 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:56.696 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:56.748 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:56.746+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:56.827 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:56.827 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:56.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:56.850 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:56.850+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:56.951 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:56.952+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:56.964 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:56.965 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:56.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:57.068 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:57.068+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:57.148 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:57.148 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:57.153 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:57.154+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:57.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:57.177 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-19T02:17:57.247 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-19T02:17:57.254 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:57.254+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:57.290 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-19T02:17:57.291 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:57.291 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:57.292 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-19T02:17:57.292 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-19T02:17:57.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:57.338 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-19T02:17:57.342 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:17:57.342 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-19T02:17:57.347 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-19T02:17:57.349 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-19T02:17:57.349 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=646b8c7d293d8ec31a40c69f7b3237b19c1be24d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-19T02:17:57.354 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:57.356+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:57.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:57.398 INFO:tasks.workunit.client.0.smithi073.stderr:+ mkdir -p fsstress 2024-04-19T02:17:57.402 INFO:tasks.workunit.client.0.smithi073.stderr:+ pushd fsstress 2024-04-19T02:17:57.403 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-19T02:17:57.403 INFO:tasks.workunit.client.0.smithi073.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-19T02:17:57.456 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:57.456+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:57.471 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:57.471 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:57.485 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:57.538 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:57.539 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:57.539 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:57.555 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:57.556 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:57.554+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:57.559 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:57.559 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:57.612 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.119342650999997, 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:57.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:57.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:57.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.119224269, 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.619 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:57.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:57.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:57.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:57.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.119155269000004, 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:57.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:57.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.119025053000001, 2024-04-19T02:17:57.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:57.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:57.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:57.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.118945500999999, 2024-04-19T02:17:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:57.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:57.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:57.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.118850058000007, 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:57.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.118769151999999, 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:57.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:57.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.118301322999997, 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:57.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:57.663 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.118240615999994, 2024-04-19T02:17:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:57.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:57.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:57.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:57.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.672 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.111088295000002, 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:57.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:57.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:57.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:57.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.679 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.101165515000005, 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:57.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:57.683 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.100814158000006, 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:57.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.100251237999998, 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.687 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.100151702999995, 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.691 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.089448239000006, 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:57.695 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:57.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.087815653999996, 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:57.699 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.086882474999996, 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.703 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:57.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:57.707 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.086756145999999, 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:57.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.086492660999994, 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:57.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 87.417395479999996, 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:57.716 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:57.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:57.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:57.721 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:57.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:57.724 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:57.720+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:57.824 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:57.824+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:57.853 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:57.853 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:57.853 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:57.853 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:57.868 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:57.959 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:57.960+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:58.026 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:58.026+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:58.033 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:58.033 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:58.034 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:58.034 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:58.034 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:58.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:58.139 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:58.140+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:58.213 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.662678769, 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.662286501, 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.661816699, 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.660879639, 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.66056403100001, 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.66011500800001, 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.659526152, 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724719723000007, 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724621236999994, 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724553580999995, 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724501625000002, 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724447627999993, 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724392922000007, 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724339361999995, 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724283409999998, 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.724235012999998, 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.714098878000001, 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.710091832000003, 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:58.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:58.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.710033800000005, 2024-04-19T02:17:58.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:58.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.316 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 93.709565256000005, 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:58.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.320 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:58.321 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:58.321 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:58.322 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:58.323 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:58.320+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:58.427 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:58.426+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:58.454 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:58.454 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:58.454 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:58.454 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:58.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:58.468 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:58.553 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:58.554+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:58.628 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:58.626+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:58.631 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:17:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:17:58.632 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:58.646 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:58.729 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:58.728+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:58.813 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.320743879000005, 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:58.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:17:58.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:17:58.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.320625496999995, 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:17:58.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:17:58.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:17:58.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.320556496999998, 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:17:58.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:58.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.830 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.320426280999996, 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:17:58.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:17:58.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:17:58.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:17:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.320346728999994, 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:17:58.842 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.320251286000001, 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:58.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:17:58.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:17:58.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.320170379999993, 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:17:58.848 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.319702551000006, 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:58.852 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:58.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:17:58.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:17:58.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.319641844000003, 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:17:58.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:17:58.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.312489522999996, 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:17:58.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:17:58.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.302566743, 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.302215386, 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.868 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.871 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.301652465999993, 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:58.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.875 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.301552931000003, 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:58.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:17:58.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.290849467000001, 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:17:58.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:17:58.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.289216882000005, 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:17:58.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.288283703000005, 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.887 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:17:58.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.288157373999994, 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:17:58.895 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.287893889000003, 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:58.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.618796708000005, 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:17:58.900 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:17:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:17:58.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:17:58.905 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:58.907 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:58.908 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:58.908+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:59.008 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:59.008+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:59.037 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:59.037 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:59.038 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:17:59.038 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:59.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:59.109 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:59.110+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:59.210 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:59.208+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:59.216 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:59.216 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:17:59.217 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:17:59.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:17:59.217 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:59.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:59.319 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:59.320+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.842595884, 2024-04-19T02:17:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:17:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:17:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.84220361600001, 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:17:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.84173381399999, 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:17:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.840796754, 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:17:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:17:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:17:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:17:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.840481146, 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:17:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:17:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:17:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:17:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:17:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:17:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:17:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:17:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:17:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:17:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:17:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:17:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.840032123, 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:17:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.83944326700001, 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904636838000002, 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:17:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:17:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904538352000003, 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:17:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:17:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:17:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904470696000004, 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:17:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904418739999997, 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:17:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:17:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:17:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904364743000002, 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:17:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904310037000002, 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:17:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:17:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904256477000004, 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:17:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:17:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:17:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904200524999993, 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:17:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.904152128000007, 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:17:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:17:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.894015992999996, 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:17:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:17:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.890008946999998, 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.889950915, 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 94.889482371, 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:17:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:17:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:17:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:17:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:17:59.503 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:17:59.505 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:17:59.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:59.506 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:59.504+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:59.559 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:59.605 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:59.602+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:59.634 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:17:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:17:59.635 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:17:59.635 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:17:59.649 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:59.715 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:17:59.715 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:59.715 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:17:59.733 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:17:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:59.736 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:59.737 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:59.741 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:17:59.742+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:17:59.807 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:59.808+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:59.813 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:59.813 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:59.828 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:59.908 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:17:59.908+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:17:59.996 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:59.996 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:00.009 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:00.006+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:00.012 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:00.110 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:00.108+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:00.144 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:00.144 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:00.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:00.255 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:00.256+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:00.312 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:00.310+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:00.331 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:00.331 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:00.346 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:00.413 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:00.410+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:00.505 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:00.506 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:00.514 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:00.514+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:00.520 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:00.584 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:18:00.584 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:18:00.584 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T02:18:00.584 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:18:00.584 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:18:00.585 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T02:18:00.615 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:00.614+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:00.651 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:00.651 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:00.666 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:00.709 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "" 2024-04-19T02:18:00.709 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:00.757 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:00.758+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:00.817 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:00.816+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:00.829 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:00.829 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:00.843 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:00.929 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:00.930+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:01.008 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:01.008 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:01.019 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:01.016+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:01.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:01.119 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:01.118+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:01.152 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:01.152 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:01.167 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:01.220 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:01.222+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:01.294 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:01.294 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:01.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:01.321 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:01.322+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:01.422 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:01.420+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:01.426 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:01.426 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:01.440 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:01.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-19T02:18:01.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:18:01.522 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:01.522+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:01.570 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:01.570 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:01.584 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:01.630 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:01.630+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:01.724 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:01.724+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:01.738 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:01.752 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:01.753 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:01.766 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:01.825 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:01.824+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:01.881 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:01.882 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:01.882 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:01.888 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:18:01.898 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:01.906 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:01.909 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:01.910 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:01.947 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:01.948+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.027 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.024+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.029 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:02.029 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:02.029 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:02.029 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:02.043 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:02.131 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.132+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.211 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:02.212 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:02.212 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:02.212 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:02.212 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:02.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:02.272 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.272+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.330 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.328+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.396 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:02.396 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 105.845624308, 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:02.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.401 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 105.84523204, 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:02.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 105.844762238, 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.407 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:18:02.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:18:02.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:18:02.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 105.843825178, 2024-04-19T02:18:02.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:18:02.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 105.84350956999999, 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:18:02.419 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 105.84306054699999, 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 105.842471691, 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:18:02.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:18:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907665261999995, 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:18:02.428 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.433 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907566775999996, 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:02.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:18:02.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:18:02.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907499119999997, 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:18:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:18:02.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:02.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907447164000004, 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:18:02.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:18:02.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.449 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907393166999995, 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:02.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.454 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907338460999995, 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:02.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:18:02.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:18:02.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:02.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907284900999997, 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:18:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:18:02.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:18:02.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907228949, 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:18:02.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.907180552, 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.469 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.897044417000004, 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.473 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:18:02.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:18:02.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.893037371000005, 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.477 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:02.481 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.892979338999993, 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:18:02.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:18:02.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 97.892510795000007, 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:18:02.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:02.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:02.490 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:02.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:02.492 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.492+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.592 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.592+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.621 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:02.621 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:02.621 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:02.621 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:02.635 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:02.692 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.692+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.749 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:02.750 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:02.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:02.793 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:02.792+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.389087703000001, 2024-04-19T02:18:02.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:18:02.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:18:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:18:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:18:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:18:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.388969321000005, 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:18:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:18:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:18:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.388900320999994, 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:18:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:18:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.388770105000006, 2024-04-19T02:18:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:18:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:18:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.388690553000004, 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:18:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:18:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:18:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.388595109999997, 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:18:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.388514204000003, 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.388046375000002, 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:18:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.387985667999999, 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.380833347000006, 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.370910566999996, 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:18:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:18:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:18:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:18:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:18:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:18:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.370559209999996, 2024-04-19T02:18:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:18:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:18:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:18:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:18:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:18:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:18:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:18:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:18:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:18:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:18:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:18:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.369996290000003, 2024-04-19T02:18:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:18:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.369896754999999, 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:18:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.359193290999997, 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:18:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:18:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.357560706000001, 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:18:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:18:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.356627527000001, 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.356501198000004, 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:18:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.356237712999999, 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 92.687140532000001, 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:18:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:18:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:18:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:18:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:18:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:02.988 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:02.989 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:02.990+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:02.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:03.091 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:03.090+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:03.121 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:03.121 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:03.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:03.122 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:03.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:03.192 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:03.190+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:03.262 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:03.262 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:03.262 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:03.262 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:03.263 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:03.276 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:03.323 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:03.324+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:03.393 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:03.392+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:03.401 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 106.849518078, 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:18:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:18:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 106.84912581, 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:18:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:18:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:18:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:18:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 106.84865600800001, 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:18:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:18:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:18:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:18:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 106.84771894799999, 2024-04-19T02:18:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:18:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:18:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 106.84740334, 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:18:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:18:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 106.846954317, 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:18:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 106.846365461, 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911559032, 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911460546000001, 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:18:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:18:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:18:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911392890000002, 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911340933999995, 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911286937, 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:18:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:18:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:18:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911232231, 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:18:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:18:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911178671000002, 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:18:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911122719000005, 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.911074322000005, 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.900938186999994, 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:18:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.896931140999996, 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:18:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:18:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.896873108999998, 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:18:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 98.896404564999997, 2024-04-19T02:18:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:18:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:18:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:03.505 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:03.507 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:03.507 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:03.506+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:03.608 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:03.606+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:03.637 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:03.637 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:03.637 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:03.638 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:03.652 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:03.709 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:03.708+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:03.810 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:03.810+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:03.820 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:03.820 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:03.821 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:03.821 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:03.835 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:03.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:18:03.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:03.921 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:03.922+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.507544327000005, 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:18:04.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:18:04.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.507425944999994, 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:18:04.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.507356944999998, 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.012 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.017 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.507226728999996, 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:18:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.507147176999993, 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.023 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:18:04.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.028 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.507051734000001, 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:04.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.506970827999993, 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:18:04.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:18:04.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.037 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.506502999000006, 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:04.041 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.506442292000003, 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:04.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:18:04.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.499289970999996, 2024-04-19T02:18:04.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:18:04.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.049 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.489367190999999, 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:04.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.489015834, 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.056 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.488452914000007, 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:04.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:18:04.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.488353379000003, 2024-04-19T02:18:04.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.477649915000001, 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:04.064 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:04.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:18:04.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.476017330000005, 2024-04-19T02:18:04.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:04.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.475084151000004, 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:18:04.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:18:04.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.474957821999993, 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:18:04.076 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:04.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 99.474694337000003, 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:18:04.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:18:04.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 93.805597156000005, 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:04.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.089 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:04.090 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:04.090 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:04.091 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:04.091 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:04.092 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:04.092 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.090+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:04.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:04.095 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:04.095 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:04.192 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.194+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.223 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:04.223 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:04.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:04.294 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.294+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.359 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:04.360 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:04.374 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:04.395 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.394+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.491 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:04.492 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:04.496 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.494+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:04.597 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.598+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.635 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:04.635 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:04.649 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:04.741 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.742+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.799 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.798+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.814 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:04.814 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:04.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:04.917 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:04.918+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:04.997 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:04.997 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:05.001 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:05.000+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:05.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:05.102 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:05.102+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:05.110 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:18:05.146 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:05.146 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:05.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:05.203 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:05.204+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:05.280 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:05.280 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:05.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:05.340 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:05.340+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:05.404 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:05.404+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:05.461 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:05.461 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:05.476 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:05.522 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:05.521+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:05.606 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:05.607 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:05.607 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:05.605+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:05.622 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:05.709 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:05.709+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:05.724 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:18:05.724 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:18:05.724 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T02:18:05.725 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-04-19T02:18:05.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-04-19T02:18:05.788 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:05.789 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:05.803 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:05.846 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:05.845+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:05.910 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:05.908+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:05.960 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:05.961 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:05.975 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:06.020 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:06.020+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:06.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:06.173 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.1 primary-affinity to 0 (802) 2024-04-19T02:18:06.173 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:06.173 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:06.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:06.174 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:06.172+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:06.274 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:06.272+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:06.343 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:06.343 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:06.357 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:06.365 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:06.365 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:06.365 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:06.385 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:06.386 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:06.389 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:06.389 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:06.400 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:06.400+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:06.476 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:06.473+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:06.525 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:06.525 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.972945701, 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:18:06.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:18:06.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.972553433, 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:18:06.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:18:06.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.972083631, 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:18:06.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.97114657100001, 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:06.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.970830963, 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:18:06.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:18:06.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:18:06.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.97038194, 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:18:06.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:18:06.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:06.554 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.969793084, 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:06.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:18:06.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.034986655, 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.559 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:18:06.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:18:06.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.564 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.034888169, 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:06.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:18:06.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.034820513, 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:06.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:18:06.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.03476855700001, 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:18:06.576 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:18:06.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.581 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.03471456, 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:18:06.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:06.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:18:06.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.034659854, 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.034606294, 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:18:06.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:18:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:06.599 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.034550342, 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:18:06.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.034501945, 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:18:06.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.02436581000001, 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.608 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:18:06.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.02035876399999, 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:06.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:18:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.020300732, 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:18:06.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 102.019832188, 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:18:06.622 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:06.623 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:06.623 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:06.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:18:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:18:06.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:06.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:18:06.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:18:06.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.630 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:06.630 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:06.630 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:06.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:06.632 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:06.629+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:06.732 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:06.732+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:06.763 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:06.763 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:06.763 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:06.763 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:06.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:06.834 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:06.832+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:06.897 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:06.897 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:06.898 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:06.898 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:06.898 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:06.911 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:06.958 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:06.957+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:07.031 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:07.031 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.538045514, 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:07.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:18:07.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.037 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.53792713199999, 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:18:07.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.043 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.537858132, 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:18:07.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:18:07.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.049 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.53772791599999, 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:18:07.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:18:07.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:18:07.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.53764836400001, 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:07.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:18:07.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:18:07.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.537552921, 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:18:07.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:18:07.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.067 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.53747201500001, 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:07.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:18:07.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.537004186, 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:18:07.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.536943479, 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.076 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:18:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:07.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.52979115799999, 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:18:07.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.084 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.519868378, 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:07.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.519517021, 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:18:07.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.092 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.51895410100001, 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:07.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:18:07.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:18:07.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.518854566, 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:18:07.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.508151102, 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.101 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:18:07.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:18:07.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.506518517, 2024-04-19T02:18:07.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:18:07.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.505585338, 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:18:07.109 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:18:07.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:18:07.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.113 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.50545900900001, 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:18:07.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:18:07.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.505195524, 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.122 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 96.836098343000003, 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:07.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:18:07.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:18:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:07.128 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:07.130 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:07.129+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:07.130 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:07.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:18:07.230 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:07.227+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:07.259 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:07.259 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:07.260 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:07.260 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:07.274 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:07.359 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:07.359+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:07.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-19T02:18:07.432 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:07.431+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:07.438 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:07.438 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:07.438 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:07.438 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:07.438 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:07.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:07.543 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:07.543+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:07.624 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:07.624 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:07.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:07.624 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:07.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:135 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'93, mlcod=10'86)", 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.07198806, 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087097159999999993, 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550801+0000", 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550800+0000", 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550813+0000", 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550836+0000", 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2405999999999999e-05 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.550851+0000", 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5786000000000001e-05 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552760+0000", 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019082929999999999 2024-04-19T02:18:07.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552796+0000", 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559457+0000", 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066606449999999998 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559511+0000", 2024-04-19T02:18:07.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4321999999999999e-05 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.071595792, 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083537750000000008, 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551193+0000", 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551192+0000", 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551205+0000", 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2660000000000001e-05 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551232+0000", 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7603e-05 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551249+0000", 2024-04-19T02:18:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6368999999999999e-05 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553552+0000", 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023034370000000002 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553586+0000", 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3729000000000002e-05 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559516+0000", 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059305110000000003 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559547+0000", 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0743e-05 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2024-04-19T02:18:07.633 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.07112599, 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084966009999999995, 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551663+0000", 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551658+0000", 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999948 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551713+0000", 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999999e-05 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551730+0000", 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6796e-05 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.551740+0000", 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554340+0000", 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002599344 2024-04-19T02:18:07.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554377+0000", 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7512999999999998e-05 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560083+0000", 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057061689999999997 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.560160+0000", 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6412e-05 2024-04-19T02:18:07.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.07018893, 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099081800000000008, 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552600+0000", 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552599+0000", 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552612+0000", 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3424000000000001e-05 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552639+0000", 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.711e-05 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552651+0000", 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2009e-05 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556844+0000", 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041923439999999998 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.556876+0000", 2024-04-19T02:18:07.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2360000000000002e-05 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562433+0000", 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055572570000000003 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562508+0000", 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5222999999999995e-05 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:139 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'97, mlcod=10'87)", 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.06987332200001, 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.009626875, 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552916+0000", 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552915+0000", 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552928+0000", 2024-04-19T02:18:07.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3176999999999999e-05 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552950+0000", 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.552966+0000", 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6062999999999999e-05 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557437+0000", 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044708789999999997 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557480+0000", 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259e-05 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562514+0000", 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050337109999999997 2024-04-19T02:18:07.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562543+0000", 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9030000000000002e-05 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:140 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'98, mlcod=10'87)", 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.069424299, 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092052690000000003, 2024-04-19T02:18:07.647 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553365+0000", 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553363+0000", 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553510+0000", 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014625200000000001 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553530+0000", 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:18:07.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553542+0000", 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1446e-05 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557965+0000", 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044237060000000003 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.557997+0000", 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1458999999999998e-05 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562545+0000", 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045476550000000003 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.562570+0000", 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5534e-05 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4148.0:141 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'99, mlcod=10'87)", 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.068835443, 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011197258999999999, 2024-04-19T02:18:07.652 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553954+0000", 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553952+0000", 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553966+0000", 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.553993+0000", 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.554030+0000", 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6176000000000001e-05 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559590+0000", 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055600470000000003 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.559623+0000", 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3492999999999999e-05 2024-04-19T02:18:07.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565081+0000", 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054577849999999997 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:16.565151+0000", 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0139e-05 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.13402901400001, 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034480121000000002, 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488760+0000", 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488757+0000", 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488775+0000", 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8485999999999999e-05 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488805+0000", 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0006e-05 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488831+0000", 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.516e-05 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499424+0000", 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010593791999999999 2024-04-19T02:18:07.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499683+0000", 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025823799999999999 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499952+0000", 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026907800000000001 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505676+0000", 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057240590000000001 2024-04-19T02:18:07.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522655+0000", 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016978798999999999 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.522784+0000", 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012928200000000001 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523240+0000", 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045638699999999999 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.13393052799999, 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.662 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:18:07.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:18:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.13386287199999, 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034470600999999997, 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488926+0000", 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488925+0000", 2024-04-19T02:18:07.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488933+0000", 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488952+0000", 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9596e-05 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488966+0000", 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.383e-05 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501107+0000", 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01214109 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501333+0000", 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022529200000000001 2024-04-19T02:18:07.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501679+0000", 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034662000000000001 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507767+0000", 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060876760000000002 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523182+0000", 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015415565000000001 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523307+0000", 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012496499999999999 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523397+0000", 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999995e-05 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.673 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.133810916, 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:18:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.679 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.13375691900001, 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029528095000000001, 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489032+0000", 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489031+0000", 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489038+0000", 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7139999999999996e-06 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489059+0000", 2024-04-19T02:18:07.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489072+0000", 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2999999999999999e-05 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496039+0000", 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069666470000000003 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496499+0000", 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046029600000000001 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.496802+0000", 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030243400000000003 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501301+0000", 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044991989999999997 2024-04-19T02:18:07.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.517626+0000", 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016324897000000001 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518466+0000", 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084053600000000002 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.518560+0000", 2024-04-19T02:18:07.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4110000000000005e-05 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.13370221300001, 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030671699, 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489087+0000", 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489086+0000", 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489092+0000", 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.64e-06 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489113+0000", 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0863e-05 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489127+0000", 2024-04-19T02:18:07.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3157e-05 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499029+0000", 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099028439999999992 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499262+0000", 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023244499999999999 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499610+0000", 2024-04-19T02:18:07.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034801999999999999 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.505475+0000", 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058653250000000002 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519410+0000", 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013934904999999999 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519657+0000", 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024736499999999999 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.519759+0000", 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101252 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.690 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.13364865299999, 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:18:07.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.133592701, 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032094812, 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489196+0000", 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489195+0000", 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489201+0000", 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6540000000000004e-06 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489218+0000", 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7232999999999999e-05 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489231+0000", 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3213e-05 2024-04-19T02:18:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.493840+0000", 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046082240000000002 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.494190+0000", 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035042100000000001 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.521291+0000", 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027101224 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:35 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.133544304, 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025130306000000002, 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489245+0000", 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489244+0000", 2024-04-19T02:18:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489259+0000", 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5699999999999999e-05 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489282+0000", 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489297+0000", 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4336e-05 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492540+0000", 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003243138 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.492845+0000", 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030559100000000002 2024-04-19T02:18:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.514375+0000", 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021529711 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.123408169, 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073389859999999996, 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.704 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499381+0000", 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499380+0000", 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499408+0000", 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.847e-05 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499428+0000", 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9259999999999999e-05 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.499441+0000", 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3199e-05 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500741+0000", 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013000240000000001 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.500787+0000", 2024-04-19T02:18:07.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6213e-05 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506631+0000", 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005843974 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506720+0000", 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8865999999999999e-05 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.708 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.119401123, 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076715530000000002, 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503388+0000", 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503387+0000", 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503402+0000", 2024-04-19T02:18:07.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4617000000000001e-05 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503420+0000", 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.806e-05 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503432+0000", 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504091+0000", 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065927499999999997 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504140+0000", 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8693000000000003e-05 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.510992+0000", 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068526000000000004 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511060+0000", 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7376e-05 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:29 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.119343091, 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098556010000000003, 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503446+0000", 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503445+0000", 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503462+0000", 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6317e-05 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503479+0000", 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6952999999999998e-05 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503490+0000", 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506084+0000", 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025939299999999999 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506115+0000", 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0822999999999999e-05 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513235+0000", 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071199760000000001 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513302+0000", 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6948999999999999e-05 2024-04-19T02:18:07.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.118874547, 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072122970000000003, 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:07.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503915+0000", 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503913+0000", 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503925+0000", 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503949+0000", 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3736000000000001e-05 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.503965+0000", 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5659999999999999e-05 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504618+0000", 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065362099999999995 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.504667+0000", 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8510000000000001e-05 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511064+0000", 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006397074 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.511127+0000", 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3202999999999998e-05 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:07.722 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:07.724 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:07.725 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:07.721+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:07.826 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:07.823+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:07.853 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:07.853 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:07.853 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:07.853 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:07.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:07.926 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:07.927+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:07.983 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:07.983 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:07.997 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:08.042 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:08.041+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.629174695, 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.123 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:18:08.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:18:08.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.62905631300001, 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:18:08.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:18:08.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:18:08.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:08.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.628987313, 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:18:08.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:08.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.140 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.62885709699999, 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.62877754500001, 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:18:08.146 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:18:08.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.628682102, 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:18:08.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.62860119600001, 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:08.157 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:18:08.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:18:08.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.628133367, 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:18:08.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.62807266, 2024-04-19T02:18:08.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:18:08.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:08.169 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.62092033899999, 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:18:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 2 lcod 17'1)", 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.610997559, 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058885199999999995, 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509906+0000", 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509905+0000", 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509914+0000", 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3759999999999997e-06 2024-04-19T02:18:08.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.509939+0000", 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4277000000000002e-05 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510054+0000", 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115346 2024-04-19T02:18:08.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510191+0000", 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013737499999999999 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510495+0000", 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030372400000000001 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.610646202, 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.61008328200001, 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:18:08.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:18:08.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.609983747, 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:18:08.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:18:08.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.599280283, 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:18:08.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.193 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.597647698, 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000712237, 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523256+0000", 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523261+0000", 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523276+0000", 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5342999999999999e-05 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523290+0000", 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3380000000000001e-05 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523737+0000", 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044704899999999998 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523968+0000", 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023151500000000001 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.596714519, 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:18:08.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.59658819000001, 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.202 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:18:08.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 103.596324705, 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:18:08.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 97.927227524000003, 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:08.211 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:18:08.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:08.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:08.216 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:08.218 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:18:08.219 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:08.219 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:08.215+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:08.319 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:08.315+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:08.349 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:08.349 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:08.363 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:08.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:08.420 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:08.421+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:08.521 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:08.519+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:08.533 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:08.533 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:08.533 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:08.533 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:08.533 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:08.545 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:08.547 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:08.566 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:08.570 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:08.571 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:08.622 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:08.621+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:08.711 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:08.712 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:08.723 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:08.719+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:08.725 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:08.824 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:08.823+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:08.854 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:08.854 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:08.868 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:08.925 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:08.925+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:08.982 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:08.982 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:08.996 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:09.027 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:09.023+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:09.128 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:09.125+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:09.160 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:09.160 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:09.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:09.229 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:09.225+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:09.304 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:09.304 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:09.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:09.330 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:09.329+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:09.431 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:09.431+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:09.433 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:09.433 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:09.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:09.539 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:09.539+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:09.617 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:09.617 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:09.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:09.634 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:09.633+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:09.735 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:09.733+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:09.763 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:09.763 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:09.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:09.835 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:09.835+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:09.936 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:09.933+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:09.944 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:09.944 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:09.958 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:10.038 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:10.035+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:10.123 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:10.123 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:10.137 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:10.139 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:10.135+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:10.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:18:10.239 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:10.237+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:10.271 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:10.271 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:10.287 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:10.340 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:10.339+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:10.407 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:10.407 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:10.421 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:10.464 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:10.463+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:10.542 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:10.541+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:10.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:10.584 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:10.584 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:10.598 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:10.643 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:10.641+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:10.720 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:10.726 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:10.726 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:10.740 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:10.740 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:10.741 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:10.743 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:10.743 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:10.786 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:10.785+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:10.845 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:10.843+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:10.908 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:10.908 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:10.909 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:10.909 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:10.909 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:10.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:10.966 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:10.965+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:11.037 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:11.037 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:11.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.545128511, 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029848889, 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:11.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491729+0000", 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491727+0000", 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491742+0000", 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5593000000000001e-05 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491773+0000", 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0873000000000001e-05 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491802+0000", 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9144000000000001e-05 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492720+0000", 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091764600000000004 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492998+0000", 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027769099999999999 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493274+0000", 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027589699999999999 2024-04-19T02:18:11.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501708+0000", 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084347220000000004 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521330+0000", 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019621277999999999 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521478+0000", 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014823200000000001 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521578+0000", 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100213 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.545010129, 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030590971000000002, 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491848+0000", 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491846+0000", 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491861+0000", 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5228999999999999e-05 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491885+0000", 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3609999999999999e-05 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491902+0000", 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7370000000000001e-05 2024-04-19T02:18:11.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495370+0000", 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034675470000000001 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495671+0000", 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030150799999999997 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496652+0000", 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0009806350000000001 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502602+0000", 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059506109999999997 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522169+0000", 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019566384999999999 2024-04-19T02:18:11.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522331+0000", 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016177300000000001 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522439+0000", 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107899 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.54494112899999, 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020949580999999998, 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491917+0000", 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491915+0000", 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.491923+0000", 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492013+0000", 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9815000000000007e-05 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492031+0000", 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7929999999999999e-05 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494543+0000", 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002511484 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494868+0000", 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032503099999999999 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.495177+0000", 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030952799999999999 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501733+0000", 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065556219999999997 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512623+0000", 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010890383 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512764+0000", 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014038899999999999 2024-04-19T02:18:11.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512866+0000", 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102562 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.54481091300001, 2024-04-19T02:18:11.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021004073000000002, 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492047+0000", 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492045+0000", 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492055+0000", 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2229999999999996e-06 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492073+0000", 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7923000000000001e-05 2024-04-19T02:18:11.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492086+0000", 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3373000000000001e-05 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.496883+0000", 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047974530000000001 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497107+0000", 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022352799999999999 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.497457+0000", 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034967100000000002 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501746+0000", 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042892299999999998 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512938+0000", 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011192483 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513004+0000", 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5344000000000003e-05 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513051+0000", 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7194999999999998e-05 2024-04-19T02:18:11.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.544731361, 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031541197, 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492126+0000", 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492125+0000", 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492135+0000", 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0407e-05 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492159+0000", 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3703e-05 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492173+0000", 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:18:11.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499314+0000", 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071402439999999996 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499632+0000", 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031889800000000002 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499953+0000", 2024-04-19T02:18:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032019399999999999 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502827+0000", 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002874054 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523438+0000", 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020611132000000001 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523571+0000", 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013351500000000001 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523667+0000", 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6199999999999994e-05 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.544635918, 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030966509999999999, 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492222+0000", 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492220+0000", 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492229+0000", 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2889999999999998e-06 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492249+0000", 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9777000000000001e-05 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492266+0000", 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7632999999999999e-05 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492567+0000", 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030122500000000002 2024-04-19T02:18:11.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492927+0000", 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035945999999999998 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493212+0000", 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028560499999999997 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.498419+0000", 2024-04-19T02:18:11.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052066220000000002 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522913+0000", 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024494387999999999 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523050+0000", 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013651900000000001 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523188+0000", 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013826499999999999 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.544555012, 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031589582999999997, 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492303+0000", 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492301+0000", 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492309+0000", 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492453+0000", 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014476300000000001 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492477+0000", 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3785999999999999e-05 2024-04-19T02:18:11.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494551+0000", 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00207406 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.494874+0000", 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032307800000000003 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523892+0000", 2024-04-19T02:18:11.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029018032999999999 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:34 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.544087183, 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031184360000000001, 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492770+0000", 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492769+0000", 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:11.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492778+0000", 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492799+0000", 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1137000000000001e-05 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492817+0000", 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8519999999999999e-05 2024-04-19T02:18:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500759+0000", 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079417310000000005 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.501061+0000", 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030141500000000003 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.523955+0000", 2024-04-19T02:18:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022894217000000001 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:36 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.544026476, 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017587703999999999, 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492831+0000", 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492830+0000", 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492838+0000", 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2530000000000004e-06 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492856+0000", 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7975999999999999e-05 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.492891+0000", 2024-04-19T02:18:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493001+0000", 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011015599999999999 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.493273+0000", 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027175399999999997 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510419+0000", 2024-04-19T02:18:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017145774999999999 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.53687415500001, 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028676980000000001, 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499984+0000", 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.499982+0000", 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500057+0000", 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4678999999999994e-05 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500084+0000", 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7189999999999999e-05 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500102+0000", 2024-04-19T02:18:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7750000000000001e-05 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500195+0000", 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2769000000000006e-05 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.500240+0000", 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5673000000000001e-05 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502754+0000", 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025137639999999999 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.502851+0000", 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7232999999999996e-05 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T02:18:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.526600018, 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032908809999999998, 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510258+0000", 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510257+0000", 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510271+0000", 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3787e-05 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510304+0000", 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3352999999999997e-05 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510358+0000", 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4271999999999998e-05 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.511718+0000", 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013594239999999999 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513549+0000", 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018307480000000001 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.526037098, 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020627739999999999, 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510821+0000", 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510820+0000", 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510841+0000", 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1189999999999999e-05 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510891+0000", 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9709000000000001e-05 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510907+0000", 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6223999999999999e-05 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512589+0000", 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016819370000000001 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512608+0000", 2024-04-19T02:18:11.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8836000000000001e-05 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512883+0000", 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027571200000000001 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e17/15 ondisk, result = 0)", 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:11.096 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.525937563, 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021405500000000002, 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510920+0000", 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510919+0000", 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510926+0000", 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510943+0000", 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7677e-05 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.510954+0000", 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1123e-05 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512921+0000", 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019665440000000002 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.512931+0000", 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.513061+0000", 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012995899999999999 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.100 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.515234099, 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00083666399999999998, 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521624+0000", 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521623+0000", 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521629+0000", 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4269999999999996e-06 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521659+0000", 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0219999999999999e-05 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.521692+0000", 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2472999999999999e-05 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522134+0000", 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044237299999999997 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522154+0000", 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9556999999999999e-05 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.522460+0000", 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306371 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:26 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.512668335, 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033011640000000001, 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524189+0000", 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524188+0000", 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524201+0000", 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2693e-05 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524219+0000", 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7445999999999999e-05 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524232+0000", 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3692999999999999e-05 2024-04-19T02:18:11.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524319+0000", 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6682999999999997e-05 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524374+0000", 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5282999999999999e-05 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527412+0000", 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373800000000001 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527490+0000", 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8888999999999996e-05 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.512542006, 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003171152, 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524316+0000", 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524315+0000", 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524338+0000", 2024-04-19T02:18:11.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3252999999999999e-05 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524357+0000", 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8850000000000001e-05 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524370+0000", 2024-04-19T02:18:11.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2643000000000001e-05 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524456+0000", 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6015999999999998e-05 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524498+0000", 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2042999999999997e-05 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527397+0000", 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002899521 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527487+0000", 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9516000000000001e-05 2024-04-19T02:18:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 106.512278521, 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029679530000000002, 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.115 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524579+0000", 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524578+0000", 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524590+0000", 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1192999999999999e-05 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524611+0000", 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1178999999999998e-05 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524624+0000", 2024-04-19T02:18:11.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.524936+0000", 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031211800000000001 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.525019+0000", 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2535999999999997e-05 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527494+0000", 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002474881 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:24.527547+0000", 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3276000000000003e-05 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.121 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 100.84318134, 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029283040000000001, 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:11.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193676+0000", 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193674+0000", 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:11.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193688+0000", 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4629e-05 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193721+0000", 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000001e-05 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193738+0000", 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6614000000000001e-05 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.193909+0000", 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017126500000000001 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194145+0000", 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023596500000000001 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.194332+0000", 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186658 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.195789+0000", 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014569959999999999 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196458+0000", 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066952099999999996 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196544+0000", 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:16:30.196605+0000", 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0846e-05 2024-04-19T02:18:11.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4170.0:3 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:08.234242+0000", 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.802615818, 2024-04-19T02:18:11.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046306999999999997, 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4170", 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.73:0/2788520021", 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.234242+0000", 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.234242+0000", 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.234239+0000", 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.234255+0000", 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6456e-05 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.234288+0000", 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2187999999999997e-05 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.234303+0000", 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5553000000000002e-05 2024-04-19T02:18:11.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.238502+0000", 2024-04-19T02:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041991440000000001 2024-04-19T02:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.238873+0000", 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037020899999999998 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4170.0:4 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:08.235602+0000", 2024-04-19T02:18:11.134 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.8012554590000001, 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030975270000000001, 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4170", 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.73:0/2788520021", 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:11.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.235602+0000", 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.235602+0000", 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:11.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.235600+0000", 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.235616+0000", 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.235645+0000", 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9385000000000001e-05 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.235662+0000", 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7255e-05 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.238520+0000", 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028581639999999998 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:08.238700+0000", 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017939 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.138 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:11.139 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:11.139 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:11.140 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:11.137+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:11.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:11.174 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:18:11.175 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:18:11.175 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-19T02:18:11.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:18:11.241 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:11.239+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:11.266 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:18:11.275 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:11.275 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:11.275 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:11.275 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:11.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:11.349 INFO:tasks.workunit.client.0.smithi073.stderr:+ tar xzf ltp-full.tgz 2024-04-19T02:18:11.380 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:11.379+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:11.443 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:11.441+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:11.476 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:11.477 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:11.494 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:11.540 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 57, 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "30a6d986-f196-4d3c-8512-6c6489722f8f", 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-19T02:16:03.364103+0000", 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-19T02:18:11.260310+0000", 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-19T02:17:11.442750+0000", 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-19T02:16:04.286795+0000", 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5806080, 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-19T02:18:11.541 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-19T02:18:11.542 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "luminous", 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:14.248072+0000", 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:18:11.543 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-19T02:18:11.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:18:11.545 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:18:11.546 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:18:11.547 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.5, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-19T02:18:11.549 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:18.602050+0000", 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:18:11.550 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.551 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:18:11.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:18:11.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:18:11.554 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.25, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.25, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.25, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.25, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:22.904068+0000", 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:18:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:18:11.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:18:11.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.559 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-19T02:18:11.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.190000057220459, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.190000057220459, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.190000057220459, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.190000057220459, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-19T02:18:11.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-19T02:16:23.465439+0000", 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:18:11.562 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-19T02:18:11.563 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-19T02:18:11.564 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-19T02:18:11.565 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-19T02:18:11.566 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1, 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1, 2024-04-19T02:18:11.567 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1, 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1, 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "16c5fbec-2207-41d1-ae33-893b400fd3da", 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:18:11.568 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 48, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6800", 2024-04-19T02:18:11.569 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6801", 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6802", 2024-04-19T02:18:11.570 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6803", 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6806", 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6807", 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6804", 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.116:6805", 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21424 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.116:6801/21424", 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.116:6803/21424", 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.116:6807/21424", 2024-04-19T02:18:11.573 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.116:6805/21424", 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3211257a-5bd5-4a10-8d5f-c3dae1d504e7", 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 0, 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:18:11.574 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 0, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 31, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6800", 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6801", 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6802", 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6803", 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6806", 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.577 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6807", 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6804", 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.136:6805", 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21483 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.136:6801/21483", 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.136:6803/21483", 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.136:6807/21483", 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.136:6805/21483", 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: "exists" 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d", 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 38, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-19T02:18:11.580 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6800", 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6801", 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.581 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6802", 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6803", 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6806", 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6807", 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.583 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6804", 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.169:6805", 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21523 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.584 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.169:6801/21523", 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.169:6803/21523", 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.169:6807/21523", 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.169:6805/21523", 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581115+0000", 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:18:11.586 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.639275+0000", 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 30 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-19T02:18:11.587 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-19T02:16:09.581003+0000", 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [ 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "4.1", 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "4.3a", 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:18:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [ 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "4.3a", 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.589 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-19T02:18:11.590 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-19T02:18:11.591 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:18:11.593 INFO:tasks.thrashosds.thrasher:j is {'epoch': 57, 'fsid': '30a6d986-f196-4d3c-8512-6c6489722f8f', 'created': '2024-04-19T02:16:03.364103+0000', 'modified': '2024-04-19T02:18:11.260310+0000', 'last_up_change': '2024-04-19T02:17:11.442750+0000', 'last_in_change': '2024-04-19T02:16:04.286795+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.5, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}], 'osds': [{'osd': 0, 'uuid': '16c5fbec-2207-41d1-ae33-893b400fd3da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 21424}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 21424}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 21424}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 21424}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 21424}]}, 'public_addr': '172.21.15.116:6801/21424', 'cluster_addr': '172.21.15.116:6803/21424', 'heartbeat_back_addr': '172.21.15.116:6807/21424', 'heartbeat_front_addr': '172.21.15.116:6805/21424', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3211257a-5bd5-4a10-8d5f-c3dae1d504e7', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 31, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6800', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6801', 'nonce': 21483}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6802', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6803', 'nonce': 21483}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6806', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6807', 'nonce': 21483}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6804', 'nonce': 21483}, {'type': 'v1', 'addr': '172.21.15.136:6805', 'nonce': 21483}]}, 'public_addr': '172.21.15.136:6801/21483', 'cluster_addr': '172.21.15.136:6803/21483', 'heartbeat_back_addr': '172.21.15.136:6807/21483', 'heartbeat_front_addr': '172.21.15.136:6805/21483', 'state': ['exists']}, {'osd': 2, 'uuid': '1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6800', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6801', 'nonce': 21523}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6802', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6803', 'nonce': 21523}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6806', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6807', 'nonce': 21523}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6804', 'nonce': 21523}, {'type': 'v1', 'addr': '172.21.15.169:6805', 'nonce': 21523}]}, 'public_addr': '172.21.15.169:6801/21523', 'cluster_addr': '172.21.15.169:6803/21523', 'heartbeat_back_addr': '172.21.15.169:6807/21523', 'heartbeat_front_addr': '172.21.15.169:6805/21523', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581115+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.639275+0000', 'dead_epoch': 30}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:16:09.581003+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.1', 'osds': [2, 0]}, {'pgid': '4.3a', 'osds': [1, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '4.3a', 'osds': [0, 2]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:18:11.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:18:11.594 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:11.591+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:11.665 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:11.665 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:11.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:11.665 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:11.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.17213282100001, 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:18:11.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:18:11.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.172013209, 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:11.676 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.17185094600001, 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:11.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:18:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.35560226900000003, 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:11.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.309340752, 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:11.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:11.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.29639908599999998, 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:11.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.29633753499999999, 2024-04-19T02:18:11.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:11.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:11.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:11.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.29538646699999999, 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:11.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:11.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.28824613999999998, 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:11.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:11.712 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:27 4.13 4:cbcb6224:::10000000212.00000000:head [write 0~3719] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.379677+0000", 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.28131443099999998, 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.071164354999999999, 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.713 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 27 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379677+0000", 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379677+0000", 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379676+0000", 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379685+0000", 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0920000000000004e-06 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379702+0000", 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7142e-05 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379713+0000", 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1381e-05 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.446183+0000", 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066469713 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.446345+0000", 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016188699999999999 2024-04-19T02:18:11.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450719+0000", 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043742049999999999 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450763+0000", 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3770999999999998e-05 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450841+0000", 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8410000000000003e-05 2024-04-19T02:18:11.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.280414037, 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:11.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:11.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.25034857100000002, 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.723 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:11.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.728 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:62 4.22 4:47efb22f:::10000000235.00000000:head [write 0~1242] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.412340+0000", 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.24865161299999999, 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073377368999999998, 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62 2024-04-19T02:18:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412340+0000", 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412340+0000", 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412339+0000", 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412346+0000", 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412357+0000", 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412364+0000", 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9040000000000003e-06 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412428+0000", 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3737000000000003e-05 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412592+0000", 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016401299999999999 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485592+0000", 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073000328000000003 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485639+0000", 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6659999999999997e-05 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485717+0000", 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8573999999999997e-05 2024-04-19T02:18:11.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.24780672400000001, 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.734 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:11.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:11.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:66 4.13 4:c9855970:::10000000239.00000000:head [write 0~5553] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.416411+0000", 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.24458028700000001, 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034562401, 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.416411+0000", 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.416411+0000", 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.416410+0000", 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.416428+0000", 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7623000000000001e-05 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.416442+0000", 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4722999999999999e-05 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.416451+0000", 2024-04-19T02:18:11.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3410000000000003e-06 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.446916+0000", 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030465485 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.447120+0000", 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000203995 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450855+0000", 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037343799999999998 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450897+0000", 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2314000000000002e-05 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450974+0000", 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6608999999999998e-05 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.744 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:70 4.22 4:45b8cac8:::1000000023d.00000000:head [write 0~2473] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.420180+0000", 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.240811736, 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065650613999999996, 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 70 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420180+0000", 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420180+0000", 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420179+0000", 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420189+0000", 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0763e-05 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420205+0000", 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5614999999999999e-05 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420215+0000", 2024-04-19T02:18:11.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0237999999999999e-05 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420271+0000", 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5414000000000002e-05 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420409+0000", 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013819200000000001 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485724+0000", 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065315038000000006 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485755+0000", 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1028000000000002e-05 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485830+0000", 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5473000000000001e-05 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:78 4.2a 4:576ad4f4:::10000000245.00000000:head [write 0~1190] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.427194+0000", 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.23379781599999999, 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.058764617999999998, 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 78 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427194+0000", 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427194+0000", 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427193+0000", 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427202+0000", 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5950000000000005e-06 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427216+0000", 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4225e-05 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427225+0000", 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2050000000000002e-06 2024-04-19T02:18:11.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427272+0000", 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7479999999999999e-05 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427390+0000", 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000118022 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485844+0000", 2024-04-19T02:18:11.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.058453972 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485880+0000", 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5596999999999998e-05 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485958+0000", 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8528000000000004e-05 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:85 4.22 4:450d4ca5:::1000000024c.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.22665713200000001, 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051708032000000001, 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 85 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434339+0000", 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3290000000000001e-06 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434350+0000", 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0859999999999999e-05 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434358+0000", 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0090000000000007e-06 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434404+0000", 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6226000000000001e-05 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434522+0000", 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011820300000000001 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485963+0000", 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051440940999999997 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485997+0000", 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3958999999999998e-05 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.486042+0000", 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5249e-05 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.759 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:91 4.32 4:4e8c6251:::10000000252.00000000:head [write 0~1155] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.439982+0000", 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.22100936400000001, 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051432111000000003, 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 91 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439982+0000", 2024-04-19T02:18:11.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439982+0000", 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439981+0000", 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439988+0000", 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740000000000002e-06 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.440001+0000", 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3152999999999999e-05 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.440008+0000", 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5299999999999999e-06 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485315+0000", 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045306943000000002 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485387+0000", 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1402000000000005e-05 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491332+0000", 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059452699999999999 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491358+0000", 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6339999999999999e-05 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491414+0000", 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5912999999999998e-05 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:124 4.28 4:178fb5ad:::10000000274.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:11.764 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.18721602900000001, 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090608116000000002, 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 124 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473779+0000", 2024-04-19T02:18:11.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8060000000000001e-06 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473788+0000", 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1889999999999996e-06 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473794+0000", 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473830+0000", 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6072000000000003e-05 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473970+0000", 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014000199999999999 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474123+0000", 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152874 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:11.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474833+0000", 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071059599999999997 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564335+0000", 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089501854000000006 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564363+0000", 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7441999999999999e-05 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:11.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564384+0000", 2024-04-19T02:18:11.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0936000000000001e-05 2024-04-19T02:18:11.770 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.770 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.770 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.770 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:11.770 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:11.770 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:11.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:11.772 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:11.771+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:11.873 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:11.869+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:11.910 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:18:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:18:11.914 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:11.914 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:11.914 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:11.915 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:11.924 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:11.928 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-04-19T02:18:11.264041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610635,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":266,"num_write_kb":3500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":140,"acting":141,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90608,"kb_used_data":1348,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283024912,"statfs":{"total":289910292480,"available":289817509888,"internally_reserved":0,"allocated":1380352,"data_stored":1746221,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5887,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.156010"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.118965+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:18:06.118965+0000","last_peered":"2024-04-19T02:18:06.118965+0000","last_clean":"2024-04-19T02:18:06.118965+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:18:06.118965+0000","last_undegraded":"2024-04-19T02:18:06.118965+0000","last_fullsized":"2024-04-19T02:18:06.118965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.118840+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:18:06.118840+0000","last_peered":"2024-04-19T02:18:06.118840+0000","last_clean":"2024-04-19T02:18:06.118840+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:18:06.118840+0000","last_undegraded":"2024-04-19T02:18:06.118840+0000","last_fullsized":"2024-04-19T02:18:06.118840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.119055+0000","last_change":"2024-04-19T02:17:12.471662+0000","last_active":"2024-04-19T02:18:06.119055+0000","last_peered":"2024-04-19T02:18:06.119055+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.471662+0000","last_became_peered":"2024-04-19T02:17:12.471662+0000","last_unstale":"2024-04-19T02:18:06.119055+0000","last_undegraded":"2024-04-19T02:18:06.119055+0000","last_fullsized":"2024-04-19T02:17:12.466748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:12:27.269263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115786+0000","last_change":"2024-04-19T02:17:12.474963+0000","last_active":"2024-04-19T02:18:06.115786+0000","last_peered":"2024-04-19T02:18:06.115786+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.474963+0000","last_became_peered":"2024-04-19T02:17:12.474963+0000","last_unstale":"2024-04-19T02:18:06.115786+0000","last_undegraded":"2024-04-19T02:18:06.115786+0000","last_fullsized":"2024-04-19T02:17:12.467385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:44:45.962189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.118160+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:18:06.118160+0000","last_peered":"2024-04-19T02:18:06.118160+0000","last_clean":"2024-04-19T02:18:06.118160+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:18:06.118160+0000","last_undegraded":"2024-04-19T02:18:06.118160+0000","last_fullsized":"2024-04-19T02:18:06.118160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":55,"state":"active+clean+remapped","last_fresh":"2024-04-19T02:18:06.117268+0000","last_change":"2024-04-19T02:17:52.431652+0000","last_active":"2024-04-19T02:18:06.117268+0000","last_peered":"2024-04-19T02:18:06.117268+0000","last_clean":"2024-04-19T02:18:06.117268+0000","last_became_active":"2024-04-19T02:17:52.430695+0000","last_became_peered":"2024-04-19T02:17:52.430695+0000","last_unstale":"2024-04-19T02:18:06.117268+0000","last_undegraded":"2024-04-19T02:18:06.117268+0000","last_fullsized":"2024-04-19T02:18:06.117268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:41.322921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114062+0000","last_change":"2024-04-19T02:17:12.472721+0000","last_active":"2024-04-19T02:18:06.114062+0000","last_peered":"2024-04-19T02:18:06.114062+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472721+0000","last_became_peered":"2024-04-19T02:17:12.472721+0000","last_unstale":"2024-04-19T02:18:06.114062+0000","last_undegraded":"2024-04-19T02:18:06.114062+0000","last_fullsized":"2024-04-19T02:17:12.465429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:34.422792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114089+0000","last_change":"2024-04-19T02:17:12.473034+0000","last_active":"2024-04-19T02:18:06.114089+0000","last_peered":"2024-04-19T02:18:06.114089+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473034+0000","last_became_peered":"2024-04-19T02:17:12.473034+0000","last_unstale":"2024-04-19T02:18:06.114089+0000","last_undegraded":"2024-04-19T02:18:06.114089+0000","last_fullsized":"2024-04-19T02:17:12.465552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:56.103189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.115649+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:18:06.115649+0000","last_peered":"2024-04-19T02:18:06.115649+0000","last_clean":"2024-04-19T02:18:06.115649+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:18:06.115649+0000","last_undegraded":"2024-04-19T02:18:06.115649+0000","last_fullsized":"2024-04-19T02:18:06.115649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.118924+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:18:06.118924+0000","last_peered":"2024-04-19T02:18:06.118924+0000","last_clean":"2024-04-19T02:18:06.118924+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:18:06.118924+0000","last_undegraded":"2024-04-19T02:18:06.118924+0000","last_fullsized":"2024-04-19T02:18:06.118924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115480+0000","last_change":"2024-04-19T02:17:12.475019+0000","last_active":"2024-04-19T02:18:06.115480+0000","last_peered":"2024-04-19T02:18:06.115480+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475019+0000","last_became_peered":"2024-04-19T02:17:12.475019+0000","last_unstale":"2024-04-19T02:18:06.115480+0000","last_undegraded":"2024-04-19T02:18:06.115480+0000","last_fullsized":"2024-04-19T02:17:12.467690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:36.724293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.118471+0000","last_change":"2024-04-19T02:17:12.468033+0000","last_active":"2024-04-19T02:18:06.118471+0000","last_peered":"2024-04-19T02:18:06.118471+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:17:12.468033+0000","last_became_peered":"2024-04-19T02:17:12.468033+0000","last_unstale":"2024-04-19T02:18:06.118471+0000","last_undegraded":"2024-04-19T02:18:06.118471+0000","last_fullsized":"2024-04-19T02:17:12.466169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:02.369844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117854+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:18:06.117854+0000","last_peered":"2024-04-19T02:18:06.117854+0000","last_clean":"2024-04-19T02:18:06.117854+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:18:06.117854+0000","last_undegraded":"2024-04-19T02:18:06.117854+0000","last_fullsized":"2024-04-19T02:18:06.117854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117205+0000","last_change":"2024-04-19T02:17:12.468218+0000","last_active":"2024-04-19T02:18:06.117205+0000","last_peered":"2024-04-19T02:18:06.117205+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468218+0000","last_became_peered":"2024-04-19T02:17:12.468218+0000","last_unstale":"2024-04-19T02:18:06.117205+0000","last_undegraded":"2024-04-19T02:18:06.117205+0000","last_fullsized":"2024-04-19T02:17:12.466471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:13.637115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117130+0000","last_change":"2024-04-19T02:17:12.468646+0000","last_active":"2024-04-19T02:18:06.117130+0000","last_peered":"2024-04-19T02:18:06.117130+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468646+0000","last_became_peered":"2024-04-19T02:17:12.468646+0000","last_unstale":"2024-04-19T02:18:06.117130+0000","last_undegraded":"2024-04-19T02:18:06.117130+0000","last_fullsized":"2024-04-19T02:17:12.465162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:56.960161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.113922+0000","last_change":"2024-04-19T02:17:12.467658+0000","last_active":"2024-04-19T02:18:06.113922+0000","last_peered":"2024-04-19T02:18:06.113922+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.467658+0000","last_became_peered":"2024-04-19T02:17:12.467658+0000","last_unstale":"2024-04-19T02:18:06.113922+0000","last_undegraded":"2024-04-19T02:18:06.113922+0000","last_fullsized":"2024-04-19T02:17:12.465360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:49.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117243+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:18:06.117243+0000","last_peered":"2024-04-19T02:18:06.117243+0000","last_clean":"2024-04-19T02:18:06.117243+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:18:06.117243+0000","last_undegraded":"2024-04-19T02:18:06.117243+0000","last_fullsized":"2024-04-19T02:18:06.117243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.119078+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:18:06.119078+0000","last_peered":"2024-04-19T02:18:06.119078+0000","last_clean":"2024-04-19T02:18:06.119078+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:18:06.119078+0000","last_undegraded":"2024-04-19T02:18:06.119078+0000","last_fullsized":"2024-04-19T02:18:06.119078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.115489+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:18:06.115489+0000","last_peered":"2024-04-19T02:18:06.115489+0000","last_clean":"2024-04-19T02:18:06.115489+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:18:06.115489+0000","last_undegraded":"2024-04-19T02:18:06.115489+0000","last_fullsized":"2024-04-19T02:18:06.115489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116522+0000","last_change":"2024-04-19T02:17:12.475684+0000","last_active":"2024-04-19T02:18:06.116522+0000","last_peered":"2024-04-19T02:18:06.116522+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475684+0000","last_became_peered":"2024-04-19T02:17:12.475684+0000","last_unstale":"2024-04-19T02:18:06.116522+0000","last_undegraded":"2024-04-19T02:18:06.116522+0000","last_fullsized":"2024-04-19T02:17:12.468218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:38.530185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116811+0000","last_change":"2024-04-19T02:17:12.482521+0000","last_active":"2024-04-19T02:18:06.116811+0000","last_peered":"2024-04-19T02:18:06.116811+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.482521+0000","last_became_peered":"2024-04-19T02:17:12.482521+0000","last_unstale":"2024-04-19T02:18:06.116811+0000","last_undegraded":"2024-04-19T02:18:06.116811+0000","last_fullsized":"2024-04-19T02:17:12.470413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:43.318373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117541+0000","last_change":"2024-04-19T02:17:12.469825+0000","last_active":"2024-04-19T02:18:06.117541+0000","last_peered":"2024-04-19T02:18:06.117541+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:17:12.469825+0000","last_became_peered":"2024-04-19T02:17:12.469825+0000","last_unstale":"2024-04-19T02:18:06.117541+0000","last_undegraded":"2024-04-19T02:18:06.117541+0000","last_fullsized":"2024-04-19T02:17:12.466905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:55:14.059675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114447+0000","last_change":"2024-04-19T02:17:12.470766+0000","last_active":"2024-04-19T02:18:06.114447+0000","last_peered":"2024-04-19T02:18:06.114447+0000","last_clean":"2024-04-19T02:17:07.001190+0000","last_became_active":"2024-04-19T02:17:12.470766+0000","last_became_peered":"2024-04-19T02:17:12.470766+0000","last_unstale":"2024-04-19T02:18:06.114447+0000","last_undegraded":"2024-04-19T02:18:06.114447+0000","last_fullsized":"2024-04-19T02:17:12.465417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:41.307510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.116945+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:18:06.116945+0000","last_peered":"2024-04-19T02:18:06.116945+0000","last_clean":"2024-04-19T02:18:06.116945+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:18:06.116945+0000","last_undegraded":"2024-04-19T02:18:06.116945+0000","last_fullsized":"2024-04-19T02:18:06.116945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.119911+0000","last_change":"2024-04-19T02:17:12.472985+0000","last_active":"2024-04-19T02:18:06.119911+0000","last_peered":"2024-04-19T02:18:06.119911+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:17:12.472985+0000","last_became_peered":"2024-04-19T02:17:12.472985+0000","last_unstale":"2024-04-19T02:18:06.119911+0000","last_undegraded":"2024-04-19T02:18:06.119911+0000","last_fullsized":"2024-04-19T02:17:12.470041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:29.004931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116322+0000","last_change":"2024-04-19T02:17:12.475928+0000","last_active":"2024-04-19T02:18:06.116322+0000","last_peered":"2024-04-19T02:18:06.116322+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:17:12.475928+0000","last_became_peered":"2024-04-19T02:17:12.475928+0000","last_unstale":"2024-04-19T02:18:06.116322+0000","last_undegraded":"2024-04-19T02:18:06.116322+0000","last_fullsized":"2024-04-19T02:17:12.468138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:08.735898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.120658+0000","last_change":"2024-04-19T02:17:12.472908+0000","last_active":"2024-04-19T02:18:06.120658+0000","last_peered":"2024-04-19T02:18:06.120658+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472908+0000","last_became_peered":"2024-04-19T02:17:12.472908+0000","last_unstale":"2024-04-19T02:18:06.120658+0000","last_undegraded":"2024-04-19T02:18:06.120658+0000","last_fullsized":"2024-04-19T02:17:12.468312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:43.318373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.119814+0000","last_change":"2024-04-19T02:17:12.470809+0000","last_active":"2024-04-19T02:18:06.119814+0000","last_peered":"2024-04-19T02:18:06.119814+0000","last_clean":"2024-04-19T02:17:09.445020+0000","last_became_active":"2024-04-19T02:17:12.470809+0000","last_became_peered":"2024-04-19T02:17:12.470809+0000","last_unstale":"2024-04-19T02:18:06.119814+0000","last_undegraded":"2024-04-19T02:18:06.119814+0000","last_fullsized":"2024-04-19T02:17:12.467256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:47.544283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.116202+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:18:06.116202+0000","last_peered":"2024-04-19T02:18:06.116202+0000","last_clean":"2024-04-19T02:18:06.116202+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:18:06.116202+0000","last_undegraded":"2024-04-19T02:18:06.116202+0000","last_fullsized":"2024-04-19T02:18:06.116202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.118043+0000","last_change":"2024-04-19T02:17:12.472579+0000","last_active":"2024-04-19T02:18:06.118043+0000","last_peered":"2024-04-19T02:18:06.118043+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:17:12.472579+0000","last_became_peered":"2024-04-19T02:17:12.472579+0000","last_unstale":"2024-04-19T02:18:06.118043+0000","last_undegraded":"2024-04-19T02:18:06.118043+0000","last_fullsized":"2024-04-19T02:17:12.467577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.053477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.114395+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:18:06.114395+0000","last_peered":"2024-04-19T02:18:06.114395+0000","last_clean":"2024-04-19T02:18:06.114395+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:18:06.114395+0000","last_undegraded":"2024-04-19T02:18:06.114395+0000","last_fullsized":"2024-04-19T02:18:06.114395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114410+0000","last_change":"2024-04-19T02:17:12.477517+0000","last_active":"2024-04-19T02:18:06.114410+0000","last_peered":"2024-04-19T02:18:06.114410+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.477517+0000","last_became_peered":"2024-04-19T02:17:12.477517+0000","last_unstale":"2024-04-19T02:18:06.114410+0000","last_undegraded":"2024-04-19T02:18:06.114410+0000","last_fullsized":"2024-04-19T02:17:12.466619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:06.010745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.118916+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:18:06.118916+0000","last_peered":"2024-04-19T02:18:06.118916+0000","last_clean":"2024-04-19T02:18:06.118916+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:18:06.118916+0000","last_undegraded":"2024-04-19T02:18:06.118916+0000","last_fullsized":"2024-04-19T02:18:06.118916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":41,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.115851+0000","last_change":"2024-04-19T02:17:12.480865+0000","last_active":"2024-04-19T02:18:06.115851+0000","last_peered":"2024-04-19T02:18:06.115851+0000","last_clean":"2024-04-19T02:16:24.494994+0000","last_became_active":"2024-04-19T02:17:12.480865+0000","last_became_peered":"2024-04-19T02:17:12.480865+0000","last_unstale":"2024-04-19T02:18:06.115851+0000","last_undegraded":"2024-04-19T02:17:12.469727+0000","last_fullsized":"2024-04-19T02:17:12.469514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:39.449809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.120205+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:18:06.120205+0000","last_peered":"2024-04-19T02:18:06.120205+0000","last_clean":"2024-04-19T02:18:06.120205+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:18:06.120205+0000","last_undegraded":"2024-04-19T02:18:06.120205+0000","last_fullsized":"2024-04-19T02:18:06.120205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116496+0000","last_change":"2024-04-19T02:17:12.475504+0000","last_active":"2024-04-19T02:18:06.116496+0000","last_peered":"2024-04-19T02:18:06.116496+0000","last_clean":"2024-04-19T02:17:07.001751+0000","last_became_active":"2024-04-19T02:17:12.475504+0000","last_became_peered":"2024-04-19T02:17:12.475504+0000","last_unstale":"2024-04-19T02:18:06.116496+0000","last_undegraded":"2024-04-19T02:18:06.116496+0000","last_fullsized":"2024-04-19T02:17:12.466749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:16.631966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117185+0000","last_change":"2024-04-19T02:17:12.480599+0000","last_active":"2024-04-19T02:18:06.117185+0000","last_peered":"2024-04-19T02:18:06.117185+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:17:12.480599+0000","last_became_peered":"2024-04-19T02:17:12.480599+0000","last_unstale":"2024-04-19T02:18:06.117185+0000","last_undegraded":"2024-04-19T02:18:06.117185+0000","last_fullsized":"2024-04-19T02:17:12.472079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:39.186907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117628+0000","last_change":"2024-04-19T02:17:12.470087+0000","last_active":"2024-04-19T02:18:06.117628+0000","last_peered":"2024-04-19T02:18:06.117628+0000","last_clean":"2024-04-19T02:17:09.444294+0000","last_became_active":"2024-04-19T02:17:12.470087+0000","last_became_peered":"2024-04-19T02:17:12.470087+0000","last_unstale":"2024-04-19T02:18:06.117628+0000","last_undegraded":"2024-04-19T02:18:06.117628+0000","last_fullsized":"2024-04-19T02:17:12.465651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:08.686889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115932+0000","last_change":"2024-04-19T02:17:12.477502+0000","last_active":"2024-04-19T02:18:06.115932+0000","last_peered":"2024-04-19T02:18:06.115932+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:17:12.477502+0000","last_became_peered":"2024-04-19T02:17:12.477502+0000","last_unstale":"2024-04-19T02:18:06.115932+0000","last_undegraded":"2024-04-19T02:18:06.115932+0000","last_fullsized":"2024-04-19T02:17:12.468662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:42.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":41,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.117235+0000","last_change":"2024-04-19T02:17:12.468566+0000","last_active":"2024-04-19T02:18:06.117235+0000","last_peered":"2024-04-19T02:18:06.117235+0000","last_clean":"2024-04-19T02:16:24.492774+0000","last_became_active":"2024-04-19T02:17:12.468566+0000","last_became_peered":"2024-04-19T02:17:12.468566+0000","last_unstale":"2024-04-19T02:18:06.117235+0000","last_undegraded":"2024-04-19T02:17:12.465406+0000","last_fullsized":"2024-04-19T02:17:12.465206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:35.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":41,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.120061+0000","last_change":"2024-04-19T02:17:12.473559+0000","last_active":"2024-04-19T02:18:06.120061+0000","last_peered":"2024-04-19T02:18:06.120061+0000","last_clean":"2024-04-19T02:16:24.491281+0000","last_became_active":"2024-04-19T02:17:12.473559+0000","last_became_peered":"2024-04-19T02:17:12.473559+0000","last_unstale":"2024-04-19T02:18:06.120061+0000","last_undegraded":"2024-04-19T02:17:12.470889+0000","last_fullsized":"2024-04-19T02:17:12.470812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:47.633899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117188+0000","last_change":"2024-04-19T02:17:12.468086+0000","last_active":"2024-04-19T02:18:06.117188+0000","last_peered":"2024-04-19T02:18:06.117188+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:17:12.468086+0000","last_became_peered":"2024-04-19T02:17:12.468086+0000","last_unstale":"2024-04-19T02:18:06.117188+0000","last_undegraded":"2024-04-19T02:18:06.117188+0000","last_fullsized":"2024-04-19T02:17:12.465179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:25:37.098688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":56,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.119275+0000","last_change":"2024-04-19T02:17:12.471922+0000","last_active":"2024-04-19T02:18:06.119275+0000","last_peered":"2024-04-19T02:18:06.119275+0000","last_clean":"2024-04-19T02:17:09.445356+0000","last_became_active":"2024-04-19T02:17:12.471922+0000","last_became_peered":"2024-04-19T02:17:12.471922+0000","last_unstale":"2024-04-19T02:18:06.119275+0000","last_undegraded":"2024-04-19T02:17:12.469493+0000","last_fullsized":"2024-04-19T02:17:12.469410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:34:44.093452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117317+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:18:06.117317+0000","last_peered":"2024-04-19T02:18:06.117317+0000","last_clean":"2024-04-19T02:18:06.117317+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:18:06.117317+0000","last_undegraded":"2024-04-19T02:18:06.117317+0000","last_fullsized":"2024-04-19T02:18:06.117317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":41,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.119963+0000","last_change":"2024-04-19T02:17:12.471586+0000","last_active":"2024-04-19T02:18:06.119963+0000","last_peered":"2024-04-19T02:18:06.119963+0000","last_clean":"2024-04-19T02:16:24.498760+0000","last_became_active":"2024-04-19T02:17:12.471586+0000","last_became_peered":"2024-04-19T02:17:12.471586+0000","last_unstale":"2024-04-19T02:18:06.119963+0000","last_undegraded":"2024-04-19T02:17:12.467226+0000","last_fullsized":"2024-04-19T02:17:12.467144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:30.560862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116431+0000","last_change":"2024-04-19T02:17:12.476188+0000","last_active":"2024-04-19T02:18:06.116431+0000","last_peered":"2024-04-19T02:18:06.116431+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.476188+0000","last_became_peered":"2024-04-19T02:17:12.476188+0000","last_unstale":"2024-04-19T02:18:06.116431+0000","last_undegraded":"2024-04-19T02:18:06.116431+0000","last_fullsized":"2024-04-19T02:17:12.467463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:08.617493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116834+0000","last_change":"2024-04-19T02:17:12.481086+0000","last_active":"2024-04-19T02:18:06.116834+0000","last_peered":"2024-04-19T02:18:06.116834+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.481086+0000","last_became_peered":"2024-04-19T02:17:12.481086+0000","last_unstale":"2024-04-19T02:18:06.116834+0000","last_undegraded":"2024-04-19T02:18:06.116834+0000","last_fullsized":"2024-04-19T02:17:12.468898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:34.809946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115516+0000","last_change":"2024-04-19T02:17:12.477363+0000","last_active":"2024-04-19T02:18:06.115516+0000","last_peered":"2024-04-19T02:18:06.115516+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:17:12.477363+0000","last_became_peered":"2024-04-19T02:17:12.477363+0000","last_unstale":"2024-04-19T02:18:06.115516+0000","last_undegraded":"2024-04-19T02:18:06.115516+0000","last_fullsized":"2024-04-19T02:17:12.466956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:06.485415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":55,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.117121+0000","last_change":"2024-04-19T02:17:12.482776+0000","last_active":"2024-04-19T02:18:06.117121+0000","last_peered":"2024-04-19T02:18:06.117121+0000","last_clean":"2024-04-19T02:17:07.002985+0000","last_became_active":"2024-04-19T02:17:12.482776+0000","last_became_peered":"2024-04-19T02:17:12.482776+0000","last_unstale":"2024-04-19T02:18:06.117121+0000","last_undegraded":"2024-04-19T02:17:12.473078+0000","last_fullsized":"2024-04-19T02:17:12.472919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:09.109279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115347+0000","last_change":"2024-04-19T02:17:12.475123+0000","last_active":"2024-04-19T02:18:06.115347+0000","last_peered":"2024-04-19T02:18:06.115347+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475123+0000","last_became_peered":"2024-04-19T02:17:12.475123+0000","last_unstale":"2024-04-19T02:18:06.115347+0000","last_undegraded":"2024-04-19T02:18:06.115347+0000","last_fullsized":"2024-04-19T02:17:12.468098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:38:10.412991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114557+0000","last_change":"2024-04-19T02:17:12.470775+0000","last_active":"2024-04-19T02:18:06.114557+0000","last_peered":"2024-04-19T02:18:06.114557+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.470775+0000","last_became_peered":"2024-04-19T02:17:12.470775+0000","last_unstale":"2024-04-19T02:18:06.114557+0000","last_undegraded":"2024-04-19T02:18:06.114557+0000","last_fullsized":"2024-04-19T02:17:12.466015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:58.235807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.120312+0000","last_change":"2024-04-19T02:17:12.472954+0000","last_active":"2024-04-19T02:18:06.120312+0000","last_peered":"2024-04-19T02:18:06.120312+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472954+0000","last_became_peered":"2024-04-19T02:17:12.472954+0000","last_unstale":"2024-04-19T02:18:06.120312+0000","last_undegraded":"2024-04-19T02:18:06.120312+0000","last_fullsized":"2024-04-19T02:17:12.467712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:33.854311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117655+0000","last_change":"2024-04-19T02:17:12.468621+0000","last_active":"2024-04-19T02:18:06.117655+0000","last_peered":"2024-04-19T02:18:06.117655+0000","last_clean":"2024-04-19T02:17:09.444347+0000","last_became_active":"2024-04-19T02:17:12.468621+0000","last_became_peered":"2024-04-19T02:17:12.468621+0000","last_unstale":"2024-04-19T02:18:06.117655+0000","last_undegraded":"2024-04-19T02:18:06.117655+0000","last_fullsized":"2024-04-19T02:17:12.466195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:31:45.463358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.119159+0000","last_change":"2024-04-19T02:17:12.469283+0000","last_active":"2024-04-19T02:18:06.119159+0000","last_peered":"2024-04-19T02:18:06.119159+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.469283+0000","last_became_peered":"2024-04-19T02:17:12.469283+0000","last_unstale":"2024-04-19T02:18:06.119159+0000","last_undegraded":"2024-04-19T02:18:06.119159+0000","last_fullsized":"2024-04-19T02:17:12.466315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:49.268315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117546+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:18:06.117546+0000","last_peered":"2024-04-19T02:18:06.117546+0000","last_clean":"2024-04-19T02:18:06.117546+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:18:06.117546+0000","last_undegraded":"2024-04-19T02:18:06.117546+0000","last_fullsized":"2024-04-19T02:18:06.117546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.116169+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:18:06.116169+0000","last_peered":"2024-04-19T02:18:06.116169+0000","last_clean":"2024-04-19T02:18:06.116169+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:18:06.116169+0000","last_undegraded":"2024-04-19T02:18:06.116169+0000","last_fullsized":"2024-04-19T02:18:06.116169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":235,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.118328+0000","last_change":"2024-04-19T02:17:12.471328+0000","last_active":"2024-04-19T02:18:06.118328+0000","last_peered":"2024-04-19T02:18:06.118328+0000","last_clean":"2024-04-19T02:16:17.202941+0000","last_became_active":"2024-04-19T02:17:12.471328+0000","last_became_peered":"2024-04-19T02:17:12.471328+0000","last_unstale":"2024-04-19T02:18:06.118328+0000","last_undegraded":"2024-04-19T02:17:12.467139+0000","last_fullsized":"2024-04-19T02:17:12.466916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:00.591621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117445+0000","last_change":"2024-04-19T02:17:12.483202+0000","last_active":"2024-04-19T02:18:06.117445+0000","last_peered":"2024-04-19T02:18:06.117445+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.483202+0000","last_became_peered":"2024-04-19T02:17:12.483202+0000","last_unstale":"2024-04-19T02:18:06.117445+0000","last_undegraded":"2024-04-19T02:18:06.117445+0000","last_fullsized":"2024-04-19T02:17:12.473235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:45.677177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.116945+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:18:06.116945+0000","last_peered":"2024-04-19T02:18:06.116945+0000","last_clean":"2024-04-19T02:18:06.116945+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:18:06.116945+0000","last_undegraded":"2024-04-19T02:18:06.116945+0000","last_fullsized":"2024-04-19T02:18:06.116945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.119942+0000","last_change":"2024-04-19T02:17:12.472439+0000","last_active":"2024-04-19T02:18:06.119942+0000","last_peered":"2024-04-19T02:18:06.119942+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.472439+0000","last_became_peered":"2024-04-19T02:17:12.472439+0000","last_unstale":"2024-04-19T02:18:06.119942+0000","last_undegraded":"2024-04-19T02:18:06.119942+0000","last_fullsized":"2024-04-19T02:17:12.467077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:38:10.412991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117793+0000","last_change":"2024-04-19T02:17:12.470205+0000","last_active":"2024-04-19T02:18:06.117793+0000","last_peered":"2024-04-19T02:18:06.117793+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.470205+0000","last_became_peered":"2024-04-19T02:17:12.470205+0000","last_unstale":"2024-04-19T02:18:06.117793+0000","last_undegraded":"2024-04-19T02:18:06.117793+0000","last_fullsized":"2024-04-19T02:17:12.466126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:18.817011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115848+0000","last_change":"2024-04-19T02:17:12.477549+0000","last_active":"2024-04-19T02:18:06.115848+0000","last_peered":"2024-04-19T02:18:06.115848+0000","last_clean":"2024-04-19T02:17:07.001902+0000","last_became_active":"2024-04-19T02:17:12.477549+0000","last_became_peered":"2024-04-19T02:17:12.477549+0000","last_unstale":"2024-04-19T02:18:06.115848+0000","last_undegraded":"2024-04-19T02:18:06.115848+0000","last_fullsized":"2024-04-19T02:17:12.468541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:55:13.051324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.119149+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:18:06.119149+0000","last_peered":"2024-04-19T02:18:06.119149+0000","last_clean":"2024-04-19T02:18:06.119149+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:18:06.119149+0000","last_undegraded":"2024-04-19T02:18:06.119149+0000","last_fullsized":"2024-04-19T02:18:06.119149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.115472+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:18:06.115472+0000","last_peered":"2024-04-19T02:18:06.115472+0000","last_clean":"2024-04-19T02:18:06.115472+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:18:06.115472+0000","last_undegraded":"2024-04-19T02:18:06.115472+0000","last_fullsized":"2024-04-19T02:18:06.115472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117701+0000","last_change":"2024-04-19T02:17:12.470093+0000","last_active":"2024-04-19T02:18:06.117701+0000","last_peered":"2024-04-19T02:18:06.117701+0000","last_clean":"2024-04-19T02:17:09.444286+0000","last_became_active":"2024-04-19T02:17:12.470093+0000","last_became_peered":"2024-04-19T02:17:12.470093+0000","last_unstale":"2024-04-19T02:18:06.117701+0000","last_undegraded":"2024-04-19T02:18:06.117701+0000","last_fullsized":"2024-04-19T02:17:12.466037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:28.739646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.116217+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:18:06.116217+0000","last_peered":"2024-04-19T02:18:06.116217+0000","last_clean":"2024-04-19T02:18:06.116217+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:18:06.116217+0000","last_undegraded":"2024-04-19T02:18:06.116217+0000","last_fullsized":"2024-04-19T02:18:06.116217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117204+0000","last_change":"2024-04-19T02:17:12.478551+0000","last_active":"2024-04-19T02:18:06.117204+0000","last_peered":"2024-04-19T02:18:06.117204+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.478551+0000","last_became_peered":"2024-04-19T02:17:12.478551+0000","last_unstale":"2024-04-19T02:18:06.117204+0000","last_undegraded":"2024-04-19T02:18:06.117204+0000","last_fullsized":"2024-04-19T02:17:12.468490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:54.966067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116550+0000","last_change":"2024-04-19T02:17:12.480849+0000","last_active":"2024-04-19T02:18:06.116550+0000","last_peered":"2024-04-19T02:18:06.116550+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480849+0000","last_became_peered":"2024-04-19T02:17:12.480849+0000","last_unstale":"2024-04-19T02:18:06.116550+0000","last_undegraded":"2024-04-19T02:18:06.116550+0000","last_fullsized":"2024-04-19T02:17:12.469891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:28:21.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.116236+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:18:06.116236+0000","last_peered":"2024-04-19T02:18:06.116236+0000","last_clean":"2024-04-19T02:18:06.116236+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:18:06.116236+0000","last_undegraded":"2024-04-19T02:18:06.116236+0000","last_fullsized":"2024-04-19T02:18:06.116236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115747+0000","last_change":"2024-04-19T02:17:12.475695+0000","last_active":"2024-04-19T02:18:06.115747+0000","last_peered":"2024-04-19T02:18:06.115747+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.475695+0000","last_became_peered":"2024-04-19T02:17:12.475695+0000","last_unstale":"2024-04-19T02:18:06.115747+0000","last_undegraded":"2024-04-19T02:18:06.115747+0000","last_fullsized":"2024-04-19T02:17:12.468442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:02.799871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117375+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:18:06.117375+0000","last_peered":"2024-04-19T02:18:06.117375+0000","last_clean":"2024-04-19T02:18:06.117375+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:18:06.117375+0000","last_undegraded":"2024-04-19T02:18:06.117375+0000","last_fullsized":"2024-04-19T02:18:06.117375+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117664+0000","last_change":"2024-04-19T02:17:12.471310+0000","last_active":"2024-04-19T02:18:06.117664+0000","last_peered":"2024-04-19T02:18:06.117664+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:17:12.471310+0000","last_became_peered":"2024-04-19T02:17:12.471310+0000","last_unstale":"2024-04-19T02:18:06.117664+0000","last_undegraded":"2024-04-19T02:18:06.117664+0000","last_fullsized":"2024-04-19T02:17:12.467496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:34.756376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117145+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:18:06.117145+0000","last_peered":"2024-04-19T02:18:06.117145+0000","last_clean":"2024-04-19T02:18:06.117145+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:18:06.117145+0000","last_undegraded":"2024-04-19T02:18:06.117145+0000","last_fullsized":"2024-04-19T02:18:06.117145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.120620+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:18:06.120620+0000","last_peered":"2024-04-19T02:18:06.120620+0000","last_clean":"2024-04-19T02:18:06.120620+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:18:06.120620+0000","last_undegraded":"2024-04-19T02:18:06.120620+0000","last_fullsized":"2024-04-19T02:18:06.120620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.117948+0000","last_change":"2024-04-19T02:17:12.469898+0000","last_active":"2024-04-19T02:18:06.117948+0000","last_peered":"2024-04-19T02:18:06.117948+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:17:12.469898+0000","last_became_peered":"2024-04-19T02:17:12.469898+0000","last_unstale":"2024-04-19T02:18:06.117948+0000","last_undegraded":"2024-04-19T02:18:06.117948+0000","last_fullsized":"2024-04-19T02:17:12.465728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:42.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117491+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:18:06.117491+0000","last_peered":"2024-04-19T02:18:06.117491+0000","last_clean":"2024-04-19T02:18:06.117491+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:18:06.117491+0000","last_undegraded":"2024-04-19T02:18:06.117491+0000","last_fullsized":"2024-04-19T02:18:06.117491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117586+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:18:06.117586+0000","last_peered":"2024-04-19T02:18:06.117586+0000","last_clean":"2024-04-19T02:18:06.117586+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:18:06.117586+0000","last_undegraded":"2024-04-19T02:18:06.117586+0000","last_fullsized":"2024-04-19T02:18:06.117586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114827+0000","last_change":"2024-04-19T02:17:12.478207+0000","last_active":"2024-04-19T02:18:06.114827+0000","last_peered":"2024-04-19T02:18:06.114827+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:17:12.478207+0000","last_became_peered":"2024-04-19T02:17:12.478207+0000","last_unstale":"2024-04-19T02:18:06.114827+0000","last_undegraded":"2024-04-19T02:18:06.114827+0000","last_fullsized":"2024-04-19T02:17:12.467111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:58.269726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"54'5","reported_seq":58,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.117549+0000","last_change":"2024-04-19T02:17:12.481269+0000","last_active":"2024-04-19T02:18:06.117549+0000","last_peered":"2024-04-19T02:18:06.117549+0000","last_clean":"2024-04-19T02:17:07.003468+0000","last_became_active":"2024-04-19T02:17:12.481269+0000","last_became_peered":"2024-04-19T02:17:12.481269+0000","last_unstale":"2024-04-19T02:18:06.117549+0000","last_undegraded":"2024-04-19T02:17:12.472467+0000","last_fullsized":"2024-04-19T02:17:12.472256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:25.797971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.120035+0000","last_change":"2024-04-19T02:17:12.473583+0000","last_active":"2024-04-19T02:18:06.120035+0000","last_peered":"2024-04-19T02:18:06.120035+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.473583+0000","last_became_peered":"2024-04-19T02:17:12.473583+0000","last_unstale":"2024-04-19T02:18:06.120035+0000","last_undegraded":"2024-04-19T02:18:06.120035+0000","last_fullsized":"2024-04-19T02:17:12.470880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:08.436045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.114109+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:18:06.114109+0000","last_peered":"2024-04-19T02:18:06.114109+0000","last_clean":"2024-04-19T02:18:06.114109+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:18:06.114109+0000","last_undegraded":"2024-04-19T02:18:06.114109+0000","last_fullsized":"2024-04-19T02:18:06.114109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:15.829506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.118136+0000","last_change":"2024-04-19T02:17:12.468034+0000","last_active":"2024-04-19T02:18:06.118136+0000","last_peered":"2024-04-19T02:18:06.118136+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.468034+0000","last_became_peered":"2024-04-19T02:17:12.468034+0000","last_unstale":"2024-04-19T02:18:06.118136+0000","last_undegraded":"2024-04-19T02:18:06.118136+0000","last_fullsized":"2024-04-19T02:17:12.465388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:52.858745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"54'15","reported_seq":62,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.119133+0000","last_change":"2024-04-19T02:17:12.468266+0000","last_active":"2024-04-19T02:18:06.119133+0000","last_peered":"2024-04-19T02:18:06.119133+0000","last_clean":"2024-04-19T02:16:54.341172+0000","last_became_active":"2024-04-19T02:17:12.468266+0000","last_became_peered":"2024-04-19T02:17:12.468266+0000","last_unstale":"2024-04-19T02:18:06.119133+0000","last_undegraded":"2024-04-19T02:17:12.466295+0000","last_fullsized":"2024-04-19T02:17:12.466215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:20.170934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19469,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.114334+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:18:06.114334+0000","last_peered":"2024-04-19T02:18:06.114334+0000","last_clean":"2024-04-19T02:18:06.114334+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:18:06.114334+0000","last_undegraded":"2024-04-19T02:18:06.114334+0000","last_fullsized":"2024-04-19T02:18:06.114334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":57,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.120478+0000","last_change":"2024-04-19T02:17:12.472711+0000","last_active":"2024-04-19T02:18:06.120478+0000","last_peered":"2024-04-19T02:18:06.120478+0000","last_clean":"2024-04-19T02:17:09.446243+0000","last_became_active":"2024-04-19T02:17:12.472711+0000","last_became_peered":"2024-04-19T02:17:12.472711+0000","last_unstale":"2024-04-19T02:18:06.120478+0000","last_undegraded":"2024-04-19T02:17:12.468046+0000","last_fullsized":"2024-04-19T02:17:12.467939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:45.500367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116613+0000","last_change":"2024-04-19T02:17:12.480946+0000","last_active":"2024-04-19T02:18:06.116613+0000","last_peered":"2024-04-19T02:18:06.116613+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480946+0000","last_became_peered":"2024-04-19T02:17:12.480946+0000","last_unstale":"2024-04-19T02:18:06.116613+0000","last_undegraded":"2024-04-19T02:18:06.116613+0000","last_fullsized":"2024-04-19T02:17:12.469729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:30.560862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114627+0000","last_change":"2024-04-19T02:17:12.474936+0000","last_active":"2024-04-19T02:18:06.114627+0000","last_peered":"2024-04-19T02:18:06.114627+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:17:12.474936+0000","last_became_peered":"2024-04-19T02:17:12.474936+0000","last_unstale":"2024-04-19T02:18:06.114627+0000","last_undegraded":"2024-04-19T02:18:06.114627+0000","last_fullsized":"2024-04-19T02:17:12.466173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:56.771899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116586+0000","last_change":"2024-04-19T02:17:12.478595+0000","last_active":"2024-04-19T02:18:06.116586+0000","last_peered":"2024-04-19T02:18:06.116586+0000","last_clean":"2024-04-19T02:17:07.003624+0000","last_became_active":"2024-04-19T02:17:12.478595+0000","last_became_peered":"2024-04-19T02:17:12.478595+0000","last_unstale":"2024-04-19T02:18:06.116586+0000","last_undegraded":"2024-04-19T02:18:06.116586+0000","last_fullsized":"2024-04-19T02:17:12.470773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:17.045125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.114747+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:18:06.114747+0000","last_peered":"2024-04-19T02:18:06.114747+0000","last_clean":"2024-04-19T02:18:06.114747+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:18:06.114747+0000","last_undegraded":"2024-04-19T02:18:06.114747+0000","last_fullsized":"2024-04-19T02:18:06.114747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.119140+0000","last_change":"2024-04-19T02:17:12.472045+0000","last_active":"2024-04-19T02:18:06.119140+0000","last_peered":"2024-04-19T02:18:06.119140+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:17:12.472045+0000","last_became_peered":"2024-04-19T02:17:12.472045+0000","last_unstale":"2024-04-19T02:18:06.119140+0000","last_undegraded":"2024-04-19T02:18:06.119140+0000","last_fullsized":"2024-04-19T02:17:12.469938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:07.174450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.114979+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:18:06.114979+0000","last_peered":"2024-04-19T02:18:06.114979+0000","last_clean":"2024-04-19T02:18:06.114979+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:18:06.114979+0000","last_undegraded":"2024-04-19T02:18:06.114979+0000","last_fullsized":"2024-04-19T02:18:06.114979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":52,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.116509+0000","last_change":"2024-04-19T02:17:12.478635+0000","last_active":"2024-04-19T02:18:06.116509+0000","last_peered":"2024-04-19T02:18:06.116509+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:17:12.478635+0000","last_became_peered":"2024-04-19T02:17:12.478635+0000","last_unstale":"2024-04-19T02:18:06.116509+0000","last_undegraded":"2024-04-19T02:18:06.116509+0000","last_fullsized":"2024-04-19T02:17:12.469417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:56.699515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.115013+0000","last_change":"2024-04-19T02:17:12.474967+0000","last_active":"2024-04-19T02:18:06.115013+0000","last_peered":"2024-04-19T02:18:06.115013+0000","last_clean":"2024-04-19T02:17:07.001688+0000","last_became_active":"2024-04-19T02:17:12.474967+0000","last_became_peered":"2024-04-19T02:17:12.474967+0000","last_unstale":"2024-04-19T02:18:06.115013+0000","last_undegraded":"2024-04-19T02:18:06.115013+0000","last_fullsized":"2024-04-19T02:17:12.468046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:12.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.119176+0000","last_change":"2024-04-19T02:17:12.468686+0000","last_active":"2024-04-19T02:18:06.119176+0000","last_peered":"2024-04-19T02:18:06.119176+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:17:12.468686+0000","last_became_peered":"2024-04-19T02:17:12.468686+0000","last_unstale":"2024-04-19T02:18:06.119176+0000","last_undegraded":"2024-04-19T02:18:06.119176+0000","last_fullsized":"2024-04-19T02:17:12.466095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:25:22.162660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117970+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:18:06.117970+0000","last_peered":"2024-04-19T02:18:06.117970+0000","last_clean":"2024-04-19T02:18:06.117970+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:18:06.117970+0000","last_undegraded":"2024-04-19T02:18:06.117970+0000","last_fullsized":"2024-04-19T02:18:06.117970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.118776+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:18:06.118776+0000","last_peered":"2024-04-19T02:18:06.118776+0000","last_clean":"2024-04-19T02:18:06.118776+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:18:06.118776+0000","last_undegraded":"2024-04-19T02:18:06.118776+0000","last_fullsized":"2024-04-19T02:18:06.118776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":55,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.118442+0000","last_change":"2024-04-19T02:17:12.470743+0000","last_active":"2024-04-19T02:18:06.118442+0000","last_peered":"2024-04-19T02:18:06.118442+0000","last_clean":"2024-04-19T02:17:09.445171+0000","last_became_active":"2024-04-19T02:17:12.470743+0000","last_became_peered":"2024-04-19T02:17:12.470743+0000","last_unstale":"2024-04-19T02:18:06.118442+0000","last_undegraded":"2024-04-19T02:18:06.118442+0000","last_fullsized":"2024-04-19T02:17:12.466575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:40.205694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114789+0000","last_change":"2024-04-19T02:17:12.473792+0000","last_active":"2024-04-19T02:18:06.114789+0000","last_peered":"2024-04-19T02:18:06.114789+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473792+0000","last_became_peered":"2024-04-19T02:17:12.473792+0000","last_unstale":"2024-04-19T02:18:06.114789+0000","last_undegraded":"2024-04-19T02:18:06.114789+0000","last_fullsized":"2024-04-19T02:17:12.465913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:38.124985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":41,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.117042+0000","last_change":"2024-04-19T02:17:12.478521+0000","last_active":"2024-04-19T02:18:06.117042+0000","last_peered":"2024-04-19T02:18:06.117042+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:17:12.478521+0000","last_became_peered":"2024-04-19T02:17:12.478521+0000","last_unstale":"2024-04-19T02:18:06.117042+0000","last_undegraded":"2024-04-19T02:17:12.469719+0000","last_fullsized":"2024-04-19T02:17:12.469506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:31.073165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114586+0000","last_change":"2024-04-19T02:17:12.475828+0000","last_active":"2024-04-19T02:18:06.114586+0000","last_peered":"2024-04-19T02:18:06.114586+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.475828+0000","last_became_peered":"2024-04-19T02:17:12.475828+0000","last_unstale":"2024-04-19T02:18:06.114586+0000","last_undegraded":"2024-04-19T02:18:06.114586+0000","last_fullsized":"2024-04-19T02:17:12.466404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:19.851029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":56,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.120333+0000","last_change":"2024-04-19T02:17:12.472468+0000","last_active":"2024-04-19T02:18:06.120333+0000","last_peered":"2024-04-19T02:18:06.120333+0000","last_clean":"2024-04-19T02:17:09.446016+0000","last_became_active":"2024-04-19T02:17:12.472468+0000","last_became_peered":"2024-04-19T02:17:12.472468+0000","last_unstale":"2024-04-19T02:18:06.120333+0000","last_undegraded":"2024-04-19T02:17:12.467641+0000","last_fullsized":"2024-04-19T02:17:12.467537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:06:19.904265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117949+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:18:06.117949+0000","last_peered":"2024-04-19T02:18:06.117949+0000","last_clean":"2024-04-19T02:18:06.117949+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:18:06.117949+0000","last_undegraded":"2024-04-19T02:18:06.117949+0000","last_fullsized":"2024-04-19T02:18:06.117949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":49,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-19T02:18:06.117358+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:18:06.117358+0000","last_peered":"2024-04-19T02:18:06.117358+0000","last_clean":"2024-04-19T02:18:06.117358+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:18:06.117358+0000","last_undegraded":"2024-04-19T02:18:06.117358+0000","last_fullsized":"2024-04-19T02:18:06.117358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-04-19T02:18:06.114269+0000","last_change":"2024-04-19T02:17:12.473290+0000","last_active":"2024-04-19T02:18:06.114269+0000","last_peered":"2024-04-19T02:18:06.114269+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:17:12.473290+0000","last_became_peered":"2024-04-19T02:17:12.473290+0000","last_unstale":"2024-04-19T02:18:06.114269+0000","last_undegraded":"2024-04-19T02:18:06.114269+0000","last_fullsized":"2024-04-19T02:17:12.466109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:51.600518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":57,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:06.117571+0000","last_change":"2024-04-19T02:17:12.477858+0000","last_active":"2024-04-19T02:18:06.117571+0000","last_peered":"2024-04-19T02:18:06.117571+0000","last_clean":"2024-04-19T02:17:07.003600+0000","last_became_active":"2024-04-19T02:17:12.477858+0000","last_became_peered":"2024-04-19T02:17:12.477858+0000","last_unstale":"2024-04-19T02:18:06.117571+0000","last_undegraded":"2024-04-19T02:17:12.470203+0000","last_fullsized":"2024-04-19T02:17:12.469946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.701657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":88,"acting":89,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":20267,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":27572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738396,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":218765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":339968,"data_stored":699288,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":565248,"data_stored":828168,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.53900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:18:11.932 INFO:tasks.thrashosds.thrasher:Setting 3.3 to [2, 0, 1] 2024-04-19T02:18:11.932 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.3', '2', '0', '1'] 2024-04-19T02:18:11.932 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.3 2 0 1 2024-04-19T02:18:12.010 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:12.009+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:12.075 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:12.071+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:12.097 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:12.098 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:12.098 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:12.098 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:12.098 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:12.114 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:12.202 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:12.201+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:12.277 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:12.273+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.93732141599999996, 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.92409335299999995, 2024-04-19T02:18:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.92399863800000004, 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.92261686200000004, 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.91796672400000001, 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.90156211600000002, 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.89234393300000003, 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.88953323299999998, 2024-04-19T02:18:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.88054715100000003, 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.87797434600000002, 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.870747049, 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:12.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:12.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.86551978399999996, 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.85376764999999999, 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.84659247999999998, 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:12.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:12.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:12.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.84259518600000005, 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.368 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:12.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.82675033399999998, 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:12.373 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:12.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.82519426900000004, 2024-04-19T02:18:12.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:12.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:12.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:12.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.82216496900000002, 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:12.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.81755915000000001, 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:12.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:138 4.20 4:056c2bbf:::10000000283.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.80479237100000001, 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083461097999999997, 2024-04-19T02:18:12.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 138 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:12.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486739+0000", 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486796+0000", 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999998e-05 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486827+0000", 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1578999999999997e-05 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486841+0000", 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3913e-05 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563957+0000", 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077115635000000002 2024-04-19T02:18:12.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304202 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570136+0000", 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058746689999999999 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570163+0000", 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7256000000000001e-05 2024-04-19T02:18:12.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570202+0000", 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9264000000000002e-05 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:12.399 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:12.401 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T02:18:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-19T02:18:12.401 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-19T02:18:12.402 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:12.403 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:12.399+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:12.502 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:12.499+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:12.541 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:12.541 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:12.542 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:12.542 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:12.556 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:12.604 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:12.603+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:12.703 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:12.699+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:12.733 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:12.733 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:12.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:12.748 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:12.804 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:12.801+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:12.901 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:12.902 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:12.905 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:12.903+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:12.925 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:12.925 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:12.926 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:12.926 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:12.928 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:12.929 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:12.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:13.006 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:13.005+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:13.090 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:13.091 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:13.107 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:13.108 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:13.103+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:13.208 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:13.207+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:13.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-19T02:18:13.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:18:13.302 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:13.302 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:13.309 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:13.305+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:13.320 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:13.409 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:13.407+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:13.499 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:13.500 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:13.510 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:13.507+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:13.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:13.611 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:13.609+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:13.655 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:13.655 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:13.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:13.720 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:13.719+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:13.799 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:13.800 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:13.813 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:13.811+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:13.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:13.913 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:13.911+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:13.987 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:13.987 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:14.002 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:14.050 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:14.049+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:14.115 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:14.111+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:14.139 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:14.139 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:14.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:14.216 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:14.215+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:14.295 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:18:14.317 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:14.313+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:14.328 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:14.328 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:14.343 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:14.434 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:14.433+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:14.513 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:14.513 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:14.518 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:14.517+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:14.529 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:14.619 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:14.619+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:14.662 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:14.662 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:14.677 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:14.724 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:14.723+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:14.822 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:14.821+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:14.861 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:14.861 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:14.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:14.923 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:14.921+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:14.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:15.005 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:15.005 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:15.020 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:15.023 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:15.021+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:15.089 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:15.090 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:15.090 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:15.112 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:15.115 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:15.115 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:15.125 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:15.123+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:15.158 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:15.158 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:15.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.158 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:2854 4.26 4:64a7f03a:::10000000e7e.00000000:head [write 0~1717 in=1717b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:18:15.158 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:15.157759+0000", 2024-04-19T02:18:15.158 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0016076160000000001, 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016555369999999999, 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2854 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.157759+0000", 2024-04-19T02:18:15.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.157759+0000", 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.157757+0000", 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.157773+0000", 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6039e-05 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.157798+0000", 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5329000000000001e-05 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.157816+0000", 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8236e-05 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.157913+0000", 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6426000000000001e-05 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.158113+0000", 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000199908 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:15.159442+0000", 2024-04-19T02:18:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013297249999999999 2024-04-19T02:18:15.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.163 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.163 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:15.163 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 1 2024-04-19T02:18:15.163 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:15.174 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:15.226 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:15.225+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:15.313 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:15.314 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:15.314 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:15.314 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:15.314 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:15.327 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:15.323+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:15.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:15.427 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:15.425+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:15.514 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1591872099999998, 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:15.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:15.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:15.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1459591470000001, 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:15.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:15.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:15.525 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1458644319999998, 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:15.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:15.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.530 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1444826560000001, 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:15.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:15.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1398325180000004, 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.536 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:15.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:15.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1234279100000002, 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.542 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:15.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:15.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1142097270000004, 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.547 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:15.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.111399027, 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1024129450000002, 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0998401400000004, 2024-04-19T02:18:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0926128430000004, 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0873855780000001, 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0756334440000002, 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0684582740000002, 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0644609799999998, 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0486161279999999, 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.047060063, 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0440307630000003, 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0394249440000003, 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:138 4.20 4:056c2bbf:::10000000283.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0266581649999997, 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083461097999999997, 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 138 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486739+0000", 2024-04-19T02:18:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486796+0000", 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999998e-05 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486827+0000", 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1578999999999997e-05 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486841+0000", 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3913e-05 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563957+0000", 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077115635000000002 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304202 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570136+0000", 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058746689999999999 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570163+0000", 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7256000000000001e-05 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570202+0000", 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9264000000000002e-05 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:15.627 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:15.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:15.629 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:15.627+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:15.729 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:15.725+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:15.776 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:3480 4.31 4:8da30a99:::10000001103.00000000:head [write 0~726 in=726b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:15.773482+0000", 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0038033799999999999, 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038356559999999998, 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:15.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3480 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773482+0000", 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773482+0000", 2024-04-19T02:18:15.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773480+0000", 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773492+0000", 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1606e-05 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773517+0000", 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5006000000000001e-05 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773530+0000", 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2773e-05 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773584+0000", 2024-04-19T02:18:15.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4292000000000001e-05 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.773717+0000", 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013263199999999999 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777171+0000", 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034545829999999998 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777313+0000", 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000141867 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:3481 4.28 4:1401b930:::10000001104.00000000:head [write 0~10102 in=10102b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:15.774315+0000", 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0029709649999999999, 2024-04-19T02:18:15.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031697660000000001, 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3481 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774315+0000", 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774315+0000", 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774313+0000", 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774327+0000", 2024-04-19T02:18:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3573e-05 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774341+0000", 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3976e-05 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774349+0000", 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9370000000000004e-06 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774458+0000", 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109483 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774698+0000", 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023985400000000001 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.774907+0000", 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020858500000000001 2024-04-19T02:18:15.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777431+0000", 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002523754 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:3482 4.3d 4:bf0d7877:::10000001105.00000000:head [write 0~9903 in=9903b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:15.775216+0000", 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.002069352, 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023813689999999999, 2024-04-19T02:18:15.787 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3482 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775216+0000", 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775216+0000", 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775214+0000", 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775251+0000", 2024-04-19T02:18:15.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7353e-05 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775313+0000", 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2261000000000006e-05 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775334+0000", 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0313999999999999e-05 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775397+0000", 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3217000000000001e-05 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775531+0000", 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134265 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:3483 4.3a 4:5fde9e61:::10000001106.00000000:head [write 0~836 in=836b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:15.775929+0000", 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0013569529999999999, 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0017555649999999999, 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:15.792 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3483 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775929+0000", 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775929+0000", 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775927+0000", 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775939+0000", 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2547e-05 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775967+0000", 2024-04-19T02:18:15.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7929e-05 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.775990+0000", 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2546000000000001e-05 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.776179+0000", 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189724 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:15.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.776343+0000", 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016356399999999999 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.776506+0000", 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016279599999999999 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.796 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:3484 4.4 e58/16 4:214027a9:::10000001107.00000000:head v 58'50, mlcod=58'48)", 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:15.777661+0000", 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9996243, 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018216799999999999, 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777661+0000", 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777661+0000", 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777660+0000", 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777669+0000", 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2600000000000005e-06 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777684+0000", 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5255e-05 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777696+0000", 2024-04-19T02:18:15.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1734e-05 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777777+0000", 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1135000000000002e-05 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.777824+0000", 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7317000000000001e-05 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:15.801 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:15.801 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 5 2024-04-19T02:18:15.801 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:15.802 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:15.830 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:15.829+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:15.931 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:15.927+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:15.933 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:15.933 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:15.933 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:15.933 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:15.933 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:15.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:16.033 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:16.029+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:16.134 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:16.133+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.644437977, 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034735895000000003, 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.136 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488859+0000", 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488857+0000", 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488869+0000", 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1226999999999999e-05 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488896+0000", 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7022999999999999e-05 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488911+0000", 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5356999999999999e-05 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501154+0000", 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012242855 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501366+0000", 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000212535 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.501723+0000", 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035625400000000002 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507758+0000", 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060353300000000002 2024-04-19T02:18:16.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523388+0000", 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015630162999999999 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523499+0000", 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000111289 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523595+0000", 2024-04-19T02:18:16.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189e-05 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.644318365, 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034920463999999998, 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488978+0000", 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488977+0000", 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.488985+0000", 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1559999999999995e-06 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489005+0000", 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9720000000000001e-05 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489021+0000", 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5514000000000001e-05 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506488+0000", 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017467047999999999 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506645+0000", 2024-04-19T02:18:16.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015731499999999999 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506976+0000", 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000330661 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513326+0000", 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063501010000000004 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523694+0000", 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010368797000000001 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523812+0000", 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011749200000000001 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523899+0000", 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6766000000000002e-05 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.147 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 111.644156102, 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035042429, 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489141+0000", 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489139+0000", 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489147+0000", 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489170+0000", 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3507e-05 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.489184+0000", 2024-04-19T02:18:16.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022999999999999e-05 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506630+0000", 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017445308 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.506917+0000", 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000287318 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.507228+0000", 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000310644 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.513344+0000", 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061166629999999996 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.523994+0000", 2024-04-19T02:18:16.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010649548 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524103+0000", 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010921600000000001 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:16:24.524183+0000", 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9796000000000006e-05 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.153 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8279074250000003, 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.154 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7816459079999998, 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:16.159 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:16.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.164 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7687042420000001, 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:16.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:16.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7686426910000002, 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.169 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:16.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:16.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7676916230000002, 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:16.175 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:16.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.760551296, 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:27 4.13 4:cbcb6224:::10000000212.00000000:head [write 0~3719] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.379677+0000", 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7536195870000002, 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.071164354999999999, 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 27 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379677+0000", 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379677+0000", 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379676+0000", 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379685+0000", 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0920000000000004e-06 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379702+0000", 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7142e-05 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.379713+0000", 2024-04-19T02:18:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1381e-05 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.446183+0000", 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066469713 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.446345+0000", 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016188699999999999 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450719+0000", 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043742049999999999 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450763+0000", 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3770999999999998e-05 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450841+0000", 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8410000000000003e-05 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7527191929999999, 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.722653727, 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:62 4.22 4:47efb22f:::10000000235.00000000:head [write 0~1242] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.412340+0000", 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7209567689999998, 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073377368999999998, 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412340+0000", 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412340+0000", 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412339+0000", 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412346+0000", 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412357+0000", 2024-04-19T02:18:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412364+0000", 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9040000000000003e-06 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412428+0000", 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3737000000000003e-05 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.412592+0000", 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016401299999999999 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485592+0000", 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073000328000000003 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485639+0000", 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6659999999999997e-05 2024-04-19T02:18:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485717+0000", 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8573999999999997e-05 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7201118800000001, 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:70 4.22 4:45b8cac8:::1000000023d.00000000:head [write 0~2473] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.420180+0000", 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7131168920000004, 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065650613999999996, 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 70 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420180+0000", 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420180+0000", 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420179+0000", 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420189+0000", 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0763e-05 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420205+0000", 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5614999999999999e-05 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420215+0000", 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0237999999999999e-05 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420271+0000", 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5414000000000002e-05 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.420409+0000", 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013819200000000001 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485724+0000", 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065315038000000006 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485755+0000", 2024-04-19T02:18:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1028000000000002e-05 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485830+0000", 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5473000000000001e-05 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:78 4.2a 4:576ad4f4:::10000000245.00000000:head [write 0~1190] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.427194+0000", 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7061029720000001, 2024-04-19T02:18:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.058764617999999998, 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 78 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427194+0000", 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427194+0000", 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427193+0000", 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427202+0000", 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5950000000000005e-06 2024-04-19T02:18:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427216+0000", 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4225e-05 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427225+0000", 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2050000000000002e-06 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427272+0000", 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7479999999999999e-05 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.427390+0000", 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000118022 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485844+0000", 2024-04-19T02:18:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.058453972 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485880+0000", 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5596999999999998e-05 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485958+0000", 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8528000000000004e-05 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:85 4.22 4:450d4ca5:::1000000024c.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.6989622879999997, 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051708032000000001, 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 85 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434334+0000", 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434339+0000", 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3290000000000001e-06 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434350+0000", 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0859999999999999e-05 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434358+0000", 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0090000000000007e-06 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434404+0000", 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6226000000000001e-05 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.434522+0000", 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011820300000000001 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485963+0000", 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051440940999999997 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485997+0000", 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3958999999999998e-05 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.486042+0000", 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5249e-05 2024-04-19T02:18:16.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:91 4.32 4:4e8c6251:::10000000252.00000000:head [write 0~1155] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.439982+0000", 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.6933145200000004, 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051432111000000003, 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.230 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 91 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439982+0000", 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439982+0000", 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439981+0000", 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.439988+0000", 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740000000000002e-06 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.440001+0000", 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3152999999999999e-05 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.440008+0000", 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5299999999999999e-06 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485315+0000", 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045306943000000002 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485387+0000", 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1402000000000005e-05 2024-04-19T02:18:16.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491332+0000", 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059452699999999999 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491358+0000", 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6339999999999999e-05 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491414+0000", 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5912999999999998e-05 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:124 4.28 4:178fb5ad:::10000000274.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.659521185, 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090608116000000002, 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:16.235 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 124 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473779+0000", 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8060000000000001e-06 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473788+0000", 2024-04-19T02:18:16.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1889999999999996e-06 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473794+0000", 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473830+0000", 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6072000000000003e-05 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473970+0000", 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014000199999999999 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474123+0000", 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152874 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474833+0000", 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071059599999999997 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564335+0000", 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089501854000000006 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564363+0000", 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7441999999999999e-05 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564384+0000", 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0936000000000001e-05 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.240 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:67 3.1b 3:ddb4e4d7:::200.00000002:head [write 2386993~1525576 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:15.913126+0000", 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.220170329, 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038922731000000002, 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.913126+0000", 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.913126+0000", 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.913125+0000", 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.915429+0000", 2024-04-19T02:18:16.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00230438 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.915455+0000", 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6279e-05 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.915468+0000", 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2490000000000001e-05 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.915551+0000", 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3671000000000006e-05 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.915686+0000", 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134893 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.951899+0000", 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036212372 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.951955+0000", 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5992000000000002e-05 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:15.952049+0000", 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4426999999999996e-05 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:16.245 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:16.247 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:16.247 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:16.243+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:16.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:18:16.348 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:16.345+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:16.391 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:16.391 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:16.391 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:16.391 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:16.407 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:16.450 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:16.449+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:16.549 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:16.545+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:16.579 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:16.579 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:16.579 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:16.579 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:16.579 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:16.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:16.650 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:16.647+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:16.752 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:16.751+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.4238144100000003, 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.4105863469999997, 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.4104916320000003, 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.4091098559999997, 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.404459718, 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3880551099999998, 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.378836927, 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3760262269999997, 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3670401449999998, 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:16.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.826 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.36446734, 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.357240043, 2024-04-19T02:18:16.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:16.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:16.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.837 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3520127779999997, 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:16.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:16.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:16.843 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3402606439999998, 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3330854739999998, 2024-04-19T02:18:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.856 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3290881800000003, 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.857 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:16.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:16.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:16.862 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3132433280000004, 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:16.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:16.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:16.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:16.868 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3116872629999996, 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:16.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:16.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:16.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:16.874 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3086579629999999, 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:16.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:16.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:16.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3040521439999999, 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.880 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:138 4.20 4:056c2bbf:::10000000283.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2912853650000002, 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083461097999999997, 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 138 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486739+0000", 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486796+0000", 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999998e-05 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486827+0000", 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1578999999999997e-05 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:16.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486841+0000", 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3913e-05 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563957+0000", 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077115635000000002 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304202 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570136+0000", 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058746689999999999 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570163+0000", 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7256000000000001e-05 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570202+0000", 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9264000000000002e-05 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.889 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.890 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.890 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:16.890 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:16.890 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:16.891 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:16.889+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:16.892 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:16.992 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:16.991+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:17.035 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:17.035 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:17.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:17.096 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:17.095+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:17.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:17.194 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:17.193+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:17.223 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:17.223 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:17.223 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:17.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:17.223 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:17.238 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:17.270 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:17.271 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:17.271 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:17.285 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:18:17.300 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:17.301 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:17.301 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:17.293+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:17.305 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:17.305 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:17.362 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:17.362 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:17.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:17.395 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:17.395+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:17.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-19T02:18:17.403 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-19T02:18:17.403 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:18:17.403 INFO:teuthology.orchestra.console.smithi136:Power on 2024-04-19T02:18:17.403 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T02:18:17.427 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-04-19T02:18:17.428 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:18:17.452 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-19T02:18:17.497 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:17.493+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:17.517 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:17.517 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:17.532 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:17.618 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:17.617+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:17.699 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:17.695+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:17.707 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:17.708 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:17.722 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:17.799 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:17.799+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:17.893 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:17.893 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:17.901 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:17.897+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:17.909 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:18.002 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:17.999+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.047 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:18.063 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:18.103 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:18.103+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.203 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:18.199+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.231 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:18.231 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:18.246 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:18.331 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:18.331+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.405 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:18.403+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.416 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:18.416 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:18.432 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:18.506 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:18.505+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:18.567 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:18.568 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:18.582 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:18.607 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:18.603+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.708 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:18.707+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.760 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:18.760 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:18.776 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:18.822 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:18.821+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:18.907 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:18.907 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:18.910 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:18.907+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:18.923 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:19.011 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:19.007+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:19.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2024-04-19T02:18:19.060 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:19.060 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:19.075 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:19.112 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:19.109+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:19.213 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:19.211+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:19.247 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:19.248 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:19.263 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:19.307 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:19.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:18:19.356 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:19.355+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:19.415 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:19.413+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:19.433 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:19.433 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:19.448 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:19.479 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:19.499 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:19.501 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:19.502 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:19.515 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:19.513+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:19.589 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:19.589 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:19.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5558 4.16 4:69ac4ff1:::1000000199c.00000000:head [write 0~1797 in=1797b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:19.588525+0000", 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001819083, 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018379259999999999, 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5558 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:19.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588525+0000", 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588525+0000", 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:19.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588523+0000", 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588536+0000", 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3055e-05 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588557+0000", 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0865000000000001e-05 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588567+0000", 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.55e-06 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588719+0000", 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015255299999999999 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.588943+0000", 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0002241 2024-04-19T02:18:19.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5559 4.26 4:65b70f1c:::1000000199d.00000000:head [write 0~2768 in=2768b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:19.589598+0000", 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00074566300000000003, 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080943499999999995, 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:19.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5559 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589598+0000", 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589598+0000", 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589597+0000", 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589608+0000", 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1347e-05 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589625+0000", 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6663999999999998e-05 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:19.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589634+0000", 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9649999999999997e-06 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589736+0000", 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102787 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:19.589971+0000", 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023475699999999999 2024-04-19T02:18:19.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:19.598 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:19.598 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:19.598 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:19.598 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:19.598 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 2 2024-04-19T02:18:19.598 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:19.606 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:19.616 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:19.615+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:19.717 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:19.713+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:19.793 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:19.793 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:19.793 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:19.793 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:19.793 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:19.809 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:19.850 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:19.849+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:19.918 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:19.917+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6478399370000005, 2024-04-19T02:18:20.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:20.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:20.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:20.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:20.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6346118740000009, 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.017 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:20.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:20.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:20.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:20.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6345171589999996, 2024-04-19T02:18:20.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:20.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6331353830000008, 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:20.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:20.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6284852450000002, 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.032 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:20.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.612080637, 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.037 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:20.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:20.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:20.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:20.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.046 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.046 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.047 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:20.047 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6028624540000003, 2024-04-19T02:18:20.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:20.047 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.047 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.047 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.048 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.048 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.048 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:20.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.048 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:20.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.053 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6000517540000008, 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.054 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:20.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.055 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:20.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:20.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:20.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:20.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:20.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:20.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5910656719999992, 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:20.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5884928669999994, 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:20.066 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:20.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5812655699999993, 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:20.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:20.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5760383050000009, 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:20.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:20.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5642861709999991, 2024-04-19T02:18:20.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:20.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5571110009999991, 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:20.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:20.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5531137069999996, 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.094 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:20.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:20.098 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5372688550000007, 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.099 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:20.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:20.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5357127899999998, 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5326834900000001, 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:20.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:20.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:20.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.114 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5280776710000001, 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:20.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:138 4.20 4:056c2bbf:::10000000283.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5153108920000005, 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083461097999999997, 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:20.119 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 138 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486741+0000", 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486739+0000", 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486796+0000", 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999998e-05 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486827+0000", 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1578999999999997e-05 2024-04-19T02:18:20.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.486841+0000", 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3913e-05 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563957+0000", 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.077115635000000002 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:20.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304202 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570136+0000", 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058746689999999999 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570163+0000", 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7256000000000001e-05 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.570202+0000", 2024-04-19T02:18:20.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9264000000000002e-05 2024-04-19T02:18:20.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.124 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:20.124 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:20.124 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:20.125 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:20.126 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:20.123+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:20.227 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:20.223+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:98 3.1a 3:5e41ab69:::200.00000005:head [write 2156711~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213387+0000", 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064358875999999995, 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064403025000000003, 2024-04-19T02:18:20.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213387+0000", 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213387+0000", 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213386+0000", 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213392+0000", 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213406+0000", 2024-04-19T02:18:20.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3729e-05 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213414+0000", 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0299999999999994e-06 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.248444+0000", 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035030015999999997 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.248695+0000", 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025074100000000002 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.249032+0000", 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033731599999999999 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.252792+0000", 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037600260000000001 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.287 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:99 3.1a 3:5e41ab69:::200.00000005:head [write 2158115~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213483+0000", 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064262311000000003, 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064440937000000004, 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213483+0000", 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213483+0000", 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213482+0000", 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213507+0000", 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4813000000000001e-05 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213527+0000", 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0475999999999998e-05 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213536+0000", 2024-04-19T02:18:20.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2630000000000003e-06 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.249939+0000", 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036403632999999998 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.250136+0000", 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000197009 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.250443+0000", 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030688699999999999 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253846+0000", 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034032910000000001 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.292 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:100 3.1a 3:5e41ab69:::200.00000005:head [write 2159514~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213560+0000", 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064185679999999995, 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064499618999999994, 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213560+0000", 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213560+0000", 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213559+0000", 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213575+0000", 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5886999999999999e-05 2024-04-19T02:18:20.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213588+0000", 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3603e-05 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213596+0000", 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7260000000000002e-06 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.251653+0000", 2024-04-19T02:18:20.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038057039000000001 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.251731+0000", 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8230000000000001e-05 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.251847+0000", 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011538 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255853+0000", 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004006257 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:101 3.1a 3:5e41ab69:::200.00000005:head [write 2160914~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213605+0000", 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064140886999999994, 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064634345999999995, 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.297 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213605+0000", 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213605+0000", 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213604+0000", 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213611+0000", 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213623+0000", 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.261e-05 2024-04-19T02:18:20.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213631+0000", 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2799999999999998e-06 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.252211+0000", 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038580314999999997 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.252314+0000", 2024-04-19T02:18:20.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102963 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.252475+0000", 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016105700000000001 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258091+0000", 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056161359999999999 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:102 3.1a 3:5e41ab69:::200.00000005:head [write 2162314~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213642+0000", 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064103082000000006, 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064715341999999995, 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213642+0000", 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213642+0000", 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213642+0000", 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213646+0000", 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5000000000000001e-06 2024-04-19T02:18:20.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213661+0000", 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4912999999999999e-05 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213669+0000", 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9670000000000001e-06 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.252838+0000", 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039168715 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.252914+0000", 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6586000000000002e-05 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253035+0000", 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000120609 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258108+0000", 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050733180000000003 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:103 3.1a 3:5e41ab69:::200.00000005:head [write 2163715~2254 [fadvise_dontneed] in=2254b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213681+0000", 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064064746000000006, 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064794473000000005, 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.306 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213681+0000", 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213681+0000", 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213680+0000", 2024-04-19T02:18:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213686+0000", 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4670000000000003e-06 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213698+0000", 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2013e-05 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213707+0000", 2024-04-19T02:18:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0000000000000002e-06 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253490+0000", 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039783776 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253535+0000", 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4319e-05 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253599+0000", 2024-04-19T02:18:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4319000000000005e-05 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258127+0000", 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045279309999999998 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:104 3.1a 3:5e41ab69:::200.00000005:head [write 2165969~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064024445999999999, 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064871110999999995, 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213720+0000", 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213726+0000", 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213738+0000", 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2057e-05 2024-04-19T02:18:20.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213745+0000", 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253886+0000", 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040141522999999998 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253963+0000", 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6638999999999996e-05 2024-04-19T02:18:20.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254078+0000", 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115504 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258143+0000", 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040645999999999998 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:105 3.1a 3:5e41ab69:::200.00000005:head [write 2167374~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063989497000000006, 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064955368999999999, 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213755+0000", 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213762+0000", 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3099999999999997e-06 2024-04-19T02:18:20.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213776+0000", 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4256e-05 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213783+0000", 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4170000000000003e-06 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254576+0000", 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040792390999999997 2024-04-19T02:18:20.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254805+0000", 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022928799999999999 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255145+0000", 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034028599999999997 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260051+0000", 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049062100000000003 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:106 3.1a 3:5e41ab69:::200.00000005:head [write 2168773~1421 [fadvise_dontneed] in=1421b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063919086, 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065001822000000001, 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.319 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213825+0000", 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213847+0000", 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1304000000000001e-05 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213853+0000", 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7769999999999997e-06 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213857+0000", 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8500000000000004e-06 2024-04-19T02:18:20.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255923+0000", 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042065845999999997 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256007+0000", 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4400000000000005e-05 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256131+0000", 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000123113 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260072+0000", 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039416759999999999 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:107 3.1a 3:5e41ab69:::200.00000005:head [write 2170194~1922 [fadvise_dontneed] in=1922b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.323 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063881692000000004, 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065080475999999998, 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213863+0000", 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213866+0000", 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6350000000000002e-06 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213875+0000", 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7520000000000002e-06 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213879+0000", 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7950000000000001e-06 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256510+0000", 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042631600999999998 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256771+0000", 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000261258 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.257103+0000", 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033202900000000002 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262757+0000", 2024-04-19T02:18:20.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056537280000000002 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:108 3.1a 3:5e41ab69:::200.00000005:head [write 2172116~1407 [fadvise_dontneed] in=1407b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063822620999999996, 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065137282000000005, 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213922+0000", 2024-04-19T02:18:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213926+0000", 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.799e-06 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213933+0000", 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8680000000000001e-06 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213937+0000", 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0709999999999996e-06 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258216+0000", 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044278961999999998 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258292+0000", 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5789000000000002e-05 2024-04-19T02:18:20.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258408+0000", 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000116575 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262772+0000", 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043633259999999998 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:76 3.1a 3:5e41ab69:::200.00000005:head [write 0~2114509 [fadvise_dontneed] in=2114509b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.078607509000000006, 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080092026999999996, 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199136+0000", 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202611+0000", 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034741699999999999 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202638+0000", 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7634999999999999e-05 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202650+0000", 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1997000000000001e-05 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202732+0000", 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2330999999999995e-05 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202838+0000", 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010571 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202995+0000", 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157045 2024-04-19T02:18:20.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237002+0000", 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034006768999999999 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:109 3.1a 3:5e41ab69:::200.00000005:head [write 2173523~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063767526000000005, 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065382861, 2024-04-19T02:18:20.337 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213977+0000", 2024-04-19T02:18:20.341 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213981+0000", 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6030000000000001e-06 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213988+0000", 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9410000000000001e-06 2024-04-19T02:18:20.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213992+0000", 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7840000000000001e-06 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258773+0000", 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044781673000000001 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259007+0000", 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023356200000000001 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259341+0000", 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033412900000000001 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264603+0000", 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052615159999999999 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:5986 4.9 4:9250f899:::10000001b79.00000000:head [write 0~298 in=298b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.266930+0000", 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.010815223000000001, 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012598064000000001, 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5986 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.345 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.266930+0000", 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.266930+0000", 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.266929+0000", 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.266935+0000", 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4330000000000003e-06 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.266945+0000", 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7790000000000007e-06 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.266950+0000", 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1649999999999997e-06 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.266986+0000", 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5790000000000001e-05 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.267063+0000", 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7832999999999998e-05 2024-04-19T02:18:20.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.267135+0000", 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1311999999999998e-05 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.267985+0000", 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000850554 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:78 3.1a 3:5e41ab69:::200.00000005:head [write 2114509~3105 [fadvise_dontneed] in=3105b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212363+0000", 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065382175000000001, 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067298916, 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212363+0000", 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212363+0000", 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212361+0000", 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212372+0000", 2024-04-19T02:18:20.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1391e-05 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212394+0000", 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-05 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212404+0000", 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0457e-05 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.233879+0000", 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021474891999999999 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.234004+0000", 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012474400000000001 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.234213+0000", 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020927900000000001 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238298+0000", 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040848899999999999 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:110 3.1a 3:5e41ab69:::200.00000005:head [write 2174924~2249 [fadvise_dontneed] in=2249b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063695130000000003, 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065727116000000002, 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.354 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214054+0000", 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.048e-06 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214061+0000", 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9890000000000003e-06 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214064+0000", 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5609999999999999e-06 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260146+0000", 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046082102 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260226+0000", 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9480000000000005e-05 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260343+0000", 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011675000000000001 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264618+0000", 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042758550000000003 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.358 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:5988 4.2e 4:76c6739b:::10000001b7b.00000000:head [write 0~1116 in=1116b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.269348+0000", 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.008397046, 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010542306, 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5988 2024-04-19T02:18:20.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269348+0000", 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269348+0000", 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269348+0000", 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269353+0000", 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4229999999999996e-06 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269363+0000", 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3950000000000007e-06 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269367+0000", 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8289999999999998e-06 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269477+0000", 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110093 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269683+0000", 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020552299999999999 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.269871+0000", 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000188259 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271166+0000", 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012943049999999999 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:79 3.1a 3:5e41ab69:::200.00000005:head [write 2117614~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212416+0000", 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065329725000000005, 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067616778000000002, 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212416+0000", 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212416+0000", 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212415+0000", 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212432+0000", 2024-04-19T02:18:20.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6772000000000001e-05 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212438+0000", 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9329999999999998e-06 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212442+0000", 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3869999999999997e-06 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.234987+0000", 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022545048000000002 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.235070+0000", 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2991000000000006e-05 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.235191+0000", 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012012 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238307+0000", 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003116377 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:111 3.1a 3:5e41ab69:::200.00000005:head [write 2177173~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063647706999999998, 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066050190999999994, 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.368 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214097+0000", 2024-04-19T02:18:20.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214101+0000", 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2259999999999999e-06 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214109+0000", 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214113+0000", 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.924e-06 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260800+0000", 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046686581999999997 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260872+0000", 2024-04-19T02:18:20.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2409000000000004e-05 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260984+0000", 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112272 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264631+0000", 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00364694 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:5990 4.6 4:60fa97b0:::10000001b7d.00000000:head [write 0~1112 in=1112b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.271751+0000", 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0059947799999999999, 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0085105819999999992, 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5990 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.373 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271751+0000", 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271751+0000", 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271749+0000", 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271761+0000", 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2293000000000001e-05 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271790+0000", 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9183000000000002e-05 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271803+0000", 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3276e-05 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.271886+0000", 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2545000000000003e-05 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.272089+0000", 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202878 2024-04-19T02:18:20.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.272298+0000", 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020871 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.273855+0000", 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015573609999999999 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:80 3.1a 3:5e41ab69:::200.00000005:head [write 2119014~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212475+0000", 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065270705999999998, 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067955518000000006, 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212475+0000", 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212475+0000", 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212474+0000", 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212478+0000", 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6830000000000001e-06 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212483+0000", 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.096e-06 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212487+0000", 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.048e-06 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.235715+0000", 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023227437 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.235935+0000", 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022014499999999999 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.236239+0000", 2024-04-19T02:18:20.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304557 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.239299+0000", 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030595689999999998 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:112 3.1a 3:5e41ab69:::200.00000005:head [write 2178578~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:20.382 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.063596995000000003, 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066398127000000001, 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:20.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214148+0000", 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214152+0000", 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000001e-06 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214159+0000", 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0500000000000003e-06 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214163+0000", 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.703e-06 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261259+0000", 2024-04-19T02:18:20.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.047096011 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261478+0000", 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021916500000000001 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261786+0000", 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030754399999999998 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.265066+0000", 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003280416 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:81 3.1a 3:5e41ab69:::200.00000005:head [write 2120413~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212494+0000", 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065251178000000007, 2024-04-19T02:18:20.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068166841000000006, 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212494+0000", 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212494+0000", 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212494+0000", 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212497+0000", 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.179e-06 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212502+0000", 2024-04-19T02:18:20.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.651e-06 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212505+0000", 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.591e-06 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237073+0000", 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024567586999999998 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237151+0000", 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8065999999999994e-05 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237269+0000", 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011792 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241222+0000", 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039527870000000001 2024-04-19T02:18:20.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:5992 4.1c 4:3bff216e:::10000001b80.00000000:head [write 0~2252 in=2252b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.275781+0000", 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0019642010000000001, 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049937610000000002, 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5992 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.275781+0000", 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.275781+0000", 2024-04-19T02:18:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.275779+0000", 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.275795+0000", 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5990000000000001e-05 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.275828+0000", 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2656e-05 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.275849+0000", 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1299000000000001e-05 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.275930+0000", 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0202000000000002e-05 2024-04-19T02:18:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276081+0000", 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015123599999999999 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276207+0000", 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012579900000000001 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.277287+0000", 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010801649999999999 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:82 3.1a 3:5e41ab69:::200.00000005:head [write 2121812~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212516+0000", 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065229996999999998, 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068386971000000005, 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212516+0000", 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212516+0000", 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212515+0000", 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212518+0000", 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2710000000000001e-06 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212523+0000", 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3730000000000003e-06 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212527+0000", 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7639999999999999e-06 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237893+0000", 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025366249 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237947+0000", 2024-04-19T02:18:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4316e-05 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238027+0000", 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9894000000000005e-05 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241229+0000", 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0032014869999999998 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:5993 4.28 4:177f6541:::10000001b81.00000000:head [write 0~1780 in=1780b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.276883+0000", 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00086227500000000002, 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042103849999999996, 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5993 2024-04-19T02:18:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276883+0000", 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276883+0000", 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276882+0000", 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276892+0000", 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0730000000000001e-05 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276914+0000", 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1882000000000002e-05 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276926+0000", 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1739999999999999e-05 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.276982+0000", 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6178000000000003e-05 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.277162+0000", 2024-04-19T02:18:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000179421 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.277303+0000", 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014165900000000001 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.278287+0000", 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00098424199999999997 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:83 3.1a 3:5e41ab69:::200.00000005:head [write 2123212~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212579+0000", 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065166650000000007, 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068645473999999998, 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212579+0000", 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212579+0000", 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212578+0000", 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212583+0000", 2024-04-19T02:18:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2470000000000002e-06 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212590+0000", 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1339999999999998e-06 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212594+0000", 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9570000000000004e-06 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238340+0000", 2024-04-19T02:18:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025746123999999999 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238472+0000", 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013252399999999999 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238556+0000", 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3843000000000003e-05 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242385+0000", 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038285609999999999 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:84 3.1a 3:5e41ab69:::200.00000005:head [write 2124611~3972 [fadvise_dontneed] in=3972b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212656+0000", 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065089975999999994, 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068684763999999995, 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212656+0000", 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212656+0000", 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212655+0000", 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212661+0000", 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2570000000000004e-06 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212669+0000", 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5909999999999998e-06 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212673+0000", 2024-04-19T02:18:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2030000000000002e-06 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238824+0000", 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026151375000000001 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238874+0000", 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0056000000000003e-05 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.238952+0000", 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7746999999999999e-05 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242391+0000", 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003439161 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:85 3.1a 3:5e41ab69:::200.00000005:head [write 2128583~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212685+0000", 2024-04-19T02:18:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.065060364999999995, 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068800799999999995, 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212685+0000", 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212685+0000", 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212685+0000", 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212688+0000", 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0800000000000002e-06 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212694+0000", 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1469999999999998e-06 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212698+0000", 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6339999999999999e-06 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.239340+0000", 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026642046999999999 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.239390+0000", 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0525999999999997e-05 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.239468+0000", 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7485999999999996e-05 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242399+0000", 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029313759999999999 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:86 3.1a 3:5e41ab69:::200.00000005:head [write 2129984~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212755+0000", 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064990944999999994, 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068846800999999999, 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212755+0000", 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212755+0000", 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212753+0000", 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212760+0000", 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212774+0000", 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3852999999999999e-05 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212782+0000", 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7959999999999996e-06 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.239798+0000", 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027015834999999998 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.239856+0000", 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8189999999999997e-05 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.239946+0000", 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9697999999999994e-05 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242407+0000", 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024609889999999998 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:87 3.1a 3:5e41ab69:::200.00000005:head [write 2131383~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212815+0000", 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064930379999999996, 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068906899999999993, 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212815+0000", 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212815+0000", 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212814+0000", 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212821+0000", 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8630000000000002e-06 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212835+0000", 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3747000000000001e-05 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212842+0000", 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4630000000000004e-06 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.240225+0000", 2024-04-19T02:18:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027382764 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.240304+0000", 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8848000000000001e-05 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.240425+0000", 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012118200000000001 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.243248+0000", 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0028228149999999998 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:88 3.1a 3:5e41ab69:::200.00000005:head [write 2132787~1918 [fadvise_dontneed] in=1918b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212853+0000", 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064892031000000003, 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068987594999999999, 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212853+0000", 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212853+0000", 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212853+0000", 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212858+0000", 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1560000000000003e-06 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212870+0000", 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2397e-05 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212877+0000", 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1300000000000003e-06 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.240722+0000", 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027844121999999999 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.240779+0000", 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6932999999999999e-05 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.240862+0000", 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3912000000000006e-05 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.245377+0000", 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045150709999999998 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:89 3.1a 3:5e41ab69:::200.00000005:head [write 2134705~2292 [fadvise_dontneed] in=2292b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.212925+0000", 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064820251999999995, 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069030534000000005, 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212925+0000", 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212925+0000", 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212924+0000", 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212931+0000", 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5869999999999998e-06 2024-04-19T02:18:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212945+0000", 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4072e-05 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.212952+0000", 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5270000000000001e-06 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241266+0000", 2024-04-19T02:18:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028313973999999999 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241321+0000", 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.431e-05 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241404+0000", 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3214999999999995e-05 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.245403+0000", 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039989370000000002 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:90 3.1a 3:5e41ab69:::200.00000005:head [write 2136997~9904 [fadvise_dontneed] in=9904b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213030+0000", 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064715188000000007, 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069053966999999994, 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213030+0000", 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213030+0000", 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213029+0000", 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213055+0000", 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5528999999999999e-05 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213070+0000", 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5106000000000001e-05 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213078+0000", 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1629999999999996e-06 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241697+0000", 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028618869000000002 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241751+0000", 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4253999999999999e-05 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.241833+0000", 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1703e-05 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.247644+0000", 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058111940000000004 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:91 3.1a 3:5e41ab69:::200.00000005:head [write 2146901~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213085+0000", 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064660193000000005, 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069179354999999998, 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213085+0000", 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213085+0000", 2024-04-19T02:18:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213085+0000", 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213090+0000", 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3260000000000003e-06 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213102+0000", 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1824000000000001e-05 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213109+0000", 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9330000000000004e-06 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242446+0000", 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029337453999999999 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242501+0000", 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4588e-05 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242585+0000", 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4727000000000004e-05 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.247659+0000", 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050731140000000001 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:5963 4.3a 4:5c7b4d29:::10000001b5d.00000000:head [write 0~152 in=152b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.231978+0000", 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.045767602999999997, 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.050403189000000001, 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5963 2024-04-19T02:18:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.231978+0000", 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.231978+0000", 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.231977+0000", 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.231984+0000", 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1899999999999998e-06 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.232001+0000", 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7476999999999999e-05 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.232018+0000", 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6546e-05 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261205+0000", 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029187533000000002 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261307+0000", 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010200300000000001 2024-04-19T02:18:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261379+0000", 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1951000000000003e-05 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264649+0000", 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0032694450000000002 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:92 3.1a 3:5e41ab69:::200.00000005:head [write 2148300~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213121+0000", 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064624446000000002, 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069393548999999999, 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213121+0000", 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213121+0000", 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213120+0000", 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213126+0000", 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213138+0000", 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1841999999999999e-05 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213145+0000", 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1169999999999998e-06 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242869+0000", 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029723958000000002 2024-04-19T02:18:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.242922+0000", 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3668999999999997e-05 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.243008+0000", 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5742999999999995e-05 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.247675+0000", 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046668439999999999 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:5964 4.3a 4:5e4192f5:::10000001b5e.00000000:head [write 0~3839 in=3839b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.233943+0000", 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.043802665999999997, 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.048691315999999998, 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5964 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.233943+0000", 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.233943+0000", 2024-04-19T02:18:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.233941+0000", 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.233962+0000", 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1063000000000001e-05 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.233988+0000", 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6139000000000002e-05 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.234006+0000", 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7767000000000001e-05 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261687+0000", 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027680785999999999 2024-04-19T02:18:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261768+0000", 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1020999999999996e-05 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261837+0000", 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9711999999999999e-05 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264667+0000", 2024-04-19T02:18:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002829739 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:93 3.1a 3:5e41ab69:::200.00000005:head [write 2149699~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213155+0000", 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064590057000000006, 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069605658000000001, 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213155+0000", 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213155+0000", 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213155+0000", 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213160+0000", 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6459999999999998e-06 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213172+0000", 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1617000000000001e-05 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213179+0000", 2024-04-19T02:18:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2459999999999997e-06 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.243274+0000", 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030094479 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.243334+0000", 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0645e-05 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.243420+0000", 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5890999999999995e-05 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.247691+0000", 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042702759999999999 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:94 3.1a 3:5e41ab69:::200.00000005:head [write 2151098~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213190+0000", 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064555655000000003, 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069691214000000001, 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213190+0000", 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213190+0000", 2024-04-19T02:18:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213189+0000", 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213195+0000", 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213207+0000", 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2157000000000001e-05 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213214+0000", 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.126e-06 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.243935+0000", 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030720912999999999 2024-04-19T02:18:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.244178+0000", 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024375800000000001 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.244537+0000", 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035893299999999997 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.249833+0000", 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052951509999999997 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:95 3.1a 3:5e41ab69:::200.00000005:head [write 2152502~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213225+0000", 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064520746000000004, 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069776348000000002, 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213225+0000", 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213225+0000", 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213224+0000", 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213229+0000", 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2399999999999998e-06 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213241+0000", 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1576000000000001e-05 2024-04-19T02:18:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213248+0000", 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2400000000000001e-06 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.245489+0000", 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032241353 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.245551+0000", 2024-04-19T02:18:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1342999999999999e-05 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.245639+0000", 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8448000000000004e-05 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.249856+0000", 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042163879999999997 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:96 3.1a 3:5e41ab69:::200.00000005:head [write 2153901~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213262+0000", 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064483589999999993, 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069855124000000005, 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213262+0000", 2024-04-19T02:18:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213262+0000", 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213261+0000", 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213266+0000", 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0429999999999998e-06 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213278+0000", 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1646e-05 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213285+0000", 2024-04-19T02:18:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3440000000000003e-06 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.245974+0000", 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032689004000000001 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.246195+0000", 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022093500000000001 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.246540+0000", 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000344402 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.251499+0000", 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004958942 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:97 3.1a 3:5e41ab69:::200.00000005:head [write 2155306~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213317+0000", 2024-04-19T02:18:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064428101000000002, 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069923462000000006, 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213317+0000", 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213317+0000", 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213316+0000", 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213324+0000", 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213338+0000", 2024-04-19T02:18:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4066999999999999e-05 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213345+0000", 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.61e-06 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.247764+0000", 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034418306000000003 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.247857+0000", 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3094e-05 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.248003+0000", 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014612800000000001 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.251517+0000", 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0035143489999999999 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.484 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:20.484 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 43 2024-04-19T02:18:20.484 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:20.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:20.485 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:20.337+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:20.486 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:20.483+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:20.586 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:20.585+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:20.618 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:20.618 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:20.633 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:20.687 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:20.685+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:20.767 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4596581870000005, 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4133966700000009, 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.773 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:20.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:20.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4004550039999994, 2024-04-19T02:18:20.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:20.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:20.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4003934529999995, 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:20.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:20.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3994423850000004, 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:20.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:20.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.794 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3923020580000003, 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:20.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:20.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3844699550000001, 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:20.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3544044890000002, 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.805 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3518626420000004, 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:20.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:20.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:124 4.28 4:178fb5ad:::10000000274.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2912719470000003, 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090608116000000002, 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:20.817 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 124 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473779+0000", 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8060000000000001e-06 2024-04-19T02:18:20.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473788+0000", 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1889999999999996e-06 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473794+0000", 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473830+0000", 2024-04-19T02:18:20.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6072000000000003e-05 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473970+0000", 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014000199999999999 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474123+0000", 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152874 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474833+0000", 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071059599999999997 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564335+0000", 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089501854000000006 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564363+0000", 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7441999999999999e-05 2024-04-19T02:18:20.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564384+0000", 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0936000000000001e-05 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:76 3.1a 3:5e41ab69:::200.00000005:head [write 0~2114509 [fadvise_dontneed] in=2114509b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56590939600000001, 2024-04-19T02:18:20.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090582039000000003, 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199136+0000", 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202611+0000", 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034741699999999999 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202638+0000", 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7634999999999999e-05 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202650+0000", 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1997000000000001e-05 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202732+0000", 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2330999999999995e-05 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202838+0000", 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010571 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202995+0000", 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157045 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237002+0000", 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034006768999999999 2024-04-19T02:18:20.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289632+0000", 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052630059 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289682+0000", 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9635000000000002e-05 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289720+0000", 2024-04-19T02:18:20.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8315000000000002e-05 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:104 3.1a 3:5e41ab69:::200.00000005:head [write 2165969~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.551326333, 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080943838000000004, 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213720+0000", 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213726+0000", 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213738+0000", 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2057e-05 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213745+0000", 2024-04-19T02:18:20.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253886+0000", 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040141522999999998 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253963+0000", 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6638999999999996e-05 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254078+0000", 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115504 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258143+0000", 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040645999999999998 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294560+0000", 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036416614999999999 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294606+0000", 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6229000000000001e-05 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294665+0000", 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9126000000000003e-05 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.834 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:105 3.1a 3:5e41ab69:::200.00000005:head [write 2167374~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.551291384, 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081039823999999996, 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213755+0000", 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213762+0000", 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3099999999999997e-06 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213776+0000", 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4256e-05 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213783+0000", 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4170000000000003e-06 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254576+0000", 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040792390999999997 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254805+0000", 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022928799999999999 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255145+0000", 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034028599999999997 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260051+0000", 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049062100000000003 2024-04-19T02:18:20.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294720+0000", 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034668643999999998 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294763+0000", 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2590999999999999e-05 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294796+0000", 2024-04-19T02:18:20.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3138e-05 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:106 3.1a 3:5e41ab69:::200.00000005:head [write 2168773~1421 [fadvise_dontneed] in=1421b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55122097299999995, 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081087216000000004, 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213825+0000", 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213847+0000", 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1304000000000001e-05 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213853+0000", 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7769999999999997e-06 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213857+0000", 2024-04-19T02:18:20.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8500000000000004e-06 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255923+0000", 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042065845999999997 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256007+0000", 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4400000000000005e-05 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256131+0000", 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000123113 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260072+0000", 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039416759999999999 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294843+0000", 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034770823999999999 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294884+0000", 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0745999999999999e-05 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294914+0000", 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9793000000000001e-05 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.845 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:107 3.1a 3:5e41ab69:::200.00000005:head [write 2170194~1922 [fadvise_dontneed] in=1922b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55118357900000003, 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081182144999999997, 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213863+0000", 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213866+0000", 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6350000000000002e-06 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213875+0000", 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7520000000000002e-06 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213879+0000", 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7950000000000001e-06 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256510+0000", 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042631600999999998 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256771+0000", 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000261258 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.257103+0000", 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033202900000000002 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262757+0000", 2024-04-19T02:18:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056537280000000002 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294965+0000", 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032207950999999999 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295011+0000", 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5940999999999999e-05 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295046+0000", 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4832000000000001e-05 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:108 3.1a 3:5e41ab69:::200.00000005:head [write 2172116~1407 [fadvise_dontneed] in=1407b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55112450800000001, 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081237127000000006, 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.851 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213922+0000", 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213926+0000", 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.799e-06 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213933+0000", 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8680000000000001e-06 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213937+0000", 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0709999999999996e-06 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258216+0000", 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044278961999999998 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258292+0000", 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5789000000000002e-05 2024-04-19T02:18:20.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258408+0000", 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000116575 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262772+0000", 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043633259999999998 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295094+0000", 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032321877999999998 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295130+0000", 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6944999999999999e-05 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295160+0000", 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9507999999999999e-05 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.856 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:109 3.1a 3:5e41ab69:::200.00000005:head [write 2173523~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55106941300000001, 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081292229999999993, 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213977+0000", 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213981+0000", 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6030000000000001e-06 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213988+0000", 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9410000000000001e-06 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213992+0000", 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7840000000000001e-06 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258773+0000", 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044781673000000001 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259007+0000", 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023356200000000001 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259341+0000", 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033412900000000001 2024-04-19T02:18:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264603+0000", 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052615159999999999 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295204+0000", 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030601587999999999 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295241+0000", 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6646000000000001e-05 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295270+0000", 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9368000000000001e-05 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:110 3.1a 3:5e41ab69:::200.00000005:head [write 2174924~2249 [fadvise_dontneed] in=2249b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.862 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55099701700000003, 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081331492000000005, 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214054+0000", 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.048e-06 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214061+0000", 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9890000000000003e-06 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214064+0000", 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5609999999999999e-06 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260146+0000", 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046082102 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260226+0000", 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9480000000000005e-05 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260343+0000", 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011675000000000001 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264618+0000", 2024-04-19T02:18:20.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042758550000000003 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295317+0000", 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030698723000000001 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295353+0000", 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5882e-05 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295382+0000", 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8855000000000001e-05 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:111 3.1a 3:5e41ab69:::200.00000005:head [write 2177173~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55094959399999999, 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081396476999999995, 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214097+0000", 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:20.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214101+0000", 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2259999999999999e-06 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214109+0000", 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214113+0000", 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.924e-06 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260800+0000", 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046686581999999997 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260872+0000", 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2409000000000004e-05 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260984+0000", 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112272 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264631+0000", 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00364694 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295428+0000", 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030796372999999998 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295464+0000", 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6331999999999997e-05 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295494+0000", 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0304e-05 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:112 3.1a 3:5e41ab69:::200.00000005:head [write 2178578~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55089888200000003, 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081460894000000006, 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214148+0000", 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214152+0000", 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000001e-06 2024-04-19T02:18:20.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214159+0000", 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0500000000000003e-06 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214163+0000", 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.703e-06 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261259+0000", 2024-04-19T02:18:20.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.047096011 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261478+0000", 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021916500000000001 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261786+0000", 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030754399999999998 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:20.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.265066+0000", 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003280416 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295545+0000", 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030478315999999998 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295581+0000", 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6569000000000002e-05 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:20.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295609+0000", 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8268000000000001e-05 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:20.879 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:20.880 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:20.881 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:20.877+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:20.982 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:20.977+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:6349 4.2d 4:b6dadc49:::10000001d12.00000000:head [write 0~1803 in=1803b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:21.011968+0000", 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.002637978, 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026887529999999999, 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.014 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 6349 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.011968+0000", 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.011968+0000", 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.011966+0000", 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.011979+0000", 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2717e-05 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.012008+0000", 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9475000000000002e-05 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.012022+0000", 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3540000000000001e-05 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.012117+0000", 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4891999999999999e-05 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.012326+0000", 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020954900000000001 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.012522+0000", 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000195422 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.013698+0000", 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011765980000000001 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.018 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:6350 4.23 4:c7f335b5:::10000001d13.00000000:head [write 0~2206 in=2206b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:21.014021+0000", 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00058521300000000001, 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089177400000000002, 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 6350 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.019 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014021+0000", 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014021+0000", 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014019+0000", 2024-04-19T02:18:21.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014032+0000", 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2796000000000001e-05 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014061+0000", 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9606000000000001e-05 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014075+0000", 2024-04-19T02:18:21.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3582e-05 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014128+0000", 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2768e-05 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014262+0000", 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013466300000000001 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:21.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:21.014387+0000", 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012511600000000001 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 2 2024-04-19T02:18:21.023 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:21.029 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:21.114 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:21.113+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:21.184 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:21.181+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:21.202 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:21.203 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:21.203 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:21.203 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:21.203 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:21.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:21.285 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:21.283+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:21.383 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:21.383 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:21.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.026027525, 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:21.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:21.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.389 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.012799462, 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.012704747000001, 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.011322971, 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:21.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.006672833, 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.404 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:21.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9902682249999994, 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:21.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9810500419999997, 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.414 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:21.418 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9782393420000002, 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.419 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:21.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:21.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9692532600000003, 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:21.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9666804550000005, 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.429 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.433 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9594531580000005, 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9542258930000003, 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.439 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:21.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:21.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9424737590000003, 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:21.444 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:21.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9352985890000003, 2024-04-19T02:18:21.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:21.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:21.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:21.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9313012950000008, 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:21.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9154564430000001, 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.460 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:21.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:21.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:21.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9139003779999992, 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.465 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:21.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:21.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9108710779999996, 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:21.470 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:21.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9062652589999995, 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:21.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:21.479 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:76 3.1a e59/15 3:5e41ab69:::200.00000005:head v 59'2, mlcod=0'0)", 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.177414634, 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.086223288999999995, 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:21.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202824+0000", 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:21.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205673+0000", 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028490899999999999 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205700+0000", 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6553000000000001e-05 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205711+0000", 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1483e-05 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205830+0000", 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119255 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205870+0000", 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9328e-05 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.288950+0000", 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083080322999999998 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:21.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.289048+0000", 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000007e-05 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:21.484 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:21.484 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:18:21.497 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:21.481+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:21.497 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:21.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:21.586 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:21.583+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:21.596 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-19T02:18:21.641 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:6627 4.2d e60/16)", 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:21.643091+0000", 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7887999999999996e-05, 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106401, 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:21.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:21.643091+0000", 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:21.643091+0000", 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:21.643090+0000", 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:21.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:21.643108+0000", 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8765000000000001e-05 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:21.643130+0000", 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1569e-05 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:21.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:21.643140+0000", 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8130000000000007e-06 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 1 2024-04-19T02:18:21.645 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:21.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:21.671 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:21.671 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:21.672 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:21.687 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:21.685+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:21.695 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:21.695 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:21.698 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:21.698 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:21.788 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:21.787+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:21.829 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:21.829 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:21.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:21.890 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:21.889+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:21.991 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:21.987+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:22.018 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:22.019 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:22.033 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:22.091 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:22.089+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:22.165 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:22.165 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:22.180 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:22.193 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:22.191+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:22.293 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:22.289+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:22.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:18:22.348 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:22.349 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:22.364 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:22.395 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:22.391+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:22.496 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:22.495+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:22.534 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:22.534 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:22.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:22.599 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:22.599+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:22.697 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:22.697 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:22.697 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:22.693+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:22.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:22.798 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:22.797+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:22.884 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:22.885 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:22.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:22.900 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:22.895+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:23.002 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:22.999+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:23.079 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:23.079 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:23.094 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:23.138 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:23.137+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:23.206 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:23.203+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:23.232 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:23.232 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:23.247 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:23.307 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:23.303+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:23.333 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:18:23.411 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:23.409+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:23.419 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:23.419 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:23.434 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:23.511 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:23.511+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:23.602 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:23.602 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:23.612 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:23.609+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:23.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:23.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:23.713 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:23.711+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:23.758 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:23.759 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:23.773 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:23.814 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:23.813+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:23.866 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:23.866 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:23.866 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:23.888 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:23.891 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:23.892 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:23.915 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:23.913+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:23.944 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:23.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:23.945 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:23.945 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:23.945 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:23.961 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:24.016 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:24.013+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:24.096 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.788678037, 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:24.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.102 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.742416520000001, 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.729474853999999, 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:24.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.112 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.729413302999999, 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:24.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:24.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.728462235, 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:24.118 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:24.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:24.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.721321908, 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:24.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:24.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.713489805, 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:24.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:24.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:24.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.683424339, 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:24.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.139 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.680882492, 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:24.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:24.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:124 4.28 4:178fb5ad:::10000000274.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.620291797, 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090608116000000002, 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 124 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:24.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473779+0000", 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8060000000000001e-06 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473788+0000", 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1889999999999996e-06 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473794+0000", 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473830+0000", 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6072000000000003e-05 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473970+0000", 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014000199999999999 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474123+0000", 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152874 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474833+0000", 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071059599999999997 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564335+0000", 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089501854000000006 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564363+0000", 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7441999999999999e-05 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564384+0000", 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0936000000000001e-05 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:76 3.1a 3:5e41ab69:::200.00000005:head [write 0~2114509 [fadvise_dontneed] in=2114509b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.151 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8949292460000002, 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090582039000000003, 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:24.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199136+0000", 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202611+0000", 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034741699999999999 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202638+0000", 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7634999999999999e-05 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202650+0000", 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1997000000000001e-05 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202732+0000", 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2330999999999995e-05 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202838+0000", 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010571 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202995+0000", 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157045 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237002+0000", 2024-04-19T02:18:24.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034006768999999999 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289632+0000", 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052630059 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289682+0000", 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9635000000000002e-05 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289720+0000", 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8315000000000002e-05 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:104 3.1a 3:5e41ab69:::200.00000005:head [write 2165969~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8803461829999999, 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080943838000000004, 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213720+0000", 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213726+0000", 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213738+0000", 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2057e-05 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213745+0000", 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253886+0000", 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040141522999999998 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253963+0000", 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6638999999999996e-05 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254078+0000", 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115504 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258143+0000", 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040645999999999998 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294560+0000", 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036416614999999999 2024-04-19T02:18:24.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294606+0000", 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6229000000000001e-05 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294665+0000", 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9126000000000003e-05 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:105 3.1a 3:5e41ab69:::200.00000005:head [write 2167374~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8803112340000001, 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081039823999999996, 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213755+0000", 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213762+0000", 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3099999999999997e-06 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213776+0000", 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4256e-05 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213783+0000", 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4170000000000003e-06 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254576+0000", 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040792390999999997 2024-04-19T02:18:24.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254805+0000", 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022928799999999999 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255145+0000", 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034028599999999997 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260051+0000", 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049062100000000003 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294720+0000", 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034668643999999998 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294763+0000", 2024-04-19T02:18:24.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2590999999999999e-05 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294796+0000", 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3138e-05 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:106 3.1a 3:5e41ab69:::200.00000005:head [write 2168773~1421 [fadvise_dontneed] in=1421b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8802408229999998, 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081087216000000004, 2024-04-19T02:18:24.168 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213825+0000", 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213847+0000", 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1304000000000001e-05 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213853+0000", 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7769999999999997e-06 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213857+0000", 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8500000000000004e-06 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255923+0000", 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042065845999999997 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256007+0000", 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4400000000000005e-05 2024-04-19T02:18:24.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256131+0000", 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000123113 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260072+0000", 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039416759999999999 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294843+0000", 2024-04-19T02:18:24.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034770823999999999 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294884+0000", 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0745999999999999e-05 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294914+0000", 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9793000000000001e-05 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:107 3.1a 3:5e41ab69:::200.00000005:head [write 2170194~1922 [fadvise_dontneed] in=1922b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8802034289999998, 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081182144999999997, 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213863+0000", 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213866+0000", 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6350000000000002e-06 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213875+0000", 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7520000000000002e-06 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213879+0000", 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7950000000000001e-06 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256510+0000", 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042631600999999998 2024-04-19T02:18:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256771+0000", 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000261258 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.257103+0000", 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033202900000000002 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262757+0000", 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056537280000000002 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294965+0000", 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032207950999999999 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295011+0000", 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5940999999999999e-05 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295046+0000", 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4832000000000001e-05 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:108 3.1a 3:5e41ab69:::200.00000005:head [write 2172116~1407 [fadvise_dontneed] in=1407b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8801443579999999, 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081237127000000006, 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.179 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213922+0000", 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213926+0000", 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.799e-06 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213933+0000", 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8680000000000001e-06 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213937+0000", 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0709999999999996e-06 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258216+0000", 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044278961999999998 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258292+0000", 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5789000000000002e-05 2024-04-19T02:18:24.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258408+0000", 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000116575 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262772+0000", 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043633259999999998 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295094+0000", 2024-04-19T02:18:24.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032321877999999998 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295130+0000", 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6944999999999999e-05 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295160+0000", 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9507999999999999e-05 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:109 3.1a 3:5e41ab69:::200.00000005:head [write 2173523~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8800892629999999, 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081292229999999993, 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213977+0000", 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213981+0000", 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6030000000000001e-06 2024-04-19T02:18:24.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213988+0000", 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9410000000000001e-06 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213992+0000", 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7840000000000001e-06 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258773+0000", 2024-04-19T02:18:24.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044781673000000001 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259007+0000", 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023356200000000001 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259341+0000", 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033412900000000001 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264603+0000", 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052615159999999999 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295204+0000", 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030601587999999999 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295241+0000", 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6646000000000001e-05 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295270+0000", 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9368000000000001e-05 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:110 3.1a 3:5e41ab69:::200.00000005:head [write 2174924~2249 [fadvise_dontneed] in=2249b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8800168670000001, 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081331492000000005, 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.190 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214054+0000", 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.048e-06 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214061+0000", 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9890000000000003e-06 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214064+0000", 2024-04-19T02:18:24.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5609999999999999e-06 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260146+0000", 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046082102 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260226+0000", 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9480000000000005e-05 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260343+0000", 2024-04-19T02:18:24.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011675000000000001 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264618+0000", 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042758550000000003 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295317+0000", 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030698723000000001 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295353+0000", 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5882e-05 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295382+0000", 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8855000000000001e-05 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.195 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:111 3.1a 3:5e41ab69:::200.00000005:head [write 2177173~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8799694439999999, 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081396476999999995, 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214097+0000", 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214101+0000", 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2259999999999999e-06 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214109+0000", 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214113+0000", 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.924e-06 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260800+0000", 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046686581999999997 2024-04-19T02:18:24.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260872+0000", 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2409000000000004e-05 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260984+0000", 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112272 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264631+0000", 2024-04-19T02:18:24.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00364694 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295428+0000", 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030796372999999998 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295464+0000", 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6331999999999997e-05 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295494+0000", 2024-04-19T02:18:24.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0304e-05 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:112 3.1a 3:5e41ab69:::200.00000005:head [write 2178578~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8799187320000001, 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081460894000000006, 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:24.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214148+0000", 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214152+0000", 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000001e-06 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214159+0000", 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0500000000000003e-06 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214163+0000", 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.703e-06 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261259+0000", 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.047096011 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261478+0000", 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021916500000000001 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261786+0000", 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030754399999999998 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.265066+0000", 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003280416 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295545+0000", 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030478315999999998 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295581+0000", 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6569000000000002e-05 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:24.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295609+0000", 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8268000000000001e-05 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:24.206 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:24.208 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:24.208 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:24.207+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:24.309 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:24.307+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:8079 4.37 4:ee3d3de8:::100000024c9.00000000:head [write 0~998 in=998b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:24.341150+0000", 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0017916150000000001, 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001810423, 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.342 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 8079 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341150+0000", 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341150+0000", 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341149+0000", 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341156+0000", 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2519999999999996e-06 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341171+0000", 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4887e-05 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341179+0000", 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3010000000000007e-06 2024-04-19T02:18:24.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341247+0000", 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8304000000000002e-05 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341435+0000", 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018827000000000001 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.341624+0000", 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000188977 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:24.342956+0000", 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013318609999999999 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 1 2024-04-19T02:18:24.347 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:24.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:24.409 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:24.405+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:24.484 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:24.484 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:24.485 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:24.485 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:24.499 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:24.546 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:24.545+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:24.611 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:24.607+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:24.688 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:24.688 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.331839112000001, 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:24.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:24.695 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.318611048999999, 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:24.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:24.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:24.700 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.318516334, 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:24.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:24.704 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.317134557999999, 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.705 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:24.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.312484420000001, 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.710 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:24.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:24.715 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.296079812, 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:24.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.720 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.286861629000001, 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:24.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.284050928999999, 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:24.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:24.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:24.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.275064846999999, 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:24.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:24.736 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.272492042, 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:24.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:24.740 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.265264745, 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.741 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:24.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:24.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.260037479999999, 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:24.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:24.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.248285345999999, 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.241110175999999, 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.237112882, 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.221268029999999, 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.219711965, 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.216682665, 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.212076846, 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:76 3.1a e59/15 3:5e41ab69:::200.00000005:head v 59'2, mlcod=0'0)", 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4832262209999998, 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.086223288999999995, 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202824+0000", 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205673+0000", 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028490899999999999 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205700+0000", 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6553000000000001e-05 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205711+0000", 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1483e-05 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205830+0000", 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119255 2024-04-19T02:18:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205870+0000", 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9328e-05 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.288950+0000", 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083080322999999998 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.289048+0000", 2024-04-19T02:18:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000007e-05 2024-04-19T02:18:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:24.794 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:24.796 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:24.793+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:24.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:24.896 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:24.893+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:24.929 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:24.929 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:24.929 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:24.929 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:24.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:24.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-19T02:18:24.997 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:24.993+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:25.068 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:25.068 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:25.068 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:25.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:25.068 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:25.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:25.128 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:25.127+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:25.198 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:25.195+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.909593921999999, 2024-04-19T02:18:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.863332405, 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.850390739, 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.850329188, 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:25.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.849378120000001, 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.239 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:25.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:25.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:25.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.842237793000001, 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.245 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.834405690000001, 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:25.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:25.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.258 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.804340224000001, 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:25.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:25.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:25.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.801798377000001, 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:25.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:124 4.28 4:178fb5ad:::10000000274.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.741207682000001, 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090608116000000002, 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 124 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:25.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473779+0000", 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8060000000000001e-06 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473788+0000", 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1889999999999996e-06 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473794+0000", 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473830+0000", 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6072000000000003e-05 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473970+0000", 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014000199999999999 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474123+0000", 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152874 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474833+0000", 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071059599999999997 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564335+0000", 2024-04-19T02:18:25.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089501854000000006 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564363+0000", 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7441999999999999e-05 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564384+0000", 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0936000000000001e-05 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:76 3.1a 3:5e41ab69:::200.00000005:head [write 0~2114509 [fadvise_dontneed] in=2114509b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0158451309999998, 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090582039000000003, 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199136+0000", 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202611+0000", 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034741699999999999 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202638+0000", 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7634999999999999e-05 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202650+0000", 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1997000000000001e-05 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202732+0000", 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2330999999999995e-05 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202838+0000", 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010571 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202995+0000", 2024-04-19T02:18:25.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157045 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237002+0000", 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034006768999999999 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289632+0000", 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052630059 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289682+0000", 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9635000000000002e-05 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289720+0000", 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8315000000000002e-05 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.282 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:104 3.1a 3:5e41ab69:::200.00000005:head [write 2165969~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0012620679999999, 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080943838000000004, 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213720+0000", 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213726+0000", 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:18:25.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213738+0000", 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2057e-05 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213745+0000", 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253886+0000", 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040141522999999998 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253963+0000", 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6638999999999996e-05 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254078+0000", 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115504 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258143+0000", 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040645999999999998 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294560+0000", 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036416614999999999 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294606+0000", 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6229000000000001e-05 2024-04-19T02:18:25.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294665+0000", 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9126000000000003e-05 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:105 3.1a 3:5e41ab69:::200.00000005:head [write 2167374~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0012271190000002, 2024-04-19T02:18:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081039823999999996, 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213755+0000", 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213762+0000", 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3099999999999997e-06 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213776+0000", 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4256e-05 2024-04-19T02:18:25.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213783+0000", 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4170000000000003e-06 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254576+0000", 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040792390999999997 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254805+0000", 2024-04-19T02:18:25.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022928799999999999 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255145+0000", 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034028599999999997 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260051+0000", 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049062100000000003 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294720+0000", 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034668643999999998 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294763+0000", 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2590999999999999e-05 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294796+0000", 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3138e-05 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.293 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:106 3.1a 3:5e41ab69:::200.00000005:head [write 2168773~1421 [fadvise_dontneed] in=1421b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0011567079999999, 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081087216000000004, 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:25.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213825+0000", 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213847+0000", 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1304000000000001e-05 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213853+0000", 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7769999999999997e-06 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213857+0000", 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8500000000000004e-06 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255923+0000", 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042065845999999997 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256007+0000", 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4400000000000005e-05 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256131+0000", 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000123113 2024-04-19T02:18:25.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260072+0000", 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039416759999999999 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294843+0000", 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034770823999999999 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294884+0000", 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0745999999999999e-05 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294914+0000", 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9793000000000001e-05 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:107 3.1a 3:5e41ab69:::200.00000005:head [write 2170194~1922 [fadvise_dontneed] in=1922b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:25.299 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0011193140000003, 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081182144999999997, 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:25.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213863+0000", 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213866+0000", 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6350000000000002e-06 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213875+0000", 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7520000000000002e-06 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213879+0000", 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7950000000000001e-06 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256510+0000", 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042631600999999998 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256771+0000", 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000261258 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.257103+0000", 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033202900000000002 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262757+0000", 2024-04-19T02:18:25.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056537280000000002 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294965+0000", 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032207950999999999 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295011+0000", 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5940999999999999e-05 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295046+0000", 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4832000000000001e-05 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:108 3.1a 3:5e41ab69:::200.00000005:head [write 2172116~1407 [fadvise_dontneed] in=1407b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0010602430000004, 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081237127000000006, 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213922+0000", 2024-04-19T02:18:25.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213926+0000", 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.799e-06 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213933+0000", 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8680000000000001e-06 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213937+0000", 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0709999999999996e-06 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258216+0000", 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044278961999999998 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258292+0000", 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5789000000000002e-05 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258408+0000", 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000116575 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262772+0000", 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043633259999999998 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295094+0000", 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032321877999999998 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295130+0000", 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6944999999999999e-05 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295160+0000", 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9507999999999999e-05 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:109 3.1a 3:5e41ab69:::200.00000005:head [write 2173523~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.001005148, 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081292229999999993, 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213977+0000", 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213981+0000", 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6030000000000001e-06 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213988+0000", 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9410000000000001e-06 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213992+0000", 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7840000000000001e-06 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258773+0000", 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044781673000000001 2024-04-19T02:18:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259007+0000", 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023356200000000001 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259341+0000", 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033412900000000001 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264603+0000", 2024-04-19T02:18:25.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052615159999999999 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295204+0000", 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030601587999999999 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295241+0000", 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6646000000000001e-05 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295270+0000", 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9368000000000001e-05 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:110 3.1a 3:5e41ab69:::200.00000005:head [write 2174924~2249 [fadvise_dontneed] in=2249b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0009327519999998, 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081331492000000005, 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214054+0000", 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.048e-06 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214061+0000", 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9890000000000003e-06 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214064+0000", 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5609999999999999e-06 2024-04-19T02:18:25.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260146+0000", 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046082102 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260226+0000", 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9480000000000005e-05 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260343+0000", 2024-04-19T02:18:25.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011675000000000001 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264618+0000", 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042758550000000003 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295317+0000", 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030698723000000001 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295353+0000", 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5882e-05 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295382+0000", 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8855000000000001e-05 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:111 3.1a 3:5e41ab69:::200.00000005:head [write 2177173~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:25.321 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0008853289999999, 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081396476999999995, 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214097+0000", 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214101+0000", 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2259999999999999e-06 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214109+0000", 2024-04-19T02:18:25.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214113+0000", 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.924e-06 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260800+0000", 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046686581999999997 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260872+0000", 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2409000000000004e-05 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260984+0000", 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112272 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264631+0000", 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00364694 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295428+0000", 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030796372999999998 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295464+0000", 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6331999999999997e-05 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295494+0000", 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0304e-05 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:112 3.1a 3:5e41ab69:::200.00000005:head [write 2178578~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.0008346169999998, 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081460894000000006, 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:25.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214148+0000", 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:25.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214152+0000", 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000001e-06 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214159+0000", 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0500000000000003e-06 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214163+0000", 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.703e-06 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261259+0000", 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.047096011 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261478+0000", 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021916500000000001 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261786+0000", 2024-04-19T02:18:25.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030754399999999998 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.265066+0000", 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003280416 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295545+0000", 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030478315999999998 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295581+0000", 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6569000000000002e-05 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295609+0000", 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8268000000000001e-05 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:25.332 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:25.334 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:25.335 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:25.333+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:25.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:18:25.434 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:25.433+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:25.467 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:8455 4.1 4:83b88139:::1000000268a.00000000:head [write 0~7709 in=7709b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T02:18:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:25.464749+0000", 2024-04-19T02:18:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0032093870000000002, 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032742209999999999, 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 8455 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.464749+0000", 2024-04-19T02:18:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.464749+0000", 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.464748+0000", 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.464758+0000", 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0305e-05 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.464769+0000", 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1173e-05 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.464777+0000", 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6260000000000003e-06 2024-04-19T02:18:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.465865+0000", 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010877770000000001 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.466073+0000", 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020866 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.466266+0000", 2024-04-19T02:18:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019316599999999999 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467253+0000", 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098630300000000001 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:8456 4.1c e61/16 4:393cf90f:::1000000268b.00000000:head v 61'120, mlcod=61'118)", 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:25.467234+0000", 2024-04-19T02:18:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00072440000000000004, 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093657600000000005, 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467234+0000", 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467234+0000", 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467233+0000", 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467246+0000", 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2619000000000001e-05 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467255+0000", 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6840000000000008e-06 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467260+0000", 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9370000000000003e-06 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467317+0000", 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6913999999999998e-05 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:25.467349+0000", 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1875999999999998e-05 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 2 2024-04-19T02:18:25.476 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:25.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:25.570 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:25.569+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:25.597 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:18:25.637 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:25.635+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:25.678 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:25.678 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:25.678 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:25.678 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:25.678 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:25.695 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:25.707 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-19T02:18:25.738 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:25.735+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:25.808 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-04-19T02:18:25.839 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:25.837+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:25.873 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:25.873 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:25.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:25.873 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:25.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.516802783999999, 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:25.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:25.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:25.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.503574721, 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.503480006, 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:25.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:25.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:25.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:25.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:25.890 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.890 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.890 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.50209823, 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.891 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:25.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:25.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:25.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:25.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:25.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.497448092000001, 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.898 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.899 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:25.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.899 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:25.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:25.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:25.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:25.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:25.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:25.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:25.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:25.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:25.907 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.481043484000001, 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:25.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:25.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:25.913 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.471825300999999, 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.914 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:25.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:25.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:25.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:25.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.469014601, 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.920 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:25.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.921 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:25.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:25.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:25.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:25.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.460028519, 2024-04-19T02:18:25.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:25.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:25.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:25.932 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.457455714, 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:25.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:25.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:25.937 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.450228417, 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:25.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:25.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.445001152, 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:25.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:25.948 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.433249018, 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.949 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:25.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:25.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:25.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:25.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:25.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:25.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:25.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:25.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:25.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:25.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:25.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:25.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.957 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.957 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.958 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:25.958 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.426073848, 2024-04-19T02:18:25.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:25.958 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.958 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.959 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.959 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.959 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.959 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:25.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.959 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:25.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:25.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:25.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:25.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:25.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:25.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.966 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.422076554, 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.967 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:25.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.406231701999999, 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.973 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:25.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.978 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.404675637, 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:25.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:25.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:25.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:25.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:25.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:25.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:25.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:25.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:25.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:25.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:25.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:25.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:25.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:25.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:25.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:25.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:25.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:25.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:25.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:25.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.987 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:25.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:25.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.988 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:25.988 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:25.989 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.401646337000001, 2024-04-19T02:18:25.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:25.989 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:25.989 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:25.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:25.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:25.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:25.990 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:25.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.990 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:25.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:25.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:25.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:25.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:25.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:25.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:25.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:25.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:25.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:25.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:25.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:25.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:25.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:25.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:25.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:25.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:25.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:25.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:25.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:25.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:25.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:25.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:25.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:25.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:25.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:25.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:25.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:25.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:25.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:25.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:25.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:25.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:26.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:26.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:26.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:26.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:26.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:26.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:26.002 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:26.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:26.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.003 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:26.003 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:26.003 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.397040518000001, 2024-04-19T02:18:26.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:26.003 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:26.004 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:26.004 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:26.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:26.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:26.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:26.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:26.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:26.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:26.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:26.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:26.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:26.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:26.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:26.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:26.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:26.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:26.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:26.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:26.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:26.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:26.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:26.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:26.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:26.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:26.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:26.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:26.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:26.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:26.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:26.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:26.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:26.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:26.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:26.013 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:26.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:26.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.013 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:76 3.1a e59/15 3:5e41ab69:::200.00000005:head v 59'2, mlcod=0'0)", 2024-04-19T02:18:26.013 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:26.014 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6681898930000001, 2024-04-19T02:18:26.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.086223288999999995, 2024-04-19T02:18:26.014 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:26.014 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:26.014 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:26.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:26.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:26.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:26.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:26.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:26.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:26.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:26.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202824+0000", 2024-04-19T02:18:26.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:26.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:26.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205673+0000", 2024-04-19T02:18:26.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028490899999999999 2024-04-19T02:18:26.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:26.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205700+0000", 2024-04-19T02:18:26.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6553000000000001e-05 2024-04-19T02:18:26.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:26.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205711+0000", 2024-04-19T02:18:26.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1483e-05 2024-04-19T02:18:26.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:26.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205830+0000", 2024-04-19T02:18:26.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119255 2024-04-19T02:18:26.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:26.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205870+0000", 2024-04-19T02:18:26.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9328e-05 2024-04-19T02:18:26.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:26.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.288950+0000", 2024-04-19T02:18:26.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083080322999999998 2024-04-19T02:18:26.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:26.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:26.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:26.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.289048+0000", 2024-04-19T02:18:26.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000007e-05 2024-04-19T02:18:26.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:26.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:26.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:26.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:26.024 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:26.024 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:26.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:26.025 DEBUG:teuthology.orchestra.console.smithi136:Waiting for login prompt 2024-04-19T02:18:26.025 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi136 2024-04-19T02:18:26.036 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:26.037 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.031+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.136 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.135+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.173 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:8981 4.f e61/16 4:f06d624e:::10000002925.00000000:head v 61'131, mlcod=61'129)", 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:26.173894+0000", 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00083424400000000004, 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084414400000000001, 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:26.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173894+0000", 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173894+0000", 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173892+0000", 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173905+0000", 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3312999999999999e-05 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173932+0000", 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6461999999999998e-05 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173944+0000", 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1747e-05 2024-04-19T02:18:26.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173977+0000", 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3325999999999999e-05 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.173992+0000", 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5165e-05 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174704+0000", 2024-04-19T02:18:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071166000000000003 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174738+0000", 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4110999999999999e-05 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:8982 4.3e 4:7e90999c:::10000002926.00000000:head [write 0~1411 in=1411b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:26.174217+0000", 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00051141700000000001, 2024-04-19T02:18:26.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00075567799999999997, 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 8982 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174217+0000", 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:26.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174217+0000", 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174216+0000", 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174222+0000", 2024-04-19T02:18:26.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4819999999999999e-06 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174237+0000", 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5259000000000001e-05 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174245+0000", 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0679999999999997e-06 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174288+0000", 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2150999999999997e-05 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174410+0000", 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012236500000000001 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:26.174518+0000", 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010791800000000001 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:26.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:26.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:26.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:26.183 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:26.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 2 2024-04-19T02:18:26.183 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:26.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:26.194 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:26.195 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:26.221 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:26.223 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:26.224 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:26.237 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:26.233+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:26.337 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.335+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.353 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:18:26.369 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:26.369 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:26.386 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:26.476 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.475+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.539 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.535+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.569 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:26.570 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:26.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:26.640 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.639+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.734 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:26.734 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:26.741 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.739+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:26.843 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.839+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:26.890 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:26.891 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:26.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:26.944 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:26.943+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:27.040 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:27.040 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:27.045 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:27.043+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:27.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:27.146 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:27.143+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:27.195 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:27.195 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:27.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:27.247 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:27.244+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:27.348 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:27.343+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:27.380 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:27.380 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:27.396 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:27.450 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:27.444+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:27.551 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:27.547+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:27.569 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:27.569 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:27.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:27.652 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:27.648+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:27.721 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:27.721 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:27.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:27.778 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:27.776+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:27.854 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:27.852+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:27.905 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:27.905 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:27.920 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:27.963 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:27.960+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:28.056 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:28.052+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:28.088 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:28.088 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:28.104 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:28.157 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:28.152+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:28.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:28.238 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:28.238 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:28.253 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:28.258 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:28.256+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:28.359 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:28.356+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:28.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:18:28.388 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:28.388 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:28.398 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:28.398 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:28.398 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:28.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:28.427 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:28.427 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:28.430 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:28.430 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:28.460 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:28.459+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:28.513 INFO:tasks.workunit.client.0.smithi073.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-19T02:18:28.517 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-19T02:18:28.517 INFO:tasks.workunit.client.0.smithi073.stderr:+ make 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.229907742000002, 2024-04-19T02:18:28.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:28.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.183646225, 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:28.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:28.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:28.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:28.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:28.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.170704559000001, 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:28.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:28.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.170643007999999, 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:28.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:28.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:28.562 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.16969194, 2024-04-19T02:18:28.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:28.563 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.563 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:28.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.162551613000002, 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:28.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:28.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.15471951, 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:28.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:28.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.124654044, 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:28.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.122112197, 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:28.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:124 4.28 4:178fb5ad:::10000000274.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.061521502000002, 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090608116000000002, 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 124 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.592 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473779+0000", 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8060000000000001e-06 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473788+0000", 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1889999999999996e-06 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473794+0000", 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473830+0000", 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6072000000000003e-05 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473970+0000", 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014000199999999999 2024-04-19T02:18:28.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474123+0000", 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152874 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474833+0000", 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071059599999999997 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564335+0000", 2024-04-19T02:18:28.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089501854000000006 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564363+0000", 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7441999999999999e-05 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564384+0000", 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0936000000000001e-05 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:76 3.1a 3:5e41ab69:::200.00000005:head [write 0~2114509 [fadvise_dontneed] in=2114509b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3361589509999998, 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090582039000000003, 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:28.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199136+0000", 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202611+0000", 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034741699999999999 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202638+0000", 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7634999999999999e-05 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202650+0000", 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1997000000000001e-05 2024-04-19T02:18:28.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202732+0000", 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2330999999999995e-05 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202838+0000", 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010571 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202995+0000", 2024-04-19T02:18:28.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157045 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237002+0000", 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034006768999999999 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289632+0000", 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052630059 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289682+0000", 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9635000000000002e-05 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289720+0000", 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8315000000000002e-05 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:104 3.1a 3:5e41ab69:::200.00000005:head [write 2165969~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.603 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3215758879999999, 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080943838000000004, 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213721+0000", 2024-04-19T02:18:28.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213720+0000", 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213726+0000", 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213738+0000", 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2057e-05 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213745+0000", 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253886+0000", 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040141522999999998 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.253963+0000", 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6638999999999996e-05 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254078+0000", 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115504 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258143+0000", 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040645999999999998 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294560+0000", 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036416614999999999 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294606+0000", 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6229000000000001e-05 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294665+0000", 2024-04-19T02:18:28.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9126000000000003e-05 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:105 3.1a 3:5e41ab69:::200.00000005:head [write 2167374~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3215409390000001, 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081039823999999996, 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213756+0000", 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213755+0000", 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:28.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213762+0000", 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3099999999999997e-06 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213776+0000", 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4256e-05 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213783+0000", 2024-04-19T02:18:28.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4170000000000003e-06 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254576+0000", 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040792390999999997 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.254805+0000", 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022928799999999999 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255145+0000", 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034028599999999997 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260051+0000", 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049062100000000003 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294720+0000", 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034668643999999998 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294763+0000", 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2590999999999999e-05 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294796+0000", 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3138e-05 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:106 3.1a 3:5e41ab69:::200.00000005:head [write 2168773~1421 [fadvise_dontneed] in=1421b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3214705280000008, 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081087216000000004, 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213825+0000", 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213847+0000", 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1304000000000001e-05 2024-04-19T02:18:28.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213853+0000", 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7769999999999997e-06 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213857+0000", 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8500000000000004e-06 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255923+0000", 2024-04-19T02:18:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042065845999999997 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256007+0000", 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4400000000000005e-05 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256131+0000", 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000123113 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260072+0000", 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039416759999999999 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294843+0000", 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034770823999999999 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294884+0000", 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0745999999999999e-05 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294914+0000", 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9793000000000001e-05 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:107 3.1a 3:5e41ab69:::200.00000005:head [write 2170194~1922 [fadvise_dontneed] in=1922b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3214331339999994, 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081182144999999997, 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213863+0000", 2024-04-19T02:18:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213866+0000", 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6350000000000002e-06 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213875+0000", 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7520000000000002e-06 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213879+0000", 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7950000000000001e-06 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256510+0000", 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042631600999999998 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256771+0000", 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000261258 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.257103+0000", 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033202900000000002 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262757+0000", 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056537280000000002 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294965+0000", 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032207950999999999 2024-04-19T02:18:28.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295011+0000", 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5940999999999999e-05 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295046+0000", 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4832000000000001e-05 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:108 3.1a 3:5e41ab69:::200.00000005:head [write 2172116~1407 [fadvise_dontneed] in=1407b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3213740630000004, 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081237127000000006, 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213922+0000", 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213926+0000", 2024-04-19T02:18:28.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.799e-06 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213933+0000", 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8680000000000001e-06 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213937+0000", 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0709999999999996e-06 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258216+0000", 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044278961999999998 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258292+0000", 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5789000000000002e-05 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258408+0000", 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000116575 2024-04-19T02:18:28.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262772+0000", 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043633259999999998 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295094+0000", 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032321877999999998 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295130+0000", 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6944999999999999e-05 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295160+0000", 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9507999999999999e-05 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:109 3.1a 3:5e41ab69:::200.00000005:head [write 2173523~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:28.631 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3213189679999999, 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081292229999999993, 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213977+0000", 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213981+0000", 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6030000000000001e-06 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213988+0000", 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9410000000000001e-06 2024-04-19T02:18:28.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213992+0000", 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7840000000000001e-06 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258773+0000", 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044781673000000001 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259007+0000", 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023356200000000001 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259341+0000", 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033412900000000001 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264603+0000", 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052615159999999999 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295204+0000", 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030601587999999999 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295241+0000", 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6646000000000001e-05 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295270+0000", 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9368000000000001e-05 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.636 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:110 3.1a 3:5e41ab69:::200.00000005:head [write 2174924~2249 [fadvise_dontneed] in=2249b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3212465719999997, 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081331492000000005, 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:28.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214054+0000", 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.048e-06 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214061+0000", 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9890000000000003e-06 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214064+0000", 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5609999999999999e-06 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260146+0000", 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046082102 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260226+0000", 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9480000000000005e-05 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260343+0000", 2024-04-19T02:18:28.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011675000000000001 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264618+0000", 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042758550000000003 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295317+0000", 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030698723000000001 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295353+0000", 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5882e-05 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295382+0000", 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8855000000000001e-05 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:111 3.1a 3:5e41ab69:::200.00000005:head [write 2177173~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3211991489999999, 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081396476999999995, 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:28.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214097+0000", 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214101+0000", 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2259999999999999e-06 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214109+0000", 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214113+0000", 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.924e-06 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260800+0000", 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046686581999999997 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260872+0000", 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2409000000000004e-05 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260984+0000", 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112272 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264631+0000", 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00364694 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295428+0000", 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030796372999999998 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295464+0000", 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6331999999999997e-05 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295494+0000", 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0304e-05 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.647 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:112 3.1a 3:5e41ab69:::200.00000005:head [write 2178578~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3211484369999997, 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081460894000000006, 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214148+0000", 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214152+0000", 2024-04-19T02:18:28.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000001e-06 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214159+0000", 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0500000000000003e-06 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214163+0000", 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.703e-06 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:28.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261259+0000", 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.047096011 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261478+0000", 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021916500000000001 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261786+0000", 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030754399999999998 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.265066+0000", 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003280416 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295545+0000", 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030478315999999998 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295581+0000", 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6569000000000002e-05 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:28.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295609+0000", 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8268000000000001e-05 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:28.653 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:28.654 INFO:tasks.workunit.client.0.smithi073.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-19T02:18:28.655 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:28.655 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:28.652+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:28.755 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:28.755+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:28.785 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:28.785 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:28.785 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:28.785 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:28.799 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:28.856 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:28.852+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:28.923 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:28.923 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:28.924 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:28.924 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:28.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:28.957 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:28.955+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:29.059 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:29.056+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:29.105 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:29.105 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:29.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:29.105 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:29.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.748317302, 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:29.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:29.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:29.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.735089239000001, 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:29.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.734994524000001, 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.733612747999999, 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:29.121 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:29.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.72896261, 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:29.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:29.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:29.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.712558002000002, 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.134 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:29.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.703339819, 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.140 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:29.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:29.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.700529118999999, 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.146 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:29.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:29.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.691543036999999, 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:29.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:29.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.688970231999999, 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.161 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.681742934999999, 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:29.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:29.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:29.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.676515670000001, 2024-04-19T02:18:29.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:29.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.664763535999999, 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.174 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:29.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:29.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.657588365999999, 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.179 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:29.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:29.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.653591072000001, 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11514907000000001, 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 100 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448938+0000", 2024-04-19T02:18:29.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448936+0000", 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448950+0000", 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3441999999999999e-05 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.448976+0000", 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6329000000000002e-05 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.449013+0000", 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6807999999999997e-05 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559505+0000", 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.11049189099999999 2024-04-19T02:18:29.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559632+0000", 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127429 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564034+0000", 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044017819999999999 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564053+0000", 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9437e-05 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564087+0000", 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4091999999999998e-05 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:115 4.0 4:0063648e:::1000000026b.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:29.191 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.63774622, 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.099816994000000006, 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 115 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464783+0000", 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464780+0000", 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464796+0000", 2024-04-19T02:18:29.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5599000000000001e-05 2024-04-19T02:18:29.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464836+0000", 2024-04-19T02:18:29.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9601000000000003e-05 2024-04-19T02:18:29.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.464858+0000", 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869000000000001e-05 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561057+0000", 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.096198061000000001 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561393+0000", 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033698700000000002 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564536+0000", 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003142176 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564563+0000", 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6920999999999999e-05 2024-04-19T02:18:29.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564600+0000", 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7623000000000002e-05 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:116 4.0 4:03f2d51d:::1000000026c.00000000:head [write 0~59119] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.636190155000001, 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.098322244000000003, 2024-04-19T02:18:29.197 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 116 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466339+0000", 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466337+0000", 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466393+0000", 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5810000000000003e-05 2024-04-19T02:18:29.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466425+0000", 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.466439+0000", 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3875e-05 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562427+0000", 2024-04-19T02:18:29.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.095988338000000006 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562531+0000", 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104314 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564604+0000", 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020732239999999998 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564627+0000", 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2892e-05 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564662+0000", 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4245000000000002e-05 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:119 4.10 4:0b3aea15:::1000000026f.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.202 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.633160855, 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.097772033999999994, 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 119 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469369+0000", 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469367+0000", 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469378+0000", 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1379000000000001e-05 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469405+0000", 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749000000000001e-05 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.469421+0000", 2024-04-19T02:18:29.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5702e-05 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562538+0000", 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.093117753999999997 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562844+0000", 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030562800000000001 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563195+0000", 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035108900000000001 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564683+0000", 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001487873 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567098+0000", 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024146910000000001 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567123+0000", 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5414000000000001e-05 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.567141+0000", 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7504999999999999e-05 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:124 4.28 e57/16 4:178fb5ad:::10000000274.00000000:head v 57'5, mlcod=0'0)", 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.628555036000002, 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089741199999999993, 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473974+0000", 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473973+0000", 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.473985+0000", 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1839e-05 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474004+0000", 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9012999999999999e-05 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.474019+0000", 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5199e-05 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557134+0000", 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083115113000000004 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557144+0000", 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0111e-05 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563694+0000", 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065494669999999998 2024-04-19T02:18:29.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563716+0000", 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1778000000000001e-05 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:76 3.1a e59/15 3:5e41ab69:::200.00000005:head v 59'2, mlcod=0'0)", 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.8997044110000001, 2024-04-19T02:18:29.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.086223288999999995, 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202825+0000", 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.202824+0000", 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205673+0000", 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028490899999999999 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205700+0000", 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6553000000000001e-05 2024-04-19T02:18:29.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205711+0000", 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1483e-05 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205830+0000", 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119255 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.205870+0000", 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9328e-05 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.288950+0000", 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.083080322999999998 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:20.289048+0000", 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8400000000000007e-05 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.218 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.218 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:29.220 INFO:tasks.workunit.client.0.smithi073.stderr:++ readlink -f fsstress 2024-04-19T02:18:29.220 INFO:tasks.workunit.client.0.smithi073.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-19T02:18:29.220 INFO:tasks.workunit.client.0.smithi073.stderr:+ popd 2024-04-19T02:18:29.220 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-19T02:18:29.221 INFO:tasks.workunit.client.0.smithi073.stderr:+ popd 2024-04-19T02:18:29.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:29.222 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-19T02:18:29.222 INFO:tasks.workunit.client.0.smithi073.stderr:++ mktemp -d -p . 2024-04-19T02:18:29.222 INFO:tasks.workunit.client.0.smithi073.stderr:+ T=./tmp.l7tSRLsH4W 2024-04-19T02:18:29.222 INFO:tasks.workunit.client.0.smithi073.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.l7tSRLsH4W -l 1 -n 1000 -p 10 -v 2024-04-19T02:18:29.226 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:29.215+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:seed = 1713627850 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:0/0: mknod c0 0 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/0: dread - no filename 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/1: truncate - no filename 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/2: fdatasync - no filename 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:0/1: chown c0 41416 1 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:1/0: symlink l0 0 2024-04-19T02:18:29.234 INFO:tasks.workunit.client.0.smithi073.stdout:1/1: rmdir - no directory 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:0/2: symlink l1 0 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:0/3: dwrite - no filename 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:1/2: creat f1 x:0 0 0 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:4/0: stat - no entries 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:4/1: creat f0 x:0 0 0 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/0: chown . 89177555 1 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/1: rename - no filename 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:5/0: mkdir d0 0 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:5/1: dread - no filename 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:4/2: write f0 [562682,21742] 0 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:5/2: chown d0 303789 1 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:5/3: write - no filename 2024-04-19T02:18:29.235 INFO:tasks.workunit.client.0.smithi073.stdout:5/4: dread - no filename 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:5/5: dwrite - no filename 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:6/2: creat f0 x:0 0 0 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:3/0: creat f0 x:0 0 0 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:8/0: creat f0 x:0 0 0 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:6/3: rename f0 to f1 0 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:3/1: dread - f0 zero size 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:8/1: mknod c1 0 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:7/0: read - no filename 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:8/2: dread - f0 zero size 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:6/4: chown f1 204925 1 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:9/0: dread - no filename 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:7/1: mkdir d0 0 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:3/2: rename f0 to f1 0 2024-04-19T02:18:29.236 INFO:tasks.workunit.client.0.smithi073.stdout:6/5: dread - f1 zero size 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:4/3: fdatasync f0 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:8/3: link f0 f2 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:9/1: mkdir d0 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:9/2: dwrite - no filename 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:7/2: mknod d0/c1 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:7/3: dwrite - no filename 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:9/3: stat d0 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:9/4: dwrite - no filename 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:3/3: link f1 f2 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:4/4: creat f1 x:0 0 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:8/4: creat f3 x:0 0 0 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:8/5: rmdir - no directory 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:7/4: rename d0 to d0/d2 22 2024-04-19T02:18:29.237 INFO:tasks.workunit.client.0.smithi073.stdout:7/5: dwrite - no filename 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:7/6: write - no filename 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:7/7: truncate - no filename 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:7/8: truncate - no filename 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:5/6: symlink d0/l1 0 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:5/7: read - no filename 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:3/4: mkdir d3 0 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:8/6: creat f4 x:0 0 0 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:3/5: chown d3 14 1 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:9/5: mknod d0/c1 0 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:5/8: creat d0/f2 x:0 0 0 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:7/9: mkdir d0/d3 0 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:9/6: mknod d0/c2 0 2024-04-19T02:18:29.238 INFO:tasks.workunit.client.0.smithi073.stdout:9/7: write - no filename 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/9: chown d0/l1 14798730 1 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:9/8: rmdir d0 39 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/3: dwrite f1 [0,4194304] 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/10: dread - d0/f2 zero size 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/4: mknod c2 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/11: write d0/f2 [242472,83301] 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:4/5: dwrite f1 [0,4194304] 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/5: dread f1 [0,4194304] 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/6: creat f3 x:0 0 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/7: mknod c4 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/8: chown f3 5432718 1 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/9: rename c2 to c5 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:4/6: read f0 [500163,47547] 0 2024-04-19T02:18:29.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/12: dread d0/f2 [0,4194304] 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/7: mknod c2 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/13: mknod d0/c3 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/8: mknod c3 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/9: creat f4 x:0 0 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/14: dread d0/f2 [0,4194304] 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/10: creat f5 x:0 0 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/15: mknod d0/c4 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/11: unlink f5 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/16: write d0/f2 [506767,75260] 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/12: link c3 c6 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/17: rename d0/c4 to d0/c5 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/13: mknod c7 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/14: creat f8 x:0 0 0 2024-04-19T02:18:29.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/18: truncate d0/f2 1567845 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:4/15: unlink c7 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:5/19: write d0/f2 [217445,119016] 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:4/16: write f4 [856019,55830] 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:4/17: mknod c9 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:4/18: dread f4 [0,4194304] 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:4/19: mkdir da 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:0/4: getdents . 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:0/5: fdatasync - no filename 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:0/6: write - no filename 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:3/6: rename f1 to d3/f4 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:6/6: getdents . 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:9/9: chown d0 9835665 1 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:0/7: creat f2 x:0 0 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:3/7: creat d3/f5 x:0 0 0 2024-04-19T02:18:29.241 INFO:tasks.workunit.client.0.smithi073.stdout:6/7: symlink l2 0 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:7/10: rename d0/c1 to d0/d3/c4 0 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:7/11: dwrite - no filename 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:3/8: dread - d3/f4 zero size 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:4/20: dwrite f1 [0,4194304] 0 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:9/10: chown d0/c2 1896399889 1 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:9/11: truncate - no filename 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/20: rename d0 to d0/d6 22 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:9/12: stat d0/c2 0 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:6/8: creat f3 x:0 0 0 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:7/12: mknod d0/c5 0 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:7/13: read - no filename 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:6/9: readlink l2 0 2024-04-19T02:18:29.242 INFO:tasks.workunit.client.0.smithi073.stdout:4/21: rename c6 to da/cb 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:5/21: rename d0 to d0/d7 22 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:7/14: creat d0/f6 x:0 0 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:6/10: unlink f1 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/22: creat da/fc x:0 0 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:7/15: rmdir d0/d3 39 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/23: symlink da/ld 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:7/16: link d0/f6 d0/f7 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/8: dwrite f2 [0,4194304] 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/9: dread f2 [0,4194304] 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/10: chown f2 2 1 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/11: rename c0 to c3 0 2024-04-19T02:18:29.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/12: creat f4 x:0 0 0 2024-04-19T02:18:29.256 INFO:tasks.workunit.client.0.smithi073.stdout:1/10: write f1 [4197603,113669] 0 2024-04-19T02:18:29.257 INFO:tasks.workunit.client.0.smithi073.stdout:1/11: unlink f1 0 2024-04-19T02:18:29.258 INFO:tasks.workunit.client.0.smithi073.stdout:1/12: link f3 f6 0 2024-04-19T02:18:29.259 INFO:tasks.workunit.client.0.smithi073.stdout:5/22: rmdir d0 39 2024-04-19T02:18:29.259 INFO:tasks.workunit.client.0.smithi073.stdout:3/9: getdents d3 0 2024-04-19T02:18:29.259 INFO:tasks.workunit.client.0.smithi073.stdout:6/11: fsync f3 0 2024-04-19T02:18:29.260 INFO:tasks.workunit.client.0.smithi073.stdout:1/13: write f6 [750723,118265] 0 2024-04-19T02:18:29.260 INFO:tasks.workunit.client.0.smithi073.stdout:3/10: dread - d3/f5 zero size 2024-04-19T02:18:29.260 INFO:tasks.workunit.client.0.smithi073.stdout:6/12: dread - f3 zero size 2024-04-19T02:18:29.260 INFO:tasks.workunit.client.0.smithi073.stdout:4/24: rename da/cb to da/ce 0 2024-04-19T02:18:29.261 INFO:tasks.workunit.client.0.smithi073.stdout:5/23: readlink d0/l1 0 2024-04-19T02:18:29.261 INFO:tasks.workunit.client.0.smithi073.stdout:6/13: symlink l4 0 2024-04-19T02:18:29.261 INFO:tasks.workunit.client.0.smithi073.stdout:3/11: mkdir d3/d6 0 2024-04-19T02:18:29.261 INFO:tasks.workunit.client.0.smithi073.stdout:3/12: readlink - no filename 2024-04-19T02:18:29.261 INFO:tasks.workunit.client.0.smithi073.stdout:4/25: truncate f8 317617 0 2024-04-19T02:18:29.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/14: creat f5 x:0 0 0 2024-04-19T02:18:29.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/15: read - f3 zero size 2024-04-19T02:18:29.263 INFO:tasks.workunit.client.0.smithi073.stdout:3/13: creat d3/d6/f7 x:0 0 0 2024-04-19T02:18:29.263 INFO:tasks.workunit.client.0.smithi073.stdout:6/16: stat f3 0 2024-04-19T02:18:29.263 INFO:tasks.workunit.client.0.smithi073.stdout:3/14: symlink d3/l8 0 2024-04-19T02:18:29.264 INFO:tasks.workunit.client.0.smithi073.stdout:1/14: read f6 [745261,118421] 0 2024-04-19T02:18:29.265 INFO:tasks.workunit.client.0.smithi073.stdout:3/15: creat d3/d6/f9 x:0 0 0 2024-04-19T02:18:29.265 INFO:tasks.workunit.client.0.smithi073.stdout:1/15: chown f3 25417 1 2024-04-19T02:18:29.266 INFO:tasks.workunit.client.0.smithi073.stdout:3/16: mknod d3/ca 0 2024-04-19T02:18:29.267 INFO:tasks.workunit.client.0.smithi073.stdout:3/17: rmdir d3 39 2024-04-19T02:18:29.268 INFO:tasks.workunit.client.0.smithi073.stdout:1/16: write f3 [1319127,114678] 0 2024-04-19T02:18:29.270 INFO:tasks.workunit.client.0.smithi073.stdout:1/17: write f6 [1424792,47208] 0 2024-04-19T02:18:29.270 INFO:tasks.workunit.client.0.smithi073.stdout:3/18: mkdir d3/d6/db 0 2024-04-19T02:18:29.273 INFO:tasks.workunit.client.0.smithi073.stdout:1/18: write f6 [2511734,38824] 0 2024-04-19T02:18:29.273 INFO:tasks.workunit.client.0.smithi073.stdout:3/19: mknod d3/cc 0 2024-04-19T02:18:29.273 INFO:tasks.workunit.client.0.smithi073.stdout:5/24: dwrite d0/f2 [0,4194304] 0 2024-04-19T02:18:29.274 INFO:tasks.workunit.client.0.smithi073.stdout:1/19: symlink l7 0 2024-04-19T02:18:29.274 INFO:tasks.workunit.client.0.smithi073.stdout:3/20: rmdir d3 39 2024-04-19T02:18:29.275 INFO:tasks.workunit.client.0.smithi073.stdout:5/25: rename d0 to d0/d8 22 2024-04-19T02:18:29.275 INFO:tasks.workunit.client.0.smithi073.stdout:4/26: dwrite da/fc [0,4194304] 0 2024-04-19T02:18:29.275 INFO:tasks.workunit.client.0.smithi073.stdout:1/20: write f6 [148006,24995] 0 2024-04-19T02:18:29.276 INFO:tasks.workunit.client.0.smithi073.stdout:5/26: write d0/f2 [3403200,103225] 0 2024-04-19T02:18:29.277 INFO:tasks.workunit.client.0.smithi073.stdout:3/21: getdents d3/d6/db 0 2024-04-19T02:18:29.278 INFO:tasks.workunit.client.0.smithi073.stdout:3/22: creat d3/d6/fd x:0 0 0 2024-04-19T02:18:29.279 INFO:tasks.workunit.client.0.smithi073.stdout:3/23: dread - d3/f4 zero size 2024-04-19T02:18:29.279 INFO:tasks.workunit.client.0.smithi073.stdout:3/24: fsync f2 0 2024-04-19T02:18:29.280 INFO:tasks.workunit.client.0.smithi073.stdout:3/25: stat d3/d6/f9 0 2024-04-19T02:18:29.283 INFO:tasks.workunit.client.0.smithi073.stdout:3/26: symlink d3/d6/db/le 0 2024-04-19T02:18:29.291 INFO:tasks.workunit.client.0.smithi073.stdout:1/21: dread f6 [0,4194304] 0 2024-04-19T02:18:29.292 INFO:tasks.workunit.client.0.smithi073.stdout:5/27: dwrite d0/f2 [0,4194304] 0 2024-04-19T02:18:29.294 INFO:tasks.workunit.client.0.smithi073.stdout:4/27: dwrite f1 [0,4194304] 0 2024-04-19T02:18:29.294 INFO:tasks.workunit.client.0.smithi073.stdout:1/22: rename l0 to l8 0 2024-04-19T02:18:29.296 INFO:tasks.workunit.client.0.smithi073.stdout:1/23: read f3 [2298868,85578] 0 2024-04-19T02:18:29.298 INFO:tasks.workunit.client.0.smithi073.stdout:1/24: link f6 f9 0 2024-04-19T02:18:29.299 INFO:tasks.workunit.client.0.smithi073.stdout:3/27: dwrite d3/d6/f7 [0,4194304] 0 2024-04-19T02:18:29.305 INFO:tasks.workunit.client.0.smithi073.stdout:4/28: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.306 INFO:tasks.workunit.client.0.smithi073.stdout:4/29: mknod da/cf 0 2024-04-19T02:18:29.306 INFO:tasks.workunit.client.0.smithi073.stdout:4/30: read f1 [1837517,33197] 0 2024-04-19T02:18:29.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/31: fsync f0 0 2024-04-19T02:18:29.307 INFO:tasks.workunit.client.0.smithi073.stdout:3/28: truncate d3/d6/fd 1013053 0 2024-04-19T02:18:29.308 INFO:tasks.workunit.client.0.smithi073.stdout:4/32: write f1 [3424395,93591] 0 2024-04-19T02:18:29.308 INFO:tasks.workunit.client.0.smithi073.stdout:3/29: dread - d3/d6/f9 zero size 2024-04-19T02:18:29.309 INFO:tasks.workunit.client.0.smithi073.stdout:3/30: dread - d3/d6/f9 zero size 2024-04-19T02:18:29.309 INFO:tasks.workunit.client.0.smithi073.stdout:4/33: creat da/f10 x:0 0 0 2024-04-19T02:18:29.309 INFO:tasks.workunit.client.0.smithi073.stdout:4/34: readlink da/ld 0 2024-04-19T02:18:29.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/31: creat d3/ff x:0 0 0 2024-04-19T02:18:29.310 INFO:tasks.workunit.client.0.smithi073.stdout:4/35: creat da/f11 x:0 0 0 2024-04-19T02:18:29.310 INFO:tasks.workunit.client.0.smithi073.stdout:0/13: getdents . 0 2024-04-19T02:18:29.311 INFO:tasks.workunit.client.0.smithi073.stdout:3/32: rmdir d3/d6/db 39 2024-04-19T02:18:29.311 INFO:tasks.workunit.client.0.smithi073.stdout:4/36: write f0 [1532010,23847] 0 2024-04-19T02:18:29.311 INFO:tasks.workunit.client.0.smithi073.stdout:4/37: symlink da/l12 0 2024-04-19T02:18:29.312 INFO:tasks.workunit.client.0.smithi073.stdout:4/38: creat da/f13 x:0 0 0 2024-04-19T02:18:29.313 INFO:tasks.workunit.client.0.smithi073.stdout:4/39: rename da/f10 to da/f14 0 2024-04-19T02:18:29.313 INFO:tasks.workunit.client.0.smithi073.stdout:4/40: write da/fc [400271,82577] 0 2024-04-19T02:18:29.318 INFO:tasks.workunit.client.0.smithi073.stdout:0/14: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.320 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:29.316+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:29.323 INFO:tasks.workunit.client.0.smithi073.stdout:0/15: dread f4 [0,4194304] 0 2024-04-19T02:18:29.323 INFO:tasks.workunit.client.0.smithi073.stdout:0/16: readlink l1 0 2024-04-19T02:18:29.324 INFO:tasks.workunit.client.0.smithi073.stdout:0/17: creat f5 x:0 0 0 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.064153276999999995, 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064194662, 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.365 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:29.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10679 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.311543+0000", 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.054511089999999998, 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.054693849000000003, 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:29.370 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10679 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311543+0000", 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311543+0000", 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311542+0000", 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.316015+0000", 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044735690000000002 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.316037+0000", 2024-04-19T02:18:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2127e-05 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.316049+0000", 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1503e-05 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.316093+0000", 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4338999999999997e-05 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.316181+0000", 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8261000000000001e-05 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.316310+0000", 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012816300000000001 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.340393+0000", 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024083226999999999 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.375 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:29.375 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 2 2024-04-19T02:18:29.375 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:29.375 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:18:29.376 INFO:tasks.workunit.client.0.smithi073.stdout:6/17: getdents . 0 2024-04-19T02:18:29.376 INFO:tasks.workunit.client.0.smithi073.stdout:3/33: symlink d3/d6/db/l10 0 2024-04-19T02:18:29.376 INFO:tasks.workunit.client.0.smithi073.stdout:3/34: truncate d3/d6/fd 1669398 0 2024-04-19T02:18:29.376 INFO:tasks.workunit.client.0.smithi073.stdout:3/35: dread - d3/ff zero size 2024-04-19T02:18:29.376 INFO:tasks.workunit.client.0.smithi073.stdout:3/36: mkdir d3/d6/d11 0 2024-04-19T02:18:29.380 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:29.383 INFO:tasks.workunit.client.0.smithi073.stdout:6/18: dwrite f3 [0,4194304] 0 2024-04-19T02:18:29.401 INFO:tasks.workunit.client.0.smithi073.stdout:4/41: getdents da 0 2024-04-19T02:18:29.402 INFO:tasks.workunit.client.0.smithi073.stdout:4/42: creat da/f15 x:0 0 0 2024-04-19T02:18:29.412 INFO:tasks.workunit.client.0.smithi073.stdout:3/37: getdents d3/d6 0 2024-04-19T02:18:29.412 INFO:tasks.workunit.client.0.smithi073.stdout:3/38: creat d3/d6/f12 x:0 0 0 2024-04-19T02:18:29.412 INFO:tasks.workunit.client.0.smithi073.stdout:3/39: symlink d3/d6/d11/l13 0 2024-04-19T02:18:29.412 INFO:tasks.workunit.client.0.smithi073.stdout:3/40: creat d3/d6/db/f14 x:0 0 0 2024-04-19T02:18:29.415 INFO:tasks.workunit.client.0.smithi073.stdout:3/41: getdents d3/d6/d11 0 2024-04-19T02:18:29.416 INFO:tasks.workunit.client.0.smithi073.stdout:3/42: chown d3/d6 87 1 2024-04-19T02:18:29.417 INFO:tasks.workunit.client.0.smithi073.stdout:3/43: creat d3/d6/f15 x:0 0 0 2024-04-19T02:18:29.418 INFO:tasks.workunit.client.0.smithi073.stdout:3/44: mkdir d3/d6/db/d16 0 2024-04-19T02:18:29.418 INFO:tasks.workunit.client.0.smithi073.stdout:3/45: stat d3/l8 0 2024-04-19T02:18:29.419 INFO:tasks.workunit.client.0.smithi073.stdout:3/46: write d3/d6/fd [1645414,31013] 0 2024-04-19T02:18:29.420 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:29.416+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:29.420 INFO:tasks.workunit.client.0.smithi073.stdout:3/47: rename d3/d6/db/l10 to d3/d6/db/l17 0 2024-04-19T02:18:29.421 INFO:tasks.workunit.client.0.smithi073.stdout:3/48: creat d3/d6/db/d16/f18 x:0 0 0 2024-04-19T02:18:29.422 INFO:tasks.workunit.client.0.smithi073.stdout:3/49: write d3/d6/db/d16/f18 [490473,20076] 0 2024-04-19T02:18:29.423 INFO:tasks.workunit.client.0.smithi073.stdout:3/50: fsync d3/d6/f12 0 2024-04-19T02:18:29.430 INFO:tasks.workunit.client.0.smithi073.stdout:4/43: dread f0 [0,4194304] 0 2024-04-19T02:18:29.431 INFO:tasks.workunit.client.0.smithi073.stdout:4/44: write da/f11 [500733,59428] 0 2024-04-19T02:18:29.433 INFO:tasks.workunit.client.0.smithi073.stdout:4/45: creat da/f16 x:0 0 0 2024-04-19T02:18:29.433 INFO:tasks.workunit.client.0.smithi073.stdout:3/51: dwrite d3/d6/f9 [0,4194304] 0 2024-04-19T02:18:29.434 INFO:tasks.workunit.client.0.smithi073.stdout:3/52: rmdir d3/d6 39 2024-04-19T02:18:29.438 INFO:tasks.workunit.client.0.smithi073.stdout:3/53: write d3/d6/f12 [389602,46975] 0 2024-04-19T02:18:29.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/54: creat d3/d6/db/f19 x:0 0 0 2024-04-19T02:18:29.441 INFO:tasks.workunit.client.0.smithi073.stdout:3/55: mkdir d3/d6/db/d1a 0 2024-04-19T02:18:29.442 INFO:tasks.workunit.client.0.smithi073.stdout:3/56: chown d3/d6/db/f19 46613 1 2024-04-19T02:18:29.443 INFO:tasks.workunit.client.0.smithi073.stdout:4/46: dwrite da/f16 [0,4194304] 0 2024-04-19T02:18:29.444 INFO:tasks.workunit.client.0.smithi073.stdout:3/57: write d3/d6/f7 [2301410,43888] 0 2024-04-19T02:18:29.444 INFO:tasks.workunit.client.0.smithi073.stdout:4/47: fdatasync da/f14 0 2024-04-19T02:18:29.445 INFO:tasks.workunit.client.0.smithi073.stdout:3/58: symlink d3/d6/l1b 0 2024-04-19T02:18:29.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/48: symlink da/l17 0 2024-04-19T02:18:29.446 INFO:tasks.workunit.client.0.smithi073.stdout:3/59: write d3/d6/db/f19 [355330,112882] 0 2024-04-19T02:18:29.449 INFO:tasks.workunit.client.0.smithi073.stdout:4/49: rmdir da 39 2024-04-19T02:18:29.449 INFO:tasks.workunit.client.0.smithi073.stdout:3/60: write d3/f4 [437432,78153] 0 2024-04-19T02:18:29.454 INFO:tasks.workunit.client.0.smithi073.stdout:4/50: dread f1 [0,4194304] 0 2024-04-19T02:18:29.454 INFO:tasks.workunit.client.0.smithi073.stdout:3/61: dread d3/d6/f9 [0,4194304] 0 2024-04-19T02:18:29.455 INFO:tasks.workunit.client.0.smithi073.stdout:3/62: mkdir d3/d1c 0 2024-04-19T02:18:29.455 INFO:tasks.workunit.client.0.smithi073.stdout:4/51: write da/f11 [83696,72145] 0 2024-04-19T02:18:29.456 INFO:tasks.workunit.client.0.smithi073.stdout:4/52: creat da/f18 x:0 0 0 2024-04-19T02:18:29.458 INFO:tasks.workunit.client.0.smithi073.stdout:3/63: dread d3/d6/db/f19 [0,4194304] 0 2024-04-19T02:18:29.459 INFO:tasks.workunit.client.0.smithi073.stdout:3/64: write f2 [289331,43035] 0 2024-04-19T02:18:29.460 INFO:tasks.workunit.client.0.smithi073.stdout:3/65: creat d3/d6/f1d x:0 0 0 2024-04-19T02:18:29.465 INFO:tasks.workunit.client.0.smithi073.stdout:4/53: dwrite f8 [0,4194304] 0 2024-04-19T02:18:29.466 INFO:tasks.workunit.client.0.smithi073.stdout:4/54: mknod da/c19 0 2024-04-19T02:18:29.467 INFO:tasks.workunit.client.0.smithi073.stdout:3/66: getdents d3 0 2024-04-19T02:18:29.467 INFO:tasks.workunit.client.0.smithi073.stdout:4/55: mkdir da/d1a 0 2024-04-19T02:18:29.467 INFO:tasks.workunit.client.0.smithi073.stdout:3/67: read d3/d6/f7 [3915938,48894] 0 2024-04-19T02:18:29.468 INFO:tasks.workunit.client.0.smithi073.stdout:4/56: mkdir da/d1a/d1b 0 2024-04-19T02:18:29.469 INFO:tasks.workunit.client.0.smithi073.stdout:3/68: rename d3/ff to d3/d6/f1e 0 2024-04-19T02:18:29.469 INFO:tasks.workunit.client.0.smithi073.stdout:4/57: symlink da/d1a/d1b/l1c 0 2024-04-19T02:18:29.470 INFO:tasks.workunit.client.0.smithi073.stdout:4/58: mkdir da/d1a/d1b/d1d 0 2024-04-19T02:18:29.477 INFO:tasks.workunit.client.0.smithi073.stdout:4/59: dread f4 [0,4194304] 0 2024-04-19T02:18:29.483 INFO:tasks.workunit.client.0.smithi073.stdout:3/69: dwrite d3/d6/fd [0,4194304] 0 2024-04-19T02:18:29.484 INFO:tasks.workunit.client.0.smithi073.stdout:3/70: mknod d3/d6/db/d1a/c1f 0 2024-04-19T02:18:29.485 INFO:tasks.workunit.client.0.smithi073.stdout:3/71: symlink d3/l20 0 2024-04-19T02:18:29.486 INFO:tasks.workunit.client.0.smithi073.stdout:3/72: symlink d3/d6/db/l21 0 2024-04-19T02:18:29.487 INFO:tasks.workunit.client.0.smithi073.stdout:3/73: chown f2 203819 1 2024-04-19T02:18:29.487 INFO:tasks.workunit.client.0.smithi073.stdout:3/74: chown d3/d6/db 217435912 1 2024-04-19T02:18:29.488 INFO:tasks.workunit.client.0.smithi073.stdout:3/75: getdents d3/d6 0 2024-04-19T02:18:29.497 INFO:tasks.workunit.client.0.smithi073.stdout:3/76: dwrite d3/d6/db/d16/f18 [0,4194304] 0 2024-04-19T02:18:29.499 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:29.499 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:29.499 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:29.499 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:29.499 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:29.501 INFO:tasks.workunit.client.0.smithi073.stdout:3/77: dread d3/d6/f9 [0,4194304] 0 2024-04-19T02:18:29.505 INFO:tasks.workunit.client.0.smithi073.stdout:3/78: dread d3/d6/f7 [0,4194304] 0 2024-04-19T02:18:29.506 INFO:tasks.workunit.client.0.smithi073.stdout:3/79: write d3/d6/f1d [896607,51932] 0 2024-04-19T02:18:29.507 INFO:tasks.workunit.client.0.smithi073.stdout:3/80: getdents d3/d6 0 2024-04-19T02:18:29.512 INFO:tasks.workunit.client.0.smithi073.stdout:3/81: dread d3/d6/f12 [0,4194304] 0 2024-04-19T02:18:29.512 INFO:tasks.workunit.client.0.smithi073.stdout:3/82: chown d3/d6/f7 4 1 2024-04-19T02:18:29.513 INFO:tasks.workunit.client.0.smithi073.stdout:3/83: chown d3/d6/f15 125007039 1 2024-04-19T02:18:29.513 INFO:tasks.workunit.client.0.smithi073.stdout:3/84: dread - d3/d6/f15 zero size 2024-04-19T02:18:29.514 INFO:tasks.workunit.client.0.smithi073.stdout:3/85: creat d3/d6/f22 x:0 0 0 2024-04-19T02:18:29.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:29.517 INFO:tasks.workunit.client.0.smithi073.stdout:3/86: dread f2 [0,4194304] 0 2024-04-19T02:18:29.521 INFO:tasks.workunit.client.0.smithi073.stdout:3/87: dread d3/d6/f9 [0,4194304] 0 2024-04-19T02:18:29.525 INFO:tasks.workunit.client.0.smithi073.stdout:3/88: dread d3/d6/db/d16/f18 [0,4194304] 0 2024-04-19T02:18:29.534 INFO:tasks.workunit.client.0.smithi073.stdout:3/89: dwrite d3/d6/db/d16/f18 [0,4194304] 0 2024-04-19T02:18:29.535 INFO:tasks.workunit.client.0.smithi073.stdout:3/90: write d3/d6/f1d [575919,80102] 0 2024-04-19T02:18:29.546 INFO:tasks.workunit.client.0.smithi073.stdout:3/91: dwrite d3/d6/f22 [0,4194304] 0 2024-04-19T02:18:29.546 INFO:tasks.workunit.client.0.smithi073.stdout:3/92: stat d3/d6/f9 0 2024-04-19T02:18:29.546 INFO:tasks.workunit.client.0.smithi073.stdout:3/93: write d3/d6/f12 [43298,65277] 0 2024-04-19T02:18:29.554 INFO:tasks.workunit.client.0.smithi073.stdout:3/94: dwrite d3/f4 [0,4194304] 0 2024-04-19T02:18:29.555 INFO:tasks.workunit.client.0.smithi073.stdout:3/95: chown d3/d6/d11/l13 448839127 1 2024-04-19T02:18:29.556 INFO:tasks.workunit.client.0.smithi073.stdout:3/96: mkdir d3/d6/db/d23 0 2024-04-19T02:18:29.557 INFO:tasks.workunit.client.0.smithi073.stdout:3/97: mkdir d3/d6/d11/d24 0 2024-04-19T02:18:29.559 INFO:tasks.workunit.client.0.smithi073.stdout:3/98: dread d3/d6/f12 [0,4194304] 0 2024-04-19T02:18:29.559 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:29.559+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:29.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/99: link d3/l20 d3/d6/d11/l25 0 2024-04-19T02:18:29.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/100: dread - d3/f5 zero size 2024-04-19T02:18:29.581 INFO:tasks.workunit.client.0.smithi073.stdout:8/7: sync 2024-04-19T02:18:29.581 INFO:tasks.workunit.client.0.smithi073.stdout:5/28: sync 2024-04-19T02:18:29.581 INFO:tasks.workunit.client.0.smithi073.stdout:1/25: sync 2024-04-19T02:18:29.582 INFO:tasks.workunit.client.0.smithi073.stdout:7/17: sync 2024-04-19T02:18:29.582 INFO:tasks.workunit.client.0.smithi073.stdout:2/3: sync 2024-04-19T02:18:29.582 INFO:tasks.workunit.client.0.smithi073.stdout:2/4: fdatasync - no filename 2024-04-19T02:18:29.582 INFO:tasks.workunit.client.0.smithi073.stdout:2/5: truncate - no filename 2024-04-19T02:18:29.582 INFO:tasks.workunit.client.0.smithi073.stdout:9/13: sync 2024-04-19T02:18:29.582 INFO:tasks.workunit.client.0.smithi073.stdout:8/8: dread - f3 zero size 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:5/29: chown d0/c3 8321 1 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:9/14: symlink d0/l3 0 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:8/9: mknod c5 0 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:2/6: creat f0 x:0 0 0 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:5/30: creat d0/f9 x:0 0 0 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:7/18: creat d0/f8 x:0 0 0 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:8/10: creat f6 x:0 0 0 2024-04-19T02:18:29.584 INFO:tasks.workunit.client.0.smithi073.stdout:2/7: truncate f0 212404 0 2024-04-19T02:18:29.585 INFO:tasks.workunit.client.0.smithi073.stdout:9/15: symlink d0/l4 0 2024-04-19T02:18:29.585 INFO:tasks.workunit.client.0.smithi073.stdout:9/16: write - no filename 2024-04-19T02:18:29.585 INFO:tasks.workunit.client.0.smithi073.stdout:2/8: chown f0 8 1 2024-04-19T02:18:29.585 INFO:tasks.workunit.client.0.smithi073.stdout:7/19: truncate d0/f8 122841 0 2024-04-19T02:18:29.585 INFO:tasks.workunit.client.0.smithi073.stdout:8/11: write f6 [474132,54251] 0 2024-04-19T02:18:29.585 INFO:tasks.workunit.client.0.smithi073.stdout:9/17: mknod d0/c5 0 2024-04-19T02:18:29.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/9: rename f0 to f1 0 2024-04-19T02:18:29.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/10: stat f1 0 2024-04-19T02:18:29.586 INFO:tasks.workunit.client.0.smithi073.stdout:9/18: creat d0/f6 x:0 0 0 2024-04-19T02:18:29.586 INFO:tasks.workunit.client.0.smithi073.stdout:7/20: read d0/f8 [107639,22313] 0 2024-04-19T02:18:29.586 INFO:tasks.workunit.client.0.smithi073.stdout:9/19: mknod d0/c7 0 2024-04-19T02:18:29.588 INFO:tasks.workunit.client.0.smithi073.stdout:2/11: dread f1 [0,4194304] 0 2024-04-19T02:18:29.591 INFO:tasks.workunit.client.0.smithi073.stdout:5/31: fsync d0/f9 0 2024-04-19T02:18:29.592 INFO:tasks.workunit.client.0.smithi073.stdout:2/12: getdents . 0 2024-04-19T02:18:29.593 INFO:tasks.workunit.client.0.smithi073.stdout:5/32: mknod d0/ca 0 2024-04-19T02:18:29.595 INFO:tasks.workunit.client.0.smithi073.stdout:7/21: write d0/f7 [949429,60047] 0 2024-04-19T02:18:29.596 INFO:tasks.workunit.client.0.smithi073.stdout:2/13: dread f1 [0,4194304] 0 2024-04-19T02:18:29.596 INFO:tasks.workunit.client.0.smithi073.stdout:8/12: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/14: unlink f1 0 2024-04-19T02:18:29.598 INFO:tasks.workunit.client.0.smithi073.stdout:2/15: chown . 46 1 2024-04-19T02:18:29.599 INFO:tasks.workunit.client.0.smithi073.stdout:7/22: truncate d0/f6 1234953 0 2024-04-19T02:18:29.599 INFO:tasks.workunit.client.0.smithi073.stdout:5/33: link d0/c5 d0/cb 0 2024-04-19T02:18:29.599 INFO:tasks.workunit.client.0.smithi073.stdout:3/101: fsync d3/d6/db/d16/f18 0 2024-04-19T02:18:29.600 INFO:tasks.workunit.client.0.smithi073.stdout:1/26: dwrite f9 [0,4194304] 0 2024-04-19T02:18:29.600 INFO:tasks.workunit.client.0.smithi073.stdout:2/16: symlink l2 0 2024-04-19T02:18:29.600 INFO:tasks.workunit.client.0.smithi073.stdout:5/34: fdatasync d0/f9 0 2024-04-19T02:18:29.600 INFO:tasks.workunit.client.0.smithi073.stdout:9/20: dwrite d0/f6 [0,4194304] 0 2024-04-19T02:18:29.603 INFO:tasks.workunit.client.0.smithi073.stdout:3/102: creat d3/d6/d11/f26 x:0 0 0 2024-04-19T02:18:29.603 INFO:tasks.workunit.client.0.smithi073.stdout:1/27: chown f3 240279170 1 2024-04-19T02:18:29.604 INFO:tasks.workunit.client.0.smithi073.stdout:2/17: creat f3 x:0 0 0 2024-04-19T02:18:29.604 INFO:tasks.workunit.client.0.smithi073.stdout:9/21: creat d0/f8 x:0 0 0 2024-04-19T02:18:29.604 INFO:tasks.workunit.client.0.smithi073.stdout:7/23: write d0/f8 [643631,102305] 0 2024-04-19T02:18:29.606 INFO:tasks.workunit.client.0.smithi073.stdout:7/24: stat d0/c5 0 2024-04-19T02:18:29.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/18: write f3 [46754,72489] 0 2024-04-19T02:18:29.607 INFO:tasks.workunit.client.0.smithi073.stdout:9/22: creat d0/f9 x:0 0 0 2024-04-19T02:18:29.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/19: readlink l2 0 2024-04-19T02:18:29.608 INFO:tasks.workunit.client.0.smithi073.stdout:9/23: creat d0/fa x:0 0 0 2024-04-19T02:18:29.610 INFO:tasks.workunit.client.0.smithi073.stdout:2/20: truncate f3 808955 0 2024-04-19T02:18:29.610 INFO:tasks.workunit.client.0.smithi073.stdout:7/25: symlink d0/d3/l9 0 2024-04-19T02:18:29.611 INFO:tasks.workunit.client.0.smithi073.stdout:8/13: dwrite f3 [0,4194304] 0 2024-04-19T02:18:29.613 INFO:tasks.workunit.client.0.smithi073.stdout:8/14: symlink l7 0 2024-04-19T02:18:29.613 INFO:tasks.workunit.client.0.smithi073.stdout:5/35: dwrite d0/f9 [0,4194304] 0 2024-04-19T02:18:29.614 INFO:tasks.workunit.client.0.smithi073.stdout:8/15: rename f3 to f8 0 2024-04-19T02:18:29.614 INFO:tasks.workunit.client.0.smithi073.stdout:7/26: read d0/f7 [698262,123712] 0 2024-04-19T02:18:29.614 INFO:tasks.workunit.client.0.smithi073.stdout:1/28: dread f6 [0,4194304] 0 2024-04-19T02:18:29.615 INFO:tasks.workunit.client.0.smithi073.stdout:5/36: fsync d0/f2 0 2024-04-19T02:18:29.615 INFO:tasks.workunit.client.0.smithi073.stdout:5/37: readlink d0/l1 0 2024-04-19T02:18:29.615 INFO:tasks.workunit.client.0.smithi073.stdout:1/29: rename c5 to ca 0 2024-04-19T02:18:29.616 INFO:tasks.workunit.client.0.smithi073.stdout:7/27: read d0/f6 [1079159,100962] 0 2024-04-19T02:18:29.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/38: creat d0/fc x:0 0 0 2024-04-19T02:18:29.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/30: mkdir db 0 2024-04-19T02:18:29.617 INFO:tasks.workunit.client.0.smithi073.stdout:3/103: dread d3/d6/fd [0,4194304] 0 2024-04-19T02:18:29.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/39: chown d0/cb 4989 1 2024-04-19T02:18:29.617 INFO:tasks.workunit.client.0.smithi073.stdout:1/31: symlink db/lc 0 2024-04-19T02:18:29.617 INFO:tasks.workunit.client.0.smithi073.stdout:3/104: rmdir d3/d6/db/d1a 39 2024-04-19T02:18:29.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/40: chown d0/c5 45434346 1 2024-04-19T02:18:29.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/41: stat d0/f9 0 2024-04-19T02:18:29.618 INFO:tasks.workunit.client.0.smithi073.stdout:1/32: creat db/fd x:0 0 0 2024-04-19T02:18:29.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/42: chown d0/f9 123609144 1 2024-04-19T02:18:29.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/105: write d3/d6/f12 [1418214,24860] 0 2024-04-19T02:18:29.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/43: write d0/fc [208659,42610] 0 2024-04-19T02:18:29.619 INFO:tasks.workunit.client.0.smithi073.stdout:5/44: stat d0/f2 0 2024-04-19T02:18:29.619 INFO:tasks.workunit.client.0.smithi073.stdout:3/106: creat d3/d6/db/d23/f27 x:0 0 0 2024-04-19T02:18:29.620 INFO:tasks.workunit.client.0.smithi073.stdout:5/45: write d0/f2 [4924283,118445] 0 2024-04-19T02:18:29.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/107: write d3/d6/d11/f26 [893901,56176] 0 2024-04-19T02:18:29.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/108: stat d3/f4 0 2024-04-19T02:18:29.621 INFO:tasks.workunit.client.0.smithi073.stdout:3/109: rmdir d3/d6/db/d1a 39 2024-04-19T02:18:29.621 INFO:tasks.workunit.client.0.smithi073.stdout:3/110: fdatasync d3/d6/f22 0 2024-04-19T02:18:29.622 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:29.616+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:29.623 INFO:tasks.workunit.client.0.smithi073.stdout:3/111: creat d3/d6/db/d1a/f28 x:0 0 0 2024-04-19T02:18:29.629 INFO:tasks.workunit.client.0.smithi073.stdout:2/21: truncate f3 512361 0 2024-04-19T02:18:29.629 INFO:tasks.workunit.client.0.smithi073.stdout:2/22: symlink l4 0 2024-04-19T02:18:29.630 INFO:tasks.workunit.client.0.smithi073.stdout:2/23: mkdir d5 0 2024-04-19T02:18:29.630 INFO:tasks.workunit.client.0.smithi073.stdout:2/24: stat f3 0 2024-04-19T02:18:29.632 INFO:tasks.workunit.client.0.smithi073.stdout:7/28: truncate d0/f6 702702 0 2024-04-19T02:18:29.632 INFO:tasks.workunit.client.0.smithi073.stdout:1/33: rename ca to db/ce 0 2024-04-19T02:18:29.633 INFO:tasks.workunit.client.0.smithi073.stdout:2/25: rename l2 to d5/l6 0 2024-04-19T02:18:29.633 INFO:tasks.workunit.client.0.smithi073.stdout:7/29: dread d0/f8 [0,4194304] 0 2024-04-19T02:18:29.634 INFO:tasks.workunit.client.0.smithi073.stdout:7/30: symlink d0/la 0 2024-04-19T02:18:29.635 INFO:tasks.workunit.client.0.smithi073.stdout:7/31: write d0/f8 [1215231,109472] 0 2024-04-19T02:18:29.638 INFO:tasks.workunit.client.0.smithi073.stdout:5/46: truncate d0/f2 4629321 0 2024-04-19T02:18:29.638 INFO:tasks.workunit.client.0.smithi073.stdout:1/34: rmdir db 39 2024-04-19T02:18:29.638 INFO:tasks.workunit.client.0.smithi073.stdout:5/47: symlink d0/ld 0 2024-04-19T02:18:29.639 INFO:tasks.workunit.client.0.smithi073.stdout:5/48: readlink d0/ld 0 2024-04-19T02:18:29.639 INFO:tasks.workunit.client.0.smithi073.stdout:1/35: creat db/ff x:0 0 0 2024-04-19T02:18:29.639 INFO:tasks.workunit.client.0.smithi073.stdout:5/49: symlink d0/le 0 2024-04-19T02:18:29.640 INFO:tasks.workunit.client.0.smithi073.stdout:1/36: rename db/lc to db/l10 0 2024-04-19T02:18:29.640 INFO:tasks.workunit.client.0.smithi073.stdout:1/37: dread - db/ff zero size 2024-04-19T02:18:29.643 INFO:tasks.workunit.client.0.smithi073.stdout:2/26: dread f3 [0,4194304] 0 2024-04-19T02:18:29.643 INFO:tasks.workunit.client.0.smithi073.stdout:2/27: creat d5/f7 x:0 0 0 2024-04-19T02:18:29.644 INFO:tasks.workunit.client.0.smithi073.stdout:2/28: creat d5/f8 x:0 0 0 2024-04-19T02:18:29.644 INFO:tasks.workunit.client.0.smithi073.stdout:7/32: dread d0/f6 [0,4194304] 0 2024-04-19T02:18:29.645 INFO:tasks.workunit.client.0.smithi073.stdout:7/33: write d0/f8 [2278735,127709] 0 2024-04-19T02:18:29.649 INFO:tasks.workunit.client.0.smithi073.stdout:7/34: write d0/f6 [1726911,122208] 0 2024-04-19T02:18:29.649 INFO:tasks.workunit.client.0.smithi073.stdout:5/50: rmdir d0 39 2024-04-19T02:18:29.649 INFO:tasks.workunit.client.0.smithi073.stdout:7/35: symlink d0/lb 0 2024-04-19T02:18:29.650 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:29.650 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:29.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:29.650 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:29.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.343867774, 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:29.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:29.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.297606256999998, 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:29.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.284664590999999, 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:29.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.28460304, 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.665 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:29.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.283651972000001, 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.671 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:29.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.276511644999999, 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:29.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.268679542000001, 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.682 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:29.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.238614076000001, 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:29.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:29.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:29.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.236072229000001, 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.693 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:29.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.698 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:124 4.28 4:178fb5ad:::10000000274.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.175481533999999, 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090608116000000002, 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 124 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:29.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473775+0000", 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473779+0000", 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8060000000000001e-06 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473788+0000", 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1889999999999996e-06 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473794+0000", 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473830+0000", 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6072000000000003e-05 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.473970+0000", 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014000199999999999 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474123+0000", 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152874 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.474833+0000", 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071059599999999997 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564335+0000", 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089501854000000006 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564363+0000", 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7441999999999999e-05 2024-04-19T02:18:29.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564384+0000", 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0936000000000001e-05 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:76 3.1a 3:5e41ab69:::200.00000005:head [write 0~2114509 [fadvise_dontneed] in=2114509b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4501189829999994, 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.090582039000000003, 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.704 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199138+0000", 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.199136+0000", 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202611+0000", 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034741699999999999 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202638+0000", 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7634999999999999e-05 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202650+0000", 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1997000000000001e-05 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202732+0000", 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2330999999999995e-05 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202838+0000", 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010571 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.202995+0000", 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157045 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.237002+0000", 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034006768999999999 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289632+0000", 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052630059 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289682+0000", 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9635000000000002e-05 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.289720+0000", 2024-04-19T02:18:29.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8315000000000002e-05 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:106 3.1a 3:5e41ab69:::200.00000005:head [write 2168773~1421 [fadvise_dontneed] in=1421b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4354305600000004, 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081087216000000004, 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213826+0000", 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213825+0000", 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213847+0000", 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1304000000000001e-05 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213853+0000", 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7769999999999997e-06 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213857+0000", 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8500000000000004e-06 2024-04-19T02:18:29.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.255923+0000", 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042065845999999997 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256007+0000", 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4400000000000005e-05 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256131+0000", 2024-04-19T02:18:29.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000123113 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260072+0000", 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039416759999999999 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294843+0000", 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034770823999999999 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294884+0000", 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0745999999999999e-05 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294914+0000", 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9793000000000001e-05 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.715 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:107 3.1a 3:5e41ab69:::200.00000005:head [write 2170194~1922 [fadvise_dontneed] in=1922b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4353931660000008, 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081182144999999997, 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:29.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213864+0000", 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213863+0000", 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213866+0000", 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6350000000000002e-06 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213875+0000", 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7520000000000002e-06 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213879+0000", 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7950000000000001e-06 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256510+0000", 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.042631600999999998 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.256771+0000", 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000261258 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.257103+0000", 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033202900000000002 2024-04-19T02:18:29.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262757+0000", 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056537280000000002 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.294965+0000", 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032207950999999999 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295011+0000", 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5940999999999999e-05 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295046+0000", 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4832000000000001e-05 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:108 3.1a 3:5e41ab69:::200.00000005:head [write 2172116~1407 [fadvise_dontneed] in=1407b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.721 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.435334095, 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081237127000000006, 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213923+0000", 2024-04-19T02:18:29.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213922+0000", 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213926+0000", 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.799e-06 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213933+0000", 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8680000000000001e-06 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213937+0000", 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0709999999999996e-06 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258216+0000", 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044278961999999998 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258292+0000", 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5789000000000002e-05 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258408+0000", 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000116575 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.262772+0000", 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043633259999999998 2024-04-19T02:18:29.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295094+0000", 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032321877999999998 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295130+0000", 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6944999999999999e-05 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295160+0000", 2024-04-19T02:18:29.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9507999999999999e-05 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:109 3.1a 3:5e41ab69:::200.00000005:head [write 2173523~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4352789999999995, 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081292229999999993, 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213978+0000", 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213977+0000", 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213981+0000", 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6030000000000001e-06 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213988+0000", 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9410000000000001e-06 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.213992+0000", 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7840000000000001e-06 2024-04-19T02:18:29.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.258773+0000", 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044781673000000001 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259007+0000", 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023356200000000001 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.259341+0000", 2024-04-19T02:18:29.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033412900000000001 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264603+0000", 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052615159999999999 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295204+0000", 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030601587999999999 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295241+0000", 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6646000000000001e-05 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295270+0000", 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9368000000000001e-05 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:110 3.1a 3:5e41ab69:::200.00000005:head [write 2174924~2249 [fadvise_dontneed] in=2249b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4352066039999993, 2024-04-19T02:18:29.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081331492000000005, 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214050+0000", 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214054+0000", 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.048e-06 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214061+0000", 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9890000000000003e-06 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214064+0000", 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5609999999999999e-06 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260146+0000", 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046082102 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260226+0000", 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9480000000000005e-05 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260343+0000", 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011675000000000001 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264618+0000", 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042758550000000003 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295317+0000", 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030698723000000001 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295353+0000", 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5882e-05 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295382+0000", 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8855000000000001e-05 2024-04-19T02:18:29.737 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:111 3.1a 3:5e41ab69:::200.00000005:head [write 2177173~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4351591809999995, 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081396476999999995, 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214098+0000", 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214097+0000", 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214101+0000", 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2259999999999999e-06 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214109+0000", 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214113+0000", 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.924e-06 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260800+0000", 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046686581999999997 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260872+0000", 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2409000000000004e-05 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.260984+0000", 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112272 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.264631+0000", 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00364694 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295428+0000", 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030796372999999998 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295464+0000", 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6331999999999997e-05 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295494+0000", 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0304e-05 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:112 3.1a 3:5e41ab69:::200.00000005:head [write 2178578~1399 [fadvise_dontneed] in=1399b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4351084689999993, 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.081460894000000006, 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.743 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214149+0000", 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214148+0000", 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214152+0000", 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000001e-06 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214159+0000", 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0500000000000003e-06 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.214163+0000", 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.703e-06 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261259+0000", 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.047096011 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261478+0000", 2024-04-19T02:18:29.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021916500000000001 2024-04-19T02:18:29.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.261786+0000", 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030754399999999998 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.265066+0000", 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003280416 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295545+0000", 2024-04-19T02:18:29.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030478315999999998 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295581+0000", 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6569000000000002e-05 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:20.295609+0000", 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8268000000000001e-05 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.34735618699999998, 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.14937139399999999, 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:29.762 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:29.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:29.765 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:29.763+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:29.783 INFO:tasks.workunit.client.0.smithi073.stdout:7/36: write d0/f8 [2456600,125683] 0 2024-04-19T02:18:29.783 INFO:tasks.workunit.client.0.smithi073.stdout:7/37: mkdir d0/dc 0 2024-04-19T02:18:29.783 INFO:tasks.workunit.client.0.smithi073.stdout:1/38: getdents db 0 2024-04-19T02:18:29.783 INFO:tasks.workunit.client.0.smithi073.stdout:7/38: symlink d0/d3/ld 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/39: creat db/f11 x:0 0 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:7/39: rmdir d0/d3 39 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/29: getdents d5 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/40: fdatasync db/f11 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/30: truncate d5/f8 677902 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/31: fsync d5/f8 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/32: dread - d5/f7 zero size 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/41: creat db/f12 x:0 0 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/33: write f3 [107810,110510] 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/42: creat db/f13 x:0 0 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:5/51: dwrite d0/fc [0,4194304] 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/34: write f3 [401672,60376] 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/35: mknod d5/c9 0 2024-04-19T02:18:29.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/43: truncate f9 1032587 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/44: readlink l8 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:2/36: creat d5/fa x:0 0 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:7/40: dwrite d0/f8 [0,4194304] 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/45: chown db/ff 1458 1 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:2/37: truncate d5/f8 1529972 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/46: rename db to db/d14 22 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/47: write db/fd [447149,40963] 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:2/38: rename l4 to d5/lb 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/48: stat db/ce 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:2/39: creat d5/fc x:0 0 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/49: write db/fd [319272,26577] 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:2/40: mkdir d5/dd 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:5/52: dread d0/f2 [0,4194304] 0 2024-04-19T02:18:29.785 INFO:tasks.workunit.client.0.smithi073.stdout:5/53: chown d0/le 755 1 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/41: creat d5/dd/fe x:0 0 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:5/54: creat d0/ff x:0 0 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/42: symlink d5/lf 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:5/55: readlink d0/l1 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/43: stat d5/fc 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/44: mkdir d5/d10 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/45: creat d5/f11 x:0 0 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:7/41: dwrite d0/f6 [0,4194304] 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/46: link d5/f11 d5/dd/f12 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:1/50: write f6 [293303,100146] 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/47: write d5/dd/fe [573198,24870] 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:1/51: chown db/f13 1947 1 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/48: creat d5/f13 x:0 0 0 2024-04-19T02:18:29.786 INFO:tasks.workunit.client.0.smithi073.stdout:1/52: symlink db/l15 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/49: mkdir d5/d10/d14 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/50: mkdir d5/d10/d15 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/51: link d5/fa d5/f16 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/52: write f3 [397735,65883] 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/53: symlink d5/d10/d15/l17 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/54: mkdir d5/d10/d14/d18 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/55: write d5/f11 [763308,80344] 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/56: symlink d5/dd/l19 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:7/42: write d0/f6 [5153845,99891] 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:7/43: getdents d0/d3 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/57: read d5/f11 [599607,128406] 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/58: getdents d5 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/59: link d5/f7 d5/d10/d14/d18/f1a 0 2024-04-19T02:18:29.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/60: rename d5/fc to d5/d10/d14/d18/f1b 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:2/61: read - d5/f16 zero size 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:2/62: write f3 [1118146,29093] 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:6/19: sync 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:4/60: sync 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:0/18: sync 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:9/24: sync 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:4/61: stat da/f18 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:0/19: symlink l6 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:9/25: creat d0/fb x:0 0 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:9/26: stat d0/c2 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:4/62: symlink da/d1a/l1e 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:9/27: creat d0/fc x:0 0 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:9/28: stat d0/c2 0 2024-04-19T02:18:29.788 INFO:tasks.workunit.client.0.smithi073.stdout:4/63: creat da/d1a/d1b/d1d/f1f x:0 0 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:9/29: write d0/f6 [4285728,85351] 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:1/53: truncate f3 133898 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:4/64: dread f0 [0,4194304] 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:4/65: write da/f15 [163711,68195] 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/63: truncate d5/fa 799059 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:4/66: readlink da/d1a/d1b/l1c 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/20: truncate f2 2820929 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:6/20: dwrite f3 [0,4194304] 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/21: mkdir d7 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:4/67: chown da/c19 31038616 1 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:6/21: rename l4 to l6 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/64: rename d5/d10/d15/l17 to d5/d10/l1c 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:4/68: unlink da/cf 0 2024-04-19T02:18:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:9/30: dwrite d0/f8 [0,4194304] 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:4/69: write f4 [2790717,32435] 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:1/54: dwrite db/f13 [0,4194304] 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:2/65: truncate d5/f16 1061190 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:1/55: getdents db 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:0/22: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:6/22: dwrite f3 [0,4194304] 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/31: dwrite d0/f8 [0,4194304] 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/32: fsync d0/f6 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/33: mknod d0/cd 0 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:7/44: sync 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:3/112: sync 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:8/16: sync 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:5/56: sync 2024-04-19T02:18:29.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/34: link d0/f6 d0/fe 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:8/17: chown c5 341920040 1 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:7/45: symlink d0/le 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:1/56: dwrite db/f12 [0,4194304] 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:9/35: fdatasync d0/fe 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:4/70: truncate da/fc 325194 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:1/57: mknod db/c16 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:9/36: mkdir d0/df 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:6/23: dwrite f5 [0,4194304] 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:3/113: link d3/d6/d11/f26 d3/d1c/f29 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:7/46: mknod d0/dc/cf 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:6/24: unlink l2 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:4/71: symlink da/d1a/d1b/l20 0 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:6/25: sync 2024-04-19T02:18:29.791 INFO:tasks.workunit.client.0.smithi073.stdout:3/114: chown d3/d6/d11 4 1 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:9/37: chown d0/l4 14782744 1 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:1/58: write db/f13 [5227310,72744] 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:4/72: fdatasync da/f13 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:7/47: write d0/f7 [2120799,112650] 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:9/38: rename d0/f9 to d0/df/f10 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:6/26: link l6 l7 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:4/73: mkdir da/d1a/d1b/d1d/d21 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:7/48: mkdir d0/dc/d10 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:7/49: sync 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:9/39: rename d0/fe to d0/df/f11 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:4/74: chown da/c19 1664530 1 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/57: dwrite d0/f2 [4194304,4194304] 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:9/40: write d0/fb [375899,108369] 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:4/75: symlink da/d1a/d1b/l22 0 2024-04-19T02:18:29.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/58: creat d0/f10 x:0 0 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:3/115: dread d3/d6/f7 [0,4194304] 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/59: rename d0/ca to d0/c11 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/60: unlink d0/f10 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:4/76: fsync f4 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/61: symlink d0/l12 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:3/116: rename d3/cc to d3/c2a 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:4/77: chown da/d1a/d1b 36992362 1 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:3/117: chown d3/d6 6 1 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/62: truncate d0/ff 740617 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:6/27: dread f3 [0,4194304] 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/63: chown d0/fc 115 1 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:6/28: mkdir d8 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/64: creat d0/f13 x:0 0 0 2024-04-19T02:18:29.793 INFO:tasks.workunit.client.0.smithi073.stdout:6/29: read f5 [3295147,38915] 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/65: mknod d0/c14 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:6/30: symlink d8/l9 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/41: dwrite d0/fc [0,4194304] 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/42: truncate d0/fb 1365857 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:4/78: dread da/f16 [0,4194304] 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/43: write d0/f6 [4513545,121341] 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:4/79: mkdir da/d23 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/66: truncate f3 966287 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/67: symlink d5/d10/l1d 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/66: dread d0/f9 [0,4194304] 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/67: chown d0/ff 260970618 1 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/68: write d0/f9 [1380576,21079] 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/69: link d0/fc d0/f15 0 2024-04-19T02:18:29.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/44: dwrite d0/f6 [4194304,4194304] 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:9/45: chown d0/fc 53539824 1 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/18: dread f6 [0,4194304] 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/19: sync 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/20: fsync f4 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/21: rmdir - no directory 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/22: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/23: link f2 d7/f8 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:3/118: fsync d3/d1c/f29 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:7/50: truncate d0/f6 1864521 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:9/46: getdents d0 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/24: chown f5 20720146 1 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/25: sync 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:6/31: getdents d8 0 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/26: dread - f5 zero size 2024-04-19T02:18:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:3/119: read - d3/d6/f15 zero size 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:5/70: getdents d0 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:5/71: creat d0/f16 x:0 0 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:3/120: creat d3/d6/db/d1a/f2b x:0 0 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:5/72: symlink d0/l17 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:0/27: getdents d7 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:3/121: dread - d3/d6/db/d1a/f2b zero size 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:3/122: fdatasync d3/d6/f15 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:0/28: read d7/f8 [1024673,87587] 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:0/29: fsync f4 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:8/23: write f2 [181519,125799] 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:0/30: unlink l6 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:4/80: dread da/f15 [0,4194304] 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:8/24: write f2 [211919,30404] 0 2024-04-19T02:18:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:4/81: fdatasync f8 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/73: dread d0/f2 [0,4194304] 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:7/51: fsync d0/f7 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:8/25: creat f9 x:0 0 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:6/32: dwrite f5 [4194304,4194304] 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:0/31: link f2 d7/f9 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/74: chown d0/c5 92892498 1 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/75: sync 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:6/33: readlink d8/l9 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:8/26: mknod ca 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:7/52: write d0/f7 [1693260,123706] 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/76: chown d0/l1 0 1 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:6/34: fdatasync f3 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:7/53: write d0/f6 [2179906,119860] 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/77: symlink d0/l18 0 2024-04-19T02:18:29.797 INFO:tasks.workunit.client.0.smithi073.stdout:0/32: fsync d7/f8 0 2024-04-19T02:18:29.798 INFO:tasks.workunit.client.0.smithi073.stdout:6/35: rename d8 to d8/da 22 2024-04-19T02:18:29.798 INFO:tasks.workunit.client.0.smithi073.stdout:3/123: dwrite d3/d6/db/f19 [0,4194304] 0 2024-04-19T02:18:29.798 INFO:tasks.workunit.client.0.smithi073.stdout:0/33: mknod d7/ca 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:0/34: readlink l1 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:4/82: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:3/124: symlink d3/d1c/l2c 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:4/83: sync 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:8/27: dread f4 [0,4194304] 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:8/28: truncate f0 1113412 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:4/84: link da/ce da/d1a/d1b/d1d/c24 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:3/125: rename d3/d6/db/d16/f18 to d3/d6/db/f2d 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:6/36: dread f5 [0,4194304] 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:4/85: stat da/d1a/d1b/d1d/d21 0 2024-04-19T02:18:29.801 INFO:tasks.workunit.client.0.smithi073.stdout:8/29: read f0 [672150,35129] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:3/126: dread - d3/d6/f1e zero size 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/35: dread f4 [0,4194304] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:8/30: unlink f2 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:6/37: write f5 [4726475,30643] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:3/127: dread - d3/d6/db/d1a/f2b zero size 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:5/78: dwrite d0/f16 [0,4194304] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/36: write f5 [988517,110828] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:8/31: write f9 [536112,56643] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:7/54: dwrite d0/f8 [0,4194304] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:5/79: write d0/f9 [2121080,65876] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:8/32: truncate f4 4726887 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:3/128: readlink d3/d6/db/l17 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/37: read d7/f8 [1786341,78543] 0 2024-04-19T02:18:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:4/86: rmdir da 39 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:8/33: unlink f8 0 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:7/55: mknod d0/dc/d10/c11 0 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:0/38: symlink d7/lb 0 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:8/34: creat fb x:0 0 0 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:7/56: mkdir d0/d3/d12 0 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:8/35: readlink l7 0 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:8/36: rmdir - no directory 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:3/129: rename d3/d6/db/f19 to d3/d6/d11/f2e 0 2024-04-19T02:18:29.803 INFO:tasks.workunit.client.0.smithi073.stdout:3/130: mkdir d3/d6/db/d1a/d2f 0 2024-04-19T02:18:29.804 INFO:tasks.workunit.client.0.smithi073.stdout:0/39: dread d7/f8 [0,4194304] 0 2024-04-19T02:18:29.804 INFO:tasks.workunit.client.0.smithi073.stdout:6/38: dwrite f5 [0,4194304] 0 2024-04-19T02:18:29.805 INFO:tasks.workunit.client.0.smithi073.stdout:9/47: fdatasync d0/fc 0 2024-04-19T02:18:29.805 INFO:tasks.workunit.client.0.smithi073.stdout:6/39: unlink d8/l9 0 2024-04-19T02:18:29.806 INFO:tasks.workunit.client.0.smithi073.stdout:3/131: link d3/d6/fd d3/d6/db/d1a/d2f/f30 0 2024-04-19T02:18:29.806 INFO:tasks.workunit.client.0.smithi073.stdout:7/57: dread d0/f8 [0,4194304] 0 2024-04-19T02:18:29.807 INFO:tasks.workunit.client.0.smithi073.stdout:4/87: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.807 INFO:tasks.workunit.client.0.smithi073.stdout:5/80: dwrite d0/f16 [4194304,4194304] 0 2024-04-19T02:18:29.807 INFO:tasks.workunit.client.0.smithi073.stdout:3/132: readlink d3/d6/l1b 0 2024-04-19T02:18:29.807 INFO:tasks.workunit.client.0.smithi073.stdout:4/88: sync 2024-04-19T02:18:29.808 INFO:tasks.workunit.client.0.smithi073.stdout:6/40: write f5 [8020266,42642] 0 2024-04-19T02:18:29.808 INFO:tasks.workunit.client.0.smithi073.stdout:9/48: creat d0/f12 x:0 0 0 2024-04-19T02:18:29.808 INFO:tasks.workunit.client.0.smithi073.stdout:4/89: read f0 [192611,103541] 0 2024-04-19T02:18:29.809 INFO:tasks.workunit.client.0.smithi073.stdout:3/133: read - d3/d6/f15 zero size 2024-04-19T02:18:29.809 INFO:tasks.workunit.client.0.smithi073.stdout:6/41: fsync f3 0 2024-04-19T02:18:29.810 INFO:tasks.workunit.client.0.smithi073.stdout:7/58: rename d0/d3/ld to d0/d3/d12/l13 0 2024-04-19T02:18:29.810 INFO:tasks.workunit.client.0.smithi073.stdout:0/40: dread d7/f8 [0,4194304] 0 2024-04-19T02:18:29.810 INFO:tasks.workunit.client.0.smithi073.stdout:9/49: write d0/f6 [6134622,127702] 0 2024-04-19T02:18:29.811 INFO:tasks.workunit.client.0.smithi073.stdout:4/90: fsync da/f15 0 2024-04-19T02:18:29.811 INFO:tasks.workunit.client.0.smithi073.stdout:3/134: fsync d3/d6/db/d1a/f28 0 2024-04-19T02:18:29.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/42: creat d8/fb x:0 0 0 2024-04-19T02:18:29.812 INFO:tasks.workunit.client.0.smithi073.stdout:9/50: creat d0/f13 x:0 0 0 2024-04-19T02:18:29.812 INFO:tasks.workunit.client.0.smithi073.stdout:8/37: dwrite f0 [0,4194304] 0 2024-04-19T02:18:29.812 INFO:tasks.workunit.client.0.smithi073.stdout:3/135: dread - d3/d6/db/d23/f27 zero size 2024-04-19T02:18:29.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/51: unlink d0/fb 0 2024-04-19T02:18:29.814 INFO:tasks.workunit.client.0.smithi073.stdout:1/59: fdatasync db/f13 0 2024-04-19T02:18:29.814 INFO:tasks.workunit.client.0.smithi073.stdout:1/60: chown db/c16 506 1 2024-04-19T02:18:29.814 INFO:tasks.workunit.client.0.smithi073.stdout:9/52: mknod d0/c14 0 2024-04-19T02:18:29.814 INFO:tasks.workunit.client.0.smithi073.stdout:4/91: rename f0 to da/d23/f25 0 2024-04-19T02:18:29.814 INFO:tasks.workunit.client.0.smithi073.stdout:2/68: dread d5/f16 [0,4194304] 0 2024-04-19T02:18:29.815 INFO:tasks.workunit.client.0.smithi073.stdout:1/61: write db/f13 [4723968,100887] 0 2024-04-19T02:18:29.815 INFO:tasks.workunit.client.0.smithi073.stdout:4/92: chown da/d1a/d1b 1537982 1 2024-04-19T02:18:29.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/53: mkdir d0/df/d15 0 2024-04-19T02:18:29.816 INFO:tasks.workunit.client.0.smithi073.stdout:2/69: readlink d5/lb 0 2024-04-19T02:18:29.816 INFO:tasks.workunit.client.0.smithi073.stdout:9/54: read - d0/f12 zero size 2024-04-19T02:18:29.816 INFO:tasks.workunit.client.0.smithi073.stdout:2/70: read d5/f16 [748623,61113] 0 2024-04-19T02:18:29.816 INFO:tasks.workunit.client.0.smithi073.stdout:4/93: mkdir da/d1a/d1b/d26 0 2024-04-19T02:18:29.816 INFO:tasks.workunit.client.0.smithi073.stdout:4/94: unlink da/f13 0 2024-04-19T02:18:29.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/55: mkdir d0/df/d16 0 2024-04-19T02:18:29.817 INFO:tasks.workunit.client.0.smithi073.stdout:3/136: read d3/d6/f1d [186725,90785] 0 2024-04-19T02:18:29.818 INFO:tasks.workunit.client.0.smithi073.stdout:2/71: write d5/d10/d14/d18/f1b [960814,125219] 0 2024-04-19T02:18:29.819 INFO:tasks.workunit.client.0.smithi073.stdout:6/43: truncate d8/fb 450999 0 2024-04-19T02:18:29.820 INFO:tasks.workunit.client.0.smithi073.stdout:9/56: creat d0/df/d15/f17 x:0 0 0 2024-04-19T02:18:29.821 INFO:tasks.workunit.client.0.smithi073.stdout:2/72: unlink d5/dd/fe 0 2024-04-19T02:18:29.821 INFO:tasks.workunit.client.0.smithi073.stdout:6/44: mknod d8/cc 0 2024-04-19T02:18:29.823 INFO:tasks.workunit.client.0.smithi073.stdout:6/45: creat d8/fd x:0 0 0 2024-04-19T02:18:29.824 INFO:tasks.workunit.client.0.smithi073.stdout:9/57: symlink d0/df/d16/l18 0 2024-04-19T02:18:29.824 INFO:tasks.workunit.client.0.smithi073.stdout:5/81: dwrite d0/fc [0,4194304] 0 2024-04-19T02:18:29.824 INFO:tasks.workunit.client.0.smithi073.stdout:0/41: dwrite f5 [0,4194304] 0 2024-04-19T02:18:29.825 INFO:tasks.workunit.client.0.smithi073.stdout:4/95: fsync da/d23/f25 0 2024-04-19T02:18:29.826 INFO:tasks.workunit.client.0.smithi073.stdout:6/46: mkdir d8/de 0 2024-04-19T02:18:29.826 INFO:tasks.workunit.client.0.smithi073.stdout:4/96: fsync da/f15 0 2024-04-19T02:18:29.826 INFO:tasks.workunit.client.0.smithi073.stdout:1/62: dwrite db/f12 [4194304,4194304] 0 2024-04-19T02:18:29.826 INFO:tasks.workunit.client.0.smithi073.stdout:9/58: mkdir d0/df/d16/d19 0 2024-04-19T02:18:29.826 INFO:tasks.workunit.client.0.smithi073.stdout:1/63: stat c4 0 2024-04-19T02:18:29.827 INFO:tasks.workunit.client.0.smithi073.stdout:9/59: unlink d0/c2 0 2024-04-19T02:18:29.827 INFO:tasks.workunit.client.0.smithi073.stdout:4/97: rmdir da/d1a/d1b/d1d/d21 0 2024-04-19T02:18:29.827 INFO:tasks.workunit.client.0.smithi073.stdout:3/137: dread d3/f4 [0,4194304] 0 2024-04-19T02:18:29.828 INFO:tasks.workunit.client.0.smithi073.stdout:9/60: mkdir d0/df/d16/d1a 0 2024-04-19T02:18:29.829 INFO:tasks.workunit.client.0.smithi073.stdout:3/138: mknod d3/d6/d11/c31 0 2024-04-19T02:18:29.831 INFO:tasks.workunit.client.0.smithi073.stdout:6/47: dread f5 [4194304,4194304] 0 2024-04-19T02:18:29.833 INFO:tasks.workunit.client.0.smithi073.stdout:5/82: dwrite d0/f9 [0,4194304] 0 2024-04-19T02:18:29.833 INFO:tasks.workunit.client.0.smithi073.stdout:4/98: dread f1 [0,4194304] 0 2024-04-19T02:18:29.833 INFO:tasks.workunit.client.0.smithi073.stdout:5/83: stat d0/c14 0 2024-04-19T02:18:29.834 INFO:tasks.workunit.client.0.smithi073.stdout:5/84: creat d0/f19 x:0 0 0 2024-04-19T02:18:29.835 INFO:tasks.workunit.client.0.smithi073.stdout:5/85: rename d0/c11 to d0/c1a 0 2024-04-19T02:18:29.836 INFO:tasks.workunit.client.0.smithi073.stdout:9/61: dwrite d0/f6 [0,4194304] 0 2024-04-19T02:18:29.836 INFO:tasks.workunit.client.0.smithi073.stdout:5/86: write d0/f19 [403216,11132] 0 2024-04-19T02:18:29.836 INFO:tasks.workunit.client.0.smithi073.stdout:5/87: chown d0/f16 35059 1 2024-04-19T02:18:29.837 INFO:tasks.workunit.client.0.smithi073.stdout:9/62: link d0/cd d0/df/d16/d1a/c1b 0 2024-04-19T02:18:29.838 INFO:tasks.workunit.client.0.smithi073.stdout:4/99: dread f4 [0,4194304] 0 2024-04-19T02:18:29.838 INFO:tasks.workunit.client.0.smithi073.stdout:4/100: getdents da/d1a/d1b/d26 0 2024-04-19T02:18:29.839 INFO:tasks.workunit.client.0.smithi073.stdout:4/101: chown da/l17 6 1 2024-04-19T02:18:29.851 INFO:tasks.workunit.client.0.smithi073.stdout:7/59: fdatasync d0/f8 0 2024-04-19T02:18:29.854 INFO:tasks.workunit.client.0.smithi073.stdout:8/38: fsync f4 0 2024-04-19T02:18:29.855 INFO:tasks.workunit.client.0.smithi073.stdout:7/60: symlink d0/d3/l14 0 2024-04-19T02:18:29.855 INFO:tasks.workunit.client.0.smithi073.stdout:8/39: creat fc x:0 0 0 2024-04-19T02:18:29.855 INFO:tasks.workunit.client.0.smithi073.stdout:5/88: sync 2024-04-19T02:18:29.855 INFO:tasks.workunit.client.0.smithi073.stdout:8/40: unlink f9 0 2024-04-19T02:18:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:7/61: write d0/f7 [2816192,101125] 0 2024-04-19T02:18:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:8/41: stat f6 0 2024-04-19T02:18:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/89: creat d0/f1b x:0 0 0 2024-04-19T02:18:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:8/42: fsync f6 0 2024-04-19T02:18:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/90: symlink d0/l1c 0 2024-04-19T02:18:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/91: mkdir d0/d1d 0 2024-04-19T02:18:29.857 INFO:tasks.workunit.client.0.smithi073.stdout:5/92: mkdir d0/d1d/d1e 0 2024-04-19T02:18:29.858 INFO:tasks.workunit.client.0.smithi073.stdout:5/93: mknod d0/d1d/c1f 0 2024-04-19T02:18:29.858 INFO:tasks.workunit.client.0.smithi073.stdout:5/94: truncate d0/f9 4240947 0 2024-04-19T02:18:29.859 INFO:tasks.workunit.client.0.smithi073.stdout:7/62: dread d0/f8 [0,4194304] 0 2024-04-19T02:18:29.859 INFO:tasks.workunit.client.0.smithi073.stdout:5/95: dread - d0/f1b zero size 2024-04-19T02:18:29.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/96: write d0/f1b [1042637,14573] 0 2024-04-19T02:18:29.860 INFO:tasks.workunit.client.0.smithi073.stdout:7/63: mkdir d0/dc/d10/d15 0 2024-04-19T02:18:29.860 INFO:tasks.workunit.client.0.smithi073.stdout:6/48: fdatasync f5 0 2024-04-19T02:18:29.861 INFO:tasks.workunit.client.0.smithi073.stdout:6/49: write d8/fb [1117383,72077] 0 2024-04-19T02:18:29.861 INFO:tasks.workunit.client.0.smithi073.stdout:8/43: dwrite f4 [0,4194304] 0 2024-04-19T02:18:29.861 INFO:tasks.workunit.client.0.smithi073.stdout:8/44: rmdir - no directory 2024-04-19T02:18:29.862 INFO:tasks.workunit.client.0.smithi073.stdout:6/50: write f3 [5057941,14650] 0 2024-04-19T02:18:29.862 INFO:tasks.workunit.client.0.smithi073.stdout:8/45: write f0 [3502840,27201] 0 2024-04-19T02:18:29.863 INFO:tasks.workunit.client.0.smithi073.stdout:8/46: unlink c5 0 2024-04-19T02:18:29.863 INFO:tasks.workunit.client.0.smithi073.stdout:6/51: creat d8/de/ff x:0 0 0 2024-04-19T02:18:29.863 INFO:tasks.workunit.client.0.smithi073.stdout:8/47: mknod cd 0 2024-04-19T02:18:29.864 INFO:tasks.workunit.client.0.smithi073.stdout:6/52: creat d8/f10 x:0 0 0 2024-04-19T02:18:29.864 INFO:tasks.workunit.client.0.smithi073.stdout:2/73: rename d5/dd to d5/d10/d14/d18/d1e 0 2024-04-19T02:18:29.864 INFO:tasks.workunit.client.0.smithi073.stdout:8/48: write fc [800519,25844] 0 2024-04-19T02:18:29.864 INFO:tasks.workunit.client.0.smithi073.stdout:0/42: rename d7 to d7/dc 22 2024-04-19T02:18:29.864 INFO:tasks.workunit.client.0.smithi073.stdout:4/102: rename da/d1a to da/d27 0 2024-04-19T02:18:29.865 INFO:tasks.workunit.client.0.smithi073.stdout:6/53: creat d8/f11 x:0 0 0 2024-04-19T02:18:29.865 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:29.860+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:29.866 INFO:tasks.workunit.client.0.smithi073.stdout:2/74: mkdir d5/d10/d15/d1f 0 2024-04-19T02:18:29.866 INFO:tasks.workunit.client.0.smithi073.stdout:6/54: chown d8/de/ff 3320 1 2024-04-19T02:18:29.866 INFO:tasks.workunit.client.0.smithi073.stdout:4/103: write da/f16 [2958032,91776] 0 2024-04-19T02:18:29.866 INFO:tasks.workunit.client.0.smithi073.stdout:9/63: rename d0/df/d16/d1a/c1b to d0/c1c 0 2024-04-19T02:18:29.866 INFO:tasks.workunit.client.0.smithi073.stdout:9/64: dread - d0/fa zero size 2024-04-19T02:18:29.866 INFO:tasks.workunit.client.0.smithi073.stdout:4/104: symlink da/d23/l28 0 2024-04-19T02:18:29.866 INFO:tasks.workunit.client.0.smithi073.stdout:5/97: rename d0/f2 to d0/d1d/f20 0 2024-04-19T02:18:29.867 INFO:tasks.workunit.client.0.smithi073.stdout:6/55: creat d8/de/f12 x:0 0 0 2024-04-19T02:18:29.867 INFO:tasks.workunit.client.0.smithi073.stdout:9/65: rename d0/df/d15 to d0/df/d1d 0 2024-04-19T02:18:29.867 INFO:tasks.workunit.client.0.smithi073.stdout:6/56: truncate f3 5206665 0 2024-04-19T02:18:29.867 INFO:tasks.workunit.client.0.smithi073.stdout:7/64: rename d0/lb to d0/dc/l16 0 2024-04-19T02:18:29.868 INFO:tasks.workunit.client.0.smithi073.stdout:9/66: write d0/df/f11 [7402872,122686] 0 2024-04-19T02:18:29.868 INFO:tasks.workunit.client.0.smithi073.stdout:6/57: unlink d8/fd 0 2024-04-19T02:18:29.868 INFO:tasks.workunit.client.0.smithi073.stdout:1/64: truncate db/f12 1617488 0 2024-04-19T02:18:29.868 INFO:tasks.workunit.client.0.smithi073.stdout:5/98: rename d0/c5 to d0/d1d/c21 0 2024-04-19T02:18:29.869 INFO:tasks.workunit.client.0.smithi073.stdout:7/65: creat d0/dc/d10/d15/f17 x:0 0 0 2024-04-19T02:18:29.869 INFO:tasks.workunit.client.0.smithi073.stdout:1/65: write db/ff [859737,90687] 0 2024-04-19T02:18:29.870 INFO:tasks.workunit.client.0.smithi073.stdout:9/67: creat d0/df/d16/f1e x:0 0 0 2024-04-19T02:18:29.870 INFO:tasks.workunit.client.0.smithi073.stdout:5/99: chown d0/l1 50 1 2024-04-19T02:18:29.870 INFO:tasks.workunit.client.0.smithi073.stdout:1/66: creat db/f17 x:0 0 0 2024-04-19T02:18:29.871 INFO:tasks.workunit.client.0.smithi073.stdout:7/66: chown d0/d3/d12/l13 17 1 2024-04-19T02:18:29.871 INFO:tasks.workunit.client.0.smithi073.stdout:6/58: link l7 d8/l13 0 2024-04-19T02:18:29.871 INFO:tasks.workunit.client.0.smithi073.stdout:1/67: sync 2024-04-19T02:18:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:4/105: dread f4 [0,4194304] 0 2024-04-19T02:18:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:9/68: write d0/df/d1d/f17 [426363,108771] 0 2024-04-19T02:18:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:5/100: rename d0/c14 to d0/d1d/d1e/c22 0 2024-04-19T02:18:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:6/59: creat d8/f14 x:0 0 0 2024-04-19T02:18:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:1/68: stat db/l15 0 2024-04-19T02:18:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:5/101: symlink d0/d1d/l23 0 2024-04-19T02:18:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:6/60: dread - d8/f10 zero size 2024-04-19T02:18:29.873 INFO:tasks.workunit.client.0.smithi073.stdout:1/69: read - db/f17 zero size 2024-04-19T02:18:29.873 INFO:tasks.workunit.client.0.smithi073.stdout:4/106: write f8 [2203531,114283] 0 2024-04-19T02:18:29.873 INFO:tasks.workunit.client.0.smithi073.stdout:3/139: dwrite d3/d1c/f29 [0,4194304] 0 2024-04-19T02:18:29.874 INFO:tasks.workunit.client.0.smithi073.stdout:6/61: rename d8/cc to d8/de/c15 0 2024-04-19T02:18:29.874 INFO:tasks.workunit.client.0.smithi073.stdout:6/62: fdatasync d8/fb 0 2024-04-19T02:18:29.877 INFO:tasks.workunit.client.0.smithi073.stdout:3/140: symlink d3/d6/db/d16/l32 0 2024-04-19T02:18:29.879 INFO:tasks.workunit.client.0.smithi073.stdout:9/69: dwrite d0/f6 [0,4194304] 0 2024-04-19T02:18:29.880 INFO:tasks.workunit.client.0.smithi073.stdout:9/70: getdents d0/df/d16/d19 0 2024-04-19T02:18:29.881 INFO:tasks.workunit.client.0.smithi073.stdout:4/107: dwrite da/f18 [0,4194304] 0 2024-04-19T02:18:29.881 INFO:tasks.workunit.client.0.smithi073.stdout:9/71: creat d0/f1f x:0 0 0 2024-04-19T02:18:29.882 INFO:tasks.workunit.client.0.smithi073.stdout:3/141: dread d3/d6/f22 [0,4194304] 0 2024-04-19T02:18:29.882 INFO:tasks.workunit.client.0.smithi073.stdout:9/72: chown d0/df/d16/d19 0 1 2024-04-19T02:18:29.882 INFO:tasks.workunit.client.0.smithi073.stdout:3/142: chown d3/d6/db/d16 79876 1 2024-04-19T02:18:29.882 INFO:tasks.workunit.client.0.smithi073.stdout:4/108: truncate da/d27/d1b/d1d/f1f 950973 0 2024-04-19T02:18:29.883 INFO:tasks.workunit.client.0.smithi073.stdout:3/143: fdatasync d3/d6/db/d23/f27 0 2024-04-19T02:18:29.885 INFO:tasks.workunit.client.0.smithi073.stdout:3/144: link d3/d6/db/l17 d3/d1c/l33 0 2024-04-19T02:18:29.886 INFO:tasks.workunit.client.0.smithi073.stdout:3/145: mknod d3/d6/db/d1a/d2f/c34 0 2024-04-19T02:18:29.887 INFO:tasks.workunit.client.0.smithi073.stdout:9/73: dwrite d0/df/f11 [4194304,4194304] 0 2024-04-19T02:18:29.888 INFO:tasks.workunit.client.0.smithi073.stdout:9/74: symlink d0/l20 0 2024-04-19T02:18:29.888 INFO:tasks.workunit.client.0.smithi073.stdout:9/75: chown d0/f13 935882 1 2024-04-19T02:18:29.889 INFO:tasks.workunit.client.0.smithi073.stdout:9/76: truncate d0/fa 547723 0 2024-04-19T02:18:29.889 INFO:tasks.workunit.client.0.smithi073.stdout:9/77: creat d0/df/f21 x:0 0 0 2024-04-19T02:18:29.891 INFO:tasks.workunit.client.0.smithi073.stdout:9/78: link d0/fc d0/df/f22 0 2024-04-19T02:18:29.893 INFO:tasks.workunit.client.0.smithi073.stdout:9/79: truncate d0/df/d16/f1e 74258 0 2024-04-19T02:18:29.893 INFO:tasks.workunit.client.0.smithi073.stdout:3/146: dwrite d3/d6/f15 [0,4194304] 0 2024-04-19T02:18:29.894 INFO:tasks.workunit.client.0.smithi073.stdout:9/80: symlink d0/df/d16/l23 0 2024-04-19T02:18:29.894 INFO:tasks.workunit.client.0.smithi073.stdout:3/147: read d3/d6/d11/f2e [981443,17043] 0 2024-04-19T02:18:29.894 INFO:tasks.workunit.client.0.smithi073.stdout:9/81: write d0/df/d1d/f17 [805398,117094] 0 2024-04-19T02:18:29.894 INFO:tasks.workunit.client.0.smithi073.stdout:3/148: creat d3/d6/d11/f35 x:0 0 0 2024-04-19T02:18:29.895 INFO:tasks.workunit.client.0.smithi073.stdout:9/82: dread - d0/df/f10 zero size 2024-04-19T02:18:29.897 INFO:tasks.workunit.client.0.smithi073.stdout:3/149: dread d3/d1c/f29 [0,4194304] 0 2024-04-19T02:18:29.909 INFO:tasks.workunit.client.0.smithi073.stdout:4/109: truncate f4 1560765 0 2024-04-19T02:18:29.910 INFO:tasks.workunit.client.0.smithi073.stdout:4/110: chown da/ce 811622 1 2024-04-19T02:18:29.915 INFO:tasks.workunit.client.0.smithi073.stdout:7/67: getdents d0/dc/d10 0 2024-04-19T02:18:29.915 INFO:tasks.workunit.client.0.smithi073.stdout:8/49: getdents . 0 2024-04-19T02:18:29.915 INFO:tasks.workunit.client.0.smithi073.stdout:1/70: truncate db/f12 2477780 0 2024-04-19T02:18:29.916 INFO:tasks.workunit.client.0.smithi073.stdout:2/75: write f3 [979791,74260] 0 2024-04-19T02:18:29.917 INFO:tasks.workunit.client.0.smithi073.stdout:7/68: write d0/f8 [4762669,100976] 0 2024-04-19T02:18:29.917 INFO:tasks.workunit.client.0.smithi073.stdout:5/102: chown d0/d1d/c21 73228 1 2024-04-19T02:18:29.917 INFO:tasks.workunit.client.0.smithi073.stdout:6/63: getdents d8 0 2024-04-19T02:18:29.917 INFO:tasks.workunit.client.0.smithi073.stdout:9/83: getdents d0 0 2024-04-19T02:18:29.918 INFO:tasks.workunit.client.0.smithi073.stdout:3/150: truncate d3/d6/f12 51902 0 2024-04-19T02:18:29.919 INFO:tasks.workunit.client.0.smithi073.stdout:4/111: truncate f8 1039968 0 2024-04-19T02:18:29.919 INFO:tasks.workunit.client.0.smithi073.stdout:5/103: mkdir d0/d1d/d24 0 2024-04-19T02:18:29.920 INFO:tasks.workunit.client.0.smithi073.stdout:7/69: creat d0/d3/f18 x:0 0 0 2024-04-19T02:18:29.920 INFO:tasks.workunit.client.0.smithi073.stdout:9/84: creat d0/df/d1d/f24 x:0 0 0 2024-04-19T02:18:29.920 INFO:tasks.workunit.client.0.smithi073.stdout:4/112: truncate f4 1832433 0 2024-04-19T02:18:29.920 INFO:tasks.workunit.client.0.smithi073.stdout:2/76: creat d5/d10/d15/d1f/f20 x:0 0 0 2024-04-19T02:18:29.920 INFO:tasks.workunit.client.0.smithi073.stdout:3/151: unlink d3/d6/db/d1a/f28 0 2024-04-19T02:18:29.921 INFO:tasks.workunit.client.0.smithi073.stdout:0/43: dwrite d7/f9 [0,4194304] 0 2024-04-19T02:18:29.921 INFO:tasks.workunit.client.0.smithi073.stdout:5/104: chown d0/d1d/c21 6654143 1 2024-04-19T02:18:29.921 INFO:tasks.workunit.client.0.smithi073.stdout:2/77: chown d5/d10/d15 4538 1 2024-04-19T02:18:29.922 INFO:tasks.workunit.client.0.smithi073.stdout:0/44: read f4 [1505035,14711] 0 2024-04-19T02:18:29.922 INFO:tasks.workunit.client.0.smithi073.stdout:8/50: dread f4 [0,4194304] 0 2024-04-19T02:18:29.922 INFO:tasks.workunit.client.0.smithi073.stdout:5/105: stat d0/f15 0 2024-04-19T02:18:29.922 INFO:tasks.workunit.client.0.smithi073.stdout:2/78: readlink d5/lb 0 2024-04-19T02:18:29.923 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:29.923 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:29.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.923 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:10833 4.19 e63/16 4:9ac2b2ed:::10000003115.00000001:head v 63'186, mlcod=63'183)", 2024-04-19T02:18:29.923 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.912592+0000", 2024-04-19T02:18:29.923 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.010409395, 2024-04-19T02:18:29.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010425917999999999, 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.912592+0000", 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.912592+0000", 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.912592+0000", 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.912714+0000", 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121935 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.912724+0000", 2024-04-19T02:18:29.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0145e-05 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.912729+0000", 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.575e-06 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.917042+0000", 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043120600000000004 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.917069+0000", 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7191000000000001e-05 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:408 4.10 4:0b02e9d1:::10000003132.00000001:head [trimtrunc 2@0] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.916776+0000", 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.006225703, 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063103949999999999, 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916776+0000", 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916776+0000", 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916776+0000", 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916778+0000", 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2879999999999999e-06 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916785+0000", 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9859999999999997e-06 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916789+0000", 2024-04-19T02:18:29.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.031e-06 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916830+0000", 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1477000000000003e-05 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916887+0000", 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7031000000000003e-05 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.916973+0000", 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6007000000000005e-05 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919195+0000", 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022217529999999999 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:10840 4.19 e63/16 4:9ac2b2ed:::10000003115.00000001:head v 63'187, mlcod=63'183)", 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.913694+0000", 2024-04-19T02:18:29.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0093076589999999994, 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094723289999999998, 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.913694+0000", 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.913694+0000", 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.913694+0000", 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.918948+0000", 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052543379999999999 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.918961+0000", 2024-04-19T02:18:29.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2668e-05 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.918967+0000", 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.426e-06 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919003+0000", 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6201000000000001e-05 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919024+0000", 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0611999999999998e-05 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:410 3.2 3:4272d415:::200.0000000b:head [write 1768542~10402 [fadvise_dontneed] in=10402b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.919755+0000", 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0032465200000000001, 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034808510000000001, 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:29.935 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919755+0000", 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919755+0000", 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919754+0000", 2024-04-19T02:18:29.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919769+0000", 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4746000000000001e-05 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919781+0000", 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1899000000000001e-05 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919790+0000", 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5529999999999998e-06 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919834+0000", 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3377999999999997e-05 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.919963+0000", 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012964399999999999 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.920042+0000", 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8734999999999997e-05 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:10828 4.19 e63/16 4:9a5899f2:::100000030c3.00000000:head v 63'185, mlcod=63'178)", 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.884296+0000", 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.038705288999999997, 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.039010019999999999, 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:29.939 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.884296+0000", 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.884296+0000", 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.884296+0000", 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:29.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.890109+0000", 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005813192 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.890122+0000", 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3335e-05 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.890132+0000", 2024-04-19T02:18:29.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2599999999999994e-06 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.890176+0000", 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4263e-05 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.890197+0000", 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0837999999999999e-05 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10839 4.29 4:9786b8f5:::10000003100.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.882710+0000", 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.040291736000000002, 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.040871262999999998, 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10839 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.943 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.882710+0000", 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.882710+0000", 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.882709+0000", 2024-04-19T02:18:29.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.892008+0000", 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092997410000000003 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.892020+0000", 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1795e-05 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.892030+0000", 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8369999999999992e-06 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.892078+0000", 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8439000000000002e-05 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.892245+0000", 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166398 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:411 3.2 3:4272d415:::200.0000000b:head [write 1778944~15759 [fadvise_dontneed] in=15759b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.922904+0000", 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.7591999999999997e-05, 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089745099999999996, 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.922904+0000", 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.922904+0000", 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.922903+0000", 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.922919+0000", 2024-04-19T02:18:29.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5500999999999999e-05 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.922933+0000", 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4015e-05 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.922942+0000", 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0459999999999994e-06 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.923000+0000", 2024-04-19T02:18:29.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8168000000000003e-05 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.923106+0000", 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105703 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.923245+0000", 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000139698 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:29.950 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.951 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:29.951 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:29.951 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 7 2024-04-19T02:18:29.951 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:29.953 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:29.964 INFO:tasks.workunit.client.0.smithi073.stdout:7/70: creat d0/dc/d10/d15/f19 x:0 0 0 2024-04-19T02:18:29.964 INFO:tasks.workunit.client.0.smithi073.stdout:6/64: dread f5 [0,4194304] 0 2024-04-19T02:18:29.964 INFO:tasks.workunit.client.0.smithi073.stdout:5/106: fdatasync d0/d1d/f20 0 2024-04-19T02:18:29.964 INFO:tasks.workunit.client.0.smithi073.stdout:0/45: rename d7/f9 to d7/fd 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/85: symlink d0/df/d16/d19/l25 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:3/152: symlink d3/d6/db/l36 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/86: readlink d0/l20 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:2/79: link d5/d10/d14/d18/d1e/f12 d5/d10/d14/f21 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:0/46: mknod d7/ce 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:3/153: write d3/d1c/f29 [3368165,29808] 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/87: getdents d0/df 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:2/80: chown d5/d10/l1d 787128 1 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/88: unlink d0/c5 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:1/71: write f3 [203807,1716] 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:2/81: sync 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/107: dread d0/f19 [0,4194304] 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:8/51: dwrite fb [0,4194304] 0 2024-04-19T02:18:29.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/108: mkdir d0/d1d/d25 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:6/65: dwrite d8/f10 [0,4194304] 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:4/113: write da/fc [928505,104278] 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:1/72: creat db/f18 x:0 0 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:9/89: creat d0/df/d16/d19/f26 x:0 0 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:5/109: fdatasync d0/f16 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:2/82: creat d5/d10/d14/d18/f22 x:0 0 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:9/90: chown d0/f13 6 1 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:4/114: chown da/d27/l1e 25375 1 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:7/71: dwrite d0/d3/f18 [0,4194304] 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:7/72: fsync d0/dc/d10/d15/f19 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:3/154: rename d3/f4 to d3/d6/db/f37 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:8/52: write fc [219754,119670] 0 2024-04-19T02:18:29.966 INFO:tasks.workunit.client.0.smithi073.stdout:2/83: unlink d5/d10/d14/d18/f1b 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:9/91: mknod d0/df/d16/d19/c27 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/84: sync 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:7/73: unlink d0/f6 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:9/92: fsync d0/f12 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:0/47: dwrite f5 [0,4194304] 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:7/74: mknod d0/dc/c1a 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/85: write f3 [1500431,6167] 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:1/73: link db/l15 db/l19 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:5/110: creat d0/d1d/d25/f26 x:0 0 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:0/48: mknod d7/cf 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:7/75: rmdir d0/dc/d10 39 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/86: symlink d5/d10/l23 0 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:1/74: chown f6 2879881 1 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:5/111: chown d0/c1a 87104460 1 2024-04-19T02:18:29.967 INFO:tasks.workunit.client.0.smithi073.stdout:3/155: rmdir d3/d6/db 39 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:0/49: creat d7/f10 x:0 0 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:2/87: unlink d5/lf 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:7/76: symlink d0/d3/l1b 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:1/75: write db/f13 [396236,44997] 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:6/66: dwrite f5 [0,4194304] 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:5/112: creat d0/d1d/d25/f27 x:0 0 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:1/76: truncate f9 448231 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:2/88: rename d5/d10 to d5/d10/d14/d24 22 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:0/50: write f2 [5189559,60720] 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:4/115: dwrite da/f18 [0,4194304] 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:8/53: dread fb [0,4194304] 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:4/116: stat c3 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:1/77: mkdir db/d1a 0 2024-04-19T02:18:29.968 INFO:tasks.workunit.client.0.smithi073.stdout:7/77: symlink d0/dc/d10/l1c 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:5/113: mknod d0/d1d/d25/c28 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:0/51: chown d7/f10 4027851 1 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:9/93: dread d0/fc [0,4194304] 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:4/117: chown da/c19 724 1 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:7/78: chown d0/dc/d10 54 1 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:6/67: truncate d8/f11 34926 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:8/54: creat fe x:0 0 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:5/114: fsync d0/f16 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:9/94: truncate d0/f13 32747 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:6/68: dread - d8/de/ff zero size 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:8/55: stat fc 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:0/52: creat d7/f11 x:0 0 0 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:5/115: dread - d0/d1d/d25/f26 zero size 2024-04-19T02:18:29.969 INFO:tasks.workunit.client.0.smithi073.stdout:4/118: write f4 [1643878,66120] 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:9/95: write d0/df/d16/f1e [30909,55043] 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:6/69: creat d8/f16 x:0 0 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/78: rmdir db/d1a 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:7/79: rename d0/d3/f18 to d0/f1d 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:8/56: dread f6 [0,4194304] 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:5/116: fsync d0/f19 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/79: symlink db/l1b 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:8/57: symlink lf 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:4/119: creat da/d27/d1b/d1d/f29 x:0 0 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/80: dread - db/f17 zero size 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:8/58: unlink fb 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:9/96: getdents d0/df 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:4/120: fdatasync da/d27/d1b/d1d/f1f 0 2024-04-19T02:18:29.970 INFO:tasks.workunit.client.0.smithi073.stdout:8/59: link fc f10 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:2/89: dwrite f3 [0,4194304] 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:2/90: readlink d5/d10/l23 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:8/60: write fc [2025,75993] 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:4/121: mkdir da/d27/d1b/d26/d2a 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:4/122: stat da/fc 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:7/80: dread d0/f1d [0,4194304] 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:6/70: dread d8/f10 [0,4194304] 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:6/71: write d8/f10 [1112902,27039] 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:6/72: mknod d8/de/c17 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:3/156: chown d3/d6/f12 10387 1 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:6/73: creat d8/f18 x:0 0 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:3/157: unlink d3/d6/db/l21 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:6/74: truncate f5 8858359 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:4/123: dread f1 [0,4194304] 0 2024-04-19T02:18:29.971 INFO:tasks.workunit.client.0.smithi073.stdout:4/124: fsync da/f15 0 2024-04-19T02:18:29.972 INFO:tasks.workunit.client.0.smithi073.stdout:3/158: fdatasync d3/d6/f15 0 2024-04-19T02:18:29.974 INFO:tasks.workunit.client.0.smithi073.stdout:2/91: dwrite d5/f13 [0,4194304] 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:3/159: mkdir d3/d1c/d38 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:8/61: dwrite fe [0,4194304] 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:3/160: dread - d3/d6/db/d1a/f2b zero size 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:8/62: write f0 [708362,85704] 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/92: link d5/d10/d15/d1f/f20 d5/d10/d14/d18/d1e/f25 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:3/161: creat d3/d6/d11/d24/f39 x:0 0 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:6/75: dread f3 [0,4194304] 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/93: dread - d5/d10/d14/d18/f1a zero size 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:6/76: link d8/de/ff d8/f19 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/94: mknod d5/d10/d14/d18/c26 0 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/95: sync 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:6/77: chown d8/f18 9825795 1 2024-04-19T02:18:29.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/96: symlink d5/l27 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:6/78: creat d8/f1a x:0 0 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:2/97: stat d5/d10/d14 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:6/79: stat d8/f10 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:6/80: mkdir d8/d1b 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:5/117: fsync d0/d1d/d25/f26 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:6/81: symlink d8/l1c 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:0/53: rmdir d7 39 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:1/81: rmdir db 39 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:6/82: readlink d8/l13 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:8/63: dwrite f10 [0,4194304] 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:5/118: symlink d0/d1d/d1e/l29 0 2024-04-19T02:18:29.976 INFO:tasks.workunit.client.0.smithi073.stdout:1/82: mkdir db/d1c 0 2024-04-19T02:18:29.977 INFO:tasks.workunit.client.0.smithi073.stdout:6/83: fdatasync d8/de/ff 0 2024-04-19T02:18:29.977 INFO:tasks.workunit.client.0.smithi073.stdout:6/84: symlink d8/l1d 0 2024-04-19T02:18:29.977 INFO:tasks.workunit.client.0.smithi073.stdout:1/83: link db/l19 db/l1d 0 2024-04-19T02:18:29.979 INFO:tasks.workunit.client.0.smithi073.stdout:1/84: symlink db/l1e 0 2024-04-19T02:18:29.979 INFO:tasks.workunit.client.0.smithi073.stdout:9/97: dread d0/f13 [0,4194304] 0 2024-04-19T02:18:29.979 INFO:tasks.workunit.client.0.smithi073.stdout:0/54: dread f2 [0,4194304] 0 2024-04-19T02:18:29.979 INFO:tasks.workunit.client.0.smithi073.stdout:2/98: dwrite d5/d10/d15/d1f/f20 [0,4194304] 0 2024-04-19T02:18:29.981 INFO:tasks.workunit.client.0.smithi073.stdout:1/85: symlink db/d1c/l1f 0 2024-04-19T02:18:29.981 INFO:tasks.workunit.client.0.smithi073.stdout:9/98: symlink d0/df/d16/l28 0 2024-04-19T02:18:29.981 INFO:tasks.workunit.client.0.smithi073.stdout:0/55: read d7/f8 [1709754,123334] 0 2024-04-19T02:18:29.982 INFO:tasks.workunit.client.0.smithi073.stdout:8/64: dread f10 [0,4194304] 0 2024-04-19T02:18:29.982 INFO:tasks.workunit.client.0.smithi073.stdout:8/65: sync 2024-04-19T02:18:29.983 INFO:tasks.workunit.client.0.smithi073.stdout:1/86: symlink db/l20 0 2024-04-19T02:18:29.983 INFO:tasks.workunit.client.0.smithi073.stdout:0/56: symlink d7/l12 0 2024-04-19T02:18:29.983 INFO:tasks.workunit.client.0.smithi073.stdout:9/99: symlink d0/df/l29 0 2024-04-19T02:18:29.983 INFO:tasks.workunit.client.0.smithi073.stdout:8/66: unlink ca 0 2024-04-19T02:18:29.983 INFO:tasks.workunit.client.0.smithi073.stdout:8/67: sync 2024-04-19T02:18:29.984 INFO:tasks.workunit.client.0.smithi073.stdout:1/87: creat db/f21 x:0 0 0 2024-04-19T02:18:29.984 INFO:tasks.workunit.client.0.smithi073.stdout:0/57: mknod d7/c13 0 2024-04-19T02:18:29.985 INFO:tasks.workunit.client.0.smithi073.stdout:0/58: chown d7/f8 11192 1 2024-04-19T02:18:29.985 INFO:tasks.workunit.client.0.smithi073.stdout:8/68: write f4 [2684889,60914] 0 2024-04-19T02:18:29.985 INFO:tasks.workunit.client.0.smithi073.stdout:5/119: dwrite d0/d1d/d25/f27 [0,4194304] 0 2024-04-19T02:18:29.985 INFO:tasks.workunit.client.0.smithi073.stdout:8/69: stat lf 0 2024-04-19T02:18:29.985 INFO:tasks.workunit.client.0.smithi073.stdout:8/70: rmdir - no directory 2024-04-19T02:18:29.985 INFO:tasks.workunit.client.0.smithi073.stdout:5/120: chown d0/l1 509168 1 2024-04-19T02:18:29.987 INFO:tasks.workunit.client.0.smithi073.stdout:1/88: mknod db/d1c/c22 0 2024-04-19T02:18:29.988 INFO:tasks.workunit.client.0.smithi073.stdout:8/71: rename fc to f11 0 2024-04-19T02:18:29.988 INFO:tasks.workunit.client.0.smithi073.stdout:8/72: rmdir - no directory 2024-04-19T02:18:29.988 INFO:tasks.workunit.client.0.smithi073.stdout:5/121: creat d0/d1d/f2a x:0 0 0 2024-04-19T02:18:29.989 INFO:tasks.workunit.client.0.smithi073.stdout:8/73: rename f10 to f12 0 2024-04-19T02:18:29.989 INFO:tasks.workunit.client.0.smithi073.stdout:1/89: link f9 db/f23 0 2024-04-19T02:18:29.989 INFO:tasks.workunit.client.0.smithi073.stdout:5/122: chown d0/d1d/f20 439818 1 2024-04-19T02:18:29.990 INFO:tasks.workunit.client.0.smithi073.stdout:1/90: fdatasync db/f23 0 2024-04-19T02:18:29.991 INFO:tasks.workunit.client.0.smithi073.stdout:5/123: creat d0/d1d/d1e/f2b x:0 0 0 2024-04-19T02:18:29.993 INFO:tasks.workunit.client.0.smithi073.stdout:9/100: dwrite d0/df/d1d/f17 [0,4194304] 0 2024-04-19T02:18:29.994 INFO:tasks.workunit.client.0.smithi073.stdout:9/101: readlink d0/l3 0 2024-04-19T02:18:29.995 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:29.992+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.003 INFO:tasks.workunit.client.0.smithi073.stdout:8/74: dwrite f6 [0,4194304] 0 2024-04-19T02:18:30.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/75: symlink l13 0 2024-04-19T02:18:30.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/91: dwrite db/ff [0,4194304] 0 2024-04-19T02:18:30.005 INFO:tasks.workunit.client.0.smithi073.stdout:7/81: fsync d0/f1d 0 2024-04-19T02:18:30.010 INFO:tasks.workunit.client.0.smithi073.stdout:3/162: rename d3/d1c to d3/d6/db/d3a 0 2024-04-19T02:18:30.010 INFO:tasks.workunit.client.0.smithi073.stdout:4/125: truncate da/f11 416099 0 2024-04-19T02:18:30.011 INFO:tasks.workunit.client.0.smithi073.stdout:6/85: rmdir d8 39 2024-04-19T02:18:30.011 INFO:tasks.workunit.client.0.smithi073.stdout:4/126: chown c2 2511187 1 2024-04-19T02:18:30.011 INFO:tasks.workunit.client.0.smithi073.stdout:2/99: write d5/fa [996998,54252] 0 2024-04-19T02:18:30.011 INFO:tasks.workunit.client.0.smithi073.stdout:0/59: truncate f5 666540 0 2024-04-19T02:18:30.013 INFO:tasks.workunit.client.0.smithi073.stdout:0/60: dread - d7/f10 zero size 2024-04-19T02:18:30.013 INFO:tasks.workunit.client.0.smithi073.stdout:1/92: creat db/d1c/f24 x:0 0 0 2024-04-19T02:18:30.013 INFO:tasks.workunit.client.0.smithi073.stdout:4/127: mkdir da/d23/d2b 0 2024-04-19T02:18:30.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/102: dwrite d0/f13 [0,4194304] 0 2024-04-19T02:18:30.014 INFO:tasks.workunit.client.0.smithi073.stdout:4/128: mkdir da/d27/d2c 0 2024-04-19T02:18:30.015 INFO:tasks.workunit.client.0.smithi073.stdout:6/86: rename d8/f19 to d8/de/f1e 0 2024-04-19T02:18:30.015 INFO:tasks.workunit.client.0.smithi073.stdout:1/93: dread - db/d1c/f24 zero size 2024-04-19T02:18:30.015 INFO:tasks.workunit.client.0.smithi073.stdout:1/94: sync 2024-04-19T02:18:30.016 INFO:tasks.workunit.client.0.smithi073.stdout:9/103: mknod d0/df/c2a 0 2024-04-19T02:18:30.016 INFO:tasks.workunit.client.0.smithi073.stdout:6/87: dread - d8/f14 zero size 2024-04-19T02:18:30.018 INFO:tasks.workunit.client.0.smithi073.stdout:4/129: write da/fc [1472081,69959] 0 2024-04-19T02:18:30.018 INFO:tasks.workunit.client.0.smithi073.stdout:1/95: chown db/l15 16037 1 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/76: dwrite f12 [0,4194304] 0 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:6/88: write d8/f10 [736850,30141] 0 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:3/163: dread d3/d6/f7 [0,4194304] 0 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:7/82: truncate d0/dc/d10/d15/f17 908446 0 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:3/164: sync 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/77: mkdir d14 0 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/78: readlink l13 0 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:6/89: rmdir d8/de 39 2024-04-19T02:18:30.020 INFO:tasks.workunit.client.0.smithi073.stdout:1/96: link db/ff db/f25 0 2024-04-19T02:18:30.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/79: readlink l13 0 2024-04-19T02:18:30.023 INFO:tasks.workunit.client.0.smithi073.stdout:9/104: link d0/l20 d0/df/d16/d19/l2b 0 2024-04-19T02:18:30.023 INFO:tasks.workunit.client.0.smithi073.stdout:6/90: readlink d8/l1d 0 2024-04-19T02:18:30.023 INFO:tasks.workunit.client.0.smithi073.stdout:3/165: readlink d3/l8 0 2024-04-19T02:18:30.023 INFO:tasks.workunit.client.0.smithi073.stdout:4/130: getdents da/d27/d2c 0 2024-04-19T02:18:30.023 INFO:tasks.workunit.client.0.smithi073.stdout:1/97: symlink db/d1c/l26 0 2024-04-19T02:18:30.024 INFO:tasks.workunit.client.0.smithi073.stdout:3/166: unlink d3/d6/f12 0 2024-04-19T02:18:30.025 INFO:tasks.workunit.client.0.smithi073.stdout:5/124: getdents d0/d1d/d1e 0 2024-04-19T02:18:30.025 INFO:tasks.workunit.client.0.smithi073.stdout:1/98: symlink db/l27 0 2024-04-19T02:18:30.025 INFO:tasks.workunit.client.0.smithi073.stdout:3/167: fsync d3/d6/f22 0 2024-04-19T02:18:30.025 INFO:tasks.workunit.client.0.smithi073.stdout:4/131: rmdir da/d23 39 2024-04-19T02:18:30.026 INFO:tasks.workunit.client.0.smithi073.stdout:0/61: dwrite d7/fd [0,4194304] 0 2024-04-19T02:18:30.026 INFO:tasks.workunit.client.0.smithi073.stdout:3/168: symlink d3/d6/l3b 0 2024-04-19T02:18:30.028 INFO:tasks.workunit.client.0.smithi073.stdout:0/62: mkdir d7/d14 0 2024-04-19T02:18:30.028 INFO:tasks.workunit.client.0.smithi073.stdout:4/132: rename da/f14 to da/d23/d2b/f2d 0 2024-04-19T02:18:30.028 INFO:tasks.workunit.client.0.smithi073.stdout:5/125: link d0/f1b d0/d1d/d24/f2c 0 2024-04-19T02:18:30.028 INFO:tasks.workunit.client.0.smithi073.stdout:3/169: symlink d3/d6/db/d1a/l3c 0 2024-04-19T02:18:30.029 INFO:tasks.workunit.client.0.smithi073.stdout:4/133: readlink da/d23/l28 0 2024-04-19T02:18:30.029 INFO:tasks.workunit.client.0.smithi073.stdout:6/91: dread d8/fb [0,4194304] 0 2024-04-19T02:18:30.029 INFO:tasks.workunit.client.0.smithi073.stdout:0/63: unlink d7/f8 0 2024-04-19T02:18:30.030 INFO:tasks.workunit.client.0.smithi073.stdout:5/126: fdatasync d0/d1d/f2a 0 2024-04-19T02:18:30.030 INFO:tasks.workunit.client.0.smithi073.stdout:4/134: readlink da/l17 0 2024-04-19T02:18:30.030 INFO:tasks.workunit.client.0.smithi073.stdout:0/64: fsync f4 0 2024-04-19T02:18:30.031 INFO:tasks.workunit.client.0.smithi073.stdout:9/105: dread d0/df/d1d/f17 [0,4194304] 0 2024-04-19T02:18:30.031 INFO:tasks.workunit.client.0.smithi073.stdout:2/100: truncate d5/fa 617460 0 2024-04-19T02:18:30.031 INFO:tasks.workunit.client.0.smithi073.stdout:5/127: mkdir d0/d2d 0 2024-04-19T02:18:30.032 INFO:tasks.workunit.client.0.smithi073.stdout:4/135: mknod da/d27/d1b/d26/c2e 0 2024-04-19T02:18:30.032 INFO:tasks.workunit.client.0.smithi073.stdout:2/101: chown d5/d10/d14/d18/f1a 0 1 2024-04-19T02:18:30.033 INFO:tasks.workunit.client.0.smithi073.stdout:0/65: creat d7/d14/f15 x:0 0 0 2024-04-19T02:18:30.033 INFO:tasks.workunit.client.0.smithi073.stdout:7/83: write d0/f7 [12298,8472] 0 2024-04-19T02:18:30.033 INFO:tasks.workunit.client.0.smithi073.stdout:1/99: dwrite db/f11 [0,4194304] 0 2024-04-19T02:18:30.034 INFO:tasks.workunit.client.0.smithi073.stdout:0/66: read - d7/f11 zero size 2024-04-19T02:18:30.034 INFO:tasks.workunit.client.0.smithi073.stdout:5/128: write d0/d1d/d25/f26 [1041601,93799] 0 2024-04-19T02:18:30.034 INFO:tasks.workunit.client.0.smithi073.stdout:7/84: fdatasync d0/f1d 0 2024-04-19T02:18:30.035 INFO:tasks.workunit.client.0.smithi073.stdout:0/67: unlink d7/l12 0 2024-04-19T02:18:30.035 INFO:tasks.workunit.client.0.smithi073.stdout:3/170: dread d3/d6/db/f37 [0,4194304] 0 2024-04-19T02:18:30.036 INFO:tasks.workunit.client.0.smithi073.stdout:0/68: sync 2024-04-19T02:18:30.036 INFO:tasks.workunit.client.0.smithi073.stdout:6/92: dread f5 [4194304,4194304] 0 2024-04-19T02:18:30.037 INFO:tasks.workunit.client.0.smithi073.stdout:7/85: rename d0/d3/l14 to d0/d3/l1e 0 2024-04-19T02:18:30.037 INFO:tasks.workunit.client.0.smithi073.stdout:0/69: rename d7/f10 to d7/d14/f16 0 2024-04-19T02:18:30.037 INFO:tasks.workunit.client.0.smithi073.stdout:0/70: chown d7 0 1 2024-04-19T02:18:30.037 INFO:tasks.workunit.client.0.smithi073.stdout:9/106: dread d0/f6 [0,4194304] 0 2024-04-19T02:18:30.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/93: rmdir d8/d1b 0 2024-04-19T02:18:30.038 INFO:tasks.workunit.client.0.smithi073.stdout:9/107: fsync d0/df/f10 0 2024-04-19T02:18:30.038 INFO:tasks.workunit.client.0.smithi073.stdout:0/71: mkdir d7/d14/d17 0 2024-04-19T02:18:30.038 INFO:tasks.workunit.client.0.smithi073.stdout:7/86: creat d0/dc/f1f x:0 0 0 2024-04-19T02:18:30.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/94: creat d8/de/f1f x:0 0 0 2024-04-19T02:18:30.039 INFO:tasks.workunit.client.0.smithi073.stdout:9/108: dread - d0/f12 zero size 2024-04-19T02:18:30.039 INFO:tasks.workunit.client.0.smithi073.stdout:6/95: fdatasync d8/f10 0 2024-04-19T02:18:30.039 INFO:tasks.workunit.client.0.smithi073.stdout:5/129: dread d0/d1d/d25/f27 [0,4194304] 0 2024-04-19T02:18:30.039 INFO:tasks.workunit.client.0.smithi073.stdout:7/87: fsync d0/dc/d10/d15/f17 0 2024-04-19T02:18:30.040 INFO:tasks.workunit.client.0.smithi073.stdout:8/80: truncate fe 1814043 0 2024-04-19T02:18:30.040 INFO:tasks.workunit.client.0.smithi073.stdout:0/72: write d7/fd [5952925,22391] 0 2024-04-19T02:18:30.041 INFO:tasks.workunit.client.0.smithi073.stdout:9/109: mkdir d0/df/d16/d1a/d2c 0 2024-04-19T02:18:30.041 INFO:tasks.workunit.client.0.smithi073.stdout:6/96: symlink d8/l20 0 2024-04-19T02:18:30.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/81: readlink l13 0 2024-04-19T02:18:30.041 INFO:tasks.workunit.client.0.smithi073.stdout:7/88: write d0/dc/f1f [287324,12168] 0 2024-04-19T02:18:30.041 INFO:tasks.workunit.client.0.smithi073.stdout:0/73: chown c3 7781 1 2024-04-19T02:18:30.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/97: mknod d8/de/c21 0 2024-04-19T02:18:30.042 INFO:tasks.workunit.client.0.smithi073.stdout:8/82: write f11 [4009300,64976] 0 2024-04-19T02:18:30.042 INFO:tasks.workunit.client.0.smithi073.stdout:0/74: dread - d7/d14/f15 zero size 2024-04-19T02:18:30.043 INFO:tasks.workunit.client.0.smithi073.stdout:0/75: sync 2024-04-19T02:18:30.043 INFO:tasks.workunit.client.0.smithi073.stdout:7/89: chown d0/dc/d10/l1c 1 1 2024-04-19T02:18:30.043 INFO:tasks.workunit.client.0.smithi073.stdout:9/110: mkdir d0/df/d16/d1a/d2d 0 2024-04-19T02:18:30.044 INFO:tasks.workunit.client.0.smithi073.stdout:1/100: dread f3 [0,4194304] 0 2024-04-19T02:18:30.044 INFO:tasks.workunit.client.0.smithi073.stdout:8/83: mkdir d14/d15 0 2024-04-19T02:18:30.045 INFO:tasks.workunit.client.0.smithi073.stdout:3/171: dwrite d3/d6/f22 [4194304,4194304] 0 2024-04-19T02:18:30.046 INFO:tasks.workunit.client.0.smithi073.stdout:8/84: unlink f4 0 2024-04-19T02:18:30.046 INFO:tasks.workunit.client.0.smithi073.stdout:9/111: write d0/df/f11 [9246505,66238] 0 2024-04-19T02:18:30.046 INFO:tasks.workunit.client.0.smithi073.stdout:1/101: creat db/f28 x:0 0 0 2024-04-19T02:18:30.046 INFO:tasks.workunit.client.0.smithi073.stdout:7/90: write d0/f1d [3405251,89179] 0 2024-04-19T02:18:30.047 INFO:tasks.workunit.client.0.smithi073.stdout:9/112: readlink d0/l4 0 2024-04-19T02:18:30.047 INFO:tasks.workunit.client.0.smithi073.stdout:8/85: write f12 [2832828,38459] 0 2024-04-19T02:18:30.048 INFO:tasks.workunit.client.0.smithi073.stdout:2/102: write d5/d10/d14/d18/f1a [484538,52585] 0 2024-04-19T02:18:30.048 INFO:tasks.workunit.client.0.smithi073.stdout:1/102: truncate db/f28 547395 0 2024-04-19T02:18:30.048 INFO:tasks.workunit.client.0.smithi073.stdout:3/172: write d3/d6/db/f2d [638113,92926] 0 2024-04-19T02:18:30.049 INFO:tasks.workunit.client.0.smithi073.stdout:1/103: stat db/l1b 0 2024-04-19T02:18:30.049 INFO:tasks.workunit.client.0.smithi073.stdout:8/86: creat d14/f16 x:0 0 0 2024-04-19T02:18:30.050 INFO:tasks.workunit.client.0.smithi073.stdout:5/130: dwrite d0/f15 [0,4194304] 0 2024-04-19T02:18:30.050 INFO:tasks.workunit.client.0.smithi073.stdout:7/91: creat d0/f20 x:0 0 0 2024-04-19T02:18:30.050 INFO:tasks.workunit.client.0.smithi073.stdout:9/113: truncate d0/df/f22 3819645 0 2024-04-19T02:18:30.050 INFO:tasks.workunit.client.0.smithi073.stdout:1/104: unlink c4 0 2024-04-19T02:18:30.050 INFO:tasks.workunit.client.0.smithi073.stdout:6/98: rmdir d8/de 39 2024-04-19T02:18:30.051 INFO:tasks.workunit.client.0.smithi073.stdout:8/87: mkdir d14/d15/d17 0 2024-04-19T02:18:30.052 INFO:tasks.workunit.client.0.smithi073.stdout:4/136: truncate da/f11 1289525 0 2024-04-19T02:18:30.052 INFO:tasks.workunit.client.0.smithi073.stdout:7/92: creat d0/dc/d10/f21 x:0 0 0 2024-04-19T02:18:30.052 INFO:tasks.workunit.client.0.smithi073.stdout:9/114: unlink d0/df/d16/d19/l25 0 2024-04-19T02:18:30.052 INFO:tasks.workunit.client.0.smithi073.stdout:1/105: creat db/f29 x:0 0 0 2024-04-19T02:18:30.052 INFO:tasks.workunit.client.0.smithi073.stdout:8/88: read f6 [2141688,84279] 0 2024-04-19T02:18:30.052 INFO:tasks.workunit.client.0.smithi073.stdout:7/93: dread - d0/dc/d10/f21 zero size 2024-04-19T02:18:30.053 INFO:tasks.workunit.client.0.smithi073.stdout:1/106: fdatasync db/f23 0 2024-04-19T02:18:30.054 INFO:tasks.workunit.client.0.smithi073.stdout:7/94: write d0/dc/d10/d15/f19 [827745,59983] 0 2024-04-19T02:18:30.054 INFO:tasks.workunit.client.0.smithi073.stdout:5/131: rename d0/f19 to d0/d1d/d24/f2e 0 2024-04-19T02:18:30.054 INFO:tasks.workunit.client.0.smithi073.stdout:8/89: creat d14/f18 x:0 0 0 2024-04-19T02:18:30.055 INFO:tasks.workunit.client.0.smithi073.stdout:6/99: mkdir d8/de/d22 0 2024-04-19T02:18:30.055 INFO:tasks.workunit.client.0.smithi073.stdout:5/132: chown d0/d2d 563 1 2024-04-19T02:18:30.056 INFO:tasks.workunit.client.0.smithi073.stdout:7/95: write d0/dc/d10/f21 [777969,72030] 0 2024-04-19T02:18:30.057 INFO:tasks.workunit.client.0.smithi073.stdout:6/100: rename f5 to d8/de/d22/f23 0 2024-04-19T02:18:30.058 INFO:tasks.workunit.client.0.smithi073.stdout:1/107: dread db/fd [0,4194304] 0 2024-04-19T02:18:30.059 INFO:tasks.workunit.client.0.smithi073.stdout:9/115: dread d0/f8 [0,4194304] 0 2024-04-19T02:18:30.060 INFO:tasks.workunit.client.0.smithi073.stdout:3/173: dwrite d3/d6/d11/d24/f39 [0,4194304] 0 2024-04-19T02:18:30.060 INFO:tasks.workunit.client.0.smithi073.stdout:0/76: truncate f2 2534640 0 2024-04-19T02:18:30.061 INFO:tasks.workunit.client.0.smithi073.stdout:6/101: mknod d8/de/d22/c24 0 2024-04-19T02:18:30.062 INFO:tasks.workunit.client.0.smithi073.stdout:4/137: dwrite da/f15 [0,4194304] 0 2024-04-19T02:18:30.062 INFO:tasks.workunit.client.0.smithi073.stdout:1/108: write db/fd [761595,52592] 0 2024-04-19T02:18:30.063 INFO:tasks.workunit.client.0.smithi073.stdout:9/116: chown d0/df/d16/l28 3357742 1 2024-04-19T02:18:30.063 INFO:tasks.workunit.client.0.smithi073.stdout:3/174: chown d3/d6/f9 2 1 2024-04-19T02:18:30.063 INFO:tasks.workunit.client.0.smithi073.stdout:6/102: write d8/f16 [320727,17203] 0 2024-04-19T02:18:30.064 INFO:tasks.workunit.client.0.smithi073.stdout:6/103: sync 2024-04-19T02:18:30.064 INFO:tasks.workunit.client.0.smithi073.stdout:9/117: stat d0/df/d16/f1e 0 2024-04-19T02:18:30.064 INFO:tasks.workunit.client.0.smithi073.stdout:1/109: rmdir db/d1c 39 2024-04-19T02:18:30.066 INFO:tasks.workunit.client.0.smithi073.stdout:3/175: rmdir d3/d6/db/d1a/d2f 39 2024-04-19T02:18:30.066 INFO:tasks.workunit.client.0.smithi073.stdout:6/104: write d8/fb [1839034,10504] 0 2024-04-19T02:18:30.067 INFO:tasks.workunit.client.0.smithi073.stdout:1/110: creat db/f2a x:0 0 0 2024-04-19T02:18:30.068 INFO:tasks.workunit.client.0.smithi073.stdout:5/133: dwrite d0/f13 [0,4194304] 0 2024-04-19T02:18:30.068 INFO:tasks.workunit.client.0.smithi073.stdout:6/105: unlink d8/f14 0 2024-04-19T02:18:30.068 INFO:tasks.workunit.client.0.smithi073.stdout:9/118: write d0/df/d1d/f24 [649907,55375] 0 2024-04-19T02:18:30.068 INFO:tasks.workunit.client.0.smithi073.stdout:3/176: creat d3/f3d x:0 0 0 2024-04-19T02:18:30.068 INFO:tasks.workunit.client.0.smithi073.stdout:6/106: dread - d8/de/f1f zero size 2024-04-19T02:18:30.069 INFO:tasks.workunit.client.0.smithi073.stdout:5/134: creat d0/d1d/d24/f2f x:0 0 0 2024-04-19T02:18:30.069 INFO:tasks.workunit.client.0.smithi073.stdout:7/96: dwrite d0/dc/d10/f21 [0,4194304] 0 2024-04-19T02:18:30.069 INFO:tasks.workunit.client.0.smithi073.stdout:1/111: creat db/d1c/f2b x:0 0 0 2024-04-19T02:18:30.069 INFO:tasks.workunit.client.0.smithi073.stdout:3/177: chown d3/d6/db/d3a 873467 1 2024-04-19T02:18:30.070 INFO:tasks.workunit.client.0.smithi073.stdout:1/112: mkdir db/d1c/d2c 0 2024-04-19T02:18:30.073 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:30.068+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.075 INFO:tasks.workunit.client.0.smithi073.stdout:3/178: creat d3/d6/db/d23/f3e x:0 0 0 2024-04-19T02:18:30.075 INFO:tasks.workunit.client.0.smithi073.stdout:1/113: fdatasync db/f28 0 2024-04-19T02:18:30.077 INFO:tasks.workunit.client.0.smithi073.stdout:9/119: mkdir d0/df/d16/d1a/d2c/d2e 0 2024-04-19T02:18:30.078 INFO:tasks.workunit.client.0.smithi073.stdout:8/90: rmdir d14 39 2024-04-19T02:18:30.079 INFO:tasks.workunit.client.0.smithi073.stdout:9/120: readlink d0/df/d16/l28 0 2024-04-19T02:18:30.080 INFO:tasks.workunit.client.0.smithi073.stdout:0/77: write d7/fd [487550,117191] 0 2024-04-19T02:18:30.080 INFO:tasks.workunit.client.0.smithi073.stdout:4/138: truncate da/f15 1058396 0 2024-04-19T02:18:30.080 INFO:tasks.workunit.client.0.smithi073.stdout:1/114: write db/f23 [1270075,39056] 0 2024-04-19T02:18:30.080 INFO:tasks.workunit.client.0.smithi073.stdout:5/135: write d0/f1b [2068104,82231] 0 2024-04-19T02:18:30.081 INFO:tasks.workunit.client.0.smithi073.stdout:3/179: stat d3/d6/db/d1a/d2f/c34 0 2024-04-19T02:18:30.082 INFO:tasks.workunit.client.0.smithi073.stdout:9/121: write d0/df/d16/d19/f26 [48809,122933] 0 2024-04-19T02:18:30.082 INFO:tasks.workunit.client.0.smithi073.stdout:4/139: dread f8 [0,4194304] 0 2024-04-19T02:18:30.083 INFO:tasks.workunit.client.0.smithi073.stdout:3/180: read - d3/d6/db/d23/f27 zero size 2024-04-19T02:18:30.083 INFO:tasks.workunit.client.0.smithi073.stdout:2/103: dwrite d5/d10/d14/d18/d1e/f12 [0,4194304] 0 2024-04-19T02:18:30.084 INFO:tasks.workunit.client.0.smithi073.stdout:7/97: dread d0/f8 [0,4194304] 0 2024-04-19T02:18:30.084 INFO:tasks.workunit.client.0.smithi073.stdout:8/91: unlink d14/f18 0 2024-04-19T02:18:30.084 INFO:tasks.workunit.client.0.smithi073.stdout:5/136: rename d0/d1d/d24/f2c to d0/d1d/d24/f30 0 2024-04-19T02:18:30.084 INFO:tasks.workunit.client.0.smithi073.stdout:8/92: fsync f11 0 2024-04-19T02:18:30.085 INFO:tasks.workunit.client.0.smithi073.stdout:3/181: write d3/d6/d11/f26 [4070227,6646] 0 2024-04-19T02:18:30.085 INFO:tasks.workunit.client.0.smithi073.stdout:4/140: mkdir da/d23/d2b/d2f 0 2024-04-19T02:18:30.085 INFO:tasks.workunit.client.0.smithi073.stdout:9/122: dread d0/df/d16/f1e [0,4194304] 0 2024-04-19T02:18:30.086 INFO:tasks.workunit.client.0.smithi073.stdout:7/98: symlink d0/dc/l22 0 2024-04-19T02:18:30.086 INFO:tasks.workunit.client.0.smithi073.stdout:5/137: stat d0/d1d/d24/f2f 0 2024-04-19T02:18:30.086 INFO:tasks.workunit.client.0.smithi073.stdout:8/93: write f11 [2045246,127829] 0 2024-04-19T02:18:30.087 INFO:tasks.workunit.client.0.smithi073.stdout:5/138: stat d0/l17 0 2024-04-19T02:18:30.087 INFO:tasks.workunit.client.0.smithi073.stdout:4/141: creat da/d27/d2c/f30 x:0 0 0 2024-04-19T02:18:30.088 INFO:tasks.workunit.client.0.smithi073.stdout:9/123: getdents d0/df/d16/d1a/d2d 0 2024-04-19T02:18:30.088 INFO:tasks.workunit.client.0.smithi073.stdout:4/142: write da/f18 [5114564,125369] 0 2024-04-19T02:18:30.089 INFO:tasks.workunit.client.0.smithi073.stdout:4/143: stat f4 0 2024-04-19T02:18:30.090 INFO:tasks.workunit.client.0.smithi073.stdout:9/124: creat d0/df/d1d/f2f x:0 0 0 2024-04-19T02:18:30.090 INFO:tasks.workunit.client.0.smithi073.stdout:0/78: dwrite f4 [0,4194304] 0 2024-04-19T02:18:30.090 INFO:tasks.workunit.client.0.smithi073.stdout:4/144: read da/d23/f25 [80356,90518] 0 2024-04-19T02:18:30.091 INFO:tasks.workunit.client.0.smithi073.stdout:4/145: symlink da/d23/d2b/l31 0 2024-04-19T02:18:30.091 INFO:tasks.workunit.client.0.smithi073.stdout:3/182: dread f2 [0,4194304] 0 2024-04-19T02:18:30.091 INFO:tasks.workunit.client.0.smithi073.stdout:9/125: rmdir d0/df/d16/d1a/d2d 0 2024-04-19T02:18:30.092 INFO:tasks.workunit.client.0.smithi073.stdout:9/126: creat d0/f30 x:0 0 0 2024-04-19T02:18:30.092 INFO:tasks.workunit.client.0.smithi073.stdout:3/183: link d3/d6/d11/f35 d3/f3f 0 2024-04-19T02:18:30.092 INFO:tasks.workunit.client.0.smithi073.stdout:9/127: creat d0/df/d16/d1a/f31 x:0 0 0 2024-04-19T02:18:30.093 INFO:tasks.workunit.client.0.smithi073.stdout:5/139: read d0/d1d/d25/f26 [622068,107665] 0 2024-04-19T02:18:30.094 INFO:tasks.workunit.client.0.smithi073.stdout:6/107: write d8/de/d22/f23 [6344024,70927] 0 2024-04-19T02:18:30.094 INFO:tasks.workunit.client.0.smithi073.stdout:3/184: mkdir d3/d6/db/d3a/d38/d40 0 2024-04-19T02:18:30.094 INFO:tasks.workunit.client.0.smithi073.stdout:6/108: sync 2024-04-19T02:18:30.095 INFO:tasks.workunit.client.0.smithi073.stdout:5/140: write d0/ff [381399,115115] 0 2024-04-19T02:18:30.095 INFO:tasks.workunit.client.0.smithi073.stdout:9/128: rename d0/df/d1d/f24 to d0/df/d1d/f32 0 2024-04-19T02:18:30.095 INFO:tasks.workunit.client.0.smithi073.stdout:0/79: dread f4 [0,4194304] 0 2024-04-19T02:18:30.095 INFO:tasks.workunit.client.0.smithi073.stdout:0/80: dread - d7/f11 zero size 2024-04-19T02:18:30.096 INFO:tasks.workunit.client.0.smithi073.stdout:9/129: chown d0/c1c 0 1 2024-04-19T02:18:30.096 INFO:tasks.workunit.client.0.smithi073.stdout:1/115: truncate f9 289238 0 2024-04-19T02:18:30.097 INFO:tasks.workunit.client.0.smithi073.stdout:3/185: creat d3/f41 x:0 0 0 2024-04-19T02:18:30.097 INFO:tasks.workunit.client.0.smithi073.stdout:6/109: dread d8/f11 [0,4194304] 0 2024-04-19T02:18:30.098 INFO:tasks.workunit.client.0.smithi073.stdout:8/94: write fe [2488855,68028] 0 2024-04-19T02:18:30.098 INFO:tasks.workunit.client.0.smithi073.stdout:7/99: dread d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.098 INFO:tasks.workunit.client.0.smithi073.stdout:0/81: chown f2 92572 1 2024-04-19T02:18:30.098 INFO:tasks.workunit.client.0.smithi073.stdout:1/116: stat db/d1c/l26 0 2024-04-19T02:18:30.099 INFO:tasks.workunit.client.0.smithi073.stdout:0/82: readlink d7/lb 0 2024-04-19T02:18:30.100 INFO:tasks.workunit.client.0.smithi073.stdout:6/110: mknod d8/de/c25 0 2024-04-19T02:18:30.100 INFO:tasks.workunit.client.0.smithi073.stdout:1/117: read db/f25 [1549784,12889] 0 2024-04-19T02:18:30.100 INFO:tasks.workunit.client.0.smithi073.stdout:7/100: chown d0/dc/d10/c11 3713908 1 2024-04-19T02:18:30.101 INFO:tasks.workunit.client.0.smithi073.stdout:0/83: write f4 [3789940,111339] 0 2024-04-19T02:18:30.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/130: rename d0/df/f22 to d0/df/d1d/f33 0 2024-04-19T02:18:30.101 INFO:tasks.workunit.client.0.smithi073.stdout:4/146: dwrite da/d23/f25 [0,4194304] 0 2024-04-19T02:18:30.101 INFO:tasks.workunit.client.0.smithi073.stdout:1/118: mkdir db/d2d 0 2024-04-19T02:18:30.102 INFO:tasks.workunit.client.0.smithi073.stdout:6/111: write d8/f16 [1250012,107368] 0 2024-04-19T02:18:30.102 INFO:tasks.workunit.client.0.smithi073.stdout:3/186: rename d3/d6/l1b to d3/d6/db/d3a/l42 0 2024-04-19T02:18:30.102 INFO:tasks.workunit.client.0.smithi073.stdout:0/84: read - d7/d14/f15 zero size 2024-04-19T02:18:30.102 INFO:tasks.workunit.client.0.smithi073.stdout:7/101: chown d0/dc/d10/c11 23 1 2024-04-19T02:18:30.103 INFO:tasks.workunit.client.0.smithi073.stdout:9/131: symlink d0/df/l34 0 2024-04-19T02:18:30.103 INFO:tasks.workunit.client.0.smithi073.stdout:0/85: sync 2024-04-19T02:18:30.103 INFO:tasks.workunit.client.0.smithi073.stdout:1/119: readlink db/l19 0 2024-04-19T02:18:30.104 INFO:tasks.workunit.client.0.smithi073.stdout:4/147: creat da/d23/d2b/f32 x:0 0 0 2024-04-19T02:18:30.104 INFO:tasks.workunit.client.0.smithi073.stdout:0/86: truncate f5 817717 0 2024-04-19T02:18:30.104 INFO:tasks.workunit.client.0.smithi073.stdout:5/141: dwrite d0/f9 [0,4194304] 0 2024-04-19T02:18:30.105 INFO:tasks.workunit.client.0.smithi073.stdout:9/132: dread - d0/df/d16/d1a/f31 zero size 2024-04-19T02:18:30.105 INFO:tasks.workunit.client.0.smithi073.stdout:7/102: write d0/f20 [757926,99221] 0 2024-04-19T02:18:30.105 INFO:tasks.workunit.client.0.smithi073.stdout:3/187: mkdir d3/d6/db/d3a/d38/d43 0 2024-04-19T02:18:30.105 INFO:tasks.workunit.client.0.smithi073.stdout:4/148: mknod da/d23/c33 0 2024-04-19T02:18:30.106 INFO:tasks.workunit.client.0.smithi073.stdout:0/87: chown d7/ce 59932 1 2024-04-19T02:18:30.106 INFO:tasks.workunit.client.0.smithi073.stdout:5/142: chown d0/d1d/c1f 501081 1 2024-04-19T02:18:30.107 INFO:tasks.workunit.client.0.smithi073.stdout:1/120: rmdir db/d2d 0 2024-04-19T02:18:30.107 INFO:tasks.workunit.client.0.smithi073.stdout:8/95: dread f12 [0,4194304] 0 2024-04-19T02:18:30.107 INFO:tasks.workunit.client.0.smithi073.stdout:9/133: mkdir d0/d35 0 2024-04-19T02:18:30.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/112: getdents d8 0 2024-04-19T02:18:30.107 INFO:tasks.workunit.client.0.smithi073.stdout:7/103: symlink d0/dc/l23 0 2024-04-19T02:18:30.108 INFO:tasks.workunit.client.0.smithi073.stdout:4/149: fsync da/f11 0 2024-04-19T02:18:30.108 INFO:tasks.workunit.client.0.smithi073.stdout:1/121: mknod db/d1c/d2c/c2e 0 2024-04-19T02:18:30.108 INFO:tasks.workunit.client.0.smithi073.stdout:0/88: write d7/d14/f16 [88045,128163] 0 2024-04-19T02:18:30.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/188: symlink d3/d6/db/d3a/d38/d43/l44 0 2024-04-19T02:18:30.108 INFO:tasks.workunit.client.0.smithi073.stdout:8/96: link f0 d14/f19 0 2024-04-19T02:18:30.109 INFO:tasks.workunit.client.0.smithi073.stdout:9/134: symlink d0/df/d1d/l36 0 2024-04-19T02:18:30.109 INFO:tasks.workunit.client.0.smithi073.stdout:9/135: sync 2024-04-19T02:18:30.109 INFO:tasks.workunit.client.0.smithi073.stdout:0/89: read f4 [151125,82016] 0 2024-04-19T02:18:30.109 INFO:tasks.workunit.client.0.smithi073.stdout:8/97: chown d14/f16 358335 1 2024-04-19T02:18:30.109 INFO:tasks.workunit.client.0.smithi073.stdout:6/113: mknod d8/de/d22/c26 0 2024-04-19T02:18:30.109 INFO:tasks.workunit.client.0.smithi073.stdout:3/189: write d3/d6/db/f37 [695619,112533] 0 2024-04-19T02:18:30.109 INFO:tasks.workunit.client.0.smithi073.stdout:0/90: fdatasync d7/d14/f15 0 2024-04-19T02:18:30.110 INFO:tasks.workunit.client.0.smithi073.stdout:7/104: getdents d0/d3 0 2024-04-19T02:18:30.110 INFO:tasks.workunit.client.0.smithi073.stdout:8/98: mknod d14/c1a 0 2024-04-19T02:18:30.111 INFO:tasks.workunit.client.0.smithi073.stdout:9/136: creat d0/df/d16/d1a/f37 x:0 0 0 2024-04-19T02:18:30.111 INFO:tasks.workunit.client.0.smithi073.stdout:3/190: dread - d3/f41 zero size 2024-04-19T02:18:30.111 INFO:tasks.workunit.client.0.smithi073.stdout:6/114: write d8/f1a [923070,33574] 0 2024-04-19T02:18:30.111 INFO:tasks.workunit.client.0.smithi073.stdout:3/191: sync 2024-04-19T02:18:30.112 INFO:tasks.workunit.client.0.smithi073.stdout:6/115: readlink d8/l1d 0 2024-04-19T02:18:30.112 INFO:tasks.workunit.client.0.smithi073.stdout:8/99: getdents d14/d15/d17 0 2024-04-19T02:18:30.112 INFO:tasks.workunit.client.0.smithi073.stdout:9/137: mkdir d0/df/d16/d19/d38 0 2024-04-19T02:18:30.112 INFO:tasks.workunit.client.0.smithi073.stdout:3/192: dread - d3/d6/db/d23/f27 zero size 2024-04-19T02:18:30.113 INFO:tasks.workunit.client.0.smithi073.stdout:9/138: fdatasync d0/df/f11 0 2024-04-19T02:18:30.113 INFO:tasks.workunit.client.0.smithi073.stdout:8/100: mkdir d14/d15/d1b 0 2024-04-19T02:18:30.113 INFO:tasks.workunit.client.0.smithi073.stdout:9/139: stat d0/l3 0 2024-04-19T02:18:30.113 INFO:tasks.workunit.client.0.smithi073.stdout:3/193: creat d3/d6/db/f45 x:0 0 0 2024-04-19T02:18:30.115 INFO:tasks.workunit.client.0.smithi073.stdout:2/104: fdatasync d5/d10/d14/d18/d1e/f12 0 2024-04-19T02:18:30.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/140: mknod d0/df/d16/d19/d38/c39 0 2024-04-19T02:18:30.116 INFO:tasks.workunit.client.0.smithi073.stdout:5/143: read d0/d1d/d24/f30 [43036,6720] 0 2024-04-19T02:18:30.117 INFO:tasks.workunit.client.0.smithi073.stdout:4/150: dwrite f4 [0,4194304] 0 2024-04-19T02:18:30.117 INFO:tasks.workunit.client.0.smithi073.stdout:3/194: mknod d3/d6/db/d16/c46 0 2024-04-19T02:18:30.118 INFO:tasks.workunit.client.0.smithi073.stdout:2/105: write f3 [1518143,18972] 0 2024-04-19T02:18:30.120 INFO:tasks.workunit.client.0.smithi073.stdout:9/141: creat d0/df/d16/d1a/f3a x:0 0 0 2024-04-19T02:18:30.120 INFO:tasks.workunit.client.0.smithi073.stdout:4/151: chown da/d27/d1b/d26/d2a 27 1 2024-04-19T02:18:30.120 INFO:tasks.workunit.client.0.smithi073.stdout:3/195: truncate d3/f3d 804130 0 2024-04-19T02:18:30.122 INFO:tasks.workunit.client.0.smithi073.stdout:7/105: dwrite d0/f20 [0,4194304] 0 2024-04-19T02:18:30.122 INFO:tasks.workunit.client.0.smithi073.stdout:1/122: truncate db/f25 175344 0 2024-04-19T02:18:30.122 INFO:tasks.workunit.client.0.smithi073.stdout:2/106: symlink d5/d10/d14/l28 0 2024-04-19T02:18:30.123 INFO:tasks.workunit.client.0.smithi073.stdout:4/152: truncate f4 4940926 0 2024-04-19T02:18:30.123 INFO:tasks.workunit.client.0.smithi073.stdout:3/196: dread - d3/d6/db/d23/f27 zero size 2024-04-19T02:18:30.124 INFO:tasks.workunit.client.0.smithi073.stdout:2/107: chown d5/c9 42 1 2024-04-19T02:18:30.124 INFO:tasks.workunit.client.0.smithi073.stdout:6/116: dwrite d8/de/ff [0,4194304] 0 2024-04-19T02:18:30.124 INFO:tasks.workunit.client.0.smithi073.stdout:9/142: creat d0/df/d16/d1a/f3b x:0 0 0 2024-04-19T02:18:30.124 INFO:tasks.workunit.client.0.smithi073.stdout:0/91: truncate d7/fd 90855 0 2024-04-19T02:18:30.124 INFO:tasks.workunit.client.0.smithi073.stdout:9/143: sync 2024-04-19T02:18:30.125 INFO:tasks.workunit.client.0.smithi073.stdout:8/101: dwrite f6 [0,4194304] 0 2024-04-19T02:18:30.125 INFO:tasks.workunit.client.0.smithi073.stdout:2/108: chown d5 375760 1 2024-04-19T02:18:30.125 INFO:tasks.workunit.client.0.smithi073.stdout:2/109: sync 2024-04-19T02:18:30.126 INFO:tasks.workunit.client.0.smithi073.stdout:1/123: creat db/f2f x:0 0 0 2024-04-19T02:18:30.126 INFO:tasks.workunit.client.0.smithi073.stdout:0/92: write d7/f11 [824412,53305] 0 2024-04-19T02:18:30.126 INFO:tasks.workunit.client.0.smithi073.stdout:7/106: write d0/dc/f1f [698619,35147] 0 2024-04-19T02:18:30.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/144: write d0/df/d16/d1a/f31 [879247,84866] 0 2024-04-19T02:18:30.127 INFO:tasks.workunit.client.0.smithi073.stdout:3/197: creat d3/f47 x:0 0 0 2024-04-19T02:18:30.127 INFO:tasks.workunit.client.0.smithi073.stdout:2/110: chown f3 25 1 2024-04-19T02:18:30.127 INFO:tasks.workunit.client.0.smithi073.stdout:8/102: mknod d14/d15/c1c 0 2024-04-19T02:18:30.127 INFO:tasks.workunit.client.0.smithi073.stdout:1/124: truncate f6 301572 0 2024-04-19T02:18:30.128 INFO:tasks.workunit.client.0.smithi073.stdout:4/153: getdents da 0 2024-04-19T02:18:30.128 INFO:tasks.workunit.client.0.smithi073.stdout:7/107: rename d0/d3/l9 to d0/d3/l24 0 2024-04-19T02:18:30.128 INFO:tasks.workunit.client.0.smithi073.stdout:3/198: mknod d3/d6/d11/d24/c48 0 2024-04-19T02:18:30.128 INFO:tasks.workunit.client.0.smithi073.stdout:6/117: link d8/de/d22/c26 d8/de/d22/c27 0 2024-04-19T02:18:30.129 INFO:tasks.workunit.client.0.smithi073.stdout:6/118: stat d8/f1a 0 2024-04-19T02:18:30.129 INFO:tasks.workunit.client.0.smithi073.stdout:2/111: truncate d5/d10/d14/d18/d1e/f12 4593840 0 2024-04-19T02:18:30.129 INFO:tasks.workunit.client.0.smithi073.stdout:4/154: creat da/d27/d1b/f34 x:0 0 0 2024-04-19T02:18:30.130 INFO:tasks.workunit.client.0.smithi073.stdout:1/125: link db/f12 db/f30 0 2024-04-19T02:18:30.131 INFO:tasks.workunit.client.0.smithi073.stdout:7/108: rename d0/c5 to d0/c25 0 2024-04-19T02:18:30.131 INFO:tasks.workunit.client.0.smithi073.stdout:6/119: write d8/de/f1e [3796818,123169] 0 2024-04-19T02:18:30.131 INFO:tasks.workunit.client.0.smithi073.stdout:2/112: unlink d5/d10/d15/d1f/f20 0 2024-04-19T02:18:30.132 INFO:tasks.workunit.client.0.smithi073.stdout:1/126: symlink db/d1c/l31 0 2024-04-19T02:18:30.132 INFO:tasks.workunit.client.0.smithi073.stdout:4/155: unlink da/d23/l28 0 2024-04-19T02:18:30.132 INFO:tasks.workunit.client.0.smithi073.stdout:2/113: mkdir d5/d10/d29 0 2024-04-19T02:18:30.133 INFO:tasks.workunit.client.0.smithi073.stdout:2/114: mknod d5/c2a 0 2024-04-19T02:18:30.134 INFO:tasks.workunit.client.0.smithi073.stdout:8/103: dread d14/f19 [0,4194304] 0 2024-04-19T02:18:30.134 INFO:tasks.workunit.client.0.smithi073.stdout:4/156: rename da/l12 to da/d27/d1b/l35 0 2024-04-19T02:18:30.136 INFO:tasks.workunit.client.0.smithi073.stdout:9/145: dwrite d0/f1f [0,4194304] 0 2024-04-19T02:18:30.136 INFO:tasks.workunit.client.0.smithi073.stdout:8/104: write f6 [4562023,82115] 0 2024-04-19T02:18:30.136 INFO:tasks.workunit.client.0.smithi073.stdout:8/105: chown f11 921402255 1 2024-04-19T02:18:30.139 INFO:tasks.workunit.client.0.smithi073.stdout:8/106: write fe [1010007,97874] 0 2024-04-19T02:18:30.139 INFO:tasks.workunit.client.0.smithi073.stdout:5/144: truncate d0/d1d/d25/f26 932705 0 2024-04-19T02:18:30.139 INFO:tasks.workunit.client.0.smithi073.stdout:0/93: fsync f2 0 2024-04-19T02:18:30.139 INFO:tasks.workunit.client.0.smithi073.stdout:1/127: dread db/f13 [0,4194304] 0 2024-04-19T02:18:30.139 INFO:tasks.workunit.client.0.smithi073.stdout:5/145: mknod d0/c31 0 2024-04-19T02:18:30.140 INFO:tasks.workunit.client.0.smithi073.stdout:7/109: dwrite d0/f1d [0,4194304] 0 2024-04-19T02:18:30.140 INFO:tasks.workunit.client.0.smithi073.stdout:6/120: dread d8/fb [0,4194304] 0 2024-04-19T02:18:30.143 INFO:tasks.workunit.client.0.smithi073.stdout:6/121: creat d8/de/f28 x:0 0 0 2024-04-19T02:18:30.144 INFO:tasks.workunit.client.0.smithi073.stdout:7/110: creat d0/dc/f26 x:0 0 0 2024-04-19T02:18:30.144 INFO:tasks.workunit.client.0.smithi073.stdout:2/115: dwrite f3 [0,4194304] 0 2024-04-19T02:18:30.149 INFO:tasks.workunit.client.0.smithi073.stdout:3/199: truncate d3/d6/d11/f2e 1649522 0 2024-04-19T02:18:30.150 INFO:tasks.workunit.client.0.smithi073.stdout:8/107: dwrite d14/f16 [0,4194304] 0 2024-04-19T02:18:30.150 INFO:tasks.workunit.client.0.smithi073.stdout:9/146: dwrite d0/df/d16/d1a/f31 [0,4194304] 0 2024-04-19T02:18:30.151 INFO:tasks.workunit.client.0.smithi073.stdout:8/108: mknod d14/d15/c1d 0 2024-04-19T02:18:30.152 INFO:tasks.workunit.client.0.smithi073.stdout:9/147: rmdir d0/df/d16 39 2024-04-19T02:18:30.152 INFO:tasks.workunit.client.0.smithi073.stdout:8/109: stat cd 0 2024-04-19T02:18:30.152 INFO:tasks.workunit.client.0.smithi073.stdout:1/128: dwrite db/f18 [0,4194304] 0 2024-04-19T02:18:30.153 INFO:tasks.workunit.client.0.smithi073.stdout:3/200: getdents d3/d6/db/d23 0 2024-04-19T02:18:30.153 INFO:tasks.workunit.client.0.smithi073.stdout:8/110: chown f12 1032875521 1 2024-04-19T02:18:30.153 INFO:tasks.workunit.client.0.smithi073.stdout:1/129: mknod db/d1c/c32 0 2024-04-19T02:18:30.154 INFO:tasks.workunit.client.0.smithi073.stdout:3/201: dread - d3/d6/f1e zero size 2024-04-19T02:18:30.154 INFO:tasks.workunit.client.0.smithi073.stdout:8/111: creat d14/d15/f1e x:0 0 0 2024-04-19T02:18:30.154 INFO:tasks.workunit.client.0.smithi073.stdout:9/148: mkdir d0/df/d16/d1a/d3c 0 2024-04-19T02:18:30.155 INFO:tasks.workunit.client.0.smithi073.stdout:8/112: unlink l13 0 2024-04-19T02:18:30.155 INFO:tasks.workunit.client.0.smithi073.stdout:6/122: dwrite d8/de/f28 [0,4194304] 0 2024-04-19T02:18:30.156 INFO:tasks.workunit.client.0.smithi073.stdout:9/149: unlink d0/df/d1d/l36 0 2024-04-19T02:18:30.156 INFO:tasks.workunit.client.0.smithi073.stdout:8/113: write f0 [2732683,75875] 0 2024-04-19T02:18:30.156 INFO:tasks.workunit.client.0.smithi073.stdout:6/123: write d8/de/f12 [69953,2327] 0 2024-04-19T02:18:30.157 INFO:tasks.workunit.client.0.smithi073.stdout:9/150: write d0/df/f21 [80916,64694] 0 2024-04-19T02:18:30.158 INFO:tasks.workunit.client.0.smithi073.stdout:3/202: getdents d3/d6/d11/d24 0 2024-04-19T02:18:30.158 INFO:tasks.workunit.client.0.smithi073.stdout:3/203: sync 2024-04-19T02:18:30.158 INFO:tasks.workunit.client.0.smithi073.stdout:6/124: rename d8/f1a to d8/f29 0 2024-04-19T02:18:30.158 INFO:tasks.workunit.client.0.smithi073.stdout:9/151: truncate d0/df/f11 9363050 0 2024-04-19T02:18:30.160 INFO:tasks.workunit.client.0.smithi073.stdout:3/204: link d3/d6/f9 d3/f49 0 2024-04-19T02:18:30.161 INFO:tasks.workunit.client.0.smithi073.stdout:9/152: truncate d0/df/f10 796848 0 2024-04-19T02:18:30.161 INFO:tasks.workunit.client.0.smithi073.stdout:3/205: getdents d3/d6/d11/d24 0 2024-04-19T02:18:30.161 INFO:tasks.workunit.client.0.smithi073.stdout:9/153: creat d0/df/d16/d19/f3d x:0 0 0 2024-04-19T02:18:30.161 INFO:tasks.workunit.client.0.smithi073.stdout:3/206: dread - d3/d6/db/d1a/f2b zero size 2024-04-19T02:18:30.162 INFO:tasks.workunit.client.0.smithi073.stdout:9/154: truncate d0/fa 1539766 0 2024-04-19T02:18:30.162 INFO:tasks.workunit.client.0.smithi073.stdout:8/114: dread d14/f19 [0,4194304] 0 2024-04-19T02:18:30.162 INFO:tasks.workunit.client.0.smithi073.stdout:3/207: symlink d3/d6/db/d3a/d38/d43/l4a 0 2024-04-19T02:18:30.162 INFO:tasks.workunit.client.0.smithi073.stdout:8/115: dread - d14/d15/f1e zero size 2024-04-19T02:18:30.162 INFO:tasks.workunit.client.0.smithi073.stdout:9/155: symlink d0/df/d16/d19/d38/l3e 0 2024-04-19T02:18:30.162 INFO:tasks.workunit.client.0.smithi073.stdout:8/116: write f0 [2350927,111201] 0 2024-04-19T02:18:30.163 INFO:tasks.workunit.client.0.smithi073.stdout:3/208: link d3/d6/db/l36 d3/d6/db/d3a/d38/d40/l4b 0 2024-04-19T02:18:30.163 INFO:tasks.workunit.client.0.smithi073.stdout:8/117: creat d14/d15/d17/f1f x:0 0 0 2024-04-19T02:18:30.164 INFO:tasks.workunit.client.0.smithi073.stdout:8/118: rmdir d14/d15/d1b 0 2024-04-19T02:18:30.165 INFO:tasks.workunit.client.0.smithi073.stdout:3/209: rename d3/d6/db/f37 to d3/d6/db/d1a/f4c 0 2024-04-19T02:18:30.166 INFO:tasks.workunit.client.0.smithi073.stdout:3/210: chown d3/f49 1105896 1 2024-04-19T02:18:30.167 INFO:tasks.workunit.client.0.smithi073.stdout:3/211: write d3/d6/d11/d24/f39 [2092177,9648] 0 2024-04-19T02:18:30.168 INFO:tasks.workunit.client.0.smithi073.stdout:3/212: creat d3/d6/db/f4d x:0 0 0 2024-04-19T02:18:30.169 INFO:tasks.workunit.client.0.smithi073.stdout:9/156: dwrite d0/fa [0,4194304] 0 2024-04-19T02:18:30.170 INFO:tasks.workunit.client.0.smithi073.stdout:3/213: truncate d3/d6/db/d1a/d2f/f30 4538248 0 2024-04-19T02:18:30.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/119: dwrite f6 [0,4194304] 0 2024-04-19T02:18:30.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/214: write d3/d6/f9 [2305013,56846] 0 2024-04-19T02:18:30.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/120: chown f0 378423 1 2024-04-19T02:18:30.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/215: sync 2024-04-19T02:18:30.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/121: write fe [3146780,102119] 0 2024-04-19T02:18:30.173 INFO:tasks.workunit.client.0.smithi073.stdout:9/157: dread d0/df/d16/d1a/f31 [0,4194304] 0 2024-04-19T02:18:30.174 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:30.168+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.174 INFO:tasks.workunit.client.0.smithi073.stdout:8/122: rename l7 to d14/d15/d17/l20 0 2024-04-19T02:18:30.174 INFO:tasks.workunit.client.0.smithi073.stdout:4/157: mkdir da/d27/d36 0 2024-04-19T02:18:30.175 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:30.175 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:30.175 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:30.175 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:30.175 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:30.175 INFO:tasks.workunit.client.0.smithi073.stdout:9/158: truncate d0/df/d1d/f33 302923 0 2024-04-19T02:18:30.176 INFO:tasks.workunit.client.0.smithi073.stdout:4/158: getdents da 0 2024-04-19T02:18:30.177 INFO:tasks.workunit.client.0.smithi073.stdout:4/159: write da/d27/d2c/f30 [237404,120603] 0 2024-04-19T02:18:30.177 INFO:tasks.workunit.client.0.smithi073.stdout:9/159: write d0/df/d16/d1a/f3a [897560,39356] 0 2024-04-19T02:18:30.177 INFO:tasks.workunit.client.0.smithi073.stdout:3/216: dread d3/d6/fd [0,4194304] 0 2024-04-19T02:18:30.178 INFO:tasks.workunit.client.0.smithi073.stdout:0/94: dwrite d7/fd [0,4194304] 0 2024-04-19T02:18:30.179 INFO:tasks.workunit.client.0.smithi073.stdout:3/217: rename d3/d6/d11/d24 to d3/d6/db/d3a/d38/d43/d4e 0 2024-04-19T02:18:30.179 INFO:tasks.workunit.client.0.smithi073.stdout:0/95: creat d7/d14/f18 x:0 0 0 2024-04-19T02:18:30.179 INFO:tasks.workunit.client.0.smithi073.stdout:3/218: sync 2024-04-19T02:18:30.180 INFO:tasks.workunit.client.0.smithi073.stdout:0/96: mknod d7/d14/c19 0 2024-04-19T02:18:30.180 INFO:tasks.workunit.client.0.smithi073.stdout:3/219: symlink d3/d6/db/d3a/d38/d43/l4f 0 2024-04-19T02:18:30.181 INFO:tasks.workunit.client.0.smithi073.stdout:0/97: mkdir d7/d14/d17/d1a 0 2024-04-19T02:18:30.184 INFO:tasks.workunit.client.0.smithi073.stdout:7/111: dread d0/dc/d10/d15/f17 [0,4194304] 0 2024-04-19T02:18:30.187 INFO:tasks.workunit.client.0.smithi073.stdout:9/160: dwrite d0/f1f [0,4194304] 0 2024-04-19T02:18:30.188 INFO:tasks.workunit.client.0.smithi073.stdout:7/112: mknod d0/dc/d10/d15/c27 0 2024-04-19T02:18:30.188 INFO:tasks.workunit.client.0.smithi073.stdout:4/160: dwrite da/d27/d1b/d1d/f29 [0,4194304] 0 2024-04-19T02:18:30.190 INFO:tasks.workunit.client.0.smithi073.stdout:7/113: mkdir d0/d28 0 2024-04-19T02:18:30.190 INFO:tasks.workunit.client.0.smithi073.stdout:4/161: creat da/d27/d1b/d1d/f37 x:0 0 0 2024-04-19T02:18:30.190 INFO:tasks.workunit.client.0.smithi073.stdout:9/161: write d0/df/d16/d19/f26 [543405,121876] 0 2024-04-19T02:18:30.190 INFO:tasks.workunit.client.0.smithi073.stdout:7/114: stat d0/le 0 2024-04-19T02:18:30.191 INFO:tasks.workunit.client.0.smithi073.stdout:0/98: dwrite f2 [0,4194304] 0 2024-04-19T02:18:30.191 INFO:tasks.workunit.client.0.smithi073.stdout:7/115: write d0/dc/f1f [1184548,24238] 0 2024-04-19T02:18:30.191 INFO:tasks.workunit.client.0.smithi073.stdout:4/162: symlink da/d27/d1b/d26/d2a/l38 0 2024-04-19T02:18:30.192 INFO:tasks.workunit.client.0.smithi073.stdout:4/163: stat da/d27/d1b/d26/d2a 0 2024-04-19T02:18:30.196 INFO:tasks.workunit.client.0.smithi073.stdout:9/162: dwrite d0/df/d1d/f2f [0,4194304] 0 2024-04-19T02:18:30.200 INFO:tasks.workunit.client.0.smithi073.stdout:4/164: rename da/d23/f25 to da/d27/f39 0 2024-04-19T02:18:30.200 INFO:tasks.workunit.client.0.smithi073.stdout:5/146: truncate d0/d1d/d25/f27 1958821 0 2024-04-19T02:18:30.201 INFO:tasks.workunit.client.0.smithi073.stdout:9/163: creat d0/df/d16/d19/d38/f3f x:0 0 0 2024-04-19T02:18:30.202 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:7/116: truncate d0/dc/d10/d15/f17 340340 0 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:5/147: fdatasync d0/f16 0 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:4/165: mkdir da/d27/d3a 0 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:9/164: rmdir d0/df 39 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:5/148: chown d0/d1d/c1f 2002925 1 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:5/149: mknod d0/c32 0 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:9/165: rename d0/f12 to d0/df/f40 0 2024-04-19T02:18:30.203 INFO:tasks.workunit.client.0.smithi073.stdout:5/150: creat d0/d1d/d1e/f33 x:0 0 0 2024-04-19T02:18:30.207 INFO:tasks.workunit.client.0.smithi073.stdout:5/151: dwrite d0/f16 [0,4194304] 0 2024-04-19T02:18:30.208 INFO:tasks.workunit.client.0.smithi073.stdout:2/116: truncate d5/f11 1686670 0 2024-04-19T02:18:30.208 INFO:tasks.workunit.client.0.smithi073.stdout:5/152: dread - d0/d1d/d1e/f2b zero size 2024-04-19T02:18:30.209 INFO:tasks.workunit.client.0.smithi073.stdout:3/220: fsync d3/f49 0 2024-04-19T02:18:30.209 INFO:tasks.workunit.client.0.smithi073.stdout:5/153: chown d0/cb 4277598 1 2024-04-19T02:18:30.211 INFO:tasks.workunit.client.0.smithi073.stdout:3/221: write d3/f3d [1471635,26792] 0 2024-04-19T02:18:30.211 INFO:tasks.workunit.client.0.smithi073.stdout:5/154: write d0/d1d/d1e/f2b [504800,61359] 0 2024-04-19T02:18:30.214 INFO:tasks.workunit.client.0.smithi073.stdout:5/155: symlink d0/d1d/l34 0 2024-04-19T02:18:30.215 INFO:tasks.workunit.client.0.smithi073.stdout:8/123: readlink d14/d15/d17/l20 0 2024-04-19T02:18:30.215 INFO:tasks.workunit.client.0.smithi073.stdout:1/130: dwrite f9 [0,4194304] 0 2024-04-19T02:18:30.215 INFO:tasks.workunit.client.0.smithi073.stdout:9/166: dread d0/df/d1d/f32 [0,4194304] 0 2024-04-19T02:18:30.216 INFO:tasks.workunit.client.0.smithi073.stdout:6/125: dwrite f3 [0,4194304] 0 2024-04-19T02:18:30.216 INFO:tasks.workunit.client.0.smithi073.stdout:0/99: getdents d7/d14/d17 0 2024-04-19T02:18:30.218 INFO:tasks.workunit.client.0.smithi073.stdout:0/100: write d7/d14/f15 [242289,76715] 0 2024-04-19T02:18:30.218 INFO:tasks.workunit.client.0.smithi073.stdout:1/131: symlink db/d1c/d2c/l33 0 2024-04-19T02:18:30.218 INFO:tasks.workunit.client.0.smithi073.stdout:6/126: creat d8/de/f2a x:0 0 0 2024-04-19T02:18:30.218 INFO:tasks.workunit.client.0.smithi073.stdout:2/117: dwrite d5/f16 [0,4194304] 0 2024-04-19T02:18:30.219 INFO:tasks.workunit.client.0.smithi073.stdout:2/118: fdatasync f3 0 2024-04-19T02:18:30.220 INFO:tasks.workunit.client.0.smithi073.stdout:1/132: rename db/d1c/f24 to db/d1c/f34 0 2024-04-19T02:18:30.222 INFO:tasks.workunit.client.0.smithi073.stdout:1/133: readlink db/l10 0 2024-04-19T02:18:30.222 INFO:tasks.workunit.client.0.smithi073.stdout:2/119: mknod d5/c2b 0 2024-04-19T02:18:30.222 INFO:tasks.workunit.client.0.smithi073.stdout:0/101: creat d7/d14/f1b x:0 0 0 2024-04-19T02:18:30.222 INFO:tasks.workunit.client.0.smithi073.stdout:6/127: link d8/de/c17 d8/de/c2b 0 2024-04-19T02:18:30.222 INFO:tasks.workunit.client.0.smithi073.stdout:0/102: chown l1 882109 1 2024-04-19T02:18:30.223 INFO:tasks.workunit.client.0.smithi073.stdout:8/124: dread f6 [0,4194304] 0 2024-04-19T02:18:30.223 INFO:tasks.workunit.client.0.smithi073.stdout:6/128: symlink d8/de/d22/l2c 0 2024-04-19T02:18:30.223 INFO:tasks.workunit.client.0.smithi073.stdout:0/103: creat d7/f1c x:0 0 0 2024-04-19T02:18:30.224 INFO:tasks.workunit.client.0.smithi073.stdout:0/104: readlink d7/lb 0 2024-04-19T02:18:30.225 INFO:tasks.workunit.client.0.smithi073.stdout:6/129: symlink d8/de/d22/l2d 0 2024-04-19T02:18:30.225 INFO:tasks.workunit.client.0.smithi073.stdout:2/120: creat d5/d10/d14/f2c x:0 0 0 2024-04-19T02:18:30.225 INFO:tasks.workunit.client.0.smithi073.stdout:0/105: chown d7/ce 17781239 1 2024-04-19T02:18:30.226 INFO:tasks.workunit.client.0.smithi073.stdout:5/156: dwrite d0/d1d/f20 [4194304,4194304] 0 2024-04-19T02:18:30.226 INFO:tasks.workunit.client.0.smithi073.stdout:6/130: write d8/f10 [5229855,101312] 0 2024-04-19T02:18:30.227 INFO:tasks.workunit.client.0.smithi073.stdout:6/131: creat d8/f2e x:0 0 0 2024-04-19T02:18:30.227 INFO:tasks.workunit.client.0.smithi073.stdout:6/132: mknod d8/de/d22/c2f 0 2024-04-19T02:18:30.228 INFO:tasks.workunit.client.0.smithi073.stdout:6/133: mkdir d8/d30 0 2024-04-19T02:18:30.229 INFO:tasks.workunit.client.0.smithi073.stdout:4/166: sync 2024-04-19T02:18:30.231 INFO:tasks.workunit.client.0.smithi073.stdout:9/167: dread d0/df/d16/d1a/f3a [0,4194304] 0 2024-04-19T02:18:30.231 INFO:tasks.workunit.client.0.smithi073.stdout:3/222: dread d3/f3d [0,4194304] 0 2024-04-19T02:18:30.231 INFO:tasks.workunit.client.0.smithi073.stdout:4/167: write da/d23/d2b/f2d [864789,99943] 0 2024-04-19T02:18:30.233 INFO:tasks.workunit.client.0.smithi073.stdout:9/168: write d0/df/f21 [519991,59492] 0 2024-04-19T02:18:30.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/121: dwrite d5/d10/d14/f2c [0,4194304] 0 2024-04-19T02:18:30.234 INFO:tasks.workunit.client.0.smithi073.stdout:4/168: mknod da/d27/d1b/d26/c3b 0 2024-04-19T02:18:30.234 INFO:tasks.workunit.client.0.smithi073.stdout:3/223: chown d3/d6/db/d3a/d38/d40/l4b 321 1 2024-04-19T02:18:30.235 INFO:tasks.workunit.client.0.smithi073.stdout:9/169: creat d0/df/f41 x:0 0 0 2024-04-19T02:18:30.235 INFO:tasks.workunit.client.0.smithi073.stdout:3/224: readlink d3/d6/db/d3a/l2c 0 2024-04-19T02:18:30.236 INFO:tasks.workunit.client.0.smithi073.stdout:4/169: chown da/d27/d1b/d1d/c24 205918 1 2024-04-19T02:18:30.236 INFO:tasks.workunit.client.0.smithi073.stdout:4/170: chown da/d27/d1b/d26 270 1 2024-04-19T02:18:30.237 INFO:tasks.workunit.client.0.smithi073.stdout:5/157: dread d0/f1b [0,4194304] 0 2024-04-19T02:18:30.237 INFO:tasks.workunit.client.0.smithi073.stdout:4/171: creat da/d27/d2c/f3c x:0 0 0 2024-04-19T02:18:30.238 INFO:tasks.workunit.client.0.smithi073.stdout:6/134: dwrite f3 [0,4194304] 0 2024-04-19T02:18:30.238 INFO:tasks.workunit.client.0.smithi073.stdout:4/172: readlink da/d27/d1b/l1c 0 2024-04-19T02:18:30.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/158: mkdir d0/d1d/d25/d35 0 2024-04-19T02:18:30.239 INFO:tasks.workunit.client.0.smithi073.stdout:4/173: stat da/d27/d1b/l20 0 2024-04-19T02:18:30.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/159: fdatasync d0/ff 0 2024-04-19T02:18:30.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/174: fdatasync da/f15 0 2024-04-19T02:18:30.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/160: dread - d0/d1d/d1e/f33 zero size 2024-04-19T02:18:30.241 INFO:tasks.workunit.client.0.smithi073.stdout:4/175: read da/f18 [2311886,123836] 0 2024-04-19T02:18:30.245 INFO:tasks.workunit.client.0.smithi073.stdout:9/170: dwrite d0/df/d16/d1a/f3b [0,4194304] 0 2024-04-19T02:18:30.245 INFO:tasks.workunit.client.0.smithi073.stdout:3/225: dwrite d3/d6/fd [0,4194304] 0 2024-04-19T02:18:30.246 INFO:tasks.workunit.client.0.smithi073.stdout:9/171: mknod d0/c42 0 2024-04-19T02:18:30.248 INFO:tasks.workunit.client.0.smithi073.stdout:6/135: dwrite d8/f2e [0,4194304] 0 2024-04-19T02:18:30.248 INFO:tasks.workunit.client.0.smithi073.stdout:3/226: mkdir d3/d6/db/d1a/d50 0 2024-04-19T02:18:30.250 INFO:tasks.workunit.client.0.smithi073.stdout:6/136: chown d8/de/d22/f23 147805 1 2024-04-19T02:18:30.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/176: dwrite da/fc [0,4194304] 0 2024-04-19T02:18:30.252 INFO:tasks.workunit.client.0.smithi073.stdout:6/137: rename d8/de/f12 to d8/de/d22/f31 0 2024-04-19T02:18:30.252 INFO:tasks.workunit.client.0.smithi073.stdout:5/161: dwrite d0/fc [0,4194304] 0 2024-04-19T02:18:30.252 INFO:tasks.workunit.client.0.smithi073.stdout:4/177: mkdir da/d23/d3d 0 2024-04-19T02:18:30.253 INFO:tasks.workunit.client.0.smithi073.stdout:6/138: creat d8/de/f32 x:0 0 0 2024-04-19T02:18:30.254 INFO:tasks.workunit.client.0.smithi073.stdout:6/139: read d8/de/f28 [418972,29899] 0 2024-04-19T02:18:30.254 INFO:tasks.workunit.client.0.smithi073.stdout:5/162: creat d0/d1d/d25/d35/f36 x:0 0 0 2024-04-19T02:18:30.254 INFO:tasks.workunit.client.0.smithi073.stdout:4/178: read - da/d27/d1b/d1d/f37 zero size 2024-04-19T02:18:30.254 INFO:tasks.workunit.client.0.smithi073.stdout:4/179: read - da/d23/d2b/f32 zero size 2024-04-19T02:18:30.254 INFO:tasks.workunit.client.0.smithi073.stdout:5/163: mkdir d0/d1d/d25/d37 0 2024-04-19T02:18:30.255 INFO:tasks.workunit.client.0.smithi073.stdout:4/180: symlink da/d27/d1b/d26/l3e 0 2024-04-19T02:18:30.256 INFO:tasks.workunit.client.0.smithi073.stdout:5/164: creat d0/d1d/d24/f38 x:0 0 0 2024-04-19T02:18:30.256 INFO:tasks.workunit.client.0.smithi073.stdout:5/165: fdatasync d0/ff 0 2024-04-19T02:18:30.257 INFO:tasks.workunit.client.0.smithi073.stdout:9/172: dwrite d0/df/d16/d19/f3d [0,4194304] 0 2024-04-19T02:18:30.257 INFO:tasks.workunit.client.0.smithi073.stdout:5/166: mkdir d0/d1d/d25/d35/d39 0 2024-04-19T02:18:30.257 INFO:tasks.workunit.client.0.smithi073.stdout:9/173: symlink d0/df/d16/d1a/l43 0 2024-04-19T02:18:30.257 INFO:tasks.workunit.client.0.smithi073.stdout:5/167: write d0/d1d/d24/f2f [31483,37588] 0 2024-04-19T02:18:30.258 INFO:tasks.workunit.client.0.smithi073.stdout:9/174: creat d0/df/d1d/f44 x:0 0 0 2024-04-19T02:18:30.258 INFO:tasks.workunit.client.0.smithi073.stdout:5/168: creat d0/d1d/d25/d35/f3a x:0 0 0 2024-04-19T02:18:30.259 INFO:tasks.workunit.client.0.smithi073.stdout:5/169: chown d0/d1d/d24/f38 114628 1 2024-04-19T02:18:30.260 INFO:tasks.workunit.client.0.smithi073.stdout:5/170: truncate d0/d1d/d25/d35/f3a 982955 0 2024-04-19T02:18:30.261 INFO:tasks.workunit.client.0.smithi073.stdout:9/175: dread d0/f8 [0,4194304] 0 2024-04-19T02:18:30.261 INFO:tasks.workunit.client.0.smithi073.stdout:9/176: mkdir d0/df/d16/d1a/d3c/d45 0 2024-04-19T02:18:30.263 INFO:tasks.workunit.client.0.smithi073.stdout:9/177: write d0/f13 [4886260,102246] 0 2024-04-19T02:18:30.263 INFO:tasks.workunit.client.0.smithi073.stdout:5/171: dread d0/f16 [0,4194304] 0 2024-04-19T02:18:30.263 INFO:tasks.workunit.client.0.smithi073.stdout:5/172: readlink d0/l17 0 2024-04-19T02:18:30.263 INFO:tasks.workunit.client.0.smithi073.stdout:9/178: creat d0/df/d16/d1a/d2c/f46 x:0 0 0 2024-04-19T02:18:30.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/173: write d0/d1d/d24/f38 [808807,88583] 0 2024-04-19T02:18:30.264 INFO:tasks.workunit.client.0.smithi073.stdout:9/179: fsync d0/df/d1d/f32 0 2024-04-19T02:18:30.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/174: readlink d0/ld 0 2024-04-19T02:18:30.264 INFO:tasks.workunit.client.0.smithi073.stdout:9/180: mkdir d0/df/d1d/d47 0 2024-04-19T02:18:30.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/175: creat d0/f3b x:0 0 0 2024-04-19T02:18:30.265 INFO:tasks.workunit.client.0.smithi073.stdout:9/181: write d0/f13 [3996616,10314] 0 2024-04-19T02:18:30.265 INFO:tasks.workunit.client.0.smithi073.stdout:5/176: mknod d0/c3c 0 2024-04-19T02:18:30.265 INFO:tasks.workunit.client.0.smithi073.stdout:9/182: read d0/df/f11 [2151903,90524] 0 2024-04-19T02:18:30.266 INFO:tasks.workunit.client.0.smithi073.stdout:5/177: mknod d0/c3d 0 2024-04-19T02:18:30.267 INFO:tasks.workunit.client.0.smithi073.stdout:9/183: write d0/df/d16/d1a/f3a [1850315,114252] 0 2024-04-19T02:18:30.267 INFO:tasks.workunit.client.0.smithi073.stdout:5/178: link d0/d1d/d24/f2e d0/d1d/d25/d37/f3e 0 2024-04-19T02:18:30.270 INFO:tasks.workunit.client.0.smithi073.stdout:7/117: dwrite d0/dc/d10/f21 [4194304,4194304] 0 2024-04-19T02:18:30.270 INFO:tasks.workunit.client.0.smithi073.stdout:5/179: mkdir d0/d1d/d25/d3f 0 2024-04-19T02:18:30.270 INFO:tasks.workunit.client.0.smithi073.stdout:9/184: link d0/df/f40 d0/df/d16/d1a/d3c/d45/f48 0 2024-04-19T02:18:30.270 INFO:tasks.workunit.client.0.smithi073.stdout:5/180: write d0/d1d/d1e/f2b [1478082,116548] 0 2024-04-19T02:18:30.271 INFO:tasks.workunit.client.0.smithi073.stdout:9/185: rename d0/df/l29 to d0/df/d16/d1a/d3c/d45/l49 0 2024-04-19T02:18:30.271 INFO:tasks.workunit.client.0.smithi073.stdout:5/181: rmdir d0/d1d/d25/d3f 0 2024-04-19T02:18:30.271 INFO:tasks.workunit.client.0.smithi073.stdout:5/182: stat d0/d1d/d24/f38 0 2024-04-19T02:18:30.272 INFO:tasks.workunit.client.0.smithi073.stdout:9/186: creat d0/df/d16/d1a/d3c/f4a x:0 0 0 2024-04-19T02:18:30.272 INFO:tasks.workunit.client.0.smithi073.stdout:5/183: creat d0/d1d/d1e/f40 x:0 0 0 2024-04-19T02:18:30.273 INFO:tasks.workunit.client.0.smithi073.stdout:9/187: creat d0/df/d16/d1a/d2c/d2e/f4b x:0 0 0 2024-04-19T02:18:30.273 INFO:tasks.workunit.client.0.smithi073.stdout:5/184: creat d0/f41 x:0 0 0 2024-04-19T02:18:30.273 INFO:tasks.workunit.client.0.smithi073.stdout:5/185: stat d0/l12 0 2024-04-19T02:18:30.274 INFO:tasks.workunit.client.0.smithi073.stdout:5/186: write d0/d1d/f20 [7966814,116612] 0 2024-04-19T02:18:30.274 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:30.271+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:30.275 INFO:tasks.workunit.client.0.smithi073.stdout:5/187: creat d0/d1d/d25/d35/f42 x:0 0 0 2024-04-19T02:18:30.276 INFO:tasks.workunit.client.0.smithi073.stdout:6/140: dread d8/de/d22/f31 [0,4194304] 0 2024-04-19T02:18:30.276 INFO:tasks.workunit.client.0.smithi073.stdout:5/188: write d0/ff [1134422,18995] 0 2024-04-19T02:18:30.276 INFO:tasks.workunit.client.0.smithi073.stdout:6/141: write d8/de/f32 [536050,114081] 0 2024-04-19T02:18:30.277 INFO:tasks.workunit.client.0.smithi073.stdout:5/189: write d0/d1d/d24/f30 [2502661,107698] 0 2024-04-19T02:18:30.277 INFO:tasks.workunit.client.0.smithi073.stdout:6/142: creat d8/d30/f33 x:0 0 0 2024-04-19T02:18:30.279 INFO:tasks.workunit.client.0.smithi073.stdout:5/190: link d0/le d0/d1d/d25/d35/l43 0 2024-04-19T02:18:30.280 INFO:tasks.workunit.client.0.smithi073.stdout:5/191: write d0/d1d/d25/d35/f42 [196421,90978] 0 2024-04-19T02:18:30.280 INFO:tasks.workunit.client.0.smithi073.stdout:5/192: mknod d0/d2d/c44 0 2024-04-19T02:18:30.281 INFO:tasks.workunit.client.0.smithi073.stdout:5/193: symlink d0/d1d/l45 0 2024-04-19T02:18:30.286 INFO:tasks.workunit.client.0.smithi073.stdout:8/125: sync 2024-04-19T02:18:30.290 INFO:tasks.workunit.client.0.smithi073.stdout:8/126: dwrite f0 [0,4194304] 0 2024-04-19T02:18:30.291 INFO:tasks.workunit.client.0.smithi073.stdout:8/127: creat d14/d15/d17/f21 x:0 0 0 2024-04-19T02:18:30.294 INFO:tasks.workunit.client.0.smithi073.stdout:0/106: dread d7/f11 [0,4194304] 0 2024-04-19T02:18:30.295 INFO:tasks.workunit.client.0.smithi073.stdout:0/107: dread d7/f11 [0,4194304] 0 2024-04-19T02:18:30.297 INFO:tasks.workunit.client.0.smithi073.stdout:1/134: dwrite db/ff [0,4194304] 0 2024-04-19T02:18:30.297 INFO:tasks.workunit.client.0.smithi073.stdout:3/227: dread d3/f49 [0,4194304] 0 2024-04-19T02:18:30.298 INFO:tasks.workunit.client.0.smithi073.stdout:3/228: chown d3/d6/db/d1a/c1f 5 1 2024-04-19T02:18:30.298 INFO:tasks.workunit.client.0.smithi073.stdout:1/135: creat db/f35 x:0 0 0 2024-04-19T02:18:30.299 INFO:tasks.workunit.client.0.smithi073.stdout:1/136: creat db/f36 x:0 0 0 2024-04-19T02:18:30.299 INFO:tasks.workunit.client.0.smithi073.stdout:1/137: read db/f23 [1001293,5099] 0 2024-04-19T02:18:30.300 INFO:tasks.workunit.client.0.smithi073.stdout:3/229: rename d3/d6/db/d3a/l42 to d3/d6/db/l51 0 2024-04-19T02:18:30.300 INFO:tasks.workunit.client.0.smithi073.stdout:1/138: fsync f9 0 2024-04-19T02:18:30.301 INFO:tasks.workunit.client.0.smithi073.stdout:3/230: mkdir d3/d6/db/d16/d52 0 2024-04-19T02:18:30.301 INFO:tasks.workunit.client.0.smithi073.stdout:0/108: dwrite d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:30.302 INFO:tasks.workunit.client.0.smithi073.stdout:3/231: creat d3/d6/db/d3a/d38/f53 x:0 0 0 2024-04-19T02:18:30.302 INFO:tasks.workunit.client.0.smithi073.stdout:0/109: write d7/d14/f18 [62337,62077] 0 2024-04-19T02:18:30.303 INFO:tasks.workunit.client.0.smithi073.stdout:3/232: mkdir d3/d6/db/d1a/d54 0 2024-04-19T02:18:30.303 INFO:tasks.workunit.client.0.smithi073.stdout:0/110: creat d7/d14/d17/f1d x:0 0 0 2024-04-19T02:18:30.308 INFO:tasks.workunit.client.0.smithi073.stdout:3/233: dwrite d3/d6/f7 [0,4194304] 0 2024-04-19T02:18:30.309 INFO:tasks.workunit.client.0.smithi073.stdout:0/111: dwrite d7/f11 [0,4194304] 0 2024-04-19T02:18:30.309 INFO:tasks.workunit.client.0.smithi073.stdout:3/234: getdents d3/d6/db/d23 0 2024-04-19T02:18:30.311 INFO:tasks.workunit.client.0.smithi073.stdout:3/235: link d3/ca d3/d6/db/d23/c55 0 2024-04-19T02:18:30.311 INFO:tasks.workunit.client.0.smithi073.stdout:3/236: creat d3/d6/db/d16/d52/f56 x:0 0 0 2024-04-19T02:18:30.318 INFO:tasks.workunit.client.0.smithi073.stdout:0/112: dread d7/d14/f18 [0,4194304] 0 2024-04-19T02:18:30.322 INFO:tasks.workunit.client.0.smithi073.stdout:0/113: dwrite d7/d14/f16 [0,4194304] 0 2024-04-19T02:18:30.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/118: truncate d0/f8 655564 0 2024-04-19T02:18:30.335 INFO:tasks.workunit.client.0.smithi073.stdout:9/188: getdents d0/df/d16/d1a/d3c/d45 0 2024-04-19T02:18:30.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/119: dread - d0/dc/f26 zero size 2024-04-19T02:18:30.335 INFO:tasks.workunit.client.0.smithi073.stdout:5/194: getdents d0/d2d 0 2024-04-19T02:18:30.335 INFO:tasks.workunit.client.0.smithi073.stdout:9/189: readlink d0/df/d16/l28 0 2024-04-19T02:18:30.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/195: read d0/f15 [1712970,22734] 0 2024-04-19T02:18:30.337 INFO:tasks.workunit.client.0.smithi073.stdout:7/120: mknod d0/d3/c29 0 2024-04-19T02:18:30.337 INFO:tasks.workunit.client.0.smithi073.stdout:9/190: dread - d0/df/d16/d1a/d2c/f46 zero size 2024-04-19T02:18:30.337 INFO:tasks.workunit.client.0.smithi073.stdout:7/121: unlink d0/le 0 2024-04-19T02:18:30.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/196: symlink d0/d1d/d24/l46 0 2024-04-19T02:18:30.337 INFO:tasks.workunit.client.0.smithi073.stdout:8/128: rmdir d14 39 2024-04-19T02:18:30.337 INFO:tasks.workunit.client.0.smithi073.stdout:7/122: write d0/dc/d10/d15/f19 [1898502,74952] 0 2024-04-19T02:18:30.337 INFO:tasks.workunit.client.0.smithi073.stdout:8/129: mknod d14/d15/d17/c22 0 2024-04-19T02:18:30.342 INFO:tasks.workunit.client.0.smithi073.stdout:7/123: dwrite d0/f7 [0,4194304] 0 2024-04-19T02:18:30.342 INFO:tasks.workunit.client.0.smithi073.stdout:8/130: dwrite d14/d15/f1e [0,4194304] 0 2024-04-19T02:18:30.349 INFO:tasks.workunit.client.0.smithi073.stdout:8/131: dwrite fe [0,4194304] 0 2024-04-19T02:18:30.351 INFO:tasks.workunit.client.0.smithi073.stdout:5/197: write d0/d1d/d24/f2e [517235,25701] 0 2024-04-19T02:18:30.351 INFO:tasks.workunit.client.0.smithi073.stdout:8/132: write d14/d15/f1e [2498961,120366] 0 2024-04-19T02:18:30.351 INFO:tasks.workunit.client.0.smithi073.stdout:5/198: fsync d0/f9 0 2024-04-19T02:18:30.351 INFO:tasks.workunit.client.0.smithi073.stdout:9/191: dwrite d0/df/f11 [0,4194304] 0 2024-04-19T02:18:30.353 INFO:tasks.workunit.client.0.smithi073.stdout:7/124: dwrite d0/dc/d10/f21 [0,4194304] 0 2024-04-19T02:18:30.353 INFO:tasks.workunit.client.0.smithi073.stdout:7/125: mkdir d0/dc/d10/d2a 0 2024-04-19T02:18:30.353 INFO:tasks.workunit.client.0.smithi073.stdout:7/126: write d0/f7 [482398,120862] 0 2024-04-19T02:18:30.358 INFO:tasks.workunit.client.0.smithi073.stdout:7/127: fdatasync d0/f8 0 2024-04-19T02:18:30.358 INFO:tasks.workunit.client.0.smithi073.stdout:7/128: stat d0/dc/cf 0 2024-04-19T02:18:30.359 INFO:tasks.workunit.client.0.smithi073.stdout:7/129: fdatasync d0/dc/d10/d15/f19 0 2024-04-19T02:18:30.359 INFO:tasks.workunit.client.0.smithi073.stdout:7/130: rmdir d0/dc/d10/d15 39 2024-04-19T02:18:30.360 INFO:tasks.workunit.client.0.smithi073.stdout:4/181: sync 2024-04-19T02:18:30.361 INFO:tasks.workunit.client.0.smithi073.stdout:6/143: sync 2024-04-19T02:18:30.361 INFO:tasks.workunit.client.0.smithi073.stdout:2/122: sync 2024-04-19T02:18:30.361 INFO:tasks.workunit.client.0.smithi073.stdout:1/139: sync 2024-04-19T02:18:30.361 INFO:tasks.workunit.client.0.smithi073.stdout:0/114: sync 2024-04-19T02:18:30.361 INFO:tasks.workunit.client.0.smithi073.stdout:3/237: sync 2024-04-19T02:18:30.362 INFO:tasks.workunit.client.0.smithi073.stdout:4/182: readlink da/d27/d1b/l35 0 2024-04-19T02:18:30.365 INFO:tasks.workunit.client.0.smithi073.stdout:2/123: read d5/f11 [1004274,24830] 0 2024-04-19T02:18:30.366 INFO:tasks.workunit.client.0.smithi073.stdout:1/140: symlink db/d1c/l37 0 2024-04-19T02:18:30.366 INFO:tasks.workunit.client.0.smithi073.stdout:2/124: rename d5/d10/d15/d1f to d5/d10/d15/d2d 0 2024-04-19T02:18:30.366 INFO:tasks.workunit.client.0.smithi073.stdout:1/141: rename db to db/d38 22 2024-04-19T02:18:30.366 INFO:tasks.workunit.client.0.smithi073.stdout:7/131: dwrite d0/f1d [0,4194304] 0 2024-04-19T02:18:30.366 INFO:tasks.workunit.client.0.smithi073.stdout:4/183: creat da/d27/d36/f3f x:0 0 0 2024-04-19T02:18:30.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/184: write da/d27/d36/f3f [748145,83787] 0 2024-04-19T02:18:30.370 INFO:tasks.workunit.client.0.smithi073.stdout:7/132: rename d0/dc/d10/d15/f19 to d0/dc/d10/d2a/f2b 0 2024-04-19T02:18:30.370 INFO:tasks.workunit.client.0.smithi073.stdout:6/144: dwrite d8/f16 [0,4194304] 0 2024-04-19T02:18:30.371 INFO:tasks.workunit.client.0.smithi073.stdout:0/115: dwrite d7/d14/d17/f1d [0,4194304] 0 2024-04-19T02:18:30.371 INFO:tasks.workunit.client.0.smithi073.stdout:4/185: dread - da/d27/d1b/d1d/f37 zero size 2024-04-19T02:18:30.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/133: symlink d0/d3/l2c 0 2024-04-19T02:18:30.372 INFO:tasks.workunit.client.0.smithi073.stdout:6/145: creat d8/de/d22/f34 x:0 0 0 2024-04-19T02:18:30.372 INFO:tasks.workunit.client.0.smithi073.stdout:7/134: unlink d0/f20 0 2024-04-19T02:18:30.373 INFO:tasks.workunit.client.0.smithi073.stdout:4/186: creat da/d23/d3d/f40 x:0 0 0 2024-04-19T02:18:30.374 INFO:tasks.workunit.client.0.smithi073.stdout:7/135: symlink d0/dc/d10/d2a/l2d 0 2024-04-19T02:18:30.374 INFO:tasks.workunit.client.0.smithi073.stdout:1/142: dwrite db/f11 [0,4194304] 0 2024-04-19T02:18:30.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/125: read d5/f7 [160518,88391] 0 2024-04-19T02:18:30.375 INFO:tasks.workunit.client.0.smithi073.stdout:1/143: creat db/d1c/f39 x:0 0 0 2024-04-19T02:18:30.375 INFO:tasks.workunit.client.0.smithi073.stdout:4/187: truncate da/d27/d2c/f30 490429 0 2024-04-19T02:18:30.375 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:30.372+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.376 INFO:tasks.workunit.client.0.smithi073.stdout:1/144: symlink db/d1c/d2c/l3a 0 2024-04-19T02:18:30.376 INFO:tasks.workunit.client.0.smithi073.stdout:4/188: symlink da/d27/d36/l41 0 2024-04-19T02:18:30.376 INFO:tasks.workunit.client.0.smithi073.stdout:1/145: readlink db/d1c/l26 0 2024-04-19T02:18:30.376 INFO:tasks.workunit.client.0.smithi073.stdout:4/189: dread - da/d27/d1b/d1d/f37 zero size 2024-04-19T02:18:30.380 INFO:tasks.workunit.client.0.smithi073.stdout:7/136: dwrite d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.380 INFO:tasks.workunit.client.0.smithi073.stdout:7/137: mknod d0/d28/c2e 0 2024-04-19T02:18:30.381 INFO:tasks.workunit.client.0.smithi073.stdout:7/138: rename d0/dc/c1a to d0/dc/d10/d2a/c2f 0 2024-04-19T02:18:30.384 INFO:tasks.workunit.client.0.smithi073.stdout:5/199: dread d0/d1d/d24/f2e [0,4194304] 0 2024-04-19T02:18:30.385 INFO:tasks.workunit.client.0.smithi073.stdout:5/200: dread - d0/d1d/d1e/f33 zero size 2024-04-19T02:18:30.385 INFO:tasks.workunit.client.0.smithi073.stdout:6/146: dread f3 [4194304,4194304] 0 2024-04-19T02:18:30.385 INFO:tasks.workunit.client.0.smithi073.stdout:5/201: read d0/d1d/d24/f2e [106186,61618] 0 2024-04-19T02:18:30.386 INFO:tasks.workunit.client.0.smithi073.stdout:6/147: mkdir d8/de/d35 0 2024-04-19T02:18:30.387 INFO:tasks.workunit.client.0.smithi073.stdout:6/148: mknod d8/d30/c36 0 2024-04-19T02:18:30.387 INFO:tasks.workunit.client.0.smithi073.stdout:7/139: dwrite d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.387 INFO:tasks.workunit.client.0.smithi073.stdout:6/149: write d8/f2e [2201826,14349] 0 2024-04-19T02:18:30.388 INFO:tasks.workunit.client.0.smithi073.stdout:6/150: write d8/de/f1e [2270907,128958] 0 2024-04-19T02:18:30.389 INFO:tasks.workunit.client.0.smithi073.stdout:5/202: link d0/d1d/d1e/c22 d0/d1d/d25/d35/d39/c47 0 2024-04-19T02:18:30.389 INFO:tasks.workunit.client.0.smithi073.stdout:6/151: write d8/d30/f33 [27056,28878] 0 2024-04-19T02:18:30.389 INFO:tasks.workunit.client.0.smithi073.stdout:6/152: fsync d8/de/f1f 0 2024-04-19T02:18:30.389 INFO:tasks.workunit.client.0.smithi073.stdout:5/203: symlink d0/d1d/d1e/l48 0 2024-04-19T02:18:30.390 INFO:tasks.workunit.client.0.smithi073.stdout:6/153: creat d8/de/d22/f37 x:0 0 0 2024-04-19T02:18:30.390 INFO:tasks.workunit.client.0.smithi073.stdout:5/204: read d0/d1d/d24/f30 [1759290,43165] 0 2024-04-19T02:18:30.391 INFO:tasks.workunit.client.0.smithi073.stdout:6/154: rename d8/de/d22/l2c to d8/l38 0 2024-04-19T02:18:30.392 INFO:tasks.workunit.client.0.smithi073.stdout:6/155: unlink d8/de/c2b 0 2024-04-19T02:18:30.393 INFO:tasks.workunit.client.0.smithi073.stdout:6/156: rename d8/de/c25 to d8/c39 0 2024-04-19T02:18:30.402 INFO:tasks.workunit.client.0.smithi073.stdout:3/238: truncate d3/d6/fd 1645299 0 2024-04-19T02:18:30.402 INFO:tasks.workunit.client.0.smithi073.stdout:3/239: mkdir d3/d6/db/d3a/d38/d57 0 2024-04-19T02:18:30.403 INFO:tasks.workunit.client.0.smithi073.stdout:3/240: chown d3/d6/db/d3a/d38/f53 367040 1 2024-04-19T02:18:30.404 INFO:tasks.workunit.client.0.smithi073.stdout:4/190: rmdir da/d23 39 2024-04-19T02:18:30.404 INFO:tasks.workunit.client.0.smithi073.stdout:3/241: rename d3/d6/d11/l13 to d3/d6/db/d1a/l58 0 2024-04-19T02:18:30.404 INFO:tasks.workunit.client.0.smithi073.stdout:1/146: getdents db/d1c 0 2024-04-19T02:18:30.406 INFO:tasks.workunit.client.0.smithi073.stdout:3/242: symlink d3/d6/db/d1a/d54/l59 0 2024-04-19T02:18:30.406 INFO:tasks.workunit.client.0.smithi073.stdout:3/243: chown d3/d6/db/d1a/c1f 7671803 1 2024-04-19T02:18:30.408 INFO:tasks.workunit.client.0.smithi073.stdout:5/205: dread d0/d1d/d25/f27 [0,4194304] 0 2024-04-19T02:18:30.408 INFO:tasks.workunit.client.0.smithi073.stdout:2/126: dwrite d5/d10/d14/f21 [0,4194304] 0 2024-04-19T02:18:30.409 INFO:tasks.workunit.client.0.smithi073.stdout:5/206: fsync d0/d1d/d25/f27 0 2024-04-19T02:18:30.409 INFO:tasks.workunit.client.0.smithi073.stdout:2/127: mkdir d5/d10/d14/d2e 0 2024-04-19T02:18:30.410 INFO:tasks.workunit.client.0.smithi073.stdout:8/133: sync 2024-04-19T02:18:30.410 INFO:tasks.workunit.client.0.smithi073.stdout:9/192: sync 2024-04-19T02:18:30.412 INFO:tasks.workunit.client.0.smithi073.stdout:8/134: creat d14/d15/d17/f23 x:0 0 0 2024-04-19T02:18:30.412 INFO:tasks.workunit.client.0.smithi073.stdout:9/193: creat d0/d35/f4c x:0 0 0 2024-04-19T02:18:30.412 INFO:tasks.workunit.client.0.smithi073.stdout:2/128: creat d5/d10/d14/d18/d1e/f2f x:0 0 0 2024-04-19T02:18:30.412 INFO:tasks.workunit.client.0.smithi073.stdout:8/135: readlink lf 0 2024-04-19T02:18:30.412 INFO:tasks.workunit.client.0.smithi073.stdout:4/191: dwrite da/d27/d1b/d1d/f1f [0,4194304] 0 2024-04-19T02:18:30.412 INFO:tasks.workunit.client.0.smithi073.stdout:9/194: readlink d0/df/d16/l18 0 2024-04-19T02:18:30.413 INFO:tasks.workunit.client.0.smithi073.stdout:2/129: symlink d5/d10/l30 0 2024-04-19T02:18:30.413 INFO:tasks.workunit.client.0.smithi073.stdout:9/195: symlink d0/df/d16/d19/l4d 0 2024-04-19T02:18:30.414 INFO:tasks.workunit.client.0.smithi073.stdout:6/157: truncate d8/de/ff 1150268 0 2024-04-19T02:18:30.414 INFO:tasks.workunit.client.0.smithi073.stdout:2/130: creat d5/f31 x:0 0 0 2024-04-19T02:18:30.416 INFO:tasks.workunit.client.0.smithi073.stdout:2/131: creat d5/d10/d15/f32 x:0 0 0 2024-04-19T02:18:30.416 INFO:tasks.workunit.client.0.smithi073.stdout:6/158: rename d8/de/d22/f23 to d8/de/d22/f3a 0 2024-04-19T02:18:30.416 INFO:tasks.workunit.client.0.smithi073.stdout:6/159: stat l7 0 2024-04-19T02:18:30.417 INFO:tasks.workunit.client.0.smithi073.stdout:8/136: dread f12 [0,4194304] 0 2024-04-19T02:18:30.418 INFO:tasks.workunit.client.0.smithi073.stdout:3/244: link d3/d6/db/d1a/d2f/f30 d3/d6/d11/f5a 0 2024-04-19T02:18:30.419 INFO:tasks.workunit.client.0.smithi073.stdout:8/137: mkdir d14/d24 0 2024-04-19T02:18:30.419 INFO:tasks.workunit.client.0.smithi073.stdout:4/192: dwrite da/d27/d1b/d1d/f37 [0,4194304] 0 2024-04-19T02:18:30.420 INFO:tasks.workunit.client.0.smithi073.stdout:3/245: chown d3/d6/d11/l25 1 1 2024-04-19T02:18:30.420 INFO:tasks.workunit.client.0.smithi073.stdout:8/138: chown d14/d15/d17/f23 28 1 2024-04-19T02:18:30.421 INFO:tasks.workunit.client.0.smithi073.stdout:8/139: chown d14 0 1 2024-04-19T02:18:30.422 INFO:tasks.workunit.client.0.smithi073.stdout:4/193: truncate da/f11 52781 0 2024-04-19T02:18:30.422 INFO:tasks.workunit.client.0.smithi073.stdout:3/246: read - d3/d6/db/d23/f27 zero size 2024-04-19T02:18:30.422 INFO:tasks.workunit.client.0.smithi073.stdout:9/196: dwrite d0/df/f41 [0,4194304] 0 2024-04-19T02:18:30.422 INFO:tasks.workunit.client.0.smithi073.stdout:8/140: mknod d14/d15/d17/c25 0 2024-04-19T02:18:30.422 INFO:tasks.workunit.client.0.smithi073.stdout:3/247: dread - d3/d6/db/f14 zero size 2024-04-19T02:18:30.423 INFO:tasks.workunit.client.0.smithi073.stdout:8/141: write f11 [2417992,105496] 0 2024-04-19T02:18:30.423 INFO:tasks.workunit.client.0.smithi073.stdout:4/194: creat da/d27/d1b/d1d/f42 x:0 0 0 2024-04-19T02:18:30.423 INFO:tasks.workunit.client.0.smithi073.stdout:9/197: creat d0/df/d16/d1a/d3c/f4e x:0 0 0 2024-04-19T02:18:30.424 INFO:tasks.workunit.client.0.smithi073.stdout:3/248: unlink d3/d6/db/d16/l32 0 2024-04-19T02:18:30.424 INFO:tasks.workunit.client.0.smithi073.stdout:9/198: fsync d0/df/d16/f1e 0 2024-04-19T02:18:30.424 INFO:tasks.workunit.client.0.smithi073.stdout:4/195: truncate da/f15 1357948 0 2024-04-19T02:18:30.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/249: unlink d3/d6/f7 0 2024-04-19T02:18:30.425 INFO:tasks.workunit.client.0.smithi073.stdout:2/132: dwrite d5/d10/d14/f2c [0,4194304] 0 2024-04-19T02:18:30.425 INFO:tasks.workunit.client.0.smithi073.stdout:4/196: symlink da/l43 0 2024-04-19T02:18:30.425 INFO:tasks.workunit.client.0.smithi073.stdout:8/142: truncate d14/d15/d17/f23 548542 0 2024-04-19T02:18:30.426 INFO:tasks.workunit.client.0.smithi073.stdout:3/250: creat d3/d6/d11/f5b x:0 0 0 2024-04-19T02:18:30.430 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.074813380999998, 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:30.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:30.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:30.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.061585317999999, 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:30.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:30.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:30.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.441 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.061490602999999, 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:30.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.060108827000001, 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.451 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.055458689000002, 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:30.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.039054081, 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:30.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:30.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:30.462 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.029835898000002, 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:30.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.467 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.027025198, 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:30.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:30.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:30.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:30.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.018039116000001, 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:30.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:30.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.015466311000001, 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:30.483 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.008239014000001, 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:30.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.489 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.003011748999999, 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.490 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:30.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.991259615000001, 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.495 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:30.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:30.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.984084445000001, 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.500 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:30.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:30.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:30.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.267704964, 2024-04-19T02:18:30.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:30.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.511 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.255420601, 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:30.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.516 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.15277399, 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.517 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:30.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.151572281, 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.522 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:30.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:30.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:30.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.526 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.148085931, 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:30.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:30.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.147734019, 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:30.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:30.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:30.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:30.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:30.536 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:30.537 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:30.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:30.539 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:30.536+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.540 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:5/207: dread d0/ff [0,4194304] 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:8/143: creat d14/d15/f26 x:0 0 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:5/208: dread - d0/d1d/f2a zero size 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:8/144: write f11 [5068477,1002] 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:5/209: creat d0/d1d/d25/d35/f49 x:0 0 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:3/251: stat d3/d6/f9 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:3/252: chown d3/d6/db/d16 25777889 1 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:3/253: rename d3/d6/db/d1a/f2b to d3/d6/db/d3a/f5c 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/197: dwrite f1 [0,4194304] 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:5/210: read d0/d1d/d25/d35/f3a [944822,69955] 0 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/198: dread - da/d27/d1b/f34 zero size 2024-04-19T02:18:30.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/199: link da/d27/d1b/d1d/f37 da/f44 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/200: chown da/d27/d2c/f3c 5094783 1 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/201: write da/d27/d2c/f3c [734872,89836] 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/202: truncate da/d23/d3d/f40 141489 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/254: dwrite d3/f5 [0,4194304] 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/203: creat da/d27/d1b/f45 x:0 0 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/255: rmdir d3/d6/db/d3a/d38/d40 39 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/204: unlink da/f15 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/256: fsync d3/d6/fd 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/205: write da/d23/d2b/f2d [879622,74496] 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/257: dread - d3/d6/db/f45 zero size 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/258: unlink d3/d6/db/d1a/d2f/f30 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/259: rename d3/d6/db/d3a/d38/d40/l4b to d3/d6/db/d23/l5d 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/260: mkdir d3/d6/d11/d5e 0 2024-04-19T02:18:30.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/261: mkdir d3/d6/db/d3a/d5f 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/133: dwrite d5/d10/d14/d18/d1e/f25 [0,4194304] 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:9/199: dwrite d0/df/d16/d1a/d3c/d45/f48 [0,4194304] 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:9/200: dread - d0/df/d16/d1a/f37 zero size 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/134: mkdir d5/d10/d15/d2d/d33 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:9/201: fsync d0/df/d16/d1a/d2c/d2e/f4b 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/135: write d5/f11 [963525,68342] 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/136: chown d5/d10/d15/d2d/d33 0 1 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/137: write d5/f11 [1970308,38584] 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/138: stat d5/d10/d14/f2c 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:6/160: fsync d8/f16 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/139: write d5/f31 [721824,5755] 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:3/262: dwrite d3/d6/db/d3a/f29 [0,4194304] 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:6/161: chown d8/de/f32 13508 1 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/140: fdatasync d5/d10/d14/d18/d1e/f2f 0 2024-04-19T02:18:30.561 INFO:tasks.workunit.client.0.smithi073.stdout:3/263: creat d3/d6/db/d1a/d50/f60 x:0 0 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:6/162: mkdir d8/de/d22/d3b 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:2/141: mknod d5/d10/d15/d2d/d33/c34 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:3/264: symlink d3/d6/db/d1a/l61 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:2/142: creat d5/d10/d15/d2d/d33/f35 x:0 0 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:3/265: dwrite d3/d6/db/d23/f27 [0,4194304] 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/202: dread d0/df/d1d/f33 [0,4194304] 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/203: truncate d0/df/f41 4269826 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/204: dread d0/fc [0,4194304] 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/205: dread d0/df/d16/d1a/f31 [0,4194304] 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/206: creat d0/df/d1d/d47/f4f x:0 0 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/207: write d0/df/f10 [1205816,104004] 0 2024-04-19T02:18:30.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/208: dread - d0/f30 zero size 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:9/209: getdents d0/df/d16 0 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:0/116: sync 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:7/140: sync 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:2/143: fsync d5/f31 0 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:0/117: write d7/d14/f15 [418110,6281] 0 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:7/141: getdents d0/d3 0 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:0/118: rename d7/c13 to d7/d14/c1e 0 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:0/119: readlink l1 0 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:7/142: mknod d0/dc/d10/d2a/c30 0 2024-04-19T02:18:30.563 INFO:tasks.workunit.client.0.smithi073.stdout:5/211: dread d0/f13 [0,4194304] 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:4/206: dread da/d27/d36/f3f [0,4194304] 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:0/120: chown l1 64475 1 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:2/144: rename d5/d10/d15/d2d/d33/f35 to d5/d10/d15/d2d/d33/f36 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:5/212: unlink d0/d1d/l45 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/143: creat d0/dc/d10/f31 x:0 0 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:4/207: mkdir da/d27/d1b/d26/d2a/d46 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:5/213: creat d0/d1d/f4a x:0 0 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/144: mknod d0/dc/c32 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:4/208: creat da/d27/d1b/d26/d2a/f47 x:0 0 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/145: mkdir d0/dc/d33 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:4/209: truncate da/d27/d1b/d1d/f29 4831419 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/146: truncate d0/dc/f26 445609 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:5/214: dread d0/f13 [0,4194304] 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:0/121: dwrite f5 [0,4194304] 0 2024-04-19T02:18:30.564 INFO:tasks.workunit.client.0.smithi073.stdout:5/215: creat d0/d1d/d25/d35/f4b x:0 0 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:0/122: creat d7/d14/d17/f1f x:0 0 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:2/145: rename d5/d10/d15/d2d/d33/f36 to d5/d10/d14/d18/d1e/f37 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:0/123: mkdir d7/d14/d17/d1a/d20 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:5/216: rename d0/d1d/d24/f2f to d0/d1d/d25/d35/d39/f4c 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:0/124: chown d7/cf 2382655 1 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:9/210: dwrite d0/fc [0,4194304] 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:4/210: truncate da/fc 1713307 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:3/266: dwrite d3/f3f [0,4194304] 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:2/146: rmdir d5 39 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:5/217: fdatasync d0/d1d/d25/d35/f49 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:0/125: mkdir d7/d14/d17/d1a/d21 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:3/267: dread - d3/d6/db/f14 zero size 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:4/211: mknod da/d27/d1b/d26/c48 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:2/147: mknod d5/d10/d14/d18/c38 0 2024-04-19T02:18:30.565 INFO:tasks.workunit.client.0.smithi073.stdout:7/147: dwrite d0/dc/d10/d15/f17 [0,4194304] 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/148: stat d5/d10/d14/d18/c26 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:3/268: fdatasync d3/f41 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/218: link d0/d1d/d25/d37/f3e d0/d1d/d25/d37/f4d 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:7/148: unlink d0/dc/d10/d2a/c30 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/149: mkdir d5/d10/d14/d18/d39 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:4/212: mkdir da/d27/d3a/d49 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:3/269: rmdir d3/d6/d11/d5e 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/219: mknod d0/d1d/c4e 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/150: write d5/d10/d14/f21 [1634351,130787] 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:4/213: write da/f16 [1761329,53493] 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/151: rmdir d5/d10/d14 39 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/220: truncate d0/f9 3577610 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:4/214: creat da/d27/d1b/d26/f4a x:0 0 0 2024-04-19T02:18:30.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/152: rmdir d5/d10/d15 39 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:5/221: fdatasync d0/d1d/f2a 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:4/215: mkdir da/d27/d3a/d4b 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:2/153: creat d5/d10/d15/d2d/f3a x:0 0 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:4/216: write da/f18 [4733843,75565] 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:2/154: symlink d5/d10/d14/d18/d1e/l3b 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:7/149: dwrite d0/dc/f26 [0,4194304] 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:4/217: creat da/d27/d1b/d26/f4c x:0 0 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:2/155: write d5/d10/d15/d2d/f3a [490222,67003] 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:3/270: dwrite d3/d6/db/f45 [0,4194304] 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:2/156: creat d5/d10/d15/f3c x:0 0 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:4/218: unlink da/d27/d1b/d26/c3b 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:7/150: getdents d0/d28 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:5/222: dwrite d0/ff [0,4194304] 0 2024-04-19T02:18:30.567 INFO:tasks.workunit.client.0.smithi073.stdout:5/223: chown d0/d1d/d25/d35 447781621 1 2024-04-19T02:18:30.568 INFO:tasks.workunit.client.0.smithi073.stdout:7/151: rename d0/dc/d10/d15/c27 to d0/dc/d10/d2a/c34 0 2024-04-19T02:18:30.568 INFO:tasks.workunit.client.0.smithi073.stdout:5/224: link d0/d1d/d24/f38 d0/f4f 0 2024-04-19T02:18:30.568 INFO:tasks.workunit.client.0.smithi073.stdout:2/157: link d5/d10/d14/d18/c26 d5/d10/d15/d2d/d33/c3d 0 2024-04-19T02:18:30.569 INFO:tasks.workunit.client.0.smithi073.stdout:3/271: mknod d3/d6/db/c62 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:8/145: sync 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:1/147: sync 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:6/163: sync 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/126: sync 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:1/148: chown db/f21 468407 1 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:8/146: rmdir d14/d24 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:2/158: write d5/d10/d14/d18/d1e/f12 [164934,51478] 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/127: link d7/d14/d17/f1f d7/d14/d17/d1a/f22 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:6/164: rename d8/l1d to d8/l3c 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:8/147: mkdir d14/d27 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:4/219: dwrite da/d27/d1b/d1d/f29 [0,4194304] 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:8/148: chown d14/f16 74 1 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/128: write d7/d14/f15 [794306,108146] 0 2024-04-19T02:18:30.570 INFO:tasks.workunit.client.0.smithi073.stdout:3/272: link d3/d6/db/d1a/l58 d3/d6/db/d1a/d54/l63 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:2/159: write d5/d10/d14/d18/f1a [355706,36327] 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:0/129: symlink d7/d14/d17/l23 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/220: rename da/d27/d3a/d4b to da/d27/d36/d4d 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:9/211: dread d0/df/d16/d1a/f3a [0,4194304] 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:2/160: chown d5/d10/d14/d18/d1e/f12 190410 1 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/221: unlink da/d27/d1b/f34 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:0/130: symlink d7/d14/d17/d1a/d21/l24 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/222: chown da/ce 15203 1 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:9/212: rename d0/df/d16/d19/d38/f3f to d0/f50 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/223: symlink da/d27/d36/d4d/l4e 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:8/149: dread d14/d15/d17/f23 [0,4194304] 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/224: link c2 da/d23/d3d/c4f 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/225: write da/d23/d3d/f40 [438784,92025] 0 2024-04-19T02:18:30.571 INFO:tasks.workunit.client.0.smithi073.stdout:6/165: dread d8/de/f32 [0,4194304] 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/273: dwrite d3/d6/db/d1a/f4c [4194304,4194304] 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/166: readlink d8/de/d22/l2d 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/167: chown d8/de/c21 2 1 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/168: dread - d8/f18 zero size 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/169: creat d8/de/d35/f3d x:0 0 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/170: mknod d8/de/d35/c3e 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/274: dwrite d3/d6/db/f45 [0,4194304] 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:2/161: rename d5/d10/d15 to d5/d10/d14/d18/d3e 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/171: dwrite d8/de/f1f [0,4194304] 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:9/213: rename d0/df/d16/d1a/f31 to d0/df/d1d/d47/f51 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:2/162: write d5/d10/d14/d18/d3e/f32 [383462,119797] 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:2/163: fdatasync d5/f7 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:9/214: creat d0/df/d16/d1a/f52 x:0 0 0 2024-04-19T02:18:30.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/172: creat d8/de/d22/d3b/f3f x:0 0 0 2024-04-19T02:18:30.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/275: dwrite d3/d6/db/d23/f27 [0,4194304] 0 2024-04-19T02:18:30.573 INFO:tasks.workunit.client.0.smithi073.stdout:6/173: mknod d8/d30/c40 0 2024-04-19T02:18:30.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/164: read d5/d10/d14/f21 [191900,19355] 0 2024-04-19T02:18:30.573 INFO:tasks.workunit.client.0.smithi073.stdout:5/225: dwrite d0/d1d/d24/f2e [0,4194304] 0 2024-04-19T02:18:30.573 INFO:tasks.workunit.client.0.smithi073.stdout:9/215: unlink d0/df/d16/d19/l4d 0 2024-04-19T02:18:30.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/276: mknod d3/c64 0 2024-04-19T02:18:30.573 INFO:tasks.workunit.client.0.smithi073.stdout:6/174: mknod d8/de/c41 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/165: truncate d5/fa 4276112 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/277: chown d3/f3d 452 1 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/166: fsync d5/d10/d14/d18/d3e/d2d/f3a 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:9/216: creat d0/df/d16/d1a/d2c/d2e/f53 x:0 0 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:6/175: symlink d8/d30/l42 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:5/226: symlink d0/d1d/d25/d37/l50 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:5/227: dread - d0/d1d/d25/d35/f36 zero size 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:6/176: symlink d8/de/d22/d3b/l43 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/167: symlink d5/d10/d14/d18/d1e/l3f 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/168: read - d5/d10/d14/d18/d1e/f37 zero size 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/131: sync 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/132: readlink d7/d14/d17/d1a/d21/l24 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/133: creat d7/f25 x:0 0 0 2024-04-19T02:18:30.574 INFO:tasks.workunit.client.0.smithi073.stdout:9/217: dwrite d0/df/d16/d19/f3d [0,4194304] 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/278: dwrite d3/d6/db/d1a/f4c [4194304,4194304] 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:0/134: mknod d7/d14/d17/d1a/d21/c26 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/218: unlink d0/df/d16/d19/c27 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/279: symlink d3/d6/db/d23/l65 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:0/135: link d7/f25 d7/d14/d17/d1a/d20/f27 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/219: creat d0/f54 x:0 0 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/280: creat d3/d6/db/f66 x:0 0 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/220: symlink d0/df/d16/d1a/d2c/l55 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/281: write d3/d6/db/f2d [858340,48539] 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/221: creat d0/df/d16/d1a/d2c/f56 x:0 0 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/222: write d0/f13 [1551000,126143] 0 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/282: dread - d3/d6/db/d3a/d38/f53 zero size 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/283: read - d3/d6/db/f14 zero size 2024-04-19T02:18:30.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/223: write d0/df/d16/d1a/d3c/f4e [302235,29445] 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:9/224: creat d0/df/d16/d19/f57 x:0 0 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:0/136: dwrite d7/f25 [0,4194304] 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:3/284: mknod d3/d6/db/d1a/d54/c67 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:9/225: mknod d0/c58 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:7/152: truncate d0/dc/f1f 3406643 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:0/137: symlink d7/d14/d17/d1a/d20/l28 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:7/153: write d0/f8 [1107225,34832] 0 2024-04-19T02:18:30.576 INFO:tasks.workunit.client.0.smithi073.stdout:4/226: truncate f1 2194755 0 2024-04-19T02:18:30.582 INFO:tasks.workunit.client.0.smithi073.stdout:2/169: getdents d5/d10/d14/d18/d1e 0 2024-04-19T02:18:30.582 INFO:tasks.workunit.client.0.smithi073.stdout:0/138: link f4 d7/d14/d17/d1a/f29 0 2024-04-19T02:18:30.582 INFO:tasks.workunit.client.0.smithi073.stdout:2/170: chown d5/lb 99488378 1 2024-04-19T02:18:30.583 INFO:tasks.workunit.client.0.smithi073.stdout:8/150: dread d14/f16 [0,4194304] 0 2024-04-19T02:18:30.583 INFO:tasks.workunit.client.0.smithi073.stdout:9/226: link d0/df/d16/d19/d38/l3e d0/df/d16/d19/d38/l59 0 2024-04-19T02:18:30.583 INFO:tasks.workunit.client.0.smithi073.stdout:7/154: creat d0/dc/d33/f35 x:0 0 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:0/139: read d7/d14/f18 [90365,1250] 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:6/177: link d8/l3c d8/l44 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/149: dwrite db/f12 [0,4194304] 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:8/151: chown d14/d15 887201561 1 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:2/171: chown d5/d10/d14/d18/d1e/l3b 0 1 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/150: dread - db/f2f zero size 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/151: stat db/f25 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:7/155: chown d0/d3/l1e 6109677 1 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:6/178: mknod d8/d30/c45 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:8/152: mknod d14/d15/d17/c28 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:9/227: link d0/fa d0/df/d1d/f5a 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:2/172: mknod d5/d10/d14/d2e/c40 0 2024-04-19T02:18:30.584 INFO:tasks.workunit.client.0.smithi073.stdout:3/285: dread d3/f3f [0,4194304] 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:1/152: creat db/d1c/f3b x:0 0 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:7/156: chown d0/dc/d10/f21 381758 1 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/179: chown d8/de/f1f 11467863 1 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:2/173: fdatasync f3 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/180: mknod d8/de/d22/d3b/c46 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:7/157: chown d0/dc/c32 62097916 1 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/181: write d8/de/f1f [272697,28250] 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:3/286: rename d3/d6/db/d16/c46 to d3/d6/c68 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/182: rename d8/f29 to d8/de/f47 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:1/153: dread db/fd [0,4194304] 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:2/174: dread d5/d10/d14/d18/d1e/f12 [0,4194304] 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:2/175: readlink d5/d10/d14/d18/d1e/l19 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:8/153: dwrite d14/f16 [0,4194304] 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:5/228: dread d0/d1d/d24/f30 [0,4194304] 0 2024-04-19T02:18:30.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/183: symlink d8/de/l48 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/154: creat db/d1c/f3c x:0 0 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/176: mknod d5/d10/d14/d18/d3e/d2d/d33/c41 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:3/287: dwrite d3/d6/d11/f35 [0,4194304] 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:8/154: mkdir d14/d27/d29 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/155: write db/f30 [227580,2516] 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:5/229: write d0/d1d/d25/d35/d39/f4c [1032228,124983] 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:6/184: creat d8/de/d35/f49 x:0 0 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:6/185: readlink d8/de/l48 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/156: dread - db/d1c/f39 zero size 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:8/155: truncate d14/d15/d17/f1f 601196 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/177: mkdir d5/d10/d29/d42 0 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:6/186: read - d8/de/f2a zero size 2024-04-19T02:18:30.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/157: rename db/f29 to db/d1c/d2c/f3d 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:6/187: fsync d8/f10 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:8/156: read f6 [2860380,18757] 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:1/158: fdatasync f3 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:5/230: getdents d0/d1d/d24 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:4/227: dwrite da/fc [0,4194304] 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:2/178: creat d5/d10/d14/d18/d3e/d2d/d33/f43 x:0 0 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:6/188: stat d8/de/d22/c27 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:5/231: mknod d0/d2d/c51 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:4/228: chown da/d27/d1b/d26/d2a/f47 2129772 1 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:5/232: unlink d0/l18 0 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:6/189: chown d8/de/d22/c24 42398 1 2024-04-19T02:18:30.587 INFO:tasks.workunit.client.0.smithi073.stdout:1/159: mkdir db/d3e 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:2/179: symlink d5/d10/d29/d42/l44 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:1/160: chown db/d1c/f3b 1313205434 1 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:3/288: dwrite d3/d6/db/f4d [0,4194304] 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:4/229: write da/d27/f39 [2217473,73449] 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:1/161: creat db/d3e/f3f x:0 0 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:6/190: link d8/de/d22/f31 d8/de/d35/f4a 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:3/289: symlink d3/d6/db/d16/l69 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:4/230: write da/d27/d1b/d1d/f29 [2825498,93266] 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:1/162: unlink db/d1c/f2b 0 2024-04-19T02:18:30.589 INFO:tasks.workunit.client.0.smithi073.stdout:2/180: creat d5/d10/d14/d18/d3e/d2d/d33/f45 x:0 0 0 2024-04-19T02:18:30.590 INFO:tasks.workunit.client.0.smithi073.stdout:7/158: read d0/dc/d10/d2a/f2b [175331,82864] 0 2024-04-19T02:18:30.590 INFO:tasks.workunit.client.0.smithi073.stdout:0/140: fsync d7/d14/d17/d1a/d20/f27 0 2024-04-19T02:18:30.590 INFO:tasks.workunit.client.0.smithi073.stdout:8/157: dwrite f0 [0,4194304] 0 2024-04-19T02:18:30.590 INFO:tasks.workunit.client.0.smithi073.stdout:3/290: write d3/d6/f22 [2728178,11831] 0 2024-04-19T02:18:30.590 INFO:tasks.workunit.client.0.smithi073.stdout:7/159: read d0/f7 [2800188,122595] 0 2024-04-19T02:18:30.590 INFO:tasks.workunit.client.0.smithi073.stdout:4/231: mkdir da/d27/d3a/d50 0 2024-04-19T02:18:30.590 INFO:tasks.workunit.client.0.smithi073.stdout:5/233: dread d0/ff [0,4194304] 0 2024-04-19T02:18:30.591 INFO:tasks.workunit.client.0.smithi073.stdout:8/158: symlink d14/d15/l2a 0 2024-04-19T02:18:30.591 INFO:tasks.workunit.client.0.smithi073.stdout:5/234: chown d0 3 1 2024-04-19T02:18:30.591 INFO:tasks.workunit.client.0.smithi073.stdout:2/181: write d5/d10/d14/d18/d3e/f3c [89428,8375] 0 2024-04-19T02:18:30.591 INFO:tasks.workunit.client.0.smithi073.stdout:0/141: write d7/d14/f18 [172250,104398] 0 2024-04-19T02:18:30.591 INFO:tasks.workunit.client.0.smithi073.stdout:5/235: read d0/f15 [1121650,21782] 0 2024-04-19T02:18:30.592 INFO:tasks.workunit.client.0.smithi073.stdout:6/191: rmdir d8/de 39 2024-04-19T02:18:30.592 INFO:tasks.workunit.client.0.smithi073.stdout:4/232: rmdir da/d27 39 2024-04-19T02:18:30.592 INFO:tasks.workunit.client.0.smithi073.stdout:0/142: symlink d7/d14/l2a 0 2024-04-19T02:18:30.592 INFO:tasks.workunit.client.0.smithi073.stdout:3/291: link d3/d6/db/d1a/f4c d3/d6/db/d3a/d38/d43/f6a 0 2024-04-19T02:18:30.592 INFO:tasks.workunit.client.0.smithi073.stdout:0/143: chown d7/ca 19057 1 2024-04-19T02:18:30.593 INFO:tasks.workunit.client.0.smithi073.stdout:1/163: link db/l1e db/l40 0 2024-04-19T02:18:30.593 INFO:tasks.workunit.client.0.smithi073.stdout:4/233: rmdir da/d23/d2b 39 2024-04-19T02:18:30.593 INFO:tasks.workunit.client.0.smithi073.stdout:6/192: mkdir d8/d4b 0 2024-04-19T02:18:30.593 INFO:tasks.workunit.client.0.smithi073.stdout:1/164: chown db/f2f 998 1 2024-04-19T02:18:30.593 INFO:tasks.workunit.client.0.smithi073.stdout:3/292: chown d3/d6/fd 51 1 2024-04-19T02:18:30.593 INFO:tasks.workunit.client.0.smithi073.stdout:7/160: mkdir d0/dc/d33/d36 0 2024-04-19T02:18:30.593 INFO:tasks.workunit.client.0.smithi073.stdout:6/193: mknod d8/d30/c4c 0 2024-04-19T02:18:30.594 INFO:tasks.workunit.client.0.smithi073.stdout:4/234: truncate da/d27/d1b/d26/d2a/f47 500229 0 2024-04-19T02:18:30.596 INFO:tasks.workunit.client.0.smithi073.stdout:3/293: mknod d3/d6/db/d3a/d38/d43/d4e/c6b 0 2024-04-19T02:18:30.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/182: dwrite d5/d10/d14/d18/d3e/f32 [0,4194304] 0 2024-04-19T02:18:30.600 INFO:tasks.workunit.client.0.smithi073.stdout:1/165: dread f9 [0,4194304] 0 2024-04-19T02:18:30.600 INFO:tasks.workunit.client.0.smithi073.stdout:0/144: rmdir d7/d14 39 2024-04-19T02:18:30.600 INFO:tasks.workunit.client.0.smithi073.stdout:6/194: getdents d8/de/d22/d3b 0 2024-04-19T02:18:30.602 INFO:tasks.workunit.client.0.smithi073.stdout:3/294: chown d3/d6/db/d23/f3e 203 1 2024-04-19T02:18:30.602 INFO:tasks.workunit.client.0.smithi073.stdout:2/183: rename d5/fa to d5/d10/d14/d18/d39/f46 0 2024-04-19T02:18:30.602 INFO:tasks.workunit.client.0.smithi073.stdout:6/195: read d8/de/d35/f4a [54701,28342] 0 2024-04-19T02:18:30.603 INFO:tasks.workunit.client.0.smithi073.stdout:6/196: creat d8/de/f4d x:0 0 0 2024-04-19T02:18:30.604 INFO:tasks.workunit.client.0.smithi073.stdout:3/295: chown d3/d6/db/d23/c55 1837900 1 2024-04-19T02:18:30.604 INFO:tasks.workunit.client.0.smithi073.stdout:2/184: mknod d5/d10/d14/d18/d3e/d2d/d33/c47 0 2024-04-19T02:18:30.605 INFO:tasks.workunit.client.0.smithi073.stdout:7/161: dwrite d0/dc/d10/d2a/f2b [0,4194304] 0 2024-04-19T02:18:30.605 INFO:tasks.workunit.client.0.smithi073.stdout:3/296: chown d3/d6/db/c62 1057576433 1 2024-04-19T02:18:30.606 INFO:tasks.workunit.client.0.smithi073.stdout:5/236: dwrite d0/f9 [0,4194304] 0 2024-04-19T02:18:30.607 INFO:tasks.workunit.client.0.smithi073.stdout:0/145: read d7/d14/d17/d1a/f29 [375527,83664] 0 2024-04-19T02:18:30.607 INFO:tasks.workunit.client.0.smithi073.stdout:7/162: symlink d0/dc/d10/d15/l37 0 2024-04-19T02:18:30.608 INFO:tasks.workunit.client.0.smithi073.stdout:0/146: chown d7/d14 1005619 1 2024-04-19T02:18:30.608 INFO:tasks.workunit.client.0.smithi073.stdout:2/185: creat d5/d10/d14/d18/d3e/d2d/d33/f48 x:0 0 0 2024-04-19T02:18:30.609 INFO:tasks.workunit.client.0.smithi073.stdout:5/237: rename d0/d1d/l34 to d0/d1d/d1e/l52 0 2024-04-19T02:18:30.610 INFO:tasks.workunit.client.0.smithi073.stdout:2/186: truncate d5/f7 1579954 0 2024-04-19T02:18:30.610 INFO:tasks.workunit.client.0.smithi073.stdout:4/235: dwrite f1 [0,4194304] 0 2024-04-19T02:18:30.611 INFO:tasks.workunit.client.0.smithi073.stdout:0/147: rename c3 to d7/d14/d17/d1a/c2b 0 2024-04-19T02:18:30.614 INFO:tasks.workunit.client.0.smithi073.stdout:7/163: link d0/dc/d10/d2a/c34 d0/dc/d10/c38 0 2024-04-19T02:18:30.615 INFO:tasks.workunit.client.0.smithi073.stdout:2/187: link f3 d5/d10/d14/d18/d3e/f49 0 2024-04-19T02:18:30.615 INFO:tasks.workunit.client.0.smithi073.stdout:5/238: link d0/d1d/c4e d0/d1d/d1e/c53 0 2024-04-19T02:18:30.615 INFO:tasks.workunit.client.0.smithi073.stdout:6/197: dwrite d8/de/f28 [0,4194304] 0 2024-04-19T02:18:30.616 INFO:tasks.workunit.client.0.smithi073.stdout:3/297: dwrite d3/d6/db/f2d [0,4194304] 0 2024-04-19T02:18:30.617 INFO:tasks.workunit.client.0.smithi073.stdout:2/188: mknod d5/d10/d29/c4a 0 2024-04-19T02:18:30.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/239: rename d0/c3 to d0/d2d/c54 0 2024-04-19T02:18:30.617 INFO:tasks.workunit.client.0.smithi073.stdout:7/164: mkdir d0/dc/d39 0 2024-04-19T02:18:30.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/298: unlink d3/d6/db/d23/f3e 0 2024-04-19T02:18:30.619 INFO:tasks.workunit.client.0.smithi073.stdout:2/189: mknod d5/d10/d14/d18/c4b 0 2024-04-19T02:18:30.620 INFO:tasks.workunit.client.0.smithi073.stdout:0/148: dwrite d7/d14/f18 [0,4194304] 0 2024-04-19T02:18:30.621 INFO:tasks.workunit.client.0.smithi073.stdout:4/236: dwrite da/d23/d2b/f32 [0,4194304] 0 2024-04-19T02:18:30.624 INFO:tasks.workunit.client.0.smithi073.stdout:7/165: creat d0/dc/d10/d2a/f3a x:0 0 0 2024-04-19T02:18:30.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/190: stat d5/d10/d14/d18/d3e/f3c 0 2024-04-19T02:18:30.624 INFO:tasks.workunit.client.0.smithi073.stdout:3/299: truncate d3/d6/db/d3a/d38/d43/f6a 3325075 0 2024-04-19T02:18:30.627 INFO:tasks.workunit.client.0.smithi073.stdout:0/149: rename d7/fd to d7/f2c 0 2024-04-19T02:18:30.627 INFO:tasks.workunit.client.0.smithi073.stdout:3/300: read - d3/d6/db/d3a/f5c zero size 2024-04-19T02:18:30.628 INFO:tasks.workunit.client.0.smithi073.stdout:3/301: chown d3/d6/f1e 117 1 2024-04-19T02:18:30.629 INFO:tasks.workunit.client.0.smithi073.stdout:2/191: write d5/d10/d14/d18/d1e/f12 [3754843,28373] 0 2024-04-19T02:18:30.629 INFO:tasks.workunit.client.0.smithi073.stdout:0/150: creat d7/d14/f2d x:0 0 0 2024-04-19T02:18:30.630 INFO:tasks.workunit.client.0.smithi073.stdout:9/228: dread d0/fa [0,4194304] 0 2024-04-19T02:18:30.631 INFO:tasks.workunit.client.0.smithi073.stdout:0/151: write d7/f11 [3690609,79909] 0 2024-04-19T02:18:30.631 INFO:tasks.workunit.client.0.smithi073.stdout:5/240: dwrite d0/f1b [0,4194304] 0 2024-04-19T02:18:30.631 INFO:tasks.workunit.client.0.smithi073.stdout:3/302: write d3/d6/db/f4d [927686,42759] 0 2024-04-19T02:18:30.631 INFO:tasks.workunit.client.0.smithi073.stdout:9/229: creat d0/df/d1d/f5b x:0 0 0 2024-04-19T02:18:30.635 INFO:tasks.workunit.client.0.smithi073.stdout:5/241: fdatasync d0/d1d/d25/d37/f3e 0 2024-04-19T02:18:30.635 INFO:tasks.workunit.client.0.smithi073.stdout:3/303: dread - d3/d6/db/d3a/f5c zero size 2024-04-19T02:18:30.635 INFO:tasks.workunit.client.0.smithi073.stdout:3/304: readlink d3/d6/db/d1a/l3c 0 2024-04-19T02:18:30.635 INFO:tasks.workunit.client.0.smithi073.stdout:6/198: dwrite d8/f11 [0,4194304] 0 2024-04-19T02:18:30.636 INFO:tasks.workunit.client.0.smithi073.stdout:0/152: mknod d7/d14/d17/d1a/c2e 0 2024-04-19T02:18:30.639 INFO:tasks.workunit.client.0.smithi073.stdout:3/305: readlink d3/d6/db/l17 0 2024-04-19T02:18:30.640 INFO:tasks.workunit.client.0.smithi073.stdout:5/242: creat d0/d1d/d1e/f55 x:0 0 0 2024-04-19T02:18:30.640 INFO:tasks.workunit.client.0.smithi073.stdout:7/166: dwrite d0/dc/d33/f35 [0,4194304] 0 2024-04-19T02:18:30.641 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:30.636+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.641 INFO:tasks.workunit.client.0.smithi073.stdout:1/166: dread db/f18 [0,4194304] 0 2024-04-19T02:18:30.642 INFO:tasks.workunit.client.0.smithi073.stdout:9/230: truncate d0/df/d16/d1a/d2c/d2e/f53 687414 0 2024-04-19T02:18:30.642 INFO:tasks.workunit.client.0.smithi073.stdout:5/243: symlink d0/d1d/d25/l56 0 2024-04-19T02:18:30.643 INFO:tasks.workunit.client.0.smithi073.stdout:1/167: mkdir db/d41 0 2024-04-19T02:18:30.643 INFO:tasks.workunit.client.0.smithi073.stdout:2/192: dwrite d5/d10/d14/d18/d3e/d2d/d33/f48 [0,4194304] 0 2024-04-19T02:18:30.643 INFO:tasks.workunit.client.0.smithi073.stdout:0/153: creat d7/d14/d17/d1a/d21/f2f x:0 0 0 2024-04-19T02:18:30.644 INFO:tasks.workunit.client.0.smithi073.stdout:9/231: mkdir d0/df/d1d/d47/d5c 0 2024-04-19T02:18:30.644 INFO:tasks.workunit.client.0.smithi073.stdout:2/193: chown d5/f11 646580116 1 2024-04-19T02:18:30.646 INFO:tasks.workunit.client.0.smithi073.stdout:2/194: symlink d5/d10/d14/d18/l4c 0 2024-04-19T02:18:30.647 INFO:tasks.workunit.client.0.smithi073.stdout:7/167: dread d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.647 INFO:tasks.workunit.client.0.smithi073.stdout:5/244: creat d0/d2d/f57 x:0 0 0 2024-04-19T02:18:30.647 INFO:tasks.workunit.client.0.smithi073.stdout:2/195: rmdir d5/d10 39 2024-04-19T02:18:30.647 INFO:tasks.workunit.client.0.smithi073.stdout:7/168: chown d0/f8 2870 1 2024-04-19T02:18:30.648 INFO:tasks.workunit.client.0.smithi073.stdout:9/232: rename d0/df/d16/d1a/d3c to d0/df/d16/d19/d38/d5d 0 2024-04-19T02:18:30.648 INFO:tasks.workunit.client.0.smithi073.stdout:6/199: dread d8/f11 [0,4194304] 0 2024-04-19T02:18:30.648 INFO:tasks.workunit.client.0.smithi073.stdout:5/245: symlink d0/d1d/d25/d37/l58 0 2024-04-19T02:18:30.649 INFO:tasks.workunit.client.0.smithi073.stdout:2/196: creat d5/d10/d14/d18/f4d x:0 0 0 2024-04-19T02:18:30.649 INFO:tasks.workunit.client.0.smithi073.stdout:7/169: rename d0/dc/d10/d15/f17 to d0/dc/d33/d36/f3b 0 2024-04-19T02:18:30.650 INFO:tasks.workunit.client.0.smithi073.stdout:6/200: creat d8/f4e x:0 0 0 2024-04-19T02:18:30.650 INFO:tasks.workunit.client.0.smithi073.stdout:7/170: fdatasync d0/f8 0 2024-04-19T02:18:30.650 INFO:tasks.workunit.client.0.smithi073.stdout:2/197: mknod d5/d10/d14/d18/d3e/d2d/c4e 0 2024-04-19T02:18:30.651 INFO:tasks.workunit.client.0.smithi073.stdout:6/201: stat d8/de/c15 0 2024-04-19T02:18:30.652 INFO:tasks.workunit.client.0.smithi073.stdout:0/154: dwrite d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:30.653 INFO:tasks.workunit.client.0.smithi073.stdout:2/198: rename d5/f13 to d5/d10/d14/d18/d3e/d2d/d33/f4f 0 2024-04-19T02:18:30.655 INFO:tasks.workunit.client.0.smithi073.stdout:2/199: symlink d5/d10/d14/d18/d3e/d2d/l50 0 2024-04-19T02:18:30.655 INFO:tasks.workunit.client.0.smithi073.stdout:9/233: dwrite d0/f50 [0,4194304] 0 2024-04-19T02:18:30.655 INFO:tasks.workunit.client.0.smithi073.stdout:0/155: truncate d7/d14/d17/d1a/d20/f27 759853 0 2024-04-19T02:18:30.656 INFO:tasks.workunit.client.0.smithi073.stdout:9/234: chown d0/f6 0 1 2024-04-19T02:18:30.657 INFO:tasks.workunit.client.0.smithi073.stdout:6/202: dread d8/de/f1f [0,4194304] 0 2024-04-19T02:18:30.658 INFO:tasks.workunit.client.0.smithi073.stdout:9/235: write d0/df/d16/d19/d38/d5d/f4e [263586,121926] 0 2024-04-19T02:18:30.659 INFO:tasks.workunit.client.0.smithi073.stdout:6/203: creat d8/de/d22/d3b/f4f x:0 0 0 2024-04-19T02:18:30.660 INFO:tasks.workunit.client.0.smithi073.stdout:6/204: chown d8/l3c 2572 1 2024-04-19T02:18:30.660 INFO:tasks.workunit.client.0.smithi073.stdout:9/236: mkdir d0/df/d16/d19/d38/d5d/d5e 0 2024-04-19T02:18:30.661 INFO:tasks.workunit.client.0.smithi073.stdout:6/205: mknod d8/c50 0 2024-04-19T02:18:30.662 INFO:tasks.workunit.client.0.smithi073.stdout:6/206: mknod d8/de/c51 0 2024-04-19T02:18:30.662 INFO:tasks.workunit.client.0.smithi073.stdout:6/207: fsync d8/de/d35/f4a 0 2024-04-19T02:18:30.663 INFO:tasks.workunit.client.0.smithi073.stdout:9/237: dread d0/df/f41 [0,4194304] 0 2024-04-19T02:18:30.663 INFO:tasks.workunit.client.0.smithi073.stdout:6/208: mknod d8/de/d22/d3b/c52 0 2024-04-19T02:18:30.664 INFO:tasks.workunit.client.0.smithi073.stdout:6/209: chown d8/de/d22/d3b 4849425 1 2024-04-19T02:18:30.664 INFO:tasks.workunit.client.0.smithi073.stdout:9/238: mknod d0/df/d16/d19/c5f 0 2024-04-19T02:18:30.664 INFO:tasks.workunit.client.0.smithi073.stdout:8/159: sync 2024-04-19T02:18:30.664 INFO:tasks.workunit.client.0.smithi073.stdout:6/210: chown d8/de/d22/f34 239940 1 2024-04-19T02:18:30.664 INFO:tasks.workunit.client.0.smithi073.stdout:5/246: sync 2024-04-19T02:18:30.664 INFO:tasks.workunit.client.0.smithi073.stdout:5/247: read d0/f1b [1609053,64153] 0 2024-04-19T02:18:30.665 INFO:tasks.workunit.client.0.smithi073.stdout:8/160: symlink d14/d27/l2b 0 2024-04-19T02:18:30.665 INFO:tasks.workunit.client.0.smithi073.stdout:5/248: write d0/d1d/f2a [126454,50532] 0 2024-04-19T02:18:30.668 INFO:tasks.workunit.client.0.smithi073.stdout:5/249: write d0/d1d/d25/d35/d39/f4c [1696869,22746] 0 2024-04-19T02:18:30.669 INFO:tasks.workunit.client.0.smithi073.stdout:5/250: rename d0/d1d/d25/c28 to d0/d1d/d25/d37/c59 0 2024-04-19T02:18:30.670 INFO:tasks.workunit.client.0.smithi073.stdout:6/211: dread d8/f11 [0,4194304] 0 2024-04-19T02:18:30.670 INFO:tasks.workunit.client.0.smithi073.stdout:5/251: symlink d0/d1d/d25/d37/l5a 0 2024-04-19T02:18:30.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/252: dread - d0/d1d/f4a zero size 2024-04-19T02:18:30.671 INFO:tasks.workunit.client.0.smithi073.stdout:6/212: symlink d8/de/l53 0 2024-04-19T02:18:30.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/253: chown d0/d1d/d1e 514687 1 2024-04-19T02:18:30.672 INFO:tasks.workunit.client.0.smithi073.stdout:5/254: symlink d0/d1d/d25/d37/l5b 0 2024-04-19T02:18:30.672 INFO:tasks.workunit.client.0.smithi073.stdout:8/161: dwrite fe [4194304,4194304] 0 2024-04-19T02:18:30.674 INFO:tasks.workunit.client.0.smithi073.stdout:5/255: unlink d0/d1d/d1e/l52 0 2024-04-19T02:18:30.674 INFO:tasks.workunit.client.0.smithi073.stdout:8/162: truncate d14/f16 5190490 0 2024-04-19T02:18:30.674 INFO:tasks.workunit.client.0.smithi073.stdout:8/163: chown d14/d15/d17/f1f 905 1 2024-04-19T02:18:30.675 INFO:tasks.workunit.client.0.smithi073.stdout:8/164: rename fe to d14/d15/d17/f2c 0 2024-04-19T02:18:30.675 INFO:tasks.workunit.client.0.smithi073.stdout:4/237: dread da/f18 [0,4194304] 0 2024-04-19T02:18:30.676 INFO:tasks.workunit.client.0.smithi073.stdout:8/165: symlink d14/d27/d29/l2d 0 2024-04-19T02:18:30.676 INFO:tasks.workunit.client.0.smithi073.stdout:4/238: creat da/d27/d36/f51 x:0 0 0 2024-04-19T02:18:30.680 INFO:tasks.workunit.client.0.smithi073.stdout:8/166: dread - d14/d15/f26 zero size 2024-04-19T02:18:30.680 INFO:tasks.workunit.client.0.smithi073.stdout:8/167: creat d14/d27/f2e x:0 0 0 2024-04-19T02:18:30.680 INFO:tasks.workunit.client.0.smithi073.stdout:8/168: symlink d14/l2f 0 2024-04-19T02:18:30.680 INFO:tasks.workunit.client.0.smithi073.stdout:3/306: sync 2024-04-19T02:18:30.680 INFO:tasks.workunit.client.0.smithi073.stdout:5/256: dread d0/d1d/d25/d35/f42 [0,4194304] 0 2024-04-19T02:18:30.681 INFO:tasks.workunit.client.0.smithi073.stdout:3/307: unlink d3/d6/db/d3a/d38/d43/l44 0 2024-04-19T02:18:30.684 INFO:tasks.workunit.client.0.smithi073.stdout:5/257: getdents d0/d1d/d25/d35/d39 0 2024-04-19T02:18:30.685 INFO:tasks.workunit.client.0.smithi073.stdout:5/258: creat d0/d1d/f5c x:0 0 0 2024-04-19T02:18:30.685 INFO:tasks.workunit.client.0.smithi073.stdout:4/239: dwrite da/d27/d36/f51 [0,4194304] 0 2024-04-19T02:18:30.685 INFO:tasks.workunit.client.0.smithi073.stdout:8/169: dwrite d14/f19 [0,4194304] 0 2024-04-19T02:18:30.685 INFO:tasks.workunit.client.0.smithi073.stdout:4/240: fdatasync da/d27/d1b/d1d/f29 0 2024-04-19T02:18:30.685 INFO:tasks.workunit.client.0.smithi073.stdout:8/170: read f11 [263896,113403] 0 2024-04-19T02:18:30.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/171: creat d14/d27/f30 x:0 0 0 2024-04-19T02:18:30.688 INFO:tasks.workunit.client.0.smithi073.stdout:8/172: mkdir d14/d27/d29/d31 0 2024-04-19T02:18:30.689 INFO:tasks.workunit.client.0.smithi073.stdout:3/308: dwrite d3/f41 [0,4194304] 0 2024-04-19T02:18:30.690 INFO:tasks.workunit.client.0.smithi073.stdout:8/173: write d14/d15/d17/f21 [964848,16763] 0 2024-04-19T02:18:30.691 INFO:tasks.workunit.client.0.smithi073.stdout:5/259: dwrite d0/d1d/f4a [0,4194304] 0 2024-04-19T02:18:30.692 INFO:tasks.workunit.client.0.smithi073.stdout:8/174: mknod d14/d27/c32 0 2024-04-19T02:18:30.692 INFO:tasks.workunit.client.0.smithi073.stdout:3/309: unlink d3/d6/db/d1a/d54/l59 0 2024-04-19T02:18:30.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/260: fsync d0/f9 0 2024-04-19T02:18:30.693 INFO:tasks.workunit.client.0.smithi073.stdout:5/261: unlink d0/c3c 0 2024-04-19T02:18:30.693 INFO:tasks.workunit.client.0.smithi073.stdout:9/239: dread d0/df/d16/d1a/f3b [0,4194304] 0 2024-04-19T02:18:30.693 INFO:tasks.workunit.client.0.smithi073.stdout:5/262: creat d0/f5d x:0 0 0 2024-04-19T02:18:30.694 INFO:tasks.workunit.client.0.smithi073.stdout:9/240: unlink d0/c42 0 2024-04-19T02:18:30.694 INFO:tasks.workunit.client.0.smithi073.stdout:4/241: dwrite da/d27/d1b/d26/f4a [0,4194304] 0 2024-04-19T02:18:30.694 INFO:tasks.workunit.client.0.smithi073.stdout:5/263: creat d0/d1d/d24/f5e x:0 0 0 2024-04-19T02:18:30.695 INFO:tasks.workunit.client.0.smithi073.stdout:1/168: rmdir db 39 2024-04-19T02:18:30.695 INFO:tasks.workunit.client.0.smithi073.stdout:4/242: fdatasync f8 0 2024-04-19T02:18:30.696 INFO:tasks.workunit.client.0.smithi073.stdout:9/241: write d0/df/d16/d1a/d2c/f56 [913004,47958] 0 2024-04-19T02:18:30.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/171: write d0/dc/f1f [3958723,105277] 0 2024-04-19T02:18:30.698 INFO:tasks.workunit.client.0.smithi073.stdout:6/213: truncate d8/de/f1f 717210 0 2024-04-19T02:18:30.699 INFO:tasks.workunit.client.0.smithi073.stdout:5/264: symlink d0/d1d/l5f 0 2024-04-19T02:18:30.699 INFO:tasks.workunit.client.0.smithi073.stdout:4/243: mknod da/d27/d1b/c52 0 2024-04-19T02:18:30.701 INFO:tasks.workunit.client.0.smithi073.stdout:9/242: mkdir d0/df/d60 0 2024-04-19T02:18:30.701 INFO:tasks.workunit.client.0.smithi073.stdout:1/169: mknod db/d1c/d2c/c42 0 2024-04-19T02:18:30.701 INFO:tasks.workunit.client.0.smithi073.stdout:6/214: write d8/de/d35/f49 [434235,85302] 0 2024-04-19T02:18:30.702 INFO:tasks.workunit.client.0.smithi073.stdout:7/172: creat d0/f3c x:0 0 0 2024-04-19T02:18:30.702 INFO:tasks.workunit.client.0.smithi073.stdout:5/265: read d0/d1d/d25/d35/f42 [135205,2060] 0 2024-04-19T02:18:30.702 INFO:tasks.workunit.client.0.smithi073.stdout:7/173: chown d0/d3/c29 0 1 2024-04-19T02:18:30.702 INFO:tasks.workunit.client.0.smithi073.stdout:0/156: dwrite d7/d14/d17/f1f [0,4194304] 0 2024-04-19T02:18:30.702 INFO:tasks.workunit.client.0.smithi073.stdout:1/170: rename db/ce to db/d3e/c43 0 2024-04-19T02:18:30.703 INFO:tasks.workunit.client.0.smithi073.stdout:1/171: sync 2024-04-19T02:18:30.704 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:30.704 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:30.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.704 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11240 4.22 4:443fef88:::100000032de.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:30.704 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.666827+0000", 2024-04-19T02:18:30.704 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.038128487000000003, 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038168379000000002, 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11240 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.666827+0000", 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:30.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.666827+0000", 2024-04-19T02:18:30.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.666826+0000", 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.671200+0000", 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043739470000000004 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.671215+0000", 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5078e-05 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.671224+0000", 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6930000000000002e-06 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:30.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.671955+0000", 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00073030199999999995 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.672097+0000", 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014249799999999999 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:11253 4.2d e63/16 4:b50f5597:::100000031e9.00000000:head v 63'185, mlcod=63'183)", 2024-04-19T02:18:30.709 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.673881+0000", 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031074714, 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031207249999999999, 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.673881+0000", 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.673881+0000", 2024-04-19T02:18:30.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.673880+0000", 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.673906+0000", 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5822000000000001e-05 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:30.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.673918+0000", 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1984000000000001e-05 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.673924+0000", 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2949999999999999e-06 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.673982+0000", 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7436999999999999e-05 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.674006+0000", 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4737e-05 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11243 4.3 4:c3e59f12:::100000031d5.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.671246+0000", 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033709355000000003, 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033920046000000002, 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:30.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11243 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.671246+0000", 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:30.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.671246+0000", 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.671245+0000", 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678063+0000", 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068187229999999996 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678083+0000", 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9117e-05 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678094+0000", 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.114e-05 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678155+0000", 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0769e-05 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678259+0000", 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104425 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11254 4.25 4:a54b332f:::100000031aa.00000001:head [write 0~4194304 [2@0] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.678140+0000", 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026815391000000001, 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027114004000000001, 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:30.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11254 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678140+0000", 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:30.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678140+0000", 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.678140+0000", 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.681626+0000", 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003486528 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.681645+0000", 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9196999999999999e-05 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.681656+0000", 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1076e-05 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.683145+0000", 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014881219999999999 2024-04-19T02:18:30.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.683517+0000", 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00037251299999999999 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11264 4.22 4:44c0b2e7:::100000032fc.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.693539+0000", 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011416789, 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011798754999999999, 2024-04-19T02:18:30.721 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11264 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.693539+0000", 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.693539+0000", 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.693538+0000", 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.698646+0000", 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051079439999999997 2024-04-19T02:18:30.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.698659+0000", 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3220999999999999e-05 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.698666+0000", 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2999999999999998e-06 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.701561+0000", 2024-04-19T02:18:30.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0028957929999999998 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.701724+0000", 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016248200000000001 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:815 3.0 3:07a02702:::200.0000000c:head [write 297223~24979 [fadvise_dontneed] in=24979b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.704418+0000", 2024-04-19T02:18:30.725 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00053730800000000001, 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001000826, 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704418+0000", 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704418+0000", 2024-04-19T02:18:30.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704416+0000", 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704441+0000", 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4994000000000002e-05 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:30.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704457+0000", 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6053999999999999e-05 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704466+0000", 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3529999999999995e-06 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704537+0000", 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1645999999999998e-05 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:30.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.704641+0000", 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103124 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 6 2024-04-19T02:18:30.729 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:30.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:9/243: rename d0/c58 to d0/df/d1d/c61 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/157: mknod d7/d14/d17/c30 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:1/172: creat db/d1c/d2c/f44 x:0 0 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:4/244: link da/d27/d1b/d1d/c24 da/d23/d2b/d2f/c53 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:5/266: link d0/d1d/d1e/f55 d0/d2d/f60 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:1/173: chown f3 151753061 1 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:6/215: link d8/l38 d8/de/d22/d3b/l54 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:9/244: mknod d0/df/d16/c62 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/158: unlink d7/d14/d17/d1a/d21/f2f 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:9/245: chown d0/df/d60 9 1 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:4/245: mkdir da/d23/d2b/d54 0 2024-04-19T02:18:30.738 INFO:tasks.workunit.client.0.smithi073.stdout:6/216: symlink d8/de/d22/d3b/l55 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:5/267: getdents d0/d1d/d25/d37 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:6/217: mknod d8/d30/c56 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:4/246: chown da/d27/d1b/c52 3521252 1 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:0/159: symlink d7/d14/d17/l31 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:5/268: chown d0/d1d 4186178 1 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:6/218: readlink l6 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:0/160: truncate f5 5214811 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:6/219: dread d8/de/d22/f31 [0,4194304] 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:9/246: rmdir d0/df/d1d 39 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:4/247: dread da/d27/d36/f3f [0,4194304] 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:0/161: link f5 d7/d14/d17/d1a/d21/f32 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:6/220: link d8/de/f4d d8/de/d35/f57 0 2024-04-19T02:18:30.739 INFO:tasks.workunit.client.0.smithi073.stdout:4/248: mknod da/d23/d3d/c55 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:1/174: dwrite db/f23 [0,4194304] 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/162: link d7/f11 d7/d14/d17/f33 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/163: sync 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:1/175: chown l7 6627 1 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:4/249: dread - da/d27/d1b/d1d/f42 zero size 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/164: chown f4 1444 1 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/165: unlink d7/ca 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/166: sync 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:1/176: creat db/d1c/d2c/f45 x:0 0 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:4/250: write da/d27/d1b/d26/d2a/f47 [74137,65913] 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/167: read - d7/d14/f2d zero size 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:7/174: dread d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:9/247: truncate d0/fc 1720196 0 2024-04-19T02:18:30.740 INFO:tasks.workunit.client.0.smithi073.stdout:1/177: rename db/l15 to db/d1c/d2c/l46 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:6/221: truncate d8/de/f1f 320365 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:7/175: fsync d0/dc/d33/d36/f3b 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:5/269: dread d0/d1d/d25/d35/d39/f4c [0,4194304] 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:4/251: truncate da/d27/d1b/d1d/f29 2886585 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:9/248: rename d0/df/d16/d19/f57 to d0/df/d16/d1a/f63 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:7/176: write d0/dc/f26 [1954617,128551] 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:7/177: readlink d0/d3/l1e 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:4/252: symlink da/d27/d1b/d26/d2a/l56 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:5/270: getdents d0/d1d 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:7/178: chown d0/d3/l1b 114453 1 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:5/271: readlink d0/d1d/d25/d37/l50 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:4/253: chown da/d27/d1b/d1d/c24 457638 1 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:0/168: read f4 [346590,86909] 0 2024-04-19T02:18:30.741 INFO:tasks.workunit.client.0.smithi073.stdout:5/272: write d0/f41 [64656,113281] 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:5/273: mkdir d0/d1d/d24/d61 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/169: chown d7/d14/d17/d1a/d21/c26 14 1 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:5/274: readlink d0/d1d/l23 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:9/249: dread d0/df/f40 [0,4194304] 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:6/222: dwrite d8/f18 [0,4194304] 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/170: symlink d7/d14/d17/d1a/l34 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:6/223: write d8/de/d35/f3d [735783,82623] 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/171: fsync f2 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:1/178: truncate db/f18 3394503 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:6/224: rename d8/d30 to d8/de/d58 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/172: write d7/d14/f18 [4049639,62749] 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/173: symlink d7/d14/d17/d1a/d21/l35 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/174: stat d7/d14/f15 0 2024-04-19T02:18:30.742 INFO:tasks.workunit.client.0.smithi073.stdout:3/310: dread d3/d6/d11/f2e [0,4194304] 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:4/254: truncate da/d27/d1b/d1d/f29 3187163 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:8/175: fdatasync d14/f19 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:1/179: dwrite db/ff [0,4194304] 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:6/225: dwrite d8/de/d35/f3d [0,4194304] 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:3/311: truncate d3/d6/db/d1a/f4c 4267877 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:1/180: write db/f2a [312274,34769] 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:8/176: write d14/d15/d17/f2c [7708368,33665] 0 2024-04-19T02:18:30.743 INFO:tasks.workunit.client.0.smithi073.stdout:9/250: dwrite d0/df/d1d/f44 [0,4194304] 0 2024-04-19T02:18:30.744 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:30.740+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.746 INFO:tasks.workunit.client.0.smithi073.stdout:4/255: rename da/d27/l1e to da/d27/d1b/d26/d2a/l57 0 2024-04-19T02:18:30.746 INFO:tasks.workunit.client.0.smithi073.stdout:6/226: write d8/de/f2a [585277,100259] 0 2024-04-19T02:18:30.746 INFO:tasks.workunit.client.0.smithi073.stdout:3/312: mknod d3/c6c 0 2024-04-19T02:18:30.746 INFO:tasks.workunit.client.0.smithi073.stdout:8/177: rmdir d14/d27 39 2024-04-19T02:18:30.746 INFO:tasks.workunit.client.0.smithi073.stdout:1/181: unlink db/f11 0 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:4/256: chown da/d27/d36/d4d 694324 1 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:6/227: chown d8/de/d22/f34 9332565 1 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:3/313: dread - d3/d6/db/d3a/d38/f53 zero size 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:5/275: sync 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:8/178: mkdir d14/d33 0 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/251: write d0/df/d16/d1a/f3a [1272766,89733] 0 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:0/175: write f4 [2767061,26850] 0 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:4/257: mknod da/d27/d3a/d49/c58 0 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/252: creat d0/df/d16/f64 x:0 0 0 2024-04-19T02:18:30.747 INFO:tasks.workunit.client.0.smithi073.stdout:0/176: creat d7/d14/d17/d1a/d21/f36 x:0 0 0 2024-04-19T02:18:30.748 INFO:tasks.workunit.client.0.smithi073.stdout:4/258: symlink da/d27/d1b/l59 0 2024-04-19T02:18:30.748 INFO:tasks.workunit.client.0.smithi073.stdout:8/179: getdents d14/d27 0 2024-04-19T02:18:30.748 INFO:tasks.workunit.client.0.smithi073.stdout:9/253: creat d0/df/d1d/f65 x:0 0 0 2024-04-19T02:18:30.748 INFO:tasks.workunit.client.0.smithi073.stdout:3/314: dwrite d3/d6/d11/f26 [0,4194304] 0 2024-04-19T02:18:30.750 INFO:tasks.workunit.client.0.smithi073.stdout:0/177: truncate d7/f25 437857 0 2024-04-19T02:18:30.750 INFO:tasks.workunit.client.0.smithi073.stdout:8/180: mkdir d14/d27/d29/d31/d34 0 2024-04-19T02:18:30.751 INFO:tasks.workunit.client.0.smithi073.stdout:1/182: dwrite db/f36 [0,4194304] 0 2024-04-19T02:18:30.752 INFO:tasks.workunit.client.0.smithi073.stdout:6/228: dwrite d8/de/d22/f3a [4194304,4194304] 0 2024-04-19T02:18:30.752 INFO:tasks.workunit.client.0.smithi073.stdout:3/315: creat d3/d6/f6d x:0 0 0 2024-04-19T02:18:30.752 INFO:tasks.workunit.client.0.smithi073.stdout:8/181: creat d14/d15/f35 x:0 0 0 2024-04-19T02:18:30.753 INFO:tasks.workunit.client.0.smithi073.stdout:1/183: creat db/d3e/f47 x:0 0 0 2024-04-19T02:18:30.753 INFO:tasks.workunit.client.0.smithi073.stdout:3/316: creat d3/d6/db/d3a/d38/d40/f6e x:0 0 0 2024-04-19T02:18:30.754 INFO:tasks.workunit.client.0.smithi073.stdout:8/182: rename d14/d15/d17/f23 to d14/d27/d29/f36 0 2024-04-19T02:18:30.754 INFO:tasks.workunit.client.0.smithi073.stdout:3/317: write d3/f5 [4500476,27666] 0 2024-04-19T02:18:30.755 INFO:tasks.workunit.client.0.smithi073.stdout:8/183: symlink d14/d27/l37 0 2024-04-19T02:18:30.755 INFO:tasks.workunit.client.0.smithi073.stdout:1/184: creat db/d41/f48 x:0 0 0 2024-04-19T02:18:30.756 INFO:tasks.workunit.client.0.smithi073.stdout:3/318: mkdir d3/d6/db/d3a/d38/d6f 0 2024-04-19T02:18:30.757 INFO:tasks.workunit.client.0.smithi073.stdout:7/179: fdatasync d0/dc/f26 0 2024-04-19T02:18:30.757 INFO:tasks.workunit.client.0.smithi073.stdout:1/185: rename db/l27 to db/d1c/l49 0 2024-04-19T02:18:30.758 INFO:tasks.workunit.client.0.smithi073.stdout:7/180: mknod d0/d28/c3d 0 2024-04-19T02:18:30.758 INFO:tasks.workunit.client.0.smithi073.stdout:3/319: creat d3/d6/db/d3a/f70 x:0 0 0 2024-04-19T02:18:30.758 INFO:tasks.workunit.client.0.smithi073.stdout:0/178: dread d7/d14/d17/f1f [0,4194304] 0 2024-04-19T02:18:30.759 INFO:tasks.workunit.client.0.smithi073.stdout:3/320: mknod d3/d6/c71 0 2024-04-19T02:18:30.760 INFO:tasks.workunit.client.0.smithi073.stdout:0/179: fsync d7/d14/d17/f1f 0 2024-04-19T02:18:30.761 INFO:tasks.workunit.client.0.smithi073.stdout:6/229: dwrite d8/de/d35/f3d [0,4194304] 0 2024-04-19T02:18:30.761 INFO:tasks.workunit.client.0.smithi073.stdout:3/321: getdents d3/d6/db/d23 0 2024-04-19T02:18:30.762 INFO:tasks.workunit.client.0.smithi073.stdout:0/180: symlink d7/d14/d17/d1a/d21/l37 0 2024-04-19T02:18:30.762 INFO:tasks.workunit.client.0.smithi073.stdout:6/230: chown d8/de/d35/f49 428084688 1 2024-04-19T02:18:30.763 INFO:tasks.workunit.client.0.smithi073.stdout:6/231: stat d8/de/ff 0 2024-04-19T02:18:30.763 INFO:tasks.workunit.client.0.smithi073.stdout:3/322: rmdir d3/d6/db/d3a/d38/d43/d4e 39 2024-04-19T02:18:30.763 INFO:tasks.workunit.client.0.smithi073.stdout:7/181: dread d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.764 INFO:tasks.workunit.client.0.smithi073.stdout:7/182: chown d0/dc/d33 0 1 2024-04-19T02:18:30.764 INFO:tasks.workunit.client.0.smithi073.stdout:7/183: fdatasync d0/f1d 0 2024-04-19T02:18:30.764 INFO:tasks.workunit.client.0.smithi073.stdout:6/232: dread d8/de/d22/f31 [0,4194304] 0 2024-04-19T02:18:30.765 INFO:tasks.workunit.client.0.smithi073.stdout:0/181: getdents d7/d14/d17/d1a 0 2024-04-19T02:18:30.765 INFO:tasks.workunit.client.0.smithi073.stdout:1/186: dwrite db/d3e/f3f [0,4194304] 0 2024-04-19T02:18:30.765 INFO:tasks.workunit.client.0.smithi073.stdout:6/233: chown d8/de/d58 5167662 1 2024-04-19T02:18:30.765 INFO:tasks.workunit.client.0.smithi073.stdout:3/323: rename d3/c64 to d3/d6/db/c72 0 2024-04-19T02:18:30.766 INFO:tasks.workunit.client.0.smithi073.stdout:7/184: stat d0/dc/d10/d2a/f3a 0 2024-04-19T02:18:30.766 INFO:tasks.workunit.client.0.smithi073.stdout:1/187: symlink db/d41/l4a 0 2024-04-19T02:18:30.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/182: write d7/d14/f2d [282605,47094] 0 2024-04-19T02:18:30.767 INFO:tasks.workunit.client.0.smithi073.stdout:6/234: write d8/de/f1e [1773432,51494] 0 2024-04-19T02:18:30.768 INFO:tasks.workunit.client.0.smithi073.stdout:7/185: creat d0/dc/d10/d15/f3e x:0 0 0 2024-04-19T02:18:30.770 INFO:tasks.workunit.client.0.smithi073.stdout:0/183: unlink d7/d14/d17/d1a/c2e 0 2024-04-19T02:18:30.770 INFO:tasks.workunit.client.0.smithi073.stdout:1/188: dread db/ff [0,4194304] 0 2024-04-19T02:18:30.774 INFO:tasks.workunit.client.0.smithi073.stdout:0/184: symlink d7/l38 0 2024-04-19T02:18:30.774 INFO:tasks.workunit.client.0.smithi073.stdout:6/235: symlink d8/d4b/l59 0 2024-04-19T02:18:30.775 INFO:tasks.workunit.client.0.smithi073.stdout:8/184: truncate d14/d15/d17/f2c 2426036 0 2024-04-19T02:18:30.775 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:30.776 INFO:tasks.workunit.client.0.smithi073.stdout:6/236: write d8/de/ff [1329604,26573] 0 2024-04-19T02:18:30.776 INFO:tasks.workunit.client.0.smithi073.stdout:8/185: truncate d14/d15/f35 423178 0 2024-04-19T02:18:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:30.777 INFO:tasks.workunit.client.0.smithi073.stdout:7/186: dwrite d0/f1d [4194304,4194304] 0 2024-04-19T02:18:30.777 INFO:tasks.workunit.client.0.smithi073.stdout:6/237: stat d8/f4e 0 2024-04-19T02:18:30.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/186: chown d14/d27 522957 1 2024-04-19T02:18:30.777 INFO:tasks.workunit.client.0.smithi073.stdout:9/254: dwrite d0/df/d1d/f33 [0,4194304] 0 2024-04-19T02:18:30.777 INFO:tasks.workunit.client.0.smithi073.stdout:6/238: mknod d8/de/d35/c5a 0 2024-04-19T02:18:30.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/187: write d14/d15/f26 [939418,13703] 0 2024-04-19T02:18:30.778 INFO:tasks.workunit.client.0.smithi073.stdout:6/239: creat d8/de/d35/f5b x:0 0 0 2024-04-19T02:18:30.779 INFO:tasks.workunit.client.0.smithi073.stdout:6/240: mknod d8/de/d22/c5c 0 2024-04-19T02:18:30.779 INFO:tasks.workunit.client.0.smithi073.stdout:1/189: dwrite db/ff [0,4194304] 0 2024-04-19T02:18:30.779 INFO:tasks.workunit.client.0.smithi073.stdout:6/241: creat d8/de/d35/f5d x:0 0 0 2024-04-19T02:18:30.780 INFO:tasks.workunit.client.0.smithi073.stdout:1/190: unlink db/f23 0 2024-04-19T02:18:30.780 INFO:tasks.workunit.client.0.smithi073.stdout:1/191: stat db/l10 0 2024-04-19T02:18:30.781 INFO:tasks.workunit.client.0.smithi073.stdout:1/192: symlink db/d1c/d2c/l4b 0 2024-04-19T02:18:30.782 INFO:tasks.workunit.client.0.smithi073.stdout:1/193: chown db/f36 101977 1 2024-04-19T02:18:30.783 INFO:tasks.workunit.client.0.smithi073.stdout:1/194: rename db/f35 to db/d41/f4c 0 2024-04-19T02:18:30.783 INFO:tasks.workunit.client.0.smithi073.stdout:1/195: dread - db/d1c/f3b zero size 2024-04-19T02:18:30.783 INFO:tasks.workunit.client.0.smithi073.stdout:9/255: dwrite d0/df/d16/f64 [0,4194304] 0 2024-04-19T02:18:30.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/196: rename db/d1c/c22 to db/d1c/d2c/c4d 0 2024-04-19T02:18:30.784 INFO:tasks.workunit.client.0.smithi073.stdout:9/256: creat d0/df/d16/d19/d38/f66 x:0 0 0 2024-04-19T02:18:30.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/197: chown db/f2f 3 1 2024-04-19T02:18:30.784 INFO:tasks.workunit.client.0.smithi073.stdout:1/198: mknod db/d41/c4e 0 2024-04-19T02:18:30.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/199: symlink db/d1c/l4f 0 2024-04-19T02:18:30.785 INFO:tasks.workunit.client.0.smithi073.stdout:9/257: getdents d0/df/d16/d19/d38/d5d 0 2024-04-19T02:18:30.786 INFO:tasks.workunit.client.0.smithi073.stdout:1/200: chown db/d1c/d2c/l46 56257474 1 2024-04-19T02:18:30.786 INFO:tasks.workunit.client.0.smithi073.stdout:1/201: mkdir db/d1c/d2c/d50 0 2024-04-19T02:18:30.788 INFO:tasks.workunit.client.0.smithi073.stdout:9/258: dread d0/df/f40 [0,4194304] 0 2024-04-19T02:18:30.793 INFO:tasks.workunit.client.0.smithi073.stdout:3/324: write d3/d6/d11/f2e [1668876,116797] 0 2024-04-19T02:18:30.795 INFO:tasks.workunit.client.0.smithi073.stdout:9/259: dwrite d0/df/d16/d1a/f37 [0,4194304] 0 2024-04-19T02:18:30.795 INFO:tasks.workunit.client.0.smithi073.stdout:3/325: mknod d3/d6/db/c73 0 2024-04-19T02:18:30.796 INFO:tasks.workunit.client.0.smithi073.stdout:9/260: symlink d0/df/d16/d19/d38/d5d/d45/l67 0 2024-04-19T02:18:30.796 INFO:tasks.workunit.client.0.smithi073.stdout:3/326: fsync d3/d6/db/d3a/d38/f53 0 2024-04-19T02:18:30.797 INFO:tasks.workunit.client.0.smithi073.stdout:9/261: write d0/df/d1d/f32 [619460,21297] 0 2024-04-19T02:18:30.798 INFO:tasks.workunit.client.0.smithi073.stdout:0/185: dwrite d7/f11 [0,4194304] 0 2024-04-19T02:18:30.798 INFO:tasks.workunit.client.0.smithi073.stdout:3/327: creat d3/d6/db/d16/f74 x:0 0 0 2024-04-19T02:18:30.800 INFO:tasks.workunit.client.0.smithi073.stdout:9/262: mkdir d0/df/d68 0 2024-04-19T02:18:30.801 INFO:tasks.workunit.client.0.smithi073.stdout:3/328: truncate d3/f3d 2166324 0 2024-04-19T02:18:30.801 INFO:tasks.workunit.client.0.smithi073.stdout:0/186: truncate d7/d14/d17/f33 4826509 0 2024-04-19T02:18:30.804 INFO:tasks.workunit.client.0.smithi073.stdout:8/188: rmdir d14/d15 39 2024-04-19T02:18:30.804 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:30.805 INFO:tasks.workunit.client.0.smithi073.stdout:7/187: truncate d0/f1d 7432977 0 2024-04-19T02:18:30.805 INFO:tasks.workunit.client.0.smithi073.stdout:9/263: dwrite d0/df/f11 [8388608,4194304] 0 2024-04-19T02:18:30.806 INFO:tasks.workunit.client.0.smithi073.stdout:7/188: creat d0/dc/d39/f3f x:0 0 0 2024-04-19T02:18:30.807 INFO:tasks.workunit.client.0.smithi073.stdout:9/264: getdents d0/df/d16/d1a/d2c/d2e 0 2024-04-19T02:18:30.808 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:30.808 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:30.809 INFO:tasks.workunit.client.0.smithi073.stdout:6/242: dwrite d8/de/f4d [0,4194304] 0 2024-04-19T02:18:30.809 INFO:tasks.workunit.client.0.smithi073.stdout:9/265: symlink d0/df/d1d/d47/d5c/l69 0 2024-04-19T02:18:30.810 INFO:tasks.workunit.client.0.smithi073.stdout:6/243: mknod d8/de/d22/c5e 0 2024-04-19T02:18:30.811 INFO:tasks.workunit.client.0.smithi073.stdout:9/266: creat d0/df/d16/d19/d38/d5d/d45/f6a x:0 0 0 2024-04-19T02:18:30.812 INFO:tasks.workunit.client.0.smithi073.stdout:8/189: dwrite d14/d27/f30 [0,4194304] 0 2024-04-19T02:18:30.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/244: dread d8/de/d22/f31 [0,4194304] 0 2024-04-19T02:18:30.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/245: write d8/de/f1e [704321,24885] 0 2024-04-19T02:18:30.812 INFO:tasks.workunit.client.0.smithi073.stdout:8/190: mknod d14/d27/d29/d31/d34/c38 0 2024-04-19T02:18:30.813 INFO:tasks.workunit.client.0.smithi073.stdout:6/246: readlink d8/de/d22/d3b/l43 0 2024-04-19T02:18:30.813 INFO:tasks.workunit.client.0.smithi073.stdout:8/191: chown f0 113693 1 2024-04-19T02:18:30.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/267: truncate d0/df/d16/d19/d38/d5d/f4e 1254663 0 2024-04-19T02:18:30.814 INFO:tasks.workunit.client.0.smithi073.stdout:9/268: mkdir d0/df/d16/d1a/d2c/d6b 0 2024-04-19T02:18:30.814 INFO:tasks.workunit.client.0.smithi073.stdout:6/247: truncate d8/de/f28 4500438 0 2024-04-19T02:18:30.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/269: symlink d0/df/d1d/d47/d5c/l6c 0 2024-04-19T02:18:30.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/270: mkdir d0/df/d16/d19/d38/d5d/d6d 0 2024-04-19T02:18:30.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/271: dread - d0/df/d16/d1a/f52 zero size 2024-04-19T02:18:30.818 INFO:tasks.workunit.client.0.smithi073.stdout:6/248: getdents d8/de/d22 0 2024-04-19T02:18:30.818 INFO:tasks.workunit.client.0.smithi073.stdout:3/329: write d3/f3d [653372,55515] 0 2024-04-19T02:18:30.819 INFO:tasks.workunit.client.0.smithi073.stdout:5/276: sync 2024-04-19T02:18:30.819 INFO:tasks.workunit.client.0.smithi073.stdout:4/259: sync 2024-04-19T02:18:30.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/272: read d0/df/d1d/f5a [3829115,28320] 0 2024-04-19T02:18:30.819 INFO:tasks.workunit.client.0.smithi073.stdout:4/260: write f1 [2849925,32984] 0 2024-04-19T02:18:30.820 INFO:tasks.workunit.client.0.smithi073.stdout:5/277: read d0/d1d/d24/f2e [1141843,70826] 0 2024-04-19T02:18:30.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/273: truncate d0/df/d16/d1a/f52 850397 0 2024-04-19T02:18:30.822 INFO:tasks.workunit.client.0.smithi073.stdout:8/192: dwrite d14/d15/d17/f1f [0,4194304] 0 2024-04-19T02:18:30.822 INFO:tasks.workunit.client.0.smithi073.stdout:4/261: rename c2 to da/d23/c5a 0 2024-04-19T02:18:30.822 INFO:tasks.workunit.client.0.smithi073.stdout:9/274: mknod d0/df/d60/c6e 0 2024-04-19T02:18:30.823 INFO:tasks.workunit.client.0.smithi073.stdout:3/330: rename d3/d6/db/d1a/d50 to d3/d6/db/d16/d75 0 2024-04-19T02:18:30.823 INFO:tasks.workunit.client.0.smithi073.stdout:9/275: dread - d0/df/d1d/f65 zero size 2024-04-19T02:18:30.823 INFO:tasks.workunit.client.0.smithi073.stdout:4/262: symlink da/d27/d1b/d1d/l5b 0 2024-04-19T02:18:30.824 INFO:tasks.workunit.client.0.smithi073.stdout:8/193: symlink d14/l39 0 2024-04-19T02:18:30.825 INFO:tasks.workunit.client.0.smithi073.stdout:3/331: rename d3/d6/db/d3a/l2c to d3/d6/db/d3a/d38/d40/l76 0 2024-04-19T02:18:30.825 INFO:tasks.workunit.client.0.smithi073.stdout:3/332: creat d3/d6/db/d3a/d38/d40/f77 x:0 0 0 2024-04-19T02:18:30.829 INFO:tasks.workunit.client.0.smithi073.stdout:4/263: dwrite da/fc [0,4194304] 0 2024-04-19T02:18:30.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-19T02:18:30.845 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:30.840+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:30.848 INFO:tasks.workunit.client.0.smithi073.stdout:9/276: truncate d0/df/d1d/f33 410145 0 2024-04-19T02:18:30.848 INFO:tasks.workunit.client.0.smithi073.stdout:3/333: rmdir d3/d6/db/d3a/d38/d40 39 2024-04-19T02:18:30.848 INFO:tasks.workunit.client.0.smithi073.stdout:7/189: dread d0/dc/d10/f21 [0,4194304] 0 2024-04-19T02:18:30.852 INFO:tasks.workunit.client.0.smithi073.stdout:2/200: dread d5/d10/d14/d18/d3e/f49 [0,4194304] 0 2024-04-19T02:18:30.853 INFO:tasks.workunit.client.0.smithi073.stdout:2/201: chown d5/f11 1063727569 1 2024-04-19T02:18:30.853 INFO:tasks.workunit.client.0.smithi073.stdout:3/334: chown f2 1 1 2024-04-19T02:18:30.853 INFO:tasks.workunit.client.0.smithi073.stdout:5/278: dread d0/d1d/d1e/f2b [0,4194304] 0 2024-04-19T02:18:30.853 INFO:tasks.workunit.client.0.smithi073.stdout:9/277: rmdir d0 39 2024-04-19T02:18:30.855 INFO:tasks.workunit.client.0.smithi073.stdout:7/190: dread d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.858 INFO:tasks.workunit.client.0.smithi073.stdout:2/202: mkdir d5/d10/d14/d18/d3e/d51 0 2024-04-19T02:18:30.858 INFO:tasks.workunit.client.0.smithi073.stdout:5/279: mkdir d0/d1d/d24/d62 0 2024-04-19T02:18:30.858 INFO:tasks.workunit.client.0.smithi073.stdout:7/191: mkdir d0/dc/d39/d40 0 2024-04-19T02:18:30.858 INFO:tasks.workunit.client.0.smithi073.stdout:3/335: creat d3/d6/db/d3a/d5f/f78 x:0 0 0 2024-04-19T02:18:30.858 INFO:tasks.workunit.client.0.smithi073.stdout:2/203: creat d5/d10/d29/d42/f52 x:0 0 0 2024-04-19T02:18:30.859 INFO:tasks.workunit.client.0.smithi073.stdout:3/336: stat d3/d6/db/d3a/f5c 0 2024-04-19T02:18:30.860 INFO:tasks.workunit.client.0.smithi073.stdout:7/192: read d0/dc/d33/d36/f3b [1072385,3284] 0 2024-04-19T02:18:30.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/280: link d0/d1d/d1e/c22 d0/d1d/d25/d35/d39/c63 0 2024-04-19T02:18:30.860 INFO:tasks.workunit.client.0.smithi073.stdout:3/337: dread - d3/d6/db/d3a/d38/d40/f6e zero size 2024-04-19T02:18:30.861 INFO:tasks.workunit.client.0.smithi073.stdout:3/338: creat d3/f79 x:0 0 0 2024-04-19T02:18:30.862 INFO:tasks.workunit.client.0.smithi073.stdout:3/339: write d3/d6/db/d3a/d38/d40/f6e [868369,126886] 0 2024-04-19T02:18:30.862 INFO:tasks.workunit.client.0.smithi073.stdout:3/340: chown d3/d6/db/d3a 32538861 1 2024-04-19T02:18:30.864 INFO:tasks.workunit.client.0.smithi073.stdout:3/341: creat d3/d6/db/d3a/d38/d57/f7a x:0 0 0 2024-04-19T02:18:30.864 INFO:tasks.workunit.client.0.smithi073.stdout:4/264: dread da/f44 [0,4194304] 0 2024-04-19T02:18:30.865 INFO:tasks.workunit.client.0.smithi073.stdout:3/342: write d3/d6/db/f4d [1886525,113009] 0 2024-04-19T02:18:30.866 INFO:tasks.workunit.client.0.smithi073.stdout:3/343: mkdir d3/d6/d11/d7b 0 2024-04-19T02:18:30.867 INFO:tasks.workunit.client.0.smithi073.stdout:7/193: dwrite d0/dc/d10/f31 [0,4194304] 0 2024-04-19T02:18:30.868 INFO:tasks.workunit.client.0.smithi073.stdout:7/194: chown d0/dc/d10/l1c 0 1 2024-04-19T02:18:30.869 INFO:tasks.workunit.client.0.smithi073.stdout:3/344: getdents d3/d6/db/d1a/d54 0 2024-04-19T02:18:30.869 INFO:tasks.workunit.client.0.smithi073.stdout:7/195: write d0/f8 [1449338,67998] 0 2024-04-19T02:18:30.871 INFO:tasks.workunit.client.0.smithi073.stdout:4/265: dwrite da/d27/d1b/d1d/f1f [0,4194304] 0 2024-04-19T02:18:30.875 INFO:tasks.workunit.client.0.smithi073.stdout:5/281: dread d0/d1d/d25/f27 [0,4194304] 0 2024-04-19T02:18:30.875 INFO:tasks.workunit.client.0.smithi073.stdout:8/194: dread f6 [0,4194304] 0 2024-04-19T02:18:30.876 INFO:tasks.workunit.client.0.smithi073.stdout:8/195: dread - d14/d27/f2e zero size 2024-04-19T02:18:30.877 INFO:tasks.workunit.client.0.smithi073.stdout:7/196: dwrite d0/dc/d39/f3f [0,4194304] 0 2024-04-19T02:18:30.877 INFO:tasks.workunit.client.0.smithi073.stdout:8/196: chown d14/d15/l2a 9914094 1 2024-04-19T02:18:30.878 INFO:tasks.workunit.client.0.smithi073.stdout:5/282: truncate d0/f4f 869783 0 2024-04-19T02:18:30.878 INFO:tasks.workunit.client.0.smithi073.stdout:5/283: mkdir d0/d1d/d64 0 2024-04-19T02:18:30.879 INFO:tasks.workunit.client.0.smithi073.stdout:4/266: dwrite da/d27/d1b/d26/d2a/f47 [0,4194304] 0 2024-04-19T02:18:30.879 INFO:tasks.workunit.client.0.smithi073.stdout:5/284: write d0/d1d/d1e/f33 [318004,72835] 0 2024-04-19T02:18:30.879 INFO:tasks.workunit.client.0.smithi073.stdout:4/267: truncate da/f16 4850756 0 2024-04-19T02:18:30.880 INFO:tasks.workunit.client.0.smithi073.stdout:5/285: truncate d0/f5d 459761 0 2024-04-19T02:18:30.880 INFO:tasks.workunit.client.0.smithi073.stdout:4/268: unlink da/fc 0 2024-04-19T02:18:30.881 INFO:tasks.workunit.client.0.smithi073.stdout:5/286: rename d0/d1d/d24/l46 to d0/d1d/l65 0 2024-04-19T02:18:30.882 INFO:tasks.workunit.client.0.smithi073.stdout:5/287: readlink d0/d1d/d1e/l29 0 2024-04-19T02:18:30.883 INFO:tasks.workunit.client.0.smithi073.stdout:4/269: getdents da/d27/d1b/d26/d2a 0 2024-04-19T02:18:30.885 INFO:tasks.workunit.client.0.smithi073.stdout:5/288: creat d0/d1d/d25/d35/d39/f66 x:0 0 0 2024-04-19T02:18:30.885 INFO:tasks.workunit.client.0.smithi073.stdout:4/270: write da/d27/d2c/f3c [87156,79253] 0 2024-04-19T02:18:30.885 INFO:tasks.workunit.client.0.smithi073.stdout:5/289: readlink d0/d1d/d25/d37/l5a 0 2024-04-19T02:18:30.885 INFO:tasks.workunit.client.0.smithi073.stdout:5/290: fdatasync d0/ff 0 2024-04-19T02:18:30.885 INFO:tasks.workunit.client.0.smithi073.stdout:7/197: dwrite d0/dc/d10/d15/f3e [0,4194304] 0 2024-04-19T02:18:30.886 INFO:tasks.workunit.client.0.smithi073.stdout:5/291: mknod d0/d1d/d25/c67 0 2024-04-19T02:18:30.886 INFO:tasks.workunit.client.0.smithi073.stdout:7/198: write d0/f8 [663230,96802] 0 2024-04-19T02:18:30.887 INFO:tasks.workunit.client.0.smithi073.stdout:5/292: write d0/f5d [231205,14075] 0 2024-04-19T02:18:30.887 INFO:tasks.workunit.client.0.smithi073.stdout:7/199: rename d0/dc/cf to d0/d28/c41 0 2024-04-19T02:18:30.887 INFO:tasks.workunit.client.0.smithi073.stdout:5/293: chown d0/d1d/d25/d37/c59 0 1 2024-04-19T02:18:30.889 INFO:tasks.workunit.client.0.smithi073.stdout:5/294: symlink d0/l68 0 2024-04-19T02:18:30.889 INFO:tasks.workunit.client.0.smithi073.stdout:7/200: write d0/f7 [3673632,67941] 0 2024-04-19T02:18:30.891 INFO:tasks.workunit.client.0.smithi073.stdout:0/187: sync 2024-04-19T02:18:30.892 INFO:tasks.workunit.client.0.smithi073.stdout:1/202: sync 2024-04-19T02:18:30.893 INFO:tasks.workunit.client.0.smithi073.stdout:1/203: chown db/d1c/l31 37 1 2024-04-19T02:18:30.894 INFO:tasks.workunit.client.0.smithi073.stdout:9/278: dread d0/df/d16/d1a/d2c/f56 [0,4194304] 0 2024-04-19T02:18:30.895 INFO:tasks.workunit.client.0.smithi073.stdout:2/204: dread d5/d10/d14/d18/d1e/f12 [0,4194304] 0 2024-04-19T02:18:30.899 INFO:tasks.workunit.client.0.smithi073.stdout:1/204: symlink db/d41/l51 0 2024-04-19T02:18:30.899 INFO:tasks.workunit.client.0.smithi073.stdout:7/201: dwrite d0/dc/d10/d15/f3e [0,4194304] 0 2024-04-19T02:18:30.900 INFO:tasks.workunit.client.0.smithi073.stdout:2/205: mkdir d5/d10/d53 0 2024-04-19T02:18:30.901 INFO:tasks.workunit.client.0.smithi073.stdout:1/205: chown db/d1c/f3c 33701211 1 2024-04-19T02:18:30.901 INFO:tasks.workunit.client.0.smithi073.stdout:0/188: truncate d7/f25 84306 0 2024-04-19T02:18:30.901 INFO:tasks.workunit.client.0.smithi073.stdout:7/202: chown d0/dc/l22 274198 1 2024-04-19T02:18:30.901 INFO:tasks.workunit.client.0.smithi073.stdout:1/206: readlink db/l10 0 2024-04-19T02:18:30.901 INFO:tasks.workunit.client.0.smithi073.stdout:5/295: dread d0/d1d/d25/d35/f3a [0,4194304] 0 2024-04-19T02:18:30.902 INFO:tasks.workunit.client.0.smithi073.stdout:1/207: mknod db/d1c/d2c/d50/c52 0 2024-04-19T02:18:30.902 INFO:tasks.workunit.client.0.smithi073.stdout:5/296: dread - d0/d1d/d25/d35/d39/f66 zero size 2024-04-19T02:18:30.903 INFO:tasks.workunit.client.0.smithi073.stdout:9/279: dwrite d0/df/d1d/f2f [0,4194304] 0 2024-04-19T02:18:30.904 INFO:tasks.workunit.client.0.smithi073.stdout:9/280: write d0/df/d1d/f17 [4054179,62261] 0 2024-04-19T02:18:30.905 INFO:tasks.workunit.client.0.smithi073.stdout:5/297: dread d0/d1d/d25/f27 [0,4194304] 0 2024-04-19T02:18:30.905 INFO:tasks.workunit.client.0.smithi073.stdout:9/281: mknod d0/df/d60/c6f 0 2024-04-19T02:18:30.906 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:30.906 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:30.907 INFO:tasks.workunit.client.0.smithi073.stdout:0/189: dread d7/d14/d17/f1f [0,4194304] 0 2024-04-19T02:18:30.907 INFO:tasks.workunit.client.0.smithi073.stdout:5/298: mkdir d0/d69 0 2024-04-19T02:18:30.907 INFO:tasks.workunit.client.0.smithi073.stdout:9/282: write d0/df/d16/d1a/f52 [72149,48205] 0 2024-04-19T02:18:30.908 INFO:tasks.workunit.client.0.smithi073.stdout:7/203: dwrite d0/dc/d33/f35 [0,4194304] 0 2024-04-19T02:18:30.908 INFO:tasks.workunit.client.0.smithi073.stdout:9/283: symlink d0/l70 0 2024-04-19T02:18:30.908 INFO:tasks.workunit.client.0.smithi073.stdout:0/190: rename d7/d14/f16 to d7/d14/d17/d1a/f39 0 2024-04-19T02:18:30.908 INFO:tasks.workunit.client.0.smithi073.stdout:5/299: rename d0/d1d/c4e to d0/d1d/d1e/c6a 0 2024-04-19T02:18:30.909 INFO:tasks.workunit.client.0.smithi073.stdout:5/300: dread - d0/d1d/d25/d35/f49 zero size 2024-04-19T02:18:30.910 INFO:tasks.workunit.client.0.smithi073.stdout:5/301: fsync d0/d1d/d25/d35/f36 0 2024-04-19T02:18:30.910 INFO:tasks.workunit.client.0.smithi073.stdout:0/191: truncate d7/d14/d17/d1a/d21/f32 4215059 0 2024-04-19T02:18:30.911 INFO:tasks.workunit.client.0.smithi073.stdout:0/192: chown d7/d14/d17/d1a/d21 1422 1 2024-04-19T02:18:30.914 INFO:tasks.workunit.client.0.smithi073.stdout:5/302: creat d0/d1d/d64/f6b x:0 0 0 2024-04-19T02:18:30.914 INFO:tasks.workunit.client.0.smithi073.stdout:0/193: rename d7/d14/d17/d1a/d21/l24 to d7/d14/d17/l3a 0 2024-04-19T02:18:30.915 INFO:tasks.workunit.client.0.smithi073.stdout:5/303: chown d0/d1d/d1e 36282 1 2024-04-19T02:18:30.915 INFO:tasks.workunit.client.0.smithi073.stdout:7/204: dwrite d0/dc/d10/d2a/f2b [0,4194304] 0 2024-04-19T02:18:30.916 INFO:tasks.workunit.client.0.smithi073.stdout:5/304: chown d0/ld 37523141 1 2024-04-19T02:18:30.917 INFO:tasks.workunit.client.0.smithi073.stdout:7/205: mknod d0/dc/d10/d15/c42 0 2024-04-19T02:18:30.917 INFO:tasks.workunit.client.0.smithi073.stdout:5/305: mknod d0/d1d/d24/d62/c6c 0 2024-04-19T02:18:30.917 INFO:tasks.workunit.client.0.smithi073.stdout:9/284: dwrite d0/fc [0,4194304] 0 2024-04-19T02:18:30.918 INFO:tasks.workunit.client.0.smithi073.stdout:5/306: symlink d0/d69/l6d 0 2024-04-19T02:18:30.920 INFO:tasks.workunit.client.0.smithi073.stdout:8/197: dread d14/f16 [4194304,4194304] 0 2024-04-19T02:18:30.920 INFO:tasks.workunit.client.0.smithi073.stdout:8/198: write d14/d15/d17/f1f [396998,38230] 0 2024-04-19T02:18:30.921 INFO:tasks.workunit.client.0.smithi073.stdout:8/199: creat d14/d27/d29/d31/d34/f3a x:0 0 0 2024-04-19T02:18:30.924 INFO:tasks.workunit.client.0.smithi073.stdout:7/206: truncate d0/f7 3953819 0 2024-04-19T02:18:30.924 INFO:tasks.workunit.client.0.smithi073.stdout:9/285: write d0/df/f41 [739982,122146] 0 2024-04-19T02:18:30.924 INFO:tasks.workunit.client.0.smithi073.stdout:5/307: write d0/d1d/d24/f38 [1375496,21720] 0 2024-04-19T02:18:30.925 INFO:tasks.workunit.client.0.smithi073.stdout:5/308: creat d0/d1d/d25/f6e x:0 0 0 2024-04-19T02:18:30.925 INFO:tasks.workunit.client.0.smithi073.stdout:5/309: write d0/d2d/f57 [210781,54280] 0 2024-04-19T02:18:30.925 INFO:tasks.workunit.client.0.smithi073.stdout:5/310: fsync d0/d1d/d25/d35/f4b 0 2024-04-19T02:18:30.925 INFO:tasks.workunit.client.0.smithi073.stdout:7/207: symlink d0/dc/d10/d2a/l43 0 2024-04-19T02:18:30.927 INFO:tasks.workunit.client.0.smithi073.stdout:8/200: dwrite d14/d15/f1e [0,4194304] 0 2024-04-19T02:18:30.927 INFO:tasks.workunit.client.0.smithi073.stdout:5/311: symlink d0/d1d/d25/d35/d39/l6f 0 2024-04-19T02:18:30.927 INFO:tasks.workunit.client.0.smithi073.stdout:8/201: fsync d14/d15/d17/f21 0 2024-04-19T02:18:30.928 INFO:tasks.workunit.client.0.smithi073.stdout:8/202: symlink d14/d15/l3b 0 2024-04-19T02:18:30.929 INFO:tasks.workunit.client.0.smithi073.stdout:8/203: chown d14/d15/d17/c28 1 1 2024-04-19T02:18:30.930 INFO:tasks.workunit.client.0.smithi073.stdout:7/208: dread d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:30.930 INFO:tasks.workunit.client.0.smithi073.stdout:5/312: rmdir d0/d1d/d25/d35/d39 39 2024-04-19T02:18:30.931 INFO:tasks.workunit.client.0.smithi073.stdout:8/204: truncate d14/d27/d29/f36 1048994 0 2024-04-19T02:18:30.931 INFO:tasks.workunit.client.0.smithi073.stdout:5/313: unlink d0/fc 0 2024-04-19T02:18:30.931 INFO:tasks.workunit.client.0.smithi073.stdout:7/209: dread - d0/dc/d10/d2a/f3a zero size 2024-04-19T02:18:30.932 INFO:tasks.workunit.client.0.smithi073.stdout:9/286: dread d0/df/f10 [0,4194304] 0 2024-04-19T02:18:30.932 INFO:tasks.workunit.client.0.smithi073.stdout:5/314: readlink d0/l12 0 2024-04-19T02:18:30.932 INFO:tasks.workunit.client.0.smithi073.stdout:8/205: mknod d14/d27/c3c 0 2024-04-19T02:18:30.932 INFO:tasks.workunit.client.0.smithi073.stdout:5/315: mknod d0/d1d/d25/c70 0 2024-04-19T02:18:30.932 INFO:tasks.workunit.client.0.smithi073.stdout:7/210: write d0/dc/d39/f3f [1801846,90039] 0 2024-04-19T02:18:30.932 INFO:tasks.workunit.client.0.smithi073.stdout:8/206: unlink d14/c1a 0 2024-04-19T02:18:30.934 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:30.934 INFO:tasks.workunit.client.0.smithi073.stdout:9/287: write d0/df/d16/d1a/d2c/d2e/f4b [923143,25135] 0 2024-04-19T02:18:30.934 INFO:tasks.workunit.client.0.smithi073.stdout:9/288: dread - d0/df/d1d/f65 zero size 2024-04-19T02:18:30.935 INFO:tasks.workunit.client.0.smithi073.stdout:9/289: mknod d0/df/d1d/c71 0 2024-04-19T02:18:30.937 INFO:tasks.workunit.client.0.smithi073.stdout:9/290: mkdir d0/df/d60/d72 0 2024-04-19T02:18:30.937 INFO:tasks.workunit.client.0.smithi073.stdout:8/207: getdents d14/d15 0 2024-04-19T02:18:30.938 INFO:tasks.workunit.client.0.smithi073.stdout:8/208: write f0 [1288969,126166] 0 2024-04-19T02:18:30.938 INFO:tasks.workunit.client.0.smithi073.stdout:7/211: dwrite d0/dc/f26 [0,4194304] 0 2024-04-19T02:18:30.939 INFO:tasks.workunit.client.0.smithi073.stdout:5/316: dwrite d0/d1d/d25/d35/d39/f66 [0,4194304] 0 2024-04-19T02:18:30.939 INFO:tasks.workunit.client.0.smithi073.stdout:8/209: chown d14/d15/d17/f21 405256 1 2024-04-19T02:18:30.940 INFO:tasks.workunit.client.0.smithi073.stdout:8/210: readlink d14/d15/l2a 0 2024-04-19T02:18:30.940 INFO:tasks.workunit.client.0.smithi073.stdout:4/271: dread f4 [0,4194304] 0 2024-04-19T02:18:30.941 INFO:tasks.workunit.client.0.smithi073.stdout:9/291: dread d0/fa [0,4194304] 0 2024-04-19T02:18:30.942 INFO:tasks.workunit.client.0.smithi073.stdout:9/292: fdatasync d0/df/f21 0 2024-04-19T02:18:30.943 INFO:tasks.workunit.client.0.smithi073.stdout:7/212: link d0/dc/d10/f21 d0/dc/d39/d40/f44 0 2024-04-19T02:18:30.944 INFO:tasks.workunit.client.0.smithi073.stdout:7/213: link d0/dc/d10/c11 d0/dc/d10/d15/c45 0 2024-04-19T02:18:30.946 INFO:tasks.workunit.client.0.smithi073.stdout:7/214: write d0/dc/d10/d2a/f2b [619329,20853] 0 2024-04-19T02:18:30.947 INFO:tasks.workunit.client.0.smithi073.stdout:7/215: write d0/dc/d10/d2a/f2b [4882923,110401] 0 2024-04-19T02:18:30.947 INFO:tasks.workunit.client.0.smithi073.stdout:3/345: dread d3/d6/d11/f35 [0,4194304] 0 2024-04-19T02:18:30.948 INFO:tasks.workunit.client.0.smithi073.stdout:2/206: dread d5/d10/d14/d18/d1e/f25 [0,4194304] 0 2024-04-19T02:18:30.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/211: dwrite d14/f16 [0,4194304] 0 2024-04-19T02:18:30.949 INFO:tasks.workunit.client.0.smithi073.stdout:3/346: dread - d3/d6/db/f66 zero size 2024-04-19T02:18:30.949 INFO:tasks.workunit.client.0.smithi073.stdout:2/207: chown d5/d10/d29/d42 11903 1 2024-04-19T02:18:30.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/212: write d14/f19 [5138868,47178] 0 2024-04-19T02:18:30.952 INFO:tasks.workunit.client.0.smithi073.stdout:9/293: read d0/f13 [2852254,75304] 0 2024-04-19T02:18:30.952 INFO:tasks.workunit.client.0.smithi073.stdout:4/272: truncate da/f44 979882 0 2024-04-19T02:18:30.952 INFO:tasks.workunit.client.0.smithi073.stdout:3/347: mkdir d3/d6/db/d16/d7c 0 2024-04-19T02:18:30.952 INFO:tasks.workunit.client.0.smithi073.stdout:8/213: creat d14/d15/d17/f3d x:0 0 0 2024-04-19T02:18:30.953 INFO:tasks.workunit.client.0.smithi073.stdout:9/294: creat d0/df/d16/d19/f73 x:0 0 0 2024-04-19T02:18:30.953 INFO:tasks.workunit.client.0.smithi073.stdout:4/273: rename da/l43 to da/d27/d2c/l5c 0 2024-04-19T02:18:30.953 INFO:tasks.workunit.client.0.smithi073.stdout:3/348: creat d3/d6/db/d1a/f7d x:0 0 0 2024-04-19T02:18:30.954 INFO:tasks.workunit.client.0.smithi073.stdout:4/274: symlink da/d23/d3d/l5d 0 2024-04-19T02:18:30.954 INFO:tasks.workunit.client.0.smithi073.stdout:9/295: rmdir d0/df/d68 0 2024-04-19T02:18:30.954 INFO:tasks.workunit.client.0.smithi073.stdout:5/317: getdents d0/d1d/d25 0 2024-04-19T02:18:30.954 INFO:tasks.workunit.client.0.smithi073.stdout:9/296: mknod d0/df/d1d/d47/c74 0 2024-04-19T02:18:30.955 INFO:tasks.workunit.client.0.smithi073.stdout:2/208: dread d5/f11 [0,4194304] 0 2024-04-19T02:18:30.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/275: getdents da/d27/d1b 0 2024-04-19T02:18:30.956 INFO:tasks.workunit.client.0.smithi073.stdout:5/318: truncate d0/d1d/d24/f5e 594583 0 2024-04-19T02:18:30.956 INFO:tasks.workunit.client.0.smithi073.stdout:9/297: read - d0/df/d16/d19/d38/d5d/f4a zero size 2024-04-19T02:18:30.957 INFO:tasks.workunit.client.0.smithi073.stdout:7/216: dwrite d0/f3c [0,4194304] 0 2024-04-19T02:18:30.957 INFO:tasks.workunit.client.0.smithi073.stdout:5/319: readlink d0/d1d/d25/d35/l43 0 2024-04-19T02:18:30.958 INFO:tasks.workunit.client.0.smithi073.stdout:9/298: read d0/df/d16/f64 [3255983,12683] 0 2024-04-19T02:18:30.958 INFO:tasks.workunit.client.0.smithi073.stdout:2/209: write d5/d10/d14/d18/d1e/f37 [620571,70451] 0 2024-04-19T02:18:30.958 INFO:tasks.workunit.client.0.smithi073.stdout:3/349: write f2 [902176,45446] 0 2024-04-19T02:18:30.959 INFO:tasks.workunit.client.0.smithi073.stdout:5/320: chown d0/d1d/d25/l56 494 1 2024-04-19T02:18:30.959 INFO:tasks.workunit.client.0.smithi073.stdout:3/350: chown d3/f49 371667570 1 2024-04-19T02:18:30.960 INFO:tasks.workunit.client.0.smithi073.stdout:2/210: chown d5/d10/d14/d18/d3e/d51 68 1 2024-04-19T02:18:30.960 INFO:tasks.workunit.client.0.smithi073.stdout:9/299: write d0/df/f21 [239527,9682] 0 2024-04-19T02:18:30.960 INFO:tasks.workunit.client.0.smithi073.stdout:8/214: dwrite f0 [0,4194304] 0 2024-04-19T02:18:30.960 INFO:tasks.workunit.client.0.smithi073.stdout:5/321: truncate d0/f5d 1030775 0 2024-04-19T02:18:30.961 INFO:tasks.workunit.client.0.smithi073.stdout:8/215: readlink d14/d15/l2a 0 2024-04-19T02:18:30.961 INFO:tasks.workunit.client.0.smithi073.stdout:2/211: chown d5/d10/d14/d18/d3e 765498544 1 2024-04-19T02:18:30.962 INFO:tasks.workunit.client.0.smithi073.stdout:5/322: mkdir d0/d1d/d25/d37/d71 0 2024-04-19T02:18:30.963 INFO:tasks.workunit.client.0.smithi073.stdout:8/216: rmdir d14/d27/d29/d31/d34 39 2024-04-19T02:18:30.963 INFO:tasks.workunit.client.0.smithi073.stdout:3/351: link d3/d6/db/d3a/d38/f53 d3/d6/db/f7e 0 2024-04-19T02:18:30.964 INFO:tasks.workunit.client.0.smithi073.stdout:2/212: creat d5/d10/d14/d2e/f54 x:0 0 0 2024-04-19T02:18:30.964 INFO:tasks.workunit.client.0.smithi073.stdout:5/323: chown d0/f3b 0 1 2024-04-19T02:18:30.964 INFO:tasks.workunit.client.0.smithi073.stdout:8/217: fdatasync d14/d15/d17/f2c 0 2024-04-19T02:18:30.965 INFO:tasks.workunit.client.0.smithi073.stdout:3/352: stat d3/d6/db/d16/d52 0 2024-04-19T02:18:30.966 INFO:tasks.workunit.client.0.smithi073.stdout:5/324: fdatasync d0/d1d/d25/f26 0 2024-04-19T02:18:30.966 INFO:tasks.workunit.client.0.smithi073.stdout:2/213: creat d5/d10/d14/d18/d1e/f55 x:0 0 0 2024-04-19T02:18:30.966 INFO:tasks.workunit.client.0.smithi073.stdout:6/249: sync 2024-04-19T02:18:30.966 INFO:tasks.workunit.client.0.smithi073.stdout:0/194: sync 2024-04-19T02:18:30.966 INFO:tasks.workunit.client.0.smithi073.stdout:4/276: dwrite da/d27/f39 [0,4194304] 0 2024-04-19T02:18:30.967 INFO:tasks.workunit.client.0.smithi073.stdout:6/250: symlink d8/de/d58/l5f 0 2024-04-19T02:18:30.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/214: mknod d5/d10/d14/c56 0 2024-04-19T02:18:30.967 INFO:tasks.workunit.client.0.smithi073.stdout:4/277: dread - da/d27/d1b/d1d/f42 zero size 2024-04-19T02:18:30.968 INFO:tasks.workunit.client.0.smithi073.stdout:5/325: truncate d0/d1d/d1e/f33 1354837 0 2024-04-19T02:18:30.968 INFO:tasks.workunit.client.0.smithi073.stdout:0/195: creat d7/d14/d17/d1a/d21/f3b x:0 0 0 2024-04-19T02:18:30.968 INFO:tasks.workunit.client.0.smithi073.stdout:9/300: dwrite d0/df/d16/f1e [0,4194304] 0 2024-04-19T02:18:30.969 INFO:tasks.workunit.client.0.smithi073.stdout:4/278: truncate da/d27/d1b/d26/f4c 21255 0 2024-04-19T02:18:30.969 INFO:tasks.workunit.client.0.smithi073.stdout:9/301: dread - d0/df/d1d/d47/f4f zero size 2024-04-19T02:18:30.970 INFO:tasks.workunit.client.0.smithi073.stdout:4/279: creat da/d27/d36/f5e x:0 0 0 2024-04-19T02:18:30.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/353: dwrite d3/d6/db/d3a/f70 [0,4194304] 0 2024-04-19T02:18:30.978 INFO:tasks.workunit.client.0.smithi073.stdout:6/251: dwrite d8/f10 [0,4194304] 0 2024-04-19T02:18:30.978 INFO:tasks.workunit.client.0.smithi073.stdout:5/326: dwrite d0/f4f [0,4194304] 0 2024-04-19T02:18:30.978 INFO:tasks.workunit.client.0.smithi073.stdout:7/217: truncate d0/f3c 1484543 0 2024-04-19T02:18:30.979 INFO:tasks.workunit.client.0.smithi073.stdout:7/218: getdents d0/dc/d33/d36 0 2024-04-19T02:18:30.980 INFO:tasks.workunit.client.0.smithi073.stdout:7/219: write d0/dc/d10/d2a/f2b [1537834,121308] 0 2024-04-19T02:18:30.981 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:30.979+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:30.982 INFO:tasks.workunit.client.0.smithi073.stdout:3/354: dwrite d3/d6/d11/f26 [0,4194304] 0 2024-04-19T02:18:30.982 INFO:tasks.workunit.client.0.smithi073.stdout:2/215: read d5/d10/d14/d18/d3e/f32 [2903540,88738] 0 2024-04-19T02:18:30.982 INFO:tasks.workunit.client.0.smithi073.stdout:7/220: creat d0/d3/f46 x:0 0 0 2024-04-19T02:18:30.982 INFO:tasks.workunit.client.0.smithi073.stdout:0/196: rmdir d7/d14/d17/d1a/d21 39 2024-04-19T02:18:30.982 INFO:tasks.workunit.client.0.smithi073.stdout:3/355: dread - d3/d6/db/f7e zero size 2024-04-19T02:18:30.983 INFO:tasks.workunit.client.0.smithi073.stdout:7/221: write d0/f8 [19356,118652] 0 2024-04-19T02:18:30.983 INFO:tasks.workunit.client.0.smithi073.stdout:2/216: link d5/d10/d29/c4a d5/c57 0 2024-04-19T02:18:30.983 INFO:tasks.workunit.client.0.smithi073.stdout:0/197: write d7/d14/d17/d1a/d21/f36 [686837,82317] 0 2024-04-19T02:18:30.983 INFO:tasks.workunit.client.0.smithi073.stdout:3/356: creat d3/d6/db/d1a/d54/f7f x:0 0 0 2024-04-19T02:18:30.984 INFO:tasks.workunit.client.0.smithi073.stdout:3/357: symlink d3/d6/l80 0 2024-04-19T02:18:30.984 INFO:tasks.workunit.client.0.smithi073.stdout:0/198: link d7/d14/f15 d7/d14/d17/d1a/d21/f3c 0 2024-04-19T02:18:30.985 INFO:tasks.workunit.client.0.smithi073.stdout:7/222: fsync d0/dc/d10/d2a/f2b 0 2024-04-19T02:18:30.985 INFO:tasks.workunit.client.0.smithi073.stdout:7/223: symlink d0/d28/l47 0 2024-04-19T02:18:30.986 INFO:tasks.workunit.client.0.smithi073.stdout:0/199: write d7/d14/f1b [863702,1975] 0 2024-04-19T02:18:30.986 INFO:tasks.workunit.client.0.smithi073.stdout:3/358: link d3/d6/db/d1a/f4c d3/d6/db/d1a/d54/f81 0 2024-04-19T02:18:30.988 INFO:tasks.workunit.client.0.smithi073.stdout:0/200: creat d7/d14/d17/d1a/f3d x:0 0 0 2024-04-19T02:18:30.988 INFO:tasks.workunit.client.0.smithi073.stdout:0/201: fdatasync d7/d14/f2d 0 2024-04-19T02:18:30.988 INFO:tasks.workunit.client.0.smithi073.stdout:4/280: write da/d27/d1b/d1d/f29 [363900,68292] 0 2024-04-19T02:18:30.988 INFO:tasks.workunit.client.0.smithi073.stdout:0/202: unlink d7/f2c 0 2024-04-19T02:18:30.989 INFO:tasks.workunit.client.0.smithi073.stdout:0/203: rename f4 to d7/d14/f3e 0 2024-04-19T02:18:30.990 INFO:tasks.workunit.client.0.smithi073.stdout:2/217: dwrite d5/d10/d14/f21 [0,4194304] 0 2024-04-19T02:18:30.990 INFO:tasks.workunit.client.0.smithi073.stdout:0/204: chown l1 1 1 2024-04-19T02:18:30.991 INFO:tasks.workunit.client.0.smithi073.stdout:6/252: read d8/de/d58/f33 [4818,56415] 0 2024-04-19T02:18:30.991 INFO:tasks.workunit.client.0.smithi073.stdout:5/327: write d0/d2d/f60 [827743,128585] 0 2024-04-19T02:18:30.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/224: rmdir d0/d3 39 2024-04-19T02:18:30.992 INFO:tasks.workunit.client.0.smithi073.stdout:6/253: truncate d8/de/ff 2209135 0 2024-04-19T02:18:30.994 INFO:tasks.workunit.client.0.smithi073.stdout:0/205: symlink d7/d14/d17/d1a/d20/l3f 0 2024-04-19T02:18:30.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/254: rename d8/de/d22/d3b to d8/de/d35/d60 0 2024-04-19T02:18:30.994 INFO:tasks.workunit.client.0.smithi073.stdout:7/225: link d0/dc/d10/d2a/l43 d0/dc/d10/d15/l48 0 2024-04-19T02:18:30.994 INFO:tasks.workunit.client.0.smithi073.stdout:3/359: dwrite d3/f47 [0,4194304] 0 2024-04-19T02:18:30.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/226: fsync d0/dc/d39/f3f 0 2024-04-19T02:18:30.996 INFO:tasks.workunit.client.0.smithi073.stdout:0/206: link d7/d14/f1b d7/d14/d17/d1a/d21/f40 0 2024-04-19T02:18:30.996 INFO:tasks.workunit.client.0.smithi073.stdout:3/360: write d3/d6/db/d3a/f5c [775445,17386] 0 2024-04-19T02:18:30.997 INFO:tasks.workunit.client.0.smithi073.stdout:2/218: dread d5/d10/d14/d18/d1e/f12 [0,4194304] 0 2024-04-19T02:18:30.997 INFO:tasks.workunit.client.0.smithi073.stdout:3/361: dread - d3/d6/db/f7e zero size 2024-04-19T02:18:30.997 INFO:tasks.workunit.client.0.smithi073.stdout:7/227: rename d0/dc/d10/d2a/f3a to d0/dc/d39/d40/f49 0 2024-04-19T02:18:30.999 INFO:tasks.workunit.client.0.smithi073.stdout:0/207: link d7/d14/d17/d1a/l34 d7/l41 0 2024-04-19T02:18:30.999 INFO:tasks.workunit.client.0.smithi073.stdout:7/228: symlink d0/dc/d39/l4a 0 2024-04-19T02:18:30.999 INFO:tasks.workunit.client.0.smithi073.stdout:2/219: creat d5/d10/d14/d18/d1e/f58 x:0 0 0 2024-04-19T02:18:30.999 INFO:tasks.workunit.client.0.smithi073.stdout:5/328: dwrite d0/d1d/d25/d35/f42 [0,4194304] 0 2024-04-19T02:18:31.001 INFO:tasks.workunit.client.0.smithi073.stdout:5/329: chown d0/d1d/f5c 2214 1 2024-04-19T02:18:31.001 INFO:tasks.workunit.client.0.smithi073.stdout:3/362: rename d3/d6/c71 to d3/d6/db/d3a/d38/c82 0 2024-04-19T02:18:31.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/229: write d0/dc/d33/f35 [4011430,100136] 0 2024-04-19T02:18:31.002 INFO:tasks.workunit.client.0.smithi073.stdout:1/208: sync 2024-04-19T02:18:31.002 INFO:tasks.workunit.client.0.smithi073.stdout:8/218: sync 2024-04-19T02:18:31.002 INFO:tasks.workunit.client.0.smithi073.stdout:4/281: sync 2024-04-19T02:18:31.002 INFO:tasks.workunit.client.0.smithi073.stdout:9/302: sync 2024-04-19T02:18:31.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/330: creat d0/d1d/d25/f72 x:0 0 0 2024-04-19T02:18:31.002 INFO:tasks.workunit.client.0.smithi073.stdout:3/363: write d3/d6/f9 [3344578,12491] 0 2024-04-19T02:18:31.003 INFO:tasks.workunit.client.0.smithi073.stdout:1/209: write db/d3e/f3f [1811376,57447] 0 2024-04-19T02:18:31.003 INFO:tasks.workunit.client.0.smithi073.stdout:4/282: chown da/d27/d2c/l5c 1585979 1 2024-04-19T02:18:31.003 INFO:tasks.workunit.client.0.smithi073.stdout:7/230: write d0/dc/d33/d36/f3b [43167,115997] 0 2024-04-19T02:18:31.003 INFO:tasks.workunit.client.0.smithi073.stdout:3/364: dread - d3/d6/db/d1a/f7d zero size 2024-04-19T02:18:31.004 INFO:tasks.workunit.client.0.smithi073.stdout:2/220: creat d5/d10/d14/d18/d3e/d51/f59 x:0 0 0 2024-04-19T02:18:31.004 INFO:tasks.workunit.client.0.smithi073.stdout:1/210: creat db/d41/f53 x:0 0 0 2024-04-19T02:18:31.005 INFO:tasks.workunit.client.0.smithi073.stdout:7/231: write d0/d3/f46 [21470,66570] 0 2024-04-19T02:18:31.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/211: unlink l8 0 2024-04-19T02:18:31.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/221: rmdir d5/d10/d14/d2e 39 2024-04-19T02:18:31.006 INFO:tasks.workunit.client.0.smithi073.stdout:0/208: dread d7/f11 [0,4194304] 0 2024-04-19T02:18:31.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/365: fsync d3/d6/db/f7e 0 2024-04-19T02:18:31.009 INFO:tasks.workunit.client.0.smithi073.stdout:0/209: readlink d7/d14/d17/d1a/d20/l28 0 2024-04-19T02:18:31.009 INFO:tasks.workunit.client.0.smithi073.stdout:6/255: getdents d8/de/d22 0 2024-04-19T02:18:31.009 INFO:tasks.workunit.client.0.smithi073.stdout:2/222: mknod d5/d10/d14/d18/d3e/c5a 0 2024-04-19T02:18:31.010 INFO:tasks.workunit.client.0.smithi073.stdout:7/232: chown d0/dc/d10/d15/c45 16 1 2024-04-19T02:18:31.011 INFO:tasks.workunit.client.0.smithi073.stdout:9/303: dread d0/df/d1d/f44 [0,4194304] 0 2024-04-19T02:18:31.012 INFO:tasks.workunit.client.0.smithi073.stdout:3/366: rename d3/d6/d11/l25 to d3/d6/db/d3a/d38/l83 0 2024-04-19T02:18:31.013 INFO:tasks.workunit.client.0.smithi073.stdout:5/331: dwrite d0/d1d/d1e/f2b [0,4194304] 0 2024-04-19T02:18:31.013 INFO:tasks.workunit.client.0.smithi073.stdout:8/219: dwrite f0 [4194304,4194304] 0 2024-04-19T02:18:31.013 INFO:tasks.workunit.client.0.smithi073.stdout:7/233: creat d0/d28/f4b x:0 0 0 2024-04-19T02:18:31.013 INFO:tasks.workunit.client.0.smithi073.stdout:2/223: mknod d5/d10/d29/d42/c5b 0 2024-04-19T02:18:31.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/256: rename d8/de/d58/l42 to d8/de/d35/l61 0 2024-04-19T02:18:31.015 INFO:tasks.workunit.client.0.smithi073.stdout:2/224: symlink d5/d10/d29/l5c 0 2024-04-19T02:18:31.015 INFO:tasks.workunit.client.0.smithi073.stdout:8/220: write d14/d27/f30 [679393,98759] 0 2024-04-19T02:18:31.015 INFO:tasks.workunit.client.0.smithi073.stdout:4/283: dread da/d27/d1b/d26/d2a/f47 [0,4194304] 0 2024-04-19T02:18:31.015 INFO:tasks.workunit.client.0.smithi073.stdout:6/257: chown d8/de/c17 2036298067 1 2024-04-19T02:18:31.016 INFO:tasks.workunit.client.0.smithi073.stdout:8/221: fdatasync d14/d15/f1e 0 2024-04-19T02:18:31.016 INFO:tasks.workunit.client.0.smithi073.stdout:7/234: write d0/dc/d39/d40/f49 [520556,59487] 0 2024-04-19T02:18:31.017 INFO:tasks.workunit.client.0.smithi073.stdout:1/212: dwrite db/d1c/f3c [0,4194304] 0 2024-04-19T02:18:31.020 INFO:tasks.workunit.client.0.smithi073.stdout:6/258: fsync d8/de/d58/f33 0 2024-04-19T02:18:31.020 INFO:tasks.workunit.client.0.smithi073.stdout:1/213: rmdir db/d1c/d2c/d50 39 2024-04-19T02:18:31.021 INFO:tasks.workunit.client.0.smithi073.stdout:1/214: readlink db/l10 0 2024-04-19T02:18:31.022 INFO:tasks.workunit.client.0.smithi073.stdout:6/259: stat d8/de/d58/c56 0 2024-04-19T02:18:31.023 INFO:tasks.workunit.client.0.smithi073.stdout:5/332: dwrite d0/d2d/f60 [0,4194304] 0 2024-04-19T02:18:31.025 INFO:tasks.workunit.client.0.smithi073.stdout:9/304: dwrite d0/df/d16/d19/d38/d5d/d45/f6a [0,4194304] 0 2024-04-19T02:18:31.025 INFO:tasks.workunit.client.0.smithi073.stdout:8/222: dread f0 [0,4194304] 0 2024-04-19T02:18:31.027 INFO:tasks.workunit.client.0.smithi073.stdout:3/367: dwrite d3/d6/db/d16/d75/f60 [0,4194304] 0 2024-04-19T02:18:31.027 INFO:tasks.workunit.client.0.smithi073.stdout:4/284: dwrite da/d23/d2b/f32 [0,4194304] 0 2024-04-19T02:18:31.030 INFO:tasks.workunit.client.0.smithi073.stdout:2/225: dwrite d5/d10/d29/d42/f52 [0,4194304] 0 2024-04-19T02:18:31.031 INFO:tasks.workunit.client.0.smithi073.stdout:3/368: chown d3/d6/db/d3a/d38/d57/f7a 3947979 1 2024-04-19T02:18:31.031 INFO:tasks.workunit.client.0.smithi073.stdout:0/210: write d7/f25 [355044,111065] 0 2024-04-19T02:18:31.031 INFO:tasks.workunit.client.0.smithi073.stdout:4/285: symlink da/d27/d1b/d26/d2a/l5f 0 2024-04-19T02:18:31.032 INFO:tasks.workunit.client.0.smithi073.stdout:9/305: creat d0/df/d16/d19/d38/d5d/d5e/f75 x:0 0 0 2024-04-19T02:18:31.032 INFO:tasks.workunit.client.0.smithi073.stdout:5/333: link d0/f4f d0/d1d/d25/d37/d71/f73 0 2024-04-19T02:18:31.032 INFO:tasks.workunit.client.0.smithi073.stdout:7/235: dwrite d0/dc/d39/d40/f49 [0,4194304] 0 2024-04-19T02:18:31.032 INFO:tasks.workunit.client.0.smithi073.stdout:3/369: read - d3/d6/f1e zero size 2024-04-19T02:18:31.032 INFO:tasks.workunit.client.0.smithi073.stdout:1/215: dread db/f25 [0,4194304] 0 2024-04-19T02:18:31.033 INFO:tasks.workunit.client.0.smithi073.stdout:8/223: creat d14/d27/d29/d31/f3e x:0 0 0 2024-04-19T02:18:31.033 INFO:tasks.workunit.client.0.smithi073.stdout:2/226: chown d5/d10/d14/d18/d3e/d2d/d33/f48 5606428 1 2024-04-19T02:18:31.034 INFO:tasks.workunit.client.0.smithi073.stdout:7/236: rmdir d0/dc/d10 39 2024-04-19T02:18:31.034 INFO:tasks.workunit.client.0.smithi073.stdout:4/286: write da/d23/d2b/f32 [4592576,67437] 0 2024-04-19T02:18:31.034 INFO:tasks.workunit.client.0.smithi073.stdout:9/306: chown d0/df/d16/d19/f26 14098124 1 2024-04-19T02:18:31.034 INFO:tasks.workunit.client.0.smithi073.stdout:1/216: write db/d1c/f39 [299110,43891] 0 2024-04-19T02:18:31.034 INFO:tasks.workunit.client.0.smithi073.stdout:5/334: write d0/f1b [3067743,46594] 0 2024-04-19T02:18:31.034 INFO:tasks.workunit.client.0.smithi073.stdout:2/227: readlink d5/d10/l1d 0 2024-04-19T02:18:31.035 INFO:tasks.workunit.client.0.smithi073.stdout:8/224: unlink d14/f16 0 2024-04-19T02:18:31.035 INFO:tasks.workunit.client.0.smithi073.stdout:4/287: mkdir da/d27/d2c/d60 0 2024-04-19T02:18:31.035 INFO:tasks.workunit.client.0.smithi073.stdout:5/335: chown d0/f9 121 1 2024-04-19T02:18:31.036 INFO:tasks.workunit.client.0.smithi073.stdout:7/237: write d0/f1d [6935527,14210] 0 2024-04-19T02:18:31.036 INFO:tasks.workunit.client.0.smithi073.stdout:1/217: truncate db/d41/f48 475913 0 2024-04-19T02:18:31.036 INFO:tasks.workunit.client.0.smithi073.stdout:3/370: creat d3/d6/db/d3a/d38/d43/f84 x:0 0 0 2024-04-19T02:18:31.036 INFO:tasks.workunit.client.0.smithi073.stdout:5/336: dread - d0/d1d/f5c zero size 2024-04-19T02:18:31.037 INFO:tasks.workunit.client.0.smithi073.stdout:2/228: creat d5/d10/d14/d18/d3e/d2d/f5d x:0 0 0 2024-04-19T02:18:31.039 INFO:tasks.workunit.client.0.smithi073.stdout:0/211: dread d7/d14/d17/d1a/d20/f27 [0,4194304] 0 2024-04-19T02:18:31.039 INFO:tasks.workunit.client.0.smithi073.stdout:1/218: mkdir db/d1c/d54 0 2024-04-19T02:18:31.039 INFO:tasks.workunit.client.0.smithi073.stdout:8/225: creat d14/d27/d29/d31/f3f x:0 0 0 2024-04-19T02:18:31.039 INFO:tasks.workunit.client.0.smithi073.stdout:7/238: write d0/f8 [102560,79827] 0 2024-04-19T02:18:31.039 INFO:tasks.workunit.client.0.smithi073.stdout:1/219: dread - db/f17 zero size 2024-04-19T02:18:31.039 INFO:tasks.workunit.client.0.smithi073.stdout:4/288: rename da/d27/d1b/d1d/f1f to da/d27/d3a/d50/f61 0 2024-04-19T02:18:31.039 INFO:tasks.workunit.client.0.smithi073.stdout:4/289: sync 2024-04-19T02:18:31.040 INFO:tasks.workunit.client.0.smithi073.stdout:0/212: mknod d7/d14/d17/c42 0 2024-04-19T02:18:31.040 INFO:tasks.workunit.client.0.smithi073.stdout:8/226: creat d14/d27/d29/d31/d34/f40 x:0 0 0 2024-04-19T02:18:31.040 INFO:tasks.workunit.client.0.smithi073.stdout:2/229: write d5/d10/d14/d18/d3e/d2d/d33/f4f [4467080,20427] 0 2024-04-19T02:18:31.040 INFO:tasks.workunit.client.0.smithi073.stdout:1/220: write db/d41/f4c [354809,41766] 0 2024-04-19T02:18:31.041 INFO:tasks.workunit.client.0.smithi073.stdout:9/307: dread d0/df/d1d/f5a [0,4194304] 0 2024-04-19T02:18:31.042 INFO:tasks.workunit.client.0.smithi073.stdout:8/227: dread - d14/d27/d29/d31/f3f zero size 2024-04-19T02:18:31.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/260: truncate d8/de/ff 1664947 0 2024-04-19T02:18:31.043 INFO:tasks.workunit.client.0.smithi073.stdout:0/213: mknod d7/d14/d17/d1a/d21/c43 0 2024-04-19T02:18:31.043 INFO:tasks.workunit.client.0.smithi073.stdout:2/230: write d5/d10/d14/f2c [4804793,30429] 0 2024-04-19T02:18:31.043 INFO:tasks.workunit.client.0.smithi073.stdout:1/221: mknod db/d1c/d2c/c55 0 2024-04-19T02:18:31.043 INFO:tasks.workunit.client.0.smithi073.stdout:9/308: dread - d0/df/d16/d1a/f63 zero size 2024-04-19T02:18:31.043 INFO:tasks.workunit.client.0.smithi073.stdout:4/290: rename da/d27/d36/f3f to da/d23/f62 0 2024-04-19T02:18:31.044 INFO:tasks.workunit.client.0.smithi073.stdout:6/261: rmdir d8/de/d58 39 2024-04-19T02:18:31.045 INFO:tasks.workunit.client.0.smithi073.stdout:2/231: readlink d5/d10/d14/l28 0 2024-04-19T02:18:31.045 INFO:tasks.workunit.client.0.smithi073.stdout:8/228: symlink d14/d33/l41 0 2024-04-19T02:18:31.045 INFO:tasks.workunit.client.0.smithi073.stdout:6/262: stat d8/f4e 0 2024-04-19T02:18:31.045 INFO:tasks.workunit.client.0.smithi073.stdout:8/229: sync 2024-04-19T02:18:31.045 INFO:tasks.workunit.client.0.smithi073.stdout:1/222: read - db/f17 zero size 2024-04-19T02:18:31.046 INFO:tasks.workunit.client.0.smithi073.stdout:5/337: dwrite d0/d1d/d25/f72 [0,4194304] 0 2024-04-19T02:18:31.046 INFO:tasks.workunit.client.0.smithi073.stdout:4/291: creat da/d23/d2b/d2f/f63 x:0 0 0 2024-04-19T02:18:31.047 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:31.043+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:31.047 INFO:tasks.workunit.client.0.smithi073.stdout:0/214: dread - d7/d14/d17/d1a/d21/f3b zero size 2024-04-19T02:18:31.047 INFO:tasks.workunit.client.0.smithi073.stdout:7/239: dwrite d0/dc/f26 [0,4194304] 0 2024-04-19T02:18:31.047 INFO:tasks.workunit.client.0.smithi073.stdout:0/215: chown d7/f1c 0 1 2024-04-19T02:18:31.049 INFO:tasks.workunit.client.0.smithi073.stdout:3/371: fdatasync d3/d6/db/d16/d75/f60 0 2024-04-19T02:18:31.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/263: creat d8/de/d35/f62 x:0 0 0 2024-04-19T02:18:31.050 INFO:tasks.workunit.client.0.smithi073.stdout:1/223: mknod db/d41/c56 0 2024-04-19T02:18:31.051 INFO:tasks.workunit.client.0.smithi073.stdout:0/216: rmdir d7/d14/d17 39 2024-04-19T02:18:31.051 INFO:tasks.workunit.client.0.smithi073.stdout:4/292: symlink da/d23/l64 0 2024-04-19T02:18:31.052 INFO:tasks.workunit.client.0.smithi073.stdout:2/232: write d5/d10/d14/d18/d1e/f12 [2023246,35966] 0 2024-04-19T02:18:31.052 INFO:tasks.workunit.client.0.smithi073.stdout:3/372: readlink d3/d6/db/l51 0 2024-04-19T02:18:31.053 INFO:tasks.workunit.client.0.smithi073.stdout:6/264: readlink d8/de/d35/d60/l54 0 2024-04-19T02:18:31.053 INFO:tasks.workunit.client.0.smithi073.stdout:6/265: sync 2024-04-19T02:18:31.053 INFO:tasks.workunit.client.0.smithi073.stdout:1/224: symlink db/d1c/d2c/l57 0 2024-04-19T02:18:31.054 INFO:tasks.workunit.client.0.smithi073.stdout:4/293: stat da/d27/d1b/d26/d2a/l57 0 2024-04-19T02:18:31.054 INFO:tasks.workunit.client.0.smithi073.stdout:7/240: creat d0/dc/f4c x:0 0 0 2024-04-19T02:18:31.055 INFO:tasks.workunit.client.0.smithi073.stdout:5/338: getdents d0/d1d/d24 0 2024-04-19T02:18:31.055 INFO:tasks.workunit.client.0.smithi073.stdout:2/233: mknod d5/d10/c5e 0 2024-04-19T02:18:31.056 INFO:tasks.workunit.client.0.smithi073.stdout:1/225: mknod db/d3e/c58 0 2024-04-19T02:18:31.056 INFO:tasks.workunit.client.0.smithi073.stdout:9/309: dwrite d0/df/d16/d1a/f63 [0,4194304] 0 2024-04-19T02:18:31.057 INFO:tasks.workunit.client.0.smithi073.stdout:6/266: mkdir d8/de/d58/d63 0 2024-04-19T02:18:31.057 INFO:tasks.workunit.client.0.smithi073.stdout:6/267: sync 2024-04-19T02:18:31.058 INFO:tasks.workunit.client.0.smithi073.stdout:6/268: readlink d8/l38 0 2024-04-19T02:18:31.059 INFO:tasks.workunit.client.0.smithi073.stdout:8/230: dwrite d14/d15/d17/f1f [0,4194304] 0 2024-04-19T02:18:31.059 INFO:tasks.workunit.client.0.smithi073.stdout:2/234: rmdir d5/d10/d14/d2e 39 2024-04-19T02:18:31.059 INFO:tasks.workunit.client.0.smithi073.stdout:1/226: write db/d41/f4c [525331,70751] 0 2024-04-19T02:18:31.059 INFO:tasks.workunit.client.0.smithi073.stdout:3/373: truncate d3/d6/d11/f5a 2554825 0 2024-04-19T02:18:31.059 INFO:tasks.workunit.client.0.smithi073.stdout:4/294: mknod da/d23/d2b/d54/c65 0 2024-04-19T02:18:31.060 INFO:tasks.workunit.client.0.smithi073.stdout:5/339: creat d0/d1d/d24/d61/f74 x:0 0 0 2024-04-19T02:18:31.063 INFO:tasks.workunit.client.0.smithi073.stdout:5/340: readlink d0/d1d/d25/d37/l50 0 2024-04-19T02:18:31.063 INFO:tasks.workunit.client.0.smithi073.stdout:6/269: creat d8/de/d22/f64 x:0 0 0 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:8/231: dread - d14/d15/d17/f3d zero size 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:9/310: mkdir d0/df/d16/d19/d38/d5d/d76 0 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:2/235: fdatasync d5/d10/d14/d18/d39/f46 0 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:0/217: dread d7/d14/d17/f1f [0,4194304] 0 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:1/227: rmdir db 39 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:8/232: dread - d14/d15/d17/f3d zero size 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:3/374: chown d3/d6/db/d3a/d38/d43/d4e/c6b 105791 1 2024-04-19T02:18:31.064 INFO:tasks.workunit.client.0.smithi073.stdout:7/241: dread d0/dc/d10/d15/f3e [0,4194304] 0 2024-04-19T02:18:31.065 INFO:tasks.workunit.client.0.smithi073.stdout:2/236: fsync d5/d10/d14/d18/d3e/f3c 0 2024-04-19T02:18:31.065 INFO:tasks.workunit.client.0.smithi073.stdout:9/311: readlink d0/df/d16/d19/d38/d5d/d45/l67 0 2024-04-19T02:18:31.065 INFO:tasks.workunit.client.0.smithi073.stdout:4/295: getdents da/d23/d2b/d54 0 2024-04-19T02:18:31.065 INFO:tasks.workunit.client.0.smithi073.stdout:3/375: dread - d3/d6/db/f7e zero size 2024-04-19T02:18:31.065 INFO:tasks.workunit.client.0.smithi073.stdout:8/233: creat d14/d15/f42 x:0 0 0 2024-04-19T02:18:31.065 INFO:tasks.workunit.client.0.smithi073.stdout:1/228: creat db/d41/f59 x:0 0 0 2024-04-19T02:18:31.067 INFO:tasks.workunit.client.0.smithi073.stdout:0/218: write d7/d14/d17/d1a/d20/f27 [1121324,86385] 0 2024-04-19T02:18:31.067 INFO:tasks.workunit.client.0.smithi073.stdout:3/376: dread - d3/d6/f1e zero size 2024-04-19T02:18:31.067 INFO:tasks.workunit.client.0.smithi073.stdout:9/312: write d0/df/d1d/d47/f4f [897046,2435] 0 2024-04-19T02:18:31.068 INFO:tasks.workunit.client.0.smithi073.stdout:8/234: fdatasync d14/d15/d17/f2c 0 2024-04-19T02:18:31.068 INFO:tasks.workunit.client.0.smithi073.stdout:3/377: dread - d3/d6/db/f7e zero size 2024-04-19T02:18:31.068 INFO:tasks.workunit.client.0.smithi073.stdout:8/235: mknod d14/d27/c43 0 2024-04-19T02:18:31.068 INFO:tasks.workunit.client.0.smithi073.stdout:4/296: link da/d27/d1b/d1d/c24 da/d27/d2c/d60/c66 0 2024-04-19T02:18:31.068 INFO:tasks.workunit.client.0.smithi073.stdout:9/313: rename d0/df/d1d/f5a to d0/df/d16/d1a/d2c/f77 0 2024-04-19T02:18:31.068 INFO:tasks.workunit.client.0.smithi073.stdout:3/378: write d3/d6/db/d3a/d38/d40/f6e [916204,3577] 0 2024-04-19T02:18:31.069 INFO:tasks.workunit.client.0.smithi073.stdout:9/314: creat d0/df/f78 x:0 0 0 2024-04-19T02:18:31.069 INFO:tasks.workunit.client.0.smithi073.stdout:3/379: getdents d3/d6/d11/d7b 0 2024-04-19T02:18:31.070 INFO:tasks.workunit.client.0.smithi073.stdout:3/380: dread - d3/d6/f1e zero size 2024-04-19T02:18:31.070 INFO:tasks.workunit.client.0.smithi073.stdout:9/315: rmdir d0/df/d16/d1a/d2c/d2e 39 2024-04-19T02:18:31.071 INFO:tasks.workunit.client.0.smithi073.stdout:6/270: dwrite d8/de/d35/d60/f3f [0,4194304] 0 2024-04-19T02:18:31.072 INFO:tasks.workunit.client.0.smithi073.stdout:3/381: chown d3/d6/db/d1a/d54/f7f 1 1 2024-04-19T02:18:31.072 INFO:tasks.workunit.client.0.smithi073.stdout:1/229: dwrite db/f13 [0,4194304] 0 2024-04-19T02:18:31.072 INFO:tasks.workunit.client.0.smithi073.stdout:9/316: write d0/f13 [520342,58459] 0 2024-04-19T02:18:31.074 INFO:tasks.workunit.client.0.smithi073.stdout:8/236: dwrite d14/d15/d17/f3d [0,4194304] 0 2024-04-19T02:18:31.076 INFO:tasks.workunit.client.0.smithi073.stdout:3/382: fdatasync d3/d6/db/d1a/f4c 0 2024-04-19T02:18:31.078 INFO:tasks.workunit.client.0.smithi073.stdout:7/242: truncate d0/dc/d39/d40/f49 179196 0 2024-04-19T02:18:31.079 INFO:tasks.workunit.client.0.smithi073.stdout:7/243: readlink d0/dc/l16 0 2024-04-19T02:18:31.080 INFO:tasks.workunit.client.0.smithi073.stdout:3/383: write d3/d6/db/d3a/d5f/f78 [695632,20759] 0 2024-04-19T02:18:31.081 INFO:tasks.workunit.client.0.smithi073.stdout:7/244: read d0/dc/d39/f3f [2248604,102689] 0 2024-04-19T02:18:31.081 INFO:tasks.workunit.client.0.smithi073.stdout:3/384: dread - d3/d6/db/f14 zero size 2024-04-19T02:18:31.082 INFO:tasks.workunit.client.0.smithi073.stdout:1/230: dwrite db/d41/f4c [0,4194304] 0 2024-04-19T02:18:31.083 INFO:tasks.workunit.client.0.smithi073.stdout:6/271: dwrite d8/de/d35/f3d [0,4194304] 0 2024-04-19T02:18:31.083 INFO:tasks.workunit.client.0.smithi073.stdout:3/385: unlink d3/d6/db/d3a/l33 0 2024-04-19T02:18:31.083 INFO:tasks.workunit.client.0.smithi073.stdout:7/245: fsync d0/dc/d10/d15/f3e 0 2024-04-19T02:18:31.084 INFO:tasks.workunit.client.0.smithi073.stdout:8/237: dwrite d14/d15/d17/f21 [0,4194304] 0 2024-04-19T02:18:31.085 INFO:tasks.workunit.client.0.smithi073.stdout:1/231: mknod db/d1c/d54/c5a 0 2024-04-19T02:18:31.085 INFO:tasks.workunit.client.0.smithi073.stdout:6/272: creat d8/de/d35/f65 x:0 0 0 2024-04-19T02:18:31.085 INFO:tasks.workunit.client.0.smithi073.stdout:8/238: chown lf 464731418 1 2024-04-19T02:18:31.085 INFO:tasks.workunit.client.0.smithi073.stdout:8/239: write d14/d15/f35 [61693,82315] 0 2024-04-19T02:18:31.086 INFO:tasks.workunit.client.0.smithi073.stdout:6/273: creat d8/f66 x:0 0 0 2024-04-19T02:18:31.086 INFO:tasks.workunit.client.0.smithi073.stdout:1/232: getdents db/d41 0 2024-04-19T02:18:31.087 INFO:tasks.workunit.client.0.smithi073.stdout:8/240: creat d14/d33/f44 x:0 0 0 2024-04-19T02:18:31.087 INFO:tasks.workunit.client.0.smithi073.stdout:6/274: write d8/de/f4d [3144259,1176] 0 2024-04-19T02:18:31.087 INFO:tasks.workunit.client.0.smithi073.stdout:6/275: chown d8/de/d22/c5e 11217767 1 2024-04-19T02:18:31.088 INFO:tasks.workunit.client.0.smithi073.stdout:6/276: chown d8/f66 8753187 1 2024-04-19T02:18:31.088 INFO:tasks.workunit.client.0.smithi073.stdout:1/233: link db/d41/c4e db/d1c/c5b 0 2024-04-19T02:18:31.088 INFO:tasks.workunit.client.0.smithi073.stdout:6/277: creat d8/de/f67 x:0 0 0 2024-04-19T02:18:31.092 INFO:tasks.workunit.client.0.smithi073.stdout:8/241: dwrite f6 [0,4194304] 0 2024-04-19T02:18:31.095 INFO:tasks.workunit.client.0.smithi073.stdout:8/242: dread f0 [0,4194304] 0 2024-04-19T02:18:31.097 INFO:tasks.workunit.client.0.smithi073.stdout:9/317: truncate d0/f50 4109049 0 2024-04-19T02:18:31.097 INFO:tasks.workunit.client.0.smithi073.stdout:3/386: getdents d3/d6/db/d3a 0 2024-04-19T02:18:31.098 INFO:tasks.workunit.client.0.smithi073.stdout:9/318: dread - d0/df/d16/d19/d38/f66 zero size 2024-04-19T02:18:31.098 INFO:tasks.workunit.client.0.smithi073.stdout:3/387: write d3/d6/f9 [4816636,34615] 0 2024-04-19T02:18:31.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/319: mknod d0/df/d1d/d47/d5c/c79 0 2024-04-19T02:18:31.102 INFO:tasks.workunit.client.0.smithi073.stdout:6/278: dwrite d8/de/d35/f4a [0,4194304] 0 2024-04-19T02:18:31.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/243: dread d14/d15/f1e [0,4194304] 0 2024-04-19T02:18:31.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/244: dread - d14/d33/f44 zero size 2024-04-19T02:18:31.104 INFO:tasks.workunit.client.0.smithi073.stdout:9/320: link d0/df/d1d/f65 d0/df/d16/d19/d38/d5d/d45/f7a 0 2024-04-19T02:18:31.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/279: rename d8/de/d22/c5c to d8/de/c68 0 2024-04-19T02:18:31.105 INFO:tasks.workunit.client.0.smithi073.stdout:6/280: truncate d8/de/f28 4908433 0 2024-04-19T02:18:31.105 INFO:tasks.workunit.client.0.smithi073.stdout:3/388: dwrite d3/d6/f22 [4194304,4194304] 0 2024-04-19T02:18:31.106 INFO:tasks.workunit.client.0.smithi073.stdout:6/281: mknod d8/de/d58/d63/c69 0 2024-04-19T02:18:31.107 INFO:tasks.workunit.client.0.smithi073.stdout:3/389: truncate d3/d6/db/d1a/f4c 166518 0 2024-04-19T02:18:31.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/282: symlink d8/d4b/l6a 0 2024-04-19T02:18:31.107 INFO:tasks.workunit.client.0.smithi073.stdout:8/245: dread f0 [0,4194304] 0 2024-04-19T02:18:31.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/283: fdatasync f3 0 2024-04-19T02:18:31.108 INFO:tasks.workunit.client.0.smithi073.stdout:8/246: dread - d14/d27/d29/d31/d34/f40 zero size 2024-04-19T02:18:31.108 INFO:tasks.workunit.client.0.smithi073.stdout:6/284: link f3 d8/de/d58/d63/f6b 0 2024-04-19T02:18:31.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/390: readlink d3/d6/db/l51 0 2024-04-19T02:18:31.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/391: stat d3/f5 0 2024-04-19T02:18:31.110 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:31.110 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:31.110 INFO:tasks.workunit.client.0.smithi073.stdout:3/392: rename d3/d6/db/l51 to d3/d6/db/d3a/d38/d40/l85 0 2024-04-19T02:18:31.111 INFO:tasks.workunit.client.0.smithi073.stdout:6/285: write d8/de/d58/d63/f6b [2745582,101351] 0 2024-04-19T02:18:31.111 INFO:tasks.workunit.client.0.smithi073.stdout:3/393: mknod d3/d6/db/d16/c86 0 2024-04-19T02:18:31.111 INFO:tasks.workunit.client.0.smithi073.stdout:6/286: chown d8/de/f4d 5 1 2024-04-19T02:18:31.111 INFO:tasks.workunit.client.0.smithi073.stdout:3/394: fsync d3/d6/f1d 0 2024-04-19T02:18:31.119 INFO:tasks.workunit.client.0.smithi073.stdout:1/234: dread db/d41/f48 [0,4194304] 0 2024-04-19T02:18:31.122 INFO:tasks.workunit.client.0.smithi073.stdout:1/235: dread db/d1c/f3c [0,4194304] 0 2024-04-19T02:18:31.123 INFO:tasks.workunit.client.0.smithi073.stdout:4/297: dread da/d27/d2c/f3c [0,4194304] 0 2024-04-19T02:18:31.123 INFO:tasks.workunit.client.0.smithi073.stdout:1/236: rmdir db/d1c/d54 39 2024-04-19T02:18:31.124 INFO:tasks.workunit.client.0.smithi073.stdout:1/237: dread - db/f2f zero size 2024-04-19T02:18:31.124 INFO:tasks.workunit.client.0.smithi073.stdout:4/298: dread da/d27/d2c/f3c [0,4194304] 0 2024-04-19T02:18:31.124 INFO:tasks.workunit.client.0.smithi073.stdout:1/238: creat db/d1c/d2c/f5c x:0 0 0 2024-04-19T02:18:31.125 INFO:tasks.workunit.client.0.smithi073.stdout:4/299: rename c9 to da/d27/d3a/d49/c67 0 2024-04-19T02:18:31.125 INFO:tasks.workunit.client.0.smithi073.stdout:6/287: truncate d8/de/d35/f4a 1204857 0 2024-04-19T02:18:31.126 INFO:tasks.workunit.client.0.smithi073.stdout:3/395: truncate d3/f49 975818 0 2024-04-19T02:18:31.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/321: link d0/f50 d0/df/d16/d1a/d2c/d2e/f7b 0 2024-04-19T02:18:31.127 INFO:tasks.workunit.client.0.smithi073.stdout:2/237: fdatasync d5/d10/d14/f2c 0 2024-04-19T02:18:31.127 INFO:tasks.workunit.client.0.smithi073.stdout:1/239: rename db/d1c/f3b to db/d1c/f5d 0 2024-04-19T02:18:31.127 INFO:tasks.workunit.client.0.smithi073.stdout:6/288: mknod d8/de/c6c 0 2024-04-19T02:18:31.127 INFO:tasks.workunit.client.0.smithi073.stdout:3/396: creat d3/d6/db/d1a/d2f/f87 x:0 0 0 2024-04-19T02:18:31.127 INFO:tasks.workunit.client.0.smithi073.stdout:1/240: rename db/d1c to db/d1c/d2c/d5e 22 2024-04-19T02:18:31.127 INFO:tasks.workunit.client.0.smithi073.stdout:3/397: chown d3/d6/db/f45 17 1 2024-04-19T02:18:31.127 INFO:tasks.workunit.client.0.smithi073.stdout:2/238: unlink d5/d10/d14/d18/d1e/l19 0 2024-04-19T02:18:31.128 INFO:tasks.workunit.client.0.smithi073.stdout:3/398: dread - d3/d6/f1e zero size 2024-04-19T02:18:31.128 INFO:tasks.workunit.client.0.smithi073.stdout:9/322: link d0/df/d16/d19/d38/d5d/d45/l49 d0/df/d16/d19/d38/d5d/l7c 0 2024-04-19T02:18:31.129 INFO:tasks.workunit.client.0.smithi073.stdout:4/300: dread da/d27/d2c/f30 [0,4194304] 0 2024-04-19T02:18:31.129 INFO:tasks.workunit.client.0.smithi073.stdout:2/239: fdatasync d5/d10/d14/d18/d3e/f3c 0 2024-04-19T02:18:31.129 INFO:tasks.workunit.client.0.smithi073.stdout:1/241: getdents db 0 2024-04-19T02:18:31.130 INFO:tasks.workunit.client.0.smithi073.stdout:4/301: fsync da/d27/f39 0 2024-04-19T02:18:31.130 INFO:tasks.workunit.client.0.smithi073.stdout:9/323: write d0/df/f78 [614001,127096] 0 2024-04-19T02:18:31.130 INFO:tasks.workunit.client.0.smithi073.stdout:1/242: creat db/f5f x:0 0 0 2024-04-19T02:18:31.131 INFO:tasks.workunit.client.0.smithi073.stdout:2/240: chown d5/d10/d14/d18/c38 76276 1 2024-04-19T02:18:31.131 INFO:tasks.workunit.client.0.smithi073.stdout:4/302: mkdir da/d23/d2b/d2f/d68 0 2024-04-19T02:18:31.132 INFO:tasks.workunit.client.0.smithi073.stdout:9/324: mkdir d0/df/d16/d19/d38/d5d/d76/d7d 0 2024-04-19T02:18:31.132 INFO:tasks.workunit.client.0.smithi073.stdout:8/247: sync 2024-04-19T02:18:31.132 INFO:tasks.workunit.client.0.smithi073.stdout:2/241: unlink d5/d10/d29/d42/l44 0 2024-04-19T02:18:31.132 INFO:tasks.workunit.client.0.smithi073.stdout:9/325: read - d0/df/d16/d19/f73 zero size 2024-04-19T02:18:31.132 INFO:tasks.workunit.client.0.smithi073.stdout:2/242: symlink d5/d10/l5f 0 2024-04-19T02:18:31.132 INFO:tasks.workunit.client.0.smithi073.stdout:8/248: link f12 d14/d33/f45 0 2024-04-19T02:18:31.133 INFO:tasks.workunit.client.0.smithi073.stdout:9/326: creat d0/df/d16/d19/d38/f7e x:0 0 0 2024-04-19T02:18:31.133 INFO:tasks.workunit.client.0.smithi073.stdout:9/327: fdatasync d0/df/d1d/f17 0 2024-04-19T02:18:31.134 INFO:tasks.workunit.client.0.smithi073.stdout:2/243: write d5/d10/d14/d18/d3e/d2d/d33/f4f [2989048,106000] 0 2024-04-19T02:18:31.135 INFO:tasks.workunit.client.0.smithi073.stdout:2/244: mknod d5/d10/d14/d18/d3e/d51/c60 0 2024-04-19T02:18:31.136 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:31.137 INFO:tasks.workunit.client.0.smithi073.stdout:3/399: write d3/d6/d11/f5a [150248,27072] 0 2024-04-19T02:18:31.139 INFO:tasks.workunit.client.0.smithi073.stdout:3/400: chown d3/d6/db/d1a/l58 12875 1 2024-04-19T02:18:31.140 INFO:tasks.workunit.client.0.smithi073.stdout:8/249: dwrite d14/d27/f30 [0,4194304] 0 2024-04-19T02:18:31.140 INFO:tasks.workunit.client.0.smithi073.stdout:0/219: dread d7/d14/f18 [0,4194304] 0 2024-04-19T02:18:31.140 INFO:tasks.workunit.client.0.smithi073.stdout:1/243: link db/f21 db/d1c/d2c/d50/f60 0 2024-04-19T02:18:31.141 INFO:tasks.workunit.client.0.smithi073.stdout:1/244: dread - db/d41/f59 zero size 2024-04-19T02:18:31.142 INFO:tasks.workunit.client.0.smithi073.stdout:1/245: creat db/d1c/d2c/f61 x:0 0 0 2024-04-19T02:18:31.143 INFO:tasks.workunit.client.0.smithi073.stdout:1/246: mkdir db/d1c/d2c/d50/d62 0 2024-04-19T02:18:31.145 INFO:tasks.workunit.client.0.smithi073.stdout:1/247: creat db/d1c/d2c/f63 x:0 0 0 2024-04-19T02:18:31.145 INFO:tasks.workunit.client.0.smithi073.stdout:0/220: write d7/f11 [5216940,9449] 0 2024-04-19T02:18:31.145 INFO:tasks.workunit.client.0.smithi073.stdout:3/401: truncate d3/d6/fd 1272366 0 2024-04-19T02:18:31.145 INFO:tasks.workunit.client.0.smithi073.stdout:4/303: sync 2024-04-19T02:18:31.146 INFO:tasks.workunit.client.0.smithi073.stdout:9/328: sync 2024-04-19T02:18:31.147 INFO:tasks.workunit.client.0.smithi073.stdout:3/402: write d3/d6/db/f66 [835825,116841] 0 2024-04-19T02:18:31.147 INFO:tasks.workunit.client.0.smithi073.stdout:5/341: dread d0/d1d/d24/f30 [0,4194304] 0 2024-04-19T02:18:31.147 INFO:tasks.workunit.client.0.smithi073.stdout:1/248: dread - db/f2f zero size 2024-04-19T02:18:31.148 INFO:tasks.workunit.client.0.smithi073.stdout:4/304: creat da/f69 x:0 0 0 2024-04-19T02:18:31.148 INFO:tasks.workunit.client.0.smithi073.stdout:8/250: dwrite d14/d27/f30 [0,4194304] 0 2024-04-19T02:18:31.149 INFO:tasks.workunit.client.0.smithi073.stdout:1/249: stat db/d1c/l4f 0 2024-04-19T02:18:31.149 INFO:tasks.workunit.client.0.smithi073.stdout:3/403: write d3/d6/f22 [1640443,115585] 0 2024-04-19T02:18:31.149 INFO:tasks.workunit.client.0.smithi073.stdout:5/342: mknod d0/d1d/d24/d62/c75 0 2024-04-19T02:18:31.149 INFO:tasks.workunit.client.0.smithi073.stdout:0/221: write f5 [1646782,87010] 0 2024-04-19T02:18:31.149 INFO:tasks.workunit.client.0.smithi073.stdout:3/404: unlink d3/f79 0 2024-04-19T02:18:31.150 INFO:tasks.workunit.client.0.smithi073.stdout:4/305: creat da/d27/d1b/d26/f6a x:0 0 0 2024-04-19T02:18:31.150 INFO:tasks.workunit.client.0.smithi073.stdout:9/329: rename d0/df/f10 to d0/df/d16/d1a/d2c/d2e/f7f 0 2024-04-19T02:18:31.150 INFO:tasks.workunit.client.0.smithi073.stdout:5/343: symlink d0/d1d/d1e/l76 0 2024-04-19T02:18:31.150 INFO:tasks.workunit.client.0.smithi073.stdout:1/250: mkdir db/d1c/d54/d64 0 2024-04-19T02:18:31.151 INFO:tasks.workunit.client.0.smithi073.stdout:0/222: mknod d7/d14/d17/d1a/c44 0 2024-04-19T02:18:31.151 INFO:tasks.workunit.client.0.smithi073.stdout:9/330: readlink d0/df/d16/d1a/l43 0 2024-04-19T02:18:31.151 INFO:tasks.workunit.client.0.smithi073.stdout:4/306: chown da/f69 140294254 1 2024-04-19T02:18:31.152 INFO:tasks.workunit.client.0.smithi073.stdout:3/405: mkdir d3/d6/db/d3a/d38/d57/d88 0 2024-04-19T02:18:31.153 INFO:tasks.workunit.client.0.smithi073.stdout:4/307: mknod da/d27/d1b/c6b 0 2024-04-19T02:18:31.154 INFO:tasks.workunit.client.0.smithi073.stdout:5/344: link d0/d1d/d25/d37/d71/f73 d0/d1d/d25/d37/f77 0 2024-04-19T02:18:31.155 INFO:tasks.workunit.client.0.smithi073.stdout:4/308: readlink da/d27/d1b/l35 0 2024-04-19T02:18:31.155 INFO:tasks.workunit.client.0.smithi073.stdout:3/406: write d3/d6/db/f2d [3410509,38714] 0 2024-04-19T02:18:31.155 INFO:tasks.workunit.client.0.smithi073.stdout:6/289: dread d8/de/d58/d63/f6b [0,4194304] 0 2024-04-19T02:18:31.156 INFO:tasks.workunit.client.0.smithi073.stdout:5/345: fdatasync d0/f41 0 2024-04-19T02:18:31.157 INFO:tasks.workunit.client.0.smithi073.stdout:6/290: write d8/de/d22/f37 [1025925,8299] 0 2024-04-19T02:18:31.157 INFO:tasks.workunit.client.0.smithi073.stdout:3/407: chown d3/d6/db/d3a/d38/d57/f7a 900224866 1 2024-04-19T02:18:31.158 INFO:tasks.workunit.client.0.smithi073.stdout:9/331: dread d0/df/d16/d19/d38/d5d/d45/f6a [0,4194304] 0 2024-04-19T02:18:31.158 INFO:tasks.workunit.client.0.smithi073.stdout:2/245: dread d5/d10/d14/d18/d39/f46 [0,4194304] 0 2024-04-19T02:18:31.159 INFO:tasks.workunit.client.0.smithi073.stdout:1/251: dwrite db/d41/f59 [0,4194304] 0 2024-04-19T02:18:31.160 INFO:tasks.workunit.client.0.smithi073.stdout:6/291: mknod d8/de/d58/c6d 0 2024-04-19T02:18:31.160 INFO:tasks.workunit.client.0.smithi073.stdout:8/251: dwrite d14/d15/f1e [0,4194304] 0 2024-04-19T02:18:31.161 INFO:tasks.workunit.client.0.smithi073.stdout:3/408: mkdir d3/d6/db/d3a/d38/d89 0 2024-04-19T02:18:31.161 INFO:tasks.workunit.client.0.smithi073.stdout:2/246: chown d5/d10/d14/d18/d3e/d2d/d33 36 1 2024-04-19T02:18:31.161 INFO:tasks.workunit.client.0.smithi073.stdout:8/252: chown d14/d27 93 1 2024-04-19T02:18:31.162 INFO:tasks.workunit.client.0.smithi073.stdout:1/252: dread - db/d1c/d2c/f45 zero size 2024-04-19T02:18:31.162 INFO:tasks.workunit.client.0.smithi073.stdout:9/332: creat d0/df/d16/d19/d38/d5d/d6d/f80 x:0 0 0 2024-04-19T02:18:31.162 INFO:tasks.workunit.client.0.smithi073.stdout:2/247: chown d5/d10/d29/d42 6824 1 2024-04-19T02:18:31.163 INFO:tasks.workunit.client.0.smithi073.stdout:6/292: truncate d8/de/d35/f65 894356 0 2024-04-19T02:18:31.163 INFO:tasks.workunit.client.0.smithi073.stdout:8/253: mknod d14/d15/d17/c46 0 2024-04-19T02:18:31.164 INFO:tasks.workunit.client.0.smithi073.stdout:7/246: dread d0/dc/d33/d36/f3b [0,4194304] 0 2024-04-19T02:18:31.164 INFO:tasks.workunit.client.0.smithi073.stdout:4/309: dread da/f44 [0,4194304] 0 2024-04-19T02:18:31.164 INFO:tasks.workunit.client.0.smithi073.stdout:8/254: chown d14/d15/d17/c25 4493 1 2024-04-19T02:18:31.166 INFO:tasks.workunit.client.0.smithi073.stdout:6/293: symlink d8/de/l6e 0 2024-04-19T02:18:31.166 INFO:tasks.workunit.client.0.smithi073.stdout:1/253: creat db/f65 x:0 0 0 2024-04-19T02:18:31.166 INFO:tasks.workunit.client.0.smithi073.stdout:7/247: mknod d0/d28/c4d 0 2024-04-19T02:18:31.166 INFO:tasks.workunit.client.0.smithi073.stdout:2/248: symlink d5/d10/d14/d18/d3e/d51/l61 0 2024-04-19T02:18:31.167 INFO:tasks.workunit.client.0.smithi073.stdout:4/310: mknod da/d27/d3a/c6c 0 2024-04-19T02:18:31.167 INFO:tasks.workunit.client.0.smithi073.stdout:9/333: rename d0/df/d1d/d47 to d0/d81 0 2024-04-19T02:18:31.167 INFO:tasks.workunit.client.0.smithi073.stdout:8/255: chown f12 1349979 1 2024-04-19T02:18:31.167 INFO:tasks.workunit.client.0.smithi073.stdout:5/346: dwrite d0/f1b [0,4194304] 0 2024-04-19T02:18:31.168 INFO:tasks.workunit.client.0.smithi073.stdout:9/334: readlink d0/d81/d5c/l69 0 2024-04-19T02:18:31.168 INFO:tasks.workunit.client.0.smithi073.stdout:6/294: symlink d8/de/d58/d63/l6f 0 2024-04-19T02:18:31.168 INFO:tasks.workunit.client.0.smithi073.stdout:7/248: mkdir d0/d4e 0 2024-04-19T02:18:31.168 INFO:tasks.workunit.client.0.smithi073.stdout:1/254: chown db/d1c/d2c/l4b 415816551 1 2024-04-19T02:18:31.169 INFO:tasks.workunit.client.0.smithi073.stdout:4/311: write da/d27/d1b/d26/f4a [4669585,24039] 0 2024-04-19T02:18:31.169 INFO:tasks.workunit.client.0.smithi073.stdout:1/255: sync 2024-04-19T02:18:31.169 INFO:tasks.workunit.client.0.smithi073.stdout:6/295: write d8/de/d35/f65 [1212312,77189] 0 2024-04-19T02:18:31.169 INFO:tasks.workunit.client.0.smithi073.stdout:3/409: truncate d3/d6/f22 925752 0 2024-04-19T02:18:31.170 INFO:tasks.workunit.client.0.smithi073.stdout:5/347: mknod d0/d2d/c78 0 2024-04-19T02:18:31.170 INFO:tasks.workunit.client.0.smithi073.stdout:2/249: creat d5/d10/d14/d18/d3e/f62 x:0 0 0 2024-04-19T02:18:31.170 INFO:tasks.workunit.client.0.smithi073.stdout:7/249: creat d0/dc/d39/f4f x:0 0 0 2024-04-19T02:18:31.170 INFO:tasks.workunit.client.0.smithi073.stdout:8/256: rename d14/d27/d29/d31 to d14/d27/d29/d31/d47 22 2024-04-19T02:18:31.170 INFO:tasks.workunit.client.0.smithi073.stdout:9/335: creat d0/df/d16/d1a/d2c/d2e/f82 x:0 0 0 2024-04-19T02:18:31.170 INFO:tasks.workunit.client.0.smithi073.stdout:1/256: symlink db/d1c/d2c/d50/l66 0 2024-04-19T02:18:31.170 INFO:tasks.workunit.client.0.smithi073.stdout:4/312: write da/d27/d1b/d26/f6a [247487,59943] 0 2024-04-19T02:18:31.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/257: chown d14/d15/d17/c28 61 1 2024-04-19T02:18:31.171 INFO:tasks.workunit.client.0.smithi073.stdout:6/296: chown d8/de/d58/d63/c69 19761 1 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:7/250: truncate d0/f3c 2245604 0 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:5/348: mkdir d0/d69/d79 0 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:1/257: chown db/f21 661135340 1 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:8/258: mkdir d14/d15/d17/d48 0 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/297: fdatasync d8/f11 0 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:2/250: rename d5/d10/d14/d18/d39 to d5/d10/d14/d18/d3e/d2d/d63 0 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:1/258: chown db/d1c/d2c/f45 8 1 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/298: mknod d8/de/d22/c70 0 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:8/259: mknod d14/c49 0 2024-04-19T02:18:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:5/349: write d0/f16 [2284116,78766] 0 2024-04-19T02:18:31.174 INFO:tasks.workunit.client.0.smithi073.stdout:4/313: rename da/d27/d1b/d26/d2a/l5f to da/l6d 0 2024-04-19T02:18:31.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/251: creat d5/f64 x:0 0 0 2024-04-19T02:18:31.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/299: write d8/de/d35/d60/f3f [1452514,109950] 0 2024-04-19T02:18:31.175 INFO:tasks.workunit.client.0.smithi073.stdout:1/259: creat db/d41/f67 x:0 0 0 2024-04-19T02:18:31.177 INFO:tasks.workunit.client.0.smithi073.stdout:4/314: write da/d27/d1b/d1d/f37 [1980709,44716] 0 2024-04-19T02:18:31.182 INFO:tasks.workunit.client.0.smithi073.stdout:3/410: dread d3/d6/f1d [0,4194304] 0 2024-04-19T02:18:31.182 INFO:tasks.workunit.client.0.smithi073.stdout:9/336: dwrite d0/df/d16/d19/f26 [0,4194304] 0 2024-04-19T02:18:31.183 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:31.180+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:31.184 INFO:tasks.workunit.client.0.smithi073.stdout:4/315: getdents da/d27/d2c 0 2024-04-19T02:18:31.184 INFO:tasks.workunit.client.0.smithi073.stdout:7/251: dwrite d0/dc/d39/d40/f49 [0,4194304] 0 2024-04-19T02:18:31.184 INFO:tasks.workunit.client.0.smithi073.stdout:3/411: write d3/d6/db/f14 [673396,5200] 0 2024-04-19T02:18:31.187 INFO:tasks.workunit.client.0.smithi073.stdout:8/260: dwrite f0 [4194304,4194304] 0 2024-04-19T02:18:31.187 INFO:tasks.workunit.client.0.smithi073.stdout:9/337: read - d0/df/d16/d19/d38/d5d/d5e/f75 zero size 2024-04-19T02:18:31.187 INFO:tasks.workunit.client.0.smithi073.stdout:3/412: chown d3/d6/db/d16 930430 1 2024-04-19T02:18:31.187 INFO:tasks.workunit.client.0.smithi073.stdout:1/260: dwrite db/f2f [0,4194304] 0 2024-04-19T02:18:31.188 INFO:tasks.workunit.client.0.smithi073.stdout:2/252: dwrite d5/f7 [0,4194304] 0 2024-04-19T02:18:31.188 INFO:tasks.workunit.client.0.smithi073.stdout:7/252: write d0/d28/f4b [898004,127421] 0 2024-04-19T02:18:31.189 INFO:tasks.workunit.client.0.smithi073.stdout:8/261: creat d14/d15/d17/f4a x:0 0 0 2024-04-19T02:18:31.189 INFO:tasks.workunit.client.0.smithi073.stdout:9/338: fdatasync d0/df/d16/d1a/d2c/f56 0 2024-04-19T02:18:31.189 INFO:tasks.workunit.client.0.smithi073.stdout:8/262: fdatasync d14/d27/d29/d31/f3f 0 2024-04-19T02:18:31.190 INFO:tasks.workunit.client.0.smithi073.stdout:2/253: write d5/d10/d14/d2e/f54 [585585,9142] 0 2024-04-19T02:18:31.191 INFO:tasks.workunit.client.0.smithi073.stdout:7/253: rename d0/d3/d12 to d0/dc/d39/d50 0 2024-04-19T02:18:31.191 INFO:tasks.workunit.client.0.smithi073.stdout:2/254: dread - d5/d10/d14/d18/d1e/f55 zero size 2024-04-19T02:18:31.191 INFO:tasks.workunit.client.0.smithi073.stdout:9/339: unlink d0/df/d16/d19/d38/d5d/l7c 0 2024-04-19T02:18:31.192 INFO:tasks.workunit.client.0.smithi073.stdout:7/254: rename d0/d4e to d0/dc/d10/d2a/d51 0 2024-04-19T02:18:31.192 INFO:tasks.workunit.client.0.smithi073.stdout:9/340: write d0/df/d16/d1a/f52 [966983,111464] 0 2024-04-19T02:18:31.193 INFO:tasks.workunit.client.0.smithi073.stdout:1/261: dwrite db/f28 [0,4194304] 0 2024-04-19T02:18:31.194 INFO:tasks.workunit.client.0.smithi073.stdout:1/262: creat db/d41/f68 x:0 0 0 2024-04-19T02:18:31.195 INFO:tasks.workunit.client.0.smithi073.stdout:1/263: write db/f2a [937468,53369] 0 2024-04-19T02:18:31.195 INFO:tasks.workunit.client.0.smithi073.stdout:1/264: sync 2024-04-19T02:18:31.196 INFO:tasks.workunit.client.0.smithi073.stdout:3/413: write d3/d6/f22 [1595012,110108] 0 2024-04-19T02:18:31.197 INFO:tasks.workunit.client.0.smithi073.stdout:1/265: chown db/l19 261975 1 2024-04-19T02:18:31.197 INFO:tasks.workunit.client.0.smithi073.stdout:1/266: getdents db/d1c/d2c/d50 0 2024-04-19T02:18:31.199 INFO:tasks.workunit.client.0.smithi073.stdout:3/414: truncate d3/d6/db/d3a/d38/d43/f6a 329631 0 2024-04-19T02:18:31.199 INFO:tasks.workunit.client.0.smithi073.stdout:7/255: write d0/dc/d39/d40/f44 [6097388,10936] 0 2024-04-19T02:18:31.199 INFO:tasks.workunit.client.0.smithi073.stdout:1/267: rename db/f5f to db/d1c/d2c/f69 0 2024-04-19T02:18:31.201 INFO:tasks.workunit.client.0.smithi073.stdout:3/415: rename d3/d6/c68 to d3/d6/d11/d7b/c8a 0 2024-04-19T02:18:31.202 INFO:tasks.workunit.client.0.smithi073.stdout:1/268: rename db/f18 to db/d1c/d54/f6a 0 2024-04-19T02:18:31.202 INFO:tasks.workunit.client.0.smithi073.stdout:9/341: dread d0/df/d16/d1a/d2c/d2e/f4b [0,4194304] 0 2024-04-19T02:18:31.202 INFO:tasks.workunit.client.0.smithi073.stdout:8/263: dwrite f11 [0,4194304] 0 2024-04-19T02:18:31.202 INFO:tasks.workunit.client.0.smithi073.stdout:1/269: stat db/d41/l4a 0 2024-04-19T02:18:31.203 INFO:tasks.workunit.client.0.smithi073.stdout:8/264: creat d14/d33/f4b x:0 0 0 2024-04-19T02:18:31.203 INFO:tasks.workunit.client.0.smithi073.stdout:1/270: unlink db/f2f 0 2024-04-19T02:18:31.203 INFO:tasks.workunit.client.0.smithi073.stdout:9/342: mkdir d0/df/d16/d19/d38/d5d/d5e/d83 0 2024-04-19T02:18:31.204 INFO:tasks.workunit.client.0.smithi073.stdout:1/271: truncate db/d1c/f34 219941 0 2024-04-19T02:18:31.204 INFO:tasks.workunit.client.0.smithi073.stdout:8/265: write d14/d33/f4b [139885,2612] 0 2024-04-19T02:18:31.204 INFO:tasks.workunit.client.0.smithi073.stdout:9/343: creat d0/df/d16/d19/d38/d5d/f84 x:0 0 0 2024-04-19T02:18:31.205 INFO:tasks.workunit.client.0.smithi073.stdout:1/272: creat db/d1c/d2c/d50/f6b x:0 0 0 2024-04-19T02:18:31.205 INFO:tasks.workunit.client.0.smithi073.stdout:8/266: write d14/d15/f35 [793880,115560] 0 2024-04-19T02:18:31.206 INFO:tasks.workunit.client.0.smithi073.stdout:9/344: symlink d0/df/d16/d19/d38/d5d/d76/l85 0 2024-04-19T02:18:31.206 INFO:tasks.workunit.client.0.smithi073.stdout:1/273: write db/d41/f53 [791520,19102] 0 2024-04-19T02:18:31.207 INFO:tasks.workunit.client.0.smithi073.stdout:7/256: dwrite d0/dc/d33/d36/f3b [0,4194304] 0 2024-04-19T02:18:31.208 INFO:tasks.workunit.client.0.smithi073.stdout:1/274: unlink db/d1c/l4f 0 2024-04-19T02:18:31.208 INFO:tasks.workunit.client.0.smithi073.stdout:9/345: symlink d0/df/d60/d72/l86 0 2024-04-19T02:18:31.208 INFO:tasks.workunit.client.0.smithi073.stdout:1/275: dread - db/d1c/d2c/d50/f60 zero size 2024-04-19T02:18:31.209 INFO:tasks.workunit.client.0.smithi073.stdout:7/257: rename d0/dc/d10/d2a/c2f to d0/dc/d10/d15/c52 0 2024-04-19T02:18:31.209 INFO:tasks.workunit.client.0.smithi073.stdout:5/350: dread d0/d1d/f20 [4194304,4194304] 0 2024-04-19T02:18:31.209 INFO:tasks.workunit.client.0.smithi073.stdout:2/255: read d5/f8 [872942,25385] 0 2024-04-19T02:18:31.210 INFO:tasks.workunit.client.0.smithi073.stdout:2/256: truncate d5/d10/d14/d18/d1e/f55 524072 0 2024-04-19T02:18:31.211 INFO:tasks.workunit.client.0.smithi073.stdout:1/276: symlink db/d1c/d2c/l6c 0 2024-04-19T02:18:31.212 INFO:tasks.workunit.client.0.smithi073.stdout:5/351: creat d0/d1d/d64/f7a x:0 0 0 2024-04-19T02:18:31.212 INFO:tasks.workunit.client.0.smithi073.stdout:1/277: creat db/d1c/d2c/d50/f6d x:0 0 0 2024-04-19T02:18:31.213 INFO:tasks.workunit.client.0.smithi073.stdout:8/267: dread d14/d15/d17/f1f [0,4194304] 0 2024-04-19T02:18:31.214 INFO:tasks.workunit.client.0.smithi073.stdout:7/258: truncate d0/d28/f4b 644781 0 2024-04-19T02:18:31.218 INFO:tasks.workunit.client.0.smithi073.stdout:2/257: dwrite d5/f16 [0,4194304] 0 2024-04-19T02:18:31.219 INFO:tasks.workunit.client.0.smithi073.stdout:2/258: unlink d5/l6 0 2024-04-19T02:18:31.219 INFO:tasks.workunit.client.0.smithi073.stdout:1/278: dwrite db/d41/f48 [0,4194304] 0 2024-04-19T02:18:31.221 INFO:tasks.workunit.client.0.smithi073.stdout:2/259: fdatasync d5/d10/d14/d18/d1e/f58 0 2024-04-19T02:18:31.221 INFO:tasks.workunit.client.0.smithi073.stdout:7/259: dwrite d0/f1d [4194304,4194304] 0 2024-04-19T02:18:31.223 INFO:tasks.workunit.client.0.smithi073.stdout:2/260: rename d5/d10/d29/c4a to d5/d10/d53/c65 0 2024-04-19T02:18:31.224 INFO:tasks.workunit.client.0.smithi073.stdout:7/260: getdents d0/dc/d10/d2a 0 2024-04-19T02:18:31.227 INFO:tasks.workunit.client.0.smithi073.stdout:1/279: dwrite db/d1c/d2c/f3d [0,4194304] 0 2024-04-19T02:18:31.230 INFO:tasks.workunit.client.0.smithi073.stdout:3/416: sync 2024-04-19T02:18:31.233 INFO:tasks.workunit.client.0.smithi073.stdout:3/417: write d3/d6/db/d16/d52/f56 [990944,32622] 0 2024-04-19T02:18:31.233 INFO:tasks.workunit.client.0.smithi073.stdout:3/418: creat d3/d6/d11/d7b/f8b x:0 0 0 2024-04-19T02:18:31.233 INFO:tasks.workunit.client.0.smithi073.stdout:3/419: link d3/d6/db/d3a/d38/d40/f77 d3/d6/f8c 0 2024-04-19T02:18:31.234 INFO:tasks.workunit.client.0.smithi073.stdout:3/420: fdatasync d3/d6/db/d23/f27 0 2024-04-19T02:18:31.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/261: truncate d5/f11 2249856 0 2024-04-19T02:18:31.235 INFO:tasks.workunit.client.0.smithi073.stdout:2/262: readlink d5/d10/d14/d18/d1e/l3b 0 2024-04-19T02:18:31.239 INFO:tasks.workunit.client.0.smithi073.stdout:3/421: dwrite d3/d6/db/d1a/d2f/f87 [0,4194304] 0 2024-04-19T02:18:31.240 INFO:tasks.workunit.client.0.smithi073.stdout:6/300: dread d8/f10 [4194304,4194304] 0 2024-04-19T02:18:31.241 INFO:tasks.workunit.client.0.smithi073.stdout:3/422: chown d3/d6/db/d3a/d38/d40/l76 361866558 1 2024-04-19T02:18:31.243 INFO:tasks.workunit.client.0.smithi073.stdout:8/268: sync 2024-04-19T02:18:31.243 INFO:tasks.workunit.client.0.smithi073.stdout:9/346: sync 2024-04-19T02:18:31.244 INFO:tasks.workunit.client.0.smithi073.stdout:8/269: mkdir d14/d27/d4c 0 2024-04-19T02:18:31.244 INFO:tasks.workunit.client.0.smithi073.stdout:9/347: dread - d0/df/d16/d1a/d2c/f46 zero size 2024-04-19T02:18:31.244 INFO:tasks.workunit.client.0.smithi073.stdout:9/348: rmdir d0/d81 39 2024-04-19T02:18:31.244 INFO:tasks.workunit.client.0.smithi073.stdout:8/270: fdatasync d14/d27/d29/d31/d34/f3a 0 2024-04-19T02:18:31.245 INFO:tasks.workunit.client.0.smithi073.stdout:8/271: symlink d14/d27/d29/d31/d34/l4d 0 2024-04-19T02:18:31.245 INFO:tasks.workunit.client.0.smithi073.stdout:8/272: chown d14/d27 12462249 1 2024-04-19T02:18:31.247 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:31.244+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:31.249 INFO:tasks.workunit.client.0.smithi073.stdout:3/423: dread d3/d6/db/d3a/d38/d43/f6a [0,4194304] 0 2024-04-19T02:18:31.251 INFO:tasks.workunit.client.0.smithi073.stdout:8/273: dwrite d14/d27/d29/d31/f3f [0,4194304] 0 2024-04-19T02:18:31.251 INFO:tasks.workunit.client.0.smithi073.stdout:3/424: chown d3/d6/db/d3a/d38/d43/d4e/c6b 130682146 1 2024-04-19T02:18:31.251 INFO:tasks.workunit.client.0.smithi073.stdout:8/274: truncate f6 5105689 0 2024-04-19T02:18:31.252 INFO:tasks.workunit.client.0.smithi073.stdout:3/425: rmdir d3/d6/db/d23 39 2024-04-19T02:18:31.252 INFO:tasks.workunit.client.0.smithi073.stdout:8/275: mknod d14/c4e 0 2024-04-19T02:18:31.253 INFO:tasks.workunit.client.0.smithi073.stdout:8/276: unlink d14/d33/f45 0 2024-04-19T02:18:31.254 INFO:tasks.workunit.client.0.smithi073.stdout:8/277: read f11 [3326598,61635] 0 2024-04-19T02:18:31.255 INFO:tasks.workunit.client.0.smithi073.stdout:8/278: write d14/d27/d29/d31/f3e [321334,87590] 0 2024-04-19T02:18:31.255 INFO:tasks.workunit.client.0.smithi073.stdout:8/279: write d14/d33/f44 [935532,22052] 0 2024-04-19T02:18:31.256 INFO:tasks.workunit.client.0.smithi073.stdout:7/261: dread d0/dc/d39/d40/f44 [4194304,4194304] 0 2024-04-19T02:18:31.256 INFO:tasks.workunit.client.0.smithi073.stdout:8/280: write d14/d15/d17/f3d [3613371,19792] 0 2024-04-19T02:18:31.256 INFO:tasks.workunit.client.0.smithi073.stdout:7/262: write d0/dc/f1f [5022243,99125] 0 2024-04-19T02:18:31.257 INFO:tasks.workunit.client.0.smithi073.stdout:8/281: creat d14/d27/d4c/f4f x:0 0 0 2024-04-19T02:18:31.257 INFO:tasks.workunit.client.0.smithi073.stdout:7/263: write d0/dc/d10/d15/f3e [2713547,26693] 0 2024-04-19T02:18:31.258 INFO:tasks.workunit.client.0.smithi073.stdout:8/282: chown d14/d27/d29/d31/d34/l4d 3 1 2024-04-19T02:18:31.264 INFO:tasks.workunit.client.0.smithi073.stdout:8/283: dwrite d14/d15/d17/f1f [4194304,4194304] 0 2024-04-19T02:18:31.265 INFO:tasks.workunit.client.0.smithi073.stdout:8/284: fsync f0 0 2024-04-19T02:18:31.265 INFO:tasks.workunit.client.0.smithi073.stdout:8/285: mkdir d14/d27/d50 0 2024-04-19T02:18:31.266 INFO:tasks.workunit.client.0.smithi073.stdout:8/286: chown c1 128 1 2024-04-19T02:18:31.266 INFO:tasks.workunit.client.0.smithi073.stdout:8/287: creat d14/d27/d29/f51 x:0 0 0 2024-04-19T02:18:31.268 INFO:tasks.workunit.client.0.smithi073.stdout:4/316: dread da/d27/d1b/d26/f4a [0,4194304] 0 2024-04-19T02:18:31.269 INFO:tasks.workunit.client.0.smithi073.stdout:7/264: truncate d0/dc/d10/d15/f3e 1968267 0 2024-04-19T02:18:31.269 INFO:tasks.workunit.client.0.smithi073.stdout:4/317: fsync da/d27/d1b/d26/f4a 0 2024-04-19T02:18:31.270 INFO:tasks.workunit.client.0.smithi073.stdout:7/265: symlink d0/l53 0 2024-04-19T02:18:31.270 INFO:tasks.workunit.client.0.smithi073.stdout:7/266: read - d0/dc/f4c zero size 2024-04-19T02:18:31.270 INFO:tasks.workunit.client.0.smithi073.stdout:7/267: stat d0/dc/d39/f4f 0 2024-04-19T02:18:31.271 INFO:tasks.workunit.client.0.smithi073.stdout:7/268: creat d0/dc/d10/d2a/d51/f54 x:0 0 0 2024-04-19T02:18:31.273 INFO:tasks.workunit.client.0.smithi073.stdout:7/269: write d0/dc/d39/f4f [799369,91340] 0 2024-04-19T02:18:31.274 INFO:tasks.workunit.client.0.smithi073.stdout:4/318: dread da/d27/d1b/d26/d2a/f47 [0,4194304] 0 2024-04-19T02:18:31.274 INFO:tasks.workunit.client.0.smithi073.stdout:2/263: dread d5/d10/d14/d18/d3e/d2d/d33/f48 [0,4194304] 0 2024-04-19T02:18:31.275 INFO:tasks.workunit.client.0.smithi073.stdout:4/319: write f4 [252649,89738] 0 2024-04-19T02:18:31.275 INFO:tasks.workunit.client.0.smithi073.stdout:8/288: dwrite d14/d27/d29/f36 [0,4194304] 0 2024-04-19T02:18:31.275 INFO:tasks.workunit.client.0.smithi073.stdout:2/264: mkdir d5/d10/d29/d66 0 2024-04-19T02:18:31.276 INFO:tasks.workunit.client.0.smithi073.stdout:8/289: rename f6 to d14/d27/d29/f52 0 2024-04-19T02:18:31.276 INFO:tasks.workunit.client.0.smithi073.stdout:4/320: unlink da/d27/d1b/d26/d2a/f47 0 2024-04-19T02:18:31.276 INFO:tasks.workunit.client.0.smithi073.stdout:1/280: sync 2024-04-19T02:18:31.277 INFO:tasks.workunit.client.0.smithi073.stdout:4/321: chown da/d27/d1b/l22 1 1 2024-04-19T02:18:31.278 INFO:tasks.workunit.client.0.smithi073.stdout:1/281: chown db/d1c/f34 8983264 1 2024-04-19T02:18:31.278 INFO:tasks.workunit.client.0.smithi073.stdout:1/282: rmdir db/d41 39 2024-04-19T02:18:31.278 INFO:tasks.workunit.client.0.smithi073.stdout:4/322: creat da/d27/d36/f6e x:0 0 0 2024-04-19T02:18:31.279 INFO:tasks.workunit.client.0.smithi073.stdout:0/223: dread f5 [0,4194304] 0 2024-04-19T02:18:31.280 INFO:tasks.workunit.client.0.smithi073.stdout:7/270: write d0/f7 [1574762,29726] 0 2024-04-19T02:18:31.280 INFO:tasks.workunit.client.0.smithi073.stdout:4/323: getdents da/d27/d3a 0 2024-04-19T02:18:31.281 INFO:tasks.workunit.client.0.smithi073.stdout:0/224: unlink d7/d14/f18 0 2024-04-19T02:18:31.281 INFO:tasks.workunit.client.0.smithi073.stdout:2/265: dread d5/f16 [0,4194304] 0 2024-04-19T02:18:31.281 INFO:tasks.workunit.client.0.smithi073.stdout:4/324: stat da/d27/d1b/d26/d2a/d46 0 2024-04-19T02:18:31.281 INFO:tasks.workunit.client.0.smithi073.stdout:0/225: chown d7/d14/d17/c30 195 1 2024-04-19T02:18:31.281 INFO:tasks.workunit.client.0.smithi073.stdout:2/266: readlink d5/d10/l1c 0 2024-04-19T02:18:31.282 INFO:tasks.workunit.client.0.smithi073.stdout:4/325: fsync da/d27/d3a/d50/f61 0 2024-04-19T02:18:31.282 INFO:tasks.workunit.client.0.smithi073.stdout:0/226: creat d7/d14/d17/d1a/f45 x:0 0 0 2024-04-19T02:18:31.283 INFO:tasks.workunit.client.0.smithi073.stdout:1/283: read db/f12 [551029,125657] 0 2024-04-19T02:18:31.284 INFO:tasks.workunit.client.0.smithi073.stdout:4/326: dread da/f11 [0,4194304] 0 2024-04-19T02:18:31.284 INFO:tasks.workunit.client.0.smithi073.stdout:5/352: dread d0/f15 [0,4194304] 0 2024-04-19T02:18:31.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/227: rename d7/d14/d17/d1a/f45 to d7/d14/d17/d1a/f46 0 2024-04-19T02:18:31.285 INFO:tasks.workunit.client.0.smithi073.stdout:5/353: readlink d0/l68 0 2024-04-19T02:18:31.286 INFO:tasks.workunit.client.0.smithi073.stdout:4/327: creat da/d27/f6f x:0 0 0 2024-04-19T02:18:31.287 INFO:tasks.workunit.client.0.smithi073.stdout:9/349: dread d0/df/d16/d1a/f37 [0,4194304] 0 2024-04-19T02:18:31.289 INFO:tasks.workunit.client.0.smithi073.stdout:5/354: dread d0/d1d/d25/d35/f3a [0,4194304] 0 2024-04-19T02:18:31.289 INFO:tasks.workunit.client.0.smithi073.stdout:9/350: creat d0/df/d16/d19/f87 x:0 0 0 2024-04-19T02:18:31.289 INFO:tasks.workunit.client.0.smithi073.stdout:5/355: stat d0/d1d 0 2024-04-19T02:18:31.289 INFO:tasks.workunit.client.0.smithi073.stdout:6/301: dread d8/f16 [0,4194304] 0 2024-04-19T02:18:31.289 INFO:tasks.workunit.client.0.smithi073.stdout:7/271: truncate d0/dc/d39/d40/f44 5710463 0 2024-04-19T02:18:31.290 INFO:tasks.workunit.client.0.smithi073.stdout:2/267: dwrite d5/d10/d14/f2c [4194304,4194304] 0 2024-04-19T02:18:31.290 INFO:tasks.workunit.client.0.smithi073.stdout:5/356: unlink d0/d1d/d25/f26 0 2024-04-19T02:18:31.290 INFO:tasks.workunit.client.0.smithi073.stdout:6/302: write d8/f2e [2163044,23723] 0 2024-04-19T02:18:31.291 INFO:tasks.workunit.client.0.smithi073.stdout:9/351: mkdir d0/df/d16/d19/d38/d5d/d76/d7d/d88 0 2024-04-19T02:18:31.291 INFO:tasks.workunit.client.0.smithi073.stdout:2/268: write d5/f7 [1004062,88282] 0 2024-04-19T02:18:31.291 INFO:tasks.workunit.client.0.smithi073.stdout:7/272: write d0/dc/d39/f3f [4626996,12246] 0 2024-04-19T02:18:31.292 INFO:tasks.workunit.client.0.smithi073.stdout:5/357: creat d0/d1d/d25/d37/d71/f7b x:0 0 0 2024-04-19T02:18:31.292 INFO:tasks.workunit.client.0.smithi073.stdout:7/273: chown d0/dc/d39/f4f 8534113 1 2024-04-19T02:18:31.292 INFO:tasks.workunit.client.0.smithi073.stdout:6/303: getdents d8 0 2024-04-19T02:18:31.293 INFO:tasks.workunit.client.0.smithi073.stdout:7/274: chown d0/d28/c4d 99577 1 2024-04-19T02:18:31.293 INFO:tasks.workunit.client.0.smithi073.stdout:2/269: rename d5/d10/d14/d18/d3e/d2d/d33 to d5/d10/d29/d66/d67 0 2024-04-19T02:18:31.293 INFO:tasks.workunit.client.0.smithi073.stdout:7/275: write d0/dc/d10/d2a/f2b [5743238,115366] 0 2024-04-19T02:18:31.295 INFO:tasks.workunit.client.0.smithi073.stdout:2/270: creat d5/d10/d29/d42/f68 x:0 0 0 2024-04-19T02:18:31.295 INFO:tasks.workunit.client.0.smithi073.stdout:0/228: write d7/d14/d17/d1a/d21/f3c [411800,72094] 0 2024-04-19T02:18:31.296 INFO:tasks.workunit.client.0.smithi073.stdout:2/271: creat d5/d10/d29/d66/f69 x:0 0 0 2024-04-19T02:18:31.296 INFO:tasks.workunit.client.0.smithi073.stdout:6/304: dread f3 [0,4194304] 0 2024-04-19T02:18:31.297 INFO:tasks.workunit.client.0.smithi073.stdout:0/229: truncate d7/d14/d17/d1a/f46 562176 0 2024-04-19T02:18:31.297 INFO:tasks.workunit.client.0.smithi073.stdout:3/426: sync 2024-04-19T02:18:31.298 INFO:tasks.workunit.client.0.smithi073.stdout:5/358: dwrite d0/d1d/f2a [0,4194304] 0 2024-04-19T02:18:31.298 INFO:tasks.workunit.client.0.smithi073.stdout:3/427: fsync d3/d6/db/d23/f27 0 2024-04-19T02:18:31.301 INFO:tasks.workunit.client.0.smithi073.stdout:2/272: link d5/d10/l1d d5/d10/d29/d42/l6a 0 2024-04-19T02:18:31.301 INFO:tasks.workunit.client.0.smithi073.stdout:3/428: mknod d3/d6/db/d23/c8d 0 2024-04-19T02:18:31.301 INFO:tasks.workunit.client.0.smithi073.stdout:5/359: getdents d0/d69/d79 0 2024-04-19T02:18:31.301 INFO:tasks.workunit.client.0.smithi073.stdout:3/429: stat d3/d6/db/d16/d7c 0 2024-04-19T02:18:31.301 INFO:tasks.workunit.client.0.smithi073.stdout:2/273: creat d5/d10/d14/d18/f6b x:0 0 0 2024-04-19T02:18:31.302 INFO:tasks.workunit.client.0.smithi073.stdout:5/360: creat d0/d1d/d24/d61/f7c x:0 0 0 2024-04-19T02:18:31.302 INFO:tasks.workunit.client.0.smithi073.stdout:3/430: fsync d3/d6/f1e 0 2024-04-19T02:18:31.303 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:31.303 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:31.303 INFO:tasks.workunit.client.0.smithi073.stdout:4/328: sync 2024-04-19T02:18:31.304 INFO:tasks.workunit.client.0.smithi073.stdout:6/305: dwrite d8/de/f67 [0,4194304] 0 2024-04-19T02:18:31.304 INFO:tasks.workunit.client.0.smithi073.stdout:2/274: unlink d5/d10/d14/d18/d3e/c5a 0 2024-04-19T02:18:31.305 INFO:tasks.workunit.client.0.smithi073.stdout:3/431: chown d3/d6/db/d1a/d2f/f87 391468 1 2024-04-19T02:18:31.305 INFO:tasks.workunit.client.0.smithi073.stdout:6/306: mkdir d8/d71 0 2024-04-19T02:18:31.306 INFO:tasks.workunit.client.0.smithi073.stdout:3/432: write d3/d6/d11/f26 [2105616,45660] 0 2024-04-19T02:18:31.308 INFO:tasks.workunit.client.0.smithi073.stdout:0/230: dwrite f5 [0,4194304] 0 2024-04-19T02:18:31.308 INFO:tasks.workunit.client.0.smithi073.stdout:7/276: dwrite d0/dc/d10/f21 [0,4194304] 0 2024-04-19T02:18:31.310 INFO:tasks.workunit.client.0.smithi073.stdout:8/290: fsync d14/d27/d29/f36 0 2024-04-19T02:18:31.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/433: getdents d3/d6 0 2024-04-19T02:18:31.310 INFO:tasks.workunit.client.0.smithi073.stdout:6/307: mknod d8/d4b/c72 0 2024-04-19T02:18:31.311 INFO:tasks.workunit.client.0.smithi073.stdout:2/275: write d5/d10/d14/d18/d3e/d2d/d63/f46 [1216573,56990] 0 2024-04-19T02:18:31.311 INFO:tasks.workunit.client.0.smithi073.stdout:7/277: mknod d0/dc/d10/d2a/c55 0 2024-04-19T02:18:31.311 INFO:tasks.workunit.client.0.smithi073.stdout:3/434: readlink d3/d6/l80 0 2024-04-19T02:18:31.311 INFO:tasks.workunit.client.0.smithi073.stdout:6/308: rmdir d8/d4b 39 2024-04-19T02:18:31.312 INFO:tasks.workunit.client.0.smithi073.stdout:5/361: dwrite d0/d1d/d24/d61/f74 [0,4194304] 0 2024-04-19T02:18:31.312 INFO:tasks.workunit.client.0.smithi073.stdout:2/276: unlink d5/d10/c5e 0 2024-04-19T02:18:31.313 INFO:tasks.workunit.client.0.smithi073.stdout:3/435: chown d3/d6/db/d3a/d38/d40/f77 1044 1 2024-04-19T02:18:31.313 INFO:tasks.workunit.client.0.smithi073.stdout:4/329: read f8 [745358,109740] 0 2024-04-19T02:18:31.314 INFO:tasks.workunit.client.0.smithi073.stdout:5/362: readlink d0/d69/l6d 0 2024-04-19T02:18:31.315 INFO:tasks.workunit.client.0.smithi073.stdout:3/436: creat d3/d6/db/d3a/f8e x:0 0 0 2024-04-19T02:18:31.315 INFO:tasks.workunit.client.0.smithi073.stdout:2/277: write d5/d10/d14/d18/d3e/d51/f59 [155,96209] 0 2024-04-19T02:18:31.315 INFO:tasks.workunit.client.0.smithi073.stdout:1/284: dread db/f36 [0,4194304] 0 2024-04-19T02:18:31.316 INFO:tasks.workunit.client.0.smithi073.stdout:5/363: readlink d0/d1d/l65 0 2024-04-19T02:18:31.316 INFO:tasks.workunit.client.0.smithi073.stdout:6/309: mknod d8/de/d22/c73 0 2024-04-19T02:18:31.318 INFO:tasks.workunit.client.0.smithi073.stdout:3/437: write d3/d6/db/d16/d75/f60 [2937866,5511] 0 2024-04-19T02:18:31.318 INFO:tasks.workunit.client.0.smithi073.stdout:4/330: write da/f11 [665763,66232] 0 2024-04-19T02:18:31.318 INFO:tasks.workunit.client.0.smithi073.stdout:8/291: rename d14/d27/d29/d31/d34/c38 to d14/d27/d29/d31/c53 0 2024-04-19T02:18:31.318 INFO:tasks.workunit.client.0.smithi073.stdout:1/285: chown db/d41 674559546 1 2024-04-19T02:18:31.319 INFO:tasks.workunit.client.0.smithi073.stdout:6/310: creat d8/de/d58/d63/f74 x:0 0 0 2024-04-19T02:18:31.320 INFO:tasks.workunit.client.0.smithi073.stdout:0/231: dwrite d7/d14/d17/d1a/f3d [0,4194304] 0 2024-04-19T02:18:31.321 INFO:tasks.workunit.client.0.smithi073.stdout:5/364: link d0/d1d/d25/d35/d39/f4c d0/d1d/f7d 0 2024-04-19T02:18:31.321 INFO:tasks.workunit.client.0.smithi073.stdout:2/278: rename d5/d10/d14/d18/d3e/d2d/l50 to d5/d10/d14/d18/d3e/d2d/l6c 0 2024-04-19T02:18:31.322 INFO:tasks.workunit.client.0.smithi073.stdout:3/438: rename f2 to d3/d6/db/d16/d52/f8f 0 2024-04-19T02:18:31.322 INFO:tasks.workunit.client.0.smithi073.stdout:6/311: unlink d8/de/d58/d63/c69 0 2024-04-19T02:18:31.322 INFO:tasks.workunit.client.0.smithi073.stdout:7/278: dwrite d0/f7 [0,4194304] 0 2024-04-19T02:18:31.323 INFO:tasks.workunit.client.0.smithi073.stdout:2/279: write d5/f31 [736991,61302] 0 2024-04-19T02:18:31.323 INFO:tasks.workunit.client.0.smithi073.stdout:3/439: fdatasync d3/d6/db/f45 0 2024-04-19T02:18:31.323 INFO:tasks.workunit.client.0.smithi073.stdout:7/279: write d0/dc/d10/d2a/f2b [486627,44311] 0 2024-04-19T02:18:31.324 INFO:tasks.workunit.client.0.smithi073.stdout:7/280: stat d0/dc/l23 0 2024-04-19T02:18:31.324 INFO:tasks.workunit.client.0.smithi073.stdout:0/232: creat d7/d14/f47 x:0 0 0 2024-04-19T02:18:31.325 INFO:tasks.workunit.client.0.smithi073.stdout:1/286: link db/d1c/d2c/l6c db/l6e 0 2024-04-19T02:18:31.325 INFO:tasks.workunit.client.0.smithi073.stdout:4/331: mknod da/d27/d1b/d26/d2a/d46/c70 0 2024-04-19T02:18:31.325 INFO:tasks.workunit.client.0.smithi073.stdout:6/312: chown d8/de/f1f 845945886 1 2024-04-19T02:18:31.325 INFO:tasks.workunit.client.0.smithi073.stdout:9/352: dread d0/df/d1d/f44 [0,4194304] 0 2024-04-19T02:18:31.326 INFO:tasks.workunit.client.0.smithi073.stdout:2/280: getdents d5/d10/d14/d18/d3e/d51 0 2024-04-19T02:18:31.326 INFO:tasks.workunit.client.0.smithi073.stdout:9/353: stat d0/f1f 0 2024-04-19T02:18:31.326 INFO:tasks.workunit.client.0.smithi073.stdout:1/287: fdatasync db/d1c/d2c/d50/f6d 0 2024-04-19T02:18:31.327 INFO:tasks.workunit.client.0.smithi073.stdout:6/313: mkdir d8/d71/d75 0 2024-04-19T02:18:31.327 INFO:tasks.workunit.client.0.smithi073.stdout:3/440: write d3/d6/db/d1a/d54/f7f [677650,87944] 0 2024-04-19T02:18:31.327 INFO:tasks.workunit.client.0.smithi073.stdout:2/281: dread - d5/d10/d14/d18/f6b zero size 2024-04-19T02:18:31.327 INFO:tasks.workunit.client.0.smithi073.stdout:0/233: unlink d7/d14/d17/d1a/d21/c43 0 2024-04-19T02:18:31.328 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:31.329 INFO:tasks.workunit.client.0.smithi073.stdout:6/314: rmdir d8/de/d58 39 2024-04-19T02:18:31.329 INFO:tasks.workunit.client.0.smithi073.stdout:3/441: mknod d3/d6/d11/c90 0 2024-04-19T02:18:31.329 INFO:tasks.workunit.client.0.smithi073.stdout:2/282: rmdir d5/d10/d29/d66 39 2024-04-19T02:18:31.330 INFO:tasks.workunit.client.0.smithi073.stdout:8/292: dwrite d14/d27/d29/d31/d34/f3a [0,4194304] 0 2024-04-19T02:18:31.331 INFO:tasks.workunit.client.0.smithi073.stdout:8/293: sync 2024-04-19T02:18:31.331 INFO:tasks.workunit.client.0.smithi073.stdout:0/234: chown d7/d14/f2d 1112525 1 2024-04-19T02:18:31.331 INFO:tasks.workunit.client.0.smithi073.stdout:1/288: write db/d1c/d2c/d50/f60 [226867,83836] 0 2024-04-19T02:18:31.331 INFO:tasks.workunit.client.0.smithi073.stdout:8/294: mknod d14/d15/c54 0 2024-04-19T02:18:31.332 INFO:tasks.workunit.client.0.smithi073.stdout:9/354: truncate d0/df/d16/d1a/d2c/d2e/f7b 3970236 0 2024-04-19T02:18:31.332 INFO:tasks.workunit.client.0.smithi073.stdout:8/295: read f0 [5507169,67694] 0 2024-04-19T02:18:31.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/289: mkdir db/d3e/d6f 0 2024-04-19T02:18:31.332 INFO:tasks.workunit.client.0.smithi073.stdout:7/281: dwrite d0/dc/d39/f4f [0,4194304] 0 2024-04-19T02:18:31.333 INFO:tasks.workunit.client.0.smithi073.stdout:0/235: write d7/d14/d17/d1a/d21/f36 [456089,64144] 0 2024-04-19T02:18:31.333 INFO:tasks.workunit.client.0.smithi073.stdout:8/296: readlink d14/d27/l2b 0 2024-04-19T02:18:31.334 INFO:tasks.workunit.client.0.smithi073.stdout:8/297: readlink d14/d15/l2a 0 2024-04-19T02:18:31.334 INFO:tasks.workunit.client.0.smithi073.stdout:7/282: write d0/f3c [1038278,24469] 0 2024-04-19T02:18:31.335 INFO:tasks.workunit.client.0.smithi073.stdout:0/236: creat d7/d14/d17/d1a/d20/f48 x:0 0 0 2024-04-19T02:18:31.335 INFO:tasks.workunit.client.0.smithi073.stdout:3/442: read d3/d6/db/f2d [71424,89203] 0 2024-04-19T02:18:31.336 INFO:tasks.workunit.client.0.smithi073.stdout:8/298: creat d14/d15/f55 x:0 0 0 2024-04-19T02:18:31.336 INFO:tasks.workunit.client.0.smithi073.stdout:9/355: mkdir d0/df/d16/d19/d38/d5d/d5e/d89 0 2024-04-19T02:18:31.337 INFO:tasks.workunit.client.0.smithi073.stdout:8/299: symlink d14/d15/d17/l56 0 2024-04-19T02:18:31.338 INFO:tasks.workunit.client.0.smithi073.stdout:6/315: dwrite d8/de/d35/f5b [0,4194304] 0 2024-04-19T02:18:31.338 INFO:tasks.workunit.client.0.smithi073.stdout:0/237: write d7/d14/d17/d1a/f39 [967958,29463] 0 2024-04-19T02:18:31.339 INFO:tasks.workunit.client.0.smithi073.stdout:8/300: fsync d14/d15/d17/f1f 0 2024-04-19T02:18:31.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/356: fsync d0/df/d1d/f65 0 2024-04-19T02:18:31.340 INFO:tasks.workunit.client.0.smithi073.stdout:3/443: rename d3/d6/db/d3a/f8e to d3/d6/db/d3a/d38/d43/d4e/f91 0 2024-04-19T02:18:31.340 INFO:tasks.workunit.client.0.smithi073.stdout:8/301: chown d14/c4e 1122462 1 2024-04-19T02:18:31.340 INFO:tasks.workunit.client.0.smithi073.stdout:2/283: dwrite d5/d10/d14/d18/d1e/f25 [0,4194304] 0 2024-04-19T02:18:31.341 INFO:tasks.workunit.client.0.smithi073.stdout:3/444: rmdir d3/d6/db/d23 39 2024-04-19T02:18:31.342 INFO:tasks.workunit.client.0.smithi073.stdout:8/302: symlink d14/d27/l57 0 2024-04-19T02:18:31.342 INFO:tasks.workunit.client.0.smithi073.stdout:9/357: chown d0/df/d16/d1a/f52 29 1 2024-04-19T02:18:31.343 INFO:tasks.workunit.client.0.smithi073.stdout:7/283: dwrite d0/d3/f46 [0,4194304] 0 2024-04-19T02:18:31.344 INFO:tasks.workunit.client.0.smithi073.stdout:2/284: write d5/d10/d14/d18/d3e/d2d/f3a [748365,86396] 0 2024-04-19T02:18:31.344 INFO:tasks.workunit.client.0.smithi073.stdout:8/303: creat d14/d15/d17/f58 x:0 0 0 2024-04-19T02:18:31.345 INFO:tasks.workunit.client.0.smithi073.stdout:5/365: dread d0/d2d/f57 [0,4194304] 0 2024-04-19T02:18:31.346 INFO:tasks.workunit.client.0.smithi073.stdout:5/366: stat d0/d1d/d25/d37/d71/f7b 0 2024-04-19T02:18:31.346 INFO:tasks.workunit.client.0.smithi073.stdout:3/445: creat d3/d6/db/d16/d7c/f92 x:0 0 0 2024-04-19T02:18:31.346 INFO:tasks.workunit.client.0.smithi073.stdout:2/285: rmdir d5 39 2024-04-19T02:18:31.346 INFO:tasks.workunit.client.0.smithi073.stdout:8/304: fsync d14/d27/d29/f52 0 2024-04-19T02:18:31.347 INFO:tasks.workunit.client.0.smithi073.stdout:0/238: dwrite d7/d14/d17/d1a/f29 [0,4194304] 0 2024-04-19T02:18:31.348 INFO:tasks.workunit.client.0.smithi073.stdout:1/290: dread db/f21 [0,4194304] 0 2024-04-19T02:18:31.348 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:31.347+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:31.349 INFO:tasks.workunit.client.0.smithi073.stdout:8/305: creat d14/d15/d17/d48/f59 x:0 0 0 2024-04-19T02:18:31.349 INFO:tasks.workunit.client.0.smithi073.stdout:2/286: mknod d5/d10/d14/d18/d3e/d2d/c6d 0 2024-04-19T02:18:31.349 INFO:tasks.workunit.client.0.smithi073.stdout:0/239: stat d7/d14/d17/f1d 0 2024-04-19T02:18:31.349 INFO:tasks.workunit.client.0.smithi073.stdout:5/367: getdents d0/d1d/d25/d37/d71 0 2024-04-19T02:18:31.349 INFO:tasks.workunit.client.0.smithi073.stdout:8/306: unlink d14/d27/d29/f36 0 2024-04-19T02:18:31.349 INFO:tasks.workunit.client.0.smithi073.stdout:0/240: chown f5 0 1 2024-04-19T02:18:31.349 INFO:tasks.workunit.client.0.smithi073.stdout:2/287: creat d5/d10/d29/d42/f6e x:0 0 0 2024-04-19T02:18:31.350 INFO:tasks.workunit.client.0.smithi073.stdout:0/241: mknod d7/d14/c49 0 2024-04-19T02:18:31.350 INFO:tasks.workunit.client.0.smithi073.stdout:1/291: mknod db/d3e/c70 0 2024-04-19T02:18:31.350 INFO:tasks.workunit.client.0.smithi073.stdout:8/307: rename cd to d14/d27/d50/c5a 0 2024-04-19T02:18:31.351 INFO:tasks.workunit.client.0.smithi073.stdout:2/288: mknod d5/d10/d14/c6f 0 2024-04-19T02:18:31.351 INFO:tasks.workunit.client.0.smithi073.stdout:1/292: fsync f3 0 2024-04-19T02:18:31.351 INFO:tasks.workunit.client.0.smithi073.stdout:0/242: symlink d7/d14/d17/d1a/d20/l4a 0 2024-04-19T02:18:31.352 INFO:tasks.workunit.client.0.smithi073.stdout:0/243: chown d7/d14/d17/d1a/d21/l37 1 1 2024-04-19T02:18:31.352 INFO:tasks.workunit.client.0.smithi073.stdout:2/289: write d5/d10/d14/d18/d3e/d51/f59 [830851,27668] 0 2024-04-19T02:18:31.353 INFO:tasks.workunit.client.0.smithi073.stdout:1/293: getdents db/d41 0 2024-04-19T02:18:31.353 INFO:tasks.workunit.client.0.smithi073.stdout:3/446: dwrite d3/f5 [0,4194304] 0 2024-04-19T02:18:31.354 INFO:tasks.workunit.client.0.smithi073.stdout:0/244: mknod d7/c4b 0 2024-04-19T02:18:31.354 INFO:tasks.workunit.client.0.smithi073.stdout:3/447: chown d3/d6/l3b 1710738 1 2024-04-19T02:18:31.356 INFO:tasks.workunit.client.0.smithi073.stdout:0/245: readlink d7/d14/d17/d1a/d20/l3f 0 2024-04-19T02:18:31.356 INFO:tasks.workunit.client.0.smithi073.stdout:3/448: dread - d3/d6/db/d16/f74 zero size 2024-04-19T02:18:31.356 INFO:tasks.workunit.client.0.smithi073.stdout:1/294: truncate db/d1c/d2c/d50/f6b 146789 0 2024-04-19T02:18:31.357 INFO:tasks.workunit.client.0.smithi073.stdout:0/246: write d7/f1c [278457,103560] 0 2024-04-19T02:18:31.357 INFO:tasks.workunit.client.0.smithi073.stdout:1/295: symlink db/d1c/l71 0 2024-04-19T02:18:31.358 INFO:tasks.workunit.client.0.smithi073.stdout:3/449: link d3/d6/db/d1a/f7d d3/d6/db/d16/d52/f93 0 2024-04-19T02:18:31.360 INFO:tasks.workunit.client.0.smithi073.stdout:8/308: dwrite d14/d15/d17/f2c [0,4194304] 0 2024-04-19T02:18:31.360 INFO:tasks.workunit.client.0.smithi073.stdout:3/450: write d3/d6/db/d3a/d38/d40/f6e [1703716,39108] 0 2024-04-19T02:18:31.360 INFO:tasks.workunit.client.0.smithi073.stdout:7/284: truncate d0/f8 1150129 0 2024-04-19T02:18:31.360 INFO:tasks.workunit.client.0.smithi073.stdout:5/368: write d0/d1d/d25/d37/f77 [3796012,66481] 0 2024-04-19T02:18:31.360 INFO:tasks.workunit.client.0.smithi073.stdout:0/247: creat d7/d14/d17/d1a/d20/f4c x:0 0 0 2024-04-19T02:18:31.361 INFO:tasks.workunit.client.0.smithi073.stdout:8/309: write f11 [2297080,70905] 0 2024-04-19T02:18:31.362 INFO:tasks.workunit.client.0.smithi073.stdout:3/451: rename d3/d6/d11 to d3/d6/db/d3a/d38/d89/d94 0 2024-04-19T02:18:31.362 INFO:tasks.workunit.client.0.smithi073.stdout:8/310: truncate d14/d15/d17/f58 909571 0 2024-04-19T02:18:31.368 INFO:tasks.workunit.client.0.smithi073.stdout:5/369: dwrite d0/f13 [0,4194304] 0 2024-04-19T02:18:31.368 INFO:tasks.workunit.client.0.smithi073.stdout:7/285: dwrite d0/dc/d39/f4f [0,4194304] 0 2024-04-19T02:18:31.369 INFO:tasks.workunit.client.0.smithi073.stdout:5/370: unlink d0/cb 0 2024-04-19T02:18:31.370 INFO:tasks.workunit.client.0.smithi073.stdout:7/286: getdents d0/dc/d39/d50 0 2024-04-19T02:18:31.370 INFO:tasks.workunit.client.0.smithi073.stdout:5/371: creat d0/d1d/d24/d62/f7e x:0 0 0 2024-04-19T02:18:31.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/311: dwrite d14/d27/d29/d31/d34/f40 [0,4194304] 0 2024-04-19T02:18:31.372 INFO:tasks.workunit.client.0.smithi073.stdout:2/290: truncate d5/f7 218446 0 2024-04-19T02:18:31.372 INFO:tasks.workunit.client.0.smithi073.stdout:1/296: truncate db/f25 1196941 0 2024-04-19T02:18:31.372 INFO:tasks.workunit.client.0.smithi073.stdout:7/287: chown d0/dc/d10/d2a 1236170 1 2024-04-19T02:18:31.372 INFO:tasks.workunit.client.0.smithi073.stdout:0/248: getdents d7/d14/d17/d1a/d20 0 2024-04-19T02:18:31.373 INFO:tasks.workunit.client.0.smithi073.stdout:6/316: dread d8/f10 [0,4194304] 0 2024-04-19T02:18:31.373 INFO:tasks.workunit.client.0.smithi073.stdout:2/291: write d5/d10/d29/d66/d67/f45 [229024,76909] 0 2024-04-19T02:18:31.374 INFO:tasks.workunit.client.0.smithi073.stdout:7/288: getdents d0/dc/d33 0 2024-04-19T02:18:31.374 INFO:tasks.workunit.client.0.smithi073.stdout:6/317: mkdir d8/de/d22/d76 0 2024-04-19T02:18:31.374 INFO:tasks.workunit.client.0.smithi073.stdout:3/452: creat d3/d6/db/d3a/d38/d40/f95 x:0 0 0 2024-04-19T02:18:31.375 INFO:tasks.workunit.client.0.smithi073.stdout:6/318: chown d8/de/d35/f5d 9540117 1 2024-04-19T02:18:31.378 INFO:tasks.workunit.client.0.smithi073.stdout:2/292: symlink d5/d10/d29/d42/l70 0 2024-04-19T02:18:31.378 INFO:tasks.workunit.client.0.smithi073.stdout:3/453: fsync d3/d6/f15 0 2024-04-19T02:18:31.378 INFO:tasks.workunit.client.0.smithi073.stdout:6/319: mkdir d8/d77 0 2024-04-19T02:18:31.379 INFO:tasks.workunit.client.0.smithi073.stdout:1/297: dwrite db/d1c/f3c [0,4194304] 0 2024-04-19T02:18:31.380 INFO:tasks.workunit.client.0.smithi073.stdout:6/320: mkdir d8/de/d78 0 2024-04-19T02:18:31.382 INFO:tasks.workunit.client.0.smithi073.stdout:3/454: rename d3/d6/db/d3a/d38/d40/l85 to d3/d6/db/d3a/d38/d43/d4e/l96 0 2024-04-19T02:18:31.382 INFO:tasks.workunit.client.0.smithi073.stdout:0/249: dwrite d7/f11 [0,4194304] 0 2024-04-19T02:18:31.382 INFO:tasks.workunit.client.0.smithi073.stdout:7/289: dwrite d0/f3c [0,4194304] 0 2024-04-19T02:18:31.383 INFO:tasks.workunit.client.0.smithi073.stdout:0/250: readlink d7/d14/d17/d1a/d20/l28 0 2024-04-19T02:18:31.383 INFO:tasks.workunit.client.0.smithi073.stdout:7/290: creat d0/dc/d10/d15/f56 x:0 0 0 2024-04-19T02:18:31.384 INFO:tasks.workunit.client.0.smithi073.stdout:2/293: read d5/d10/d14/f21 [787299,14242] 0 2024-04-19T02:18:31.384 INFO:tasks.workunit.client.0.smithi073.stdout:3/455: symlink d3/d6/db/d3a/d38/d57/d88/l97 0 2024-04-19T02:18:31.384 INFO:tasks.workunit.client.0.smithi073.stdout:5/372: read d0/d1d/d25/f27 [1476545,114480] 0 2024-04-19T02:18:31.384 INFO:tasks.workunit.client.0.smithi073.stdout:0/251: write d7/d14/d17/d1a/d21/f3b [833341,129571] 0 2024-04-19T02:18:31.385 INFO:tasks.workunit.client.0.smithi073.stdout:2/294: chown d5/d10/d14/d18/d3e/d51 923673734 1 2024-04-19T02:18:31.385 INFO:tasks.workunit.client.0.smithi073.stdout:5/373: read d0/d1d/d24/f30 [1544717,73541] 0 2024-04-19T02:18:31.385 INFO:tasks.workunit.client.0.smithi073.stdout:1/298: dread db/d41/f59 [0,4194304] 0 2024-04-19T02:18:31.387 INFO:tasks.workunit.client.0.smithi073.stdout:7/291: symlink d0/dc/d39/l57 0 2024-04-19T02:18:31.387 INFO:tasks.workunit.client.0.smithi073.stdout:3/456: symlink d3/d6/db/d1a/d2f/l98 0 2024-04-19T02:18:31.387 INFO:tasks.workunit.client.0.smithi073.stdout:2/295: rmdir d5/d10 39 2024-04-19T02:18:31.387 INFO:tasks.workunit.client.0.smithi073.stdout:0/252: creat d7/d14/d17/d1a/d20/f4d x:0 0 0 2024-04-19T02:18:31.387 INFO:tasks.workunit.client.0.smithi073.stdout:5/374: chown d0/f5d 1 1 2024-04-19T02:18:31.388 INFO:tasks.workunit.client.0.smithi073.stdout:1/299: rmdir db/d1c/d54/d64 0 2024-04-19T02:18:31.388 INFO:tasks.workunit.client.0.smithi073.stdout:2/296: readlink d5/d10/d29/l5c 0 2024-04-19T02:18:31.388 INFO:tasks.workunit.client.0.smithi073.stdout:1/300: fsync db/d1c/d2c/f63 0 2024-04-19T02:18:31.388 INFO:tasks.workunit.client.0.smithi073.stdout:5/375: write d0/d1d/d24/f2e [4900266,93401] 0 2024-04-19T02:18:31.388 INFO:tasks.workunit.client.0.smithi073.stdout:7/292: truncate d0/d28/f4b 1380883 0 2024-04-19T02:18:31.388 INFO:tasks.workunit.client.0.smithi073.stdout:2/297: mknod d5/d10/d29/d42/c71 0 2024-04-19T02:18:31.389 INFO:tasks.workunit.client.0.smithi073.stdout:1/301: truncate db/f17 275298 0 2024-04-19T02:18:31.390 INFO:tasks.workunit.client.0.smithi073.stdout:1/302: rename db/f12 to db/d1c/d2c/f72 0 2024-04-19T02:18:31.391 INFO:tasks.workunit.client.0.smithi073.stdout:2/298: rename d5/d10/d14/d18/d1e to d5/d10/d29/d66/d67/d72 0 2024-04-19T02:18:31.392 INFO:tasks.workunit.client.0.smithi073.stdout:1/303: rename db/d1c/d2c/l33 to db/d1c/d54/l73 0 2024-04-19T02:18:31.392 INFO:tasks.workunit.client.0.smithi073.stdout:2/299: creat d5/d10/d53/f73 x:0 0 0 2024-04-19T02:18:31.393 INFO:tasks.workunit.client.0.smithi073.stdout:1/304: fsync db/d1c/d2c/f61 0 2024-04-19T02:18:31.393 INFO:tasks.workunit.client.0.smithi073.stdout:7/293: dread d0/f7 [0,4194304] 0 2024-04-19T02:18:31.393 INFO:tasks.workunit.client.0.smithi073.stdout:0/253: dwrite d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:31.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:18:31.394 INFO:tasks.workunit.client.0.smithi073.stdout:2/300: mknod d5/c74 0 2024-04-19T02:18:31.394 INFO:tasks.workunit.client.0.smithi073.stdout:1/305: creat db/d41/f74 x:0 0 0 2024-04-19T02:18:31.395 INFO:tasks.workunit.client.0.smithi073.stdout:7/294: creat d0/dc/d39/d50/f58 x:0 0 0 2024-04-19T02:18:31.395 INFO:tasks.workunit.client.0.smithi073.stdout:1/306: chown db/fd 1381960028 1 2024-04-19T02:18:31.395 INFO:tasks.workunit.client.0.smithi073.stdout:7/295: chown d0/dc/d10/d15 46135975 1 2024-04-19T02:18:31.397 INFO:tasks.workunit.client.0.smithi073.stdout:1/307: write db/d41/f53 [151437,65145] 0 2024-04-19T02:18:31.397 INFO:tasks.workunit.client.0.smithi073.stdout:0/254: rename d7/d14/d17/d1a/d20/l4a to d7/d14/d17/d1a/l4e 0 2024-04-19T02:18:31.397 INFO:tasks.workunit.client.0.smithi073.stdout:1/308: creat db/d3e/d6f/f75 x:0 0 0 2024-04-19T02:18:31.397 INFO:tasks.workunit.client.0.smithi073.stdout:1/309: chown db/d1c/f39 389 1 2024-04-19T02:18:31.399 INFO:tasks.workunit.client.0.smithi073.stdout:1/310: chown db/d3e/d6f 281444 1 2024-04-19T02:18:31.399 INFO:tasks.workunit.client.0.smithi073.stdout:1/311: fsync db/d1c/d2c/d50/f6d 0 2024-04-19T02:18:31.399 INFO:tasks.workunit.client.0.smithi073.stdout:1/312: write db/f2a [1358705,102765] 0 2024-04-19T02:18:31.400 INFO:tasks.workunit.client.0.smithi073.stdout:5/376: truncate d0/d1d/d25/d37/f4d 2639964 0 2024-04-19T02:18:31.400 INFO:tasks.workunit.client.0.smithi073.stdout:2/301: dwrite d5/d10/d29/d42/f52 [0,4194304] 0 2024-04-19T02:18:31.400 INFO:tasks.workunit.client.0.smithi073.stdout:1/313: write db/d41/f67 [234913,8675] 0 2024-04-19T02:18:31.402 INFO:tasks.workunit.client.0.smithi073.stdout:5/377: creat d0/d1d/d25/d35/d39/f7f x:0 0 0 2024-04-19T02:18:31.402 INFO:tasks.workunit.client.0.smithi073.stdout:2/302: truncate d5/d10/d14/d18/f6b 10292 0 2024-04-19T02:18:31.402 INFO:tasks.workunit.client.0.smithi073.stdout:1/314: rename db/l10 to db/d3e/d6f/l76 0 2024-04-19T02:18:31.403 INFO:tasks.workunit.client.0.smithi073.stdout:1/315: stat db/f25 0 2024-04-19T02:18:31.403 INFO:tasks.workunit.client.0.smithi073.stdout:5/378: creat d0/d1d/d1e/f80 x:0 0 0 2024-04-19T02:18:31.404 INFO:tasks.workunit.client.0.smithi073.stdout:0/255: dwrite d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:31.404 INFO:tasks.workunit.client.0.smithi073.stdout:2/303: truncate d5/d10/d14/d18/d3e/d2d/f5d 131610 0 2024-04-19T02:18:31.405 INFO:tasks.workunit.client.0.smithi073.stdout:1/316: rename db/d41/f48 to db/d1c/d2c/f77 0 2024-04-19T02:18:31.406 INFO:tasks.workunit.client.0.smithi073.stdout:5/379: rename d0/d1d/d25/d37/l5a to d0/d69/d79/l81 0 2024-04-19T02:18:31.406 INFO:tasks.workunit.client.0.smithi073.stdout:5/380: write d0/d1d/d25/d37/f77 [1385459,52577] 0 2024-04-19T02:18:31.407 INFO:tasks.workunit.client.0.smithi073.stdout:5/381: chown d0/d1d/d25 125 1 2024-04-19T02:18:31.408 INFO:tasks.workunit.client.0.smithi073.stdout:5/382: write d0/f13 [145856,88043] 0 2024-04-19T02:18:31.410 INFO:tasks.workunit.client.0.smithi073.stdout:3/457: dread d3/d6/f9 [0,4194304] 0 2024-04-19T02:18:31.410 INFO:tasks.workunit.client.0.smithi073.stdout:5/383: creat d0/d1d/f82 x:0 0 0 2024-04-19T02:18:31.411 INFO:tasks.workunit.client.0.smithi073.stdout:3/458: creat d3/d6/db/d16/d52/f99 x:0 0 0 2024-04-19T02:18:31.413 INFO:tasks.workunit.client.0.smithi073.stdout:1/317: dwrite db/f2a [0,4194304] 0 2024-04-19T02:18:31.413 INFO:tasks.workunit.client.0.smithi073.stdout:2/304: dwrite d5/d10/d29/d66/d67/f45 [0,4194304] 0 2024-04-19T02:18:31.414 INFO:tasks.workunit.client.0.smithi073.stdout:3/459: link d3/d6/db/d1a/f7d d3/d6/db/d1a/f9a 0 2024-04-19T02:18:31.415 INFO:tasks.workunit.client.0.smithi073.stdout:2/305: getdents d5/d10/d14/d18 0 2024-04-19T02:18:31.416 INFO:tasks.workunit.client.0.smithi073.stdout:3/460: creat d3/d6/db/d3a/d38/d89/d94/d7b/f9b x:0 0 0 2024-04-19T02:18:31.417 INFO:tasks.workunit.client.0.smithi073.stdout:3/461: rmdir d3/d6/db/d3a/d38/d89 39 2024-04-19T02:18:31.417 INFO:tasks.workunit.client.0.smithi073.stdout:1/318: dread db/f36 [0,4194304] 0 2024-04-19T02:18:31.418 INFO:tasks.workunit.client.0.smithi073.stdout:3/462: mknod d3/d6/db/d3a/d38/d57/c9c 0 2024-04-19T02:18:31.421 INFO:tasks.workunit.client.0.smithi073.stdout:2/306: dwrite d5/d10/d14/d18/f22 [0,4194304] 0 2024-04-19T02:18:31.422 INFO:tasks.workunit.client.0.smithi073.stdout:2/307: unlink d5/d10/d29/d42/l70 0 2024-04-19T02:18:31.423 INFO:tasks.workunit.client.0.smithi073.stdout:2/308: unlink d5/d10/l1d 0 2024-04-19T02:18:31.424 INFO:tasks.workunit.client.0.smithi073.stdout:2/309: chown d5/d10/d29/l5c 29585019 1 2024-04-19T02:18:31.424 INFO:tasks.workunit.client.0.smithi073.stdout:3/463: dwrite d3/d6/db/d3a/d38/d43/f84 [0,4194304] 0 2024-04-19T02:18:31.424 INFO:tasks.workunit.client.0.smithi073.stdout:6/321: dread d8/de/ff [0,4194304] 0 2024-04-19T02:18:31.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/464: symlink d3/d6/db/d3a/d38/d43/l9d 0 2024-04-19T02:18:31.426 INFO:tasks.workunit.client.0.smithi073.stdout:2/310: write d5/d10/d14/d18/f4d [221898,82388] 0 2024-04-19T02:18:31.426 INFO:tasks.workunit.client.0.smithi073.stdout:3/465: mkdir d3/d6/db/d16/d9e 0 2024-04-19T02:18:31.427 INFO:tasks.workunit.client.0.smithi073.stdout:3/466: creat d3/d6/db/d1a/d2f/f9f x:0 0 0 2024-04-19T02:18:31.427 INFO:tasks.workunit.client.0.smithi073.stdout:3/467: dread - d3/d6/db/d3a/d38/f53 zero size 2024-04-19T02:18:31.429 INFO:tasks.workunit.client.0.smithi073.stdout:3/468: link d3/d6/db/d3a/d38/d40/f95 d3/d6/db/fa0 0 2024-04-19T02:18:31.432 INFO:tasks.workunit.client.0.smithi073.stdout:1/319: getdents db/d41 0 2024-04-19T02:18:31.434 INFO:tasks.workunit.client.0.smithi073.stdout:5/384: dwrite d0/d1d/d25/d37/f4d [0,4194304] 0 2024-04-19T02:18:31.434 INFO:tasks.workunit.client.0.smithi073.stdout:8/312: sync 2024-04-19T02:18:31.435 INFO:tasks.workunit.client.0.smithi073.stdout:3/469: dwrite d3/d6/db/f4d [0,4194304] 0 2024-04-19T02:18:31.436 INFO:tasks.workunit.client.0.smithi073.stdout:5/385: rename d0/d1d/f5c to d0/d1d/d1e/f83 0 2024-04-19T02:18:31.436 INFO:tasks.workunit.client.0.smithi073.stdout:8/313: write d14/d27/d29/d31/d34/f40 [4833939,35] 0 2024-04-19T02:18:31.436 INFO:tasks.workunit.client.0.smithi073.stdout:5/386: mknod d0/d1d/d24/c84 0 2024-04-19T02:18:31.437 INFO:tasks.workunit.client.0.smithi073.stdout:3/470: creat d3/d6/db/fa1 x:0 0 0 2024-04-19T02:18:31.438 INFO:tasks.workunit.client.0.smithi073.stdout:5/387: mknod d0/d1d/d1e/c85 0 2024-04-19T02:18:31.438 INFO:tasks.workunit.client.0.smithi073.stdout:4/332: dread da/f11 [0,4194304] 0 2024-04-19T02:18:31.438 INFO:tasks.workunit.client.0.smithi073.stdout:5/388: dread - d0/f3b zero size 2024-04-19T02:18:31.438 INFO:tasks.workunit.client.0.smithi073.stdout:3/471: rename d3/d6/db/d3a/d38/d43/l9d to d3/d6/db/d16/la2 0 2024-04-19T02:18:31.439 INFO:tasks.workunit.client.0.smithi073.stdout:4/333: creat da/d27/d2c/d60/f71 x:0 0 0 2024-04-19T02:18:31.439 INFO:tasks.workunit.client.0.smithi073.stdout:4/334: write da/d23/d2b/f32 [499988,2896] 0 2024-04-19T02:18:31.440 INFO:tasks.workunit.client.0.smithi073.stdout:5/389: rename d0/d2d/f57 to d0/d1d/d25/d35/d39/f86 0 2024-04-19T02:18:31.441 INFO:tasks.workunit.client.0.smithi073.stdout:4/335: getdents da 0 2024-04-19T02:18:31.441 INFO:tasks.workunit.client.0.smithi073.stdout:5/390: dread - d0/d1d/d24/d61/f7c zero size 2024-04-19T02:18:31.441 INFO:tasks.workunit.client.0.smithi073.stdout:8/314: dread d14/d15/d17/f1f [4194304,4194304] 0 2024-04-19T02:18:31.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/391: readlink d0/d1d/d25/d35/l43 0 2024-04-19T02:18:31.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/392: fdatasync d0/ff 0 2024-04-19T02:18:31.443 INFO:tasks.workunit.client.0.smithi073.stdout:8/315: getdents d14/d15/d17 0 2024-04-19T02:18:31.443 INFO:tasks.workunit.client.0.smithi073.stdout:5/393: mknod d0/d1d/d24/c87 0 2024-04-19T02:18:31.445 INFO:tasks.workunit.client.0.smithi073.stdout:5/394: rename d0/d69/d79 to d0/d1d/d25/d35/d88 0 2024-04-19T02:18:31.445 INFO:tasks.workunit.client.0.smithi073.stdout:3/472: dwrite d3/d6/f22 [0,4194304] 0 2024-04-19T02:18:31.446 INFO:tasks.workunit.client.0.smithi073.stdout:3/473: creat d3/d6/db/d3a/d5f/fa3 x:0 0 0 2024-04-19T02:18:31.448 INFO:tasks.workunit.client.0.smithi073.stdout:3/474: write d3/d6/db/d3a/d38/d89/d94/d7b/f9b [419905,63602] 0 2024-04-19T02:18:31.448 INFO:tasks.workunit.client.0.smithi073.stdout:4/336: dwrite da/d27/d1b/d1d/f42 [0,4194304] 0 2024-04-19T02:18:31.449 INFO:tasks.workunit.client.0.smithi073.stdout:3/475: unlink d3/d6/db/d1a/f4c 0 2024-04-19T02:18:31.450 INFO:tasks.workunit.client.0.smithi073.stdout:4/337: getdents da/d23 0 2024-04-19T02:18:31.450 INFO:tasks.workunit.client.0.smithi073.stdout:3/476: write d3/f41 [2622702,107402] 0 2024-04-19T02:18:31.450 INFO:tasks.workunit.client.0.smithi073.stdout:3/477: stat d3/d6/db/d1a/l61 0 2024-04-19T02:18:31.451 INFO:tasks.workunit.client.0.smithi073.stdout:4/338: getdents da/d23/d3d 0 2024-04-19T02:18:31.453 INFO:tasks.workunit.client.0.smithi073.stdout:0/256: dread d7/d14/f2d [0,4194304] 0 2024-04-19T02:18:31.455 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:31.452+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:31.456 INFO:tasks.workunit.client.0.smithi073.stdout:4/339: dwrite da/d27/d1b/f45 [0,4194304] 0 2024-04-19T02:18:31.457 INFO:tasks.workunit.client.0.smithi073.stdout:1/320: write f6 [3923990,82871] 0 2024-04-19T02:18:31.460 INFO:tasks.workunit.client.0.smithi073.stdout:2/311: dwrite d5/d10/d29/d66/d67/d72/f12 [0,4194304] 0 2024-04-19T02:18:31.460 INFO:tasks.workunit.client.0.smithi073.stdout:2/312: unlink d5/d10/d29/d66/d67/d72/f55 0 2024-04-19T02:18:31.461 INFO:tasks.workunit.client.0.smithi073.stdout:2/313: creat d5/d10/d53/f75 x:0 0 0 2024-04-19T02:18:31.462 INFO:tasks.workunit.client.0.smithi073.stdout:2/314: write d5/f8 [83049,78907] 0 2024-04-19T02:18:31.464 INFO:tasks.workunit.client.0.smithi073.stdout:2/315: mkdir d5/d10/d14/d2e/d76 0 2024-04-19T02:18:31.467 INFO:tasks.workunit.client.0.smithi073.stdout:9/358: dread d0/f13 [0,4194304] 0 2024-04-19T02:18:31.468 INFO:tasks.workunit.client.0.smithi073.stdout:2/316: dwrite d5/d10/d53/f75 [0,4194304] 0 2024-04-19T02:18:31.469 INFO:tasks.workunit.client.0.smithi073.stdout:2/317: symlink d5/d10/l77 0 2024-04-19T02:18:31.472 INFO:tasks.workunit.client.0.smithi073.stdout:0/257: read d7/d14/d17/f1d [3171704,83754] 0 2024-04-19T02:18:31.473 INFO:tasks.workunit.client.0.smithi073.stdout:9/359: dwrite d0/df/d1d/f44 [4194304,4194304] 0 2024-04-19T02:18:31.473 INFO:tasks.workunit.client.0.smithi073.stdout:0/258: mknod d7/d14/d17/d1a/d20/c4f 0 2024-04-19T02:18:31.474 INFO:tasks.workunit.client.0.smithi073.stdout:0/259: write d7/d14/f1b [907916,130123] 0 2024-04-19T02:18:31.474 INFO:tasks.workunit.client.0.smithi073.stdout:9/360: mknod d0/df/d16/d19/d38/d5d/d5e/c8a 0 2024-04-19T02:18:31.475 INFO:tasks.workunit.client.0.smithi073.stdout:9/361: chown d0/df/d16/d19/d38/d5d/d6d 9 1 2024-04-19T02:18:31.475 INFO:tasks.workunit.client.0.smithi073.stdout:9/362: fsync d0/df/f41 0 2024-04-19T02:18:31.475 INFO:tasks.workunit.client.0.smithi073.stdout:9/363: rmdir d0/d35 39 2024-04-19T02:18:31.477 INFO:tasks.workunit.client.0.smithi073.stdout:9/364: link d0/d35/f4c d0/f8b 0 2024-04-19T02:18:31.477 INFO:tasks.workunit.client.0.smithi073.stdout:9/365: chown d0/df/d60 13571 1 2024-04-19T02:18:31.479 INFO:tasks.workunit.client.0.smithi073.stdout:3/478: rmdir d3 39 2024-04-19T02:18:31.480 INFO:tasks.workunit.client.0.smithi073.stdout:0/260: dwrite d7/d14/d17/f1d [0,4194304] 0 2024-04-19T02:18:31.481 INFO:tasks.workunit.client.0.smithi073.stdout:0/261: stat d7/d14/d17/d1a/d21/f32 0 2024-04-19T02:18:31.481 INFO:tasks.workunit.client.0.smithi073.stdout:3/479: symlink d3/d6/db/d16/d9e/la4 0 2024-04-19T02:18:31.482 INFO:tasks.workunit.client.0.smithi073.stdout:3/480: mknod d3/d6/db/d3a/d5f/ca5 0 2024-04-19T02:18:31.483 INFO:tasks.workunit.client.0.smithi073.stdout:5/395: dwrite d0/d1d/f7d [0,4194304] 0 2024-04-19T02:18:31.484 INFO:tasks.workunit.client.0.smithi073.stdout:3/481: mkdir d3/d6/da6 0 2024-04-19T02:18:31.484 INFO:tasks.workunit.client.0.smithi073.stdout:5/396: unlink d0/d1d/l23 0 2024-04-19T02:18:31.485 INFO:tasks.workunit.client.0.smithi073.stdout:3/482: readlink d3/l20 0 2024-04-19T02:18:31.485 INFO:tasks.workunit.client.0.smithi073.stdout:1/321: write db/d1c/d54/f6a [2111734,30596] 0 2024-04-19T02:18:31.486 INFO:tasks.workunit.client.0.smithi073.stdout:1/322: fsync db/d41/f74 0 2024-04-19T02:18:31.486 INFO:tasks.workunit.client.0.smithi073.stdout:5/397: creat d0/d1d/d25/d37/d71/f89 x:0 0 0 2024-04-19T02:18:31.486 INFO:tasks.workunit.client.0.smithi073.stdout:2/318: unlink d5/d10/d29/d42/c5b 0 2024-04-19T02:18:31.487 INFO:tasks.workunit.client.0.smithi073.stdout:9/366: dwrite d0/df/d16/d19/d38/d5d/d45/f48 [0,4194304] 0 2024-04-19T02:18:31.487 INFO:tasks.workunit.client.0.smithi073.stdout:1/323: mkdir db/d1c/d78 0 2024-04-19T02:18:31.489 INFO:tasks.workunit.client.0.smithi073.stdout:3/483: truncate d3/d6/f15 814486 0 2024-04-19T02:18:31.489 INFO:tasks.workunit.client.0.smithi073.stdout:2/319: mknod d5/d10/d14/d18/d3e/d2d/d63/c78 0 2024-04-19T02:18:31.489 INFO:tasks.workunit.client.0.smithi073.stdout:1/324: rename db/d1c/d2c/f44 to db/d1c/d2c/d50/d62/f79 0 2024-04-19T02:18:31.491 INFO:tasks.workunit.client.0.smithi073.stdout:1/325: mknod db/d1c/d2c/d50/d62/c7a 0 2024-04-19T02:18:31.492 INFO:tasks.workunit.client.0.smithi073.stdout:0/262: dwrite d7/d14/d17/d1a/d20/f4c [0,4194304] 0 2024-04-19T02:18:31.493 INFO:tasks.workunit.client.0.smithi073.stdout:2/320: truncate d5/d10/d14/f2c 9070221 0 2024-04-19T02:18:31.494 INFO:tasks.workunit.client.0.smithi073.stdout:2/321: chown d5/d10/d14/d18/d3e 1152522 1 2024-04-19T02:18:31.494 INFO:tasks.workunit.client.0.smithi073.stdout:0/263: mkdir d7/d14/d17/d1a/d20/d50 0 2024-04-19T02:18:31.496 INFO:tasks.workunit.client.0.smithi073.stdout:5/398: dwrite d0/d1d/d25/d35/d39/f86 [0,4194304] 0 2024-04-19T02:18:31.496 INFO:tasks.workunit.client.0.smithi073.stdout:2/322: creat d5/d10/d14/d18/d3e/d51/f79 x:0 0 0 2024-04-19T02:18:31.498 INFO:tasks.workunit.client.0.smithi073.stdout:9/367: dwrite d0/d81/f4f [0,4194304] 0 2024-04-19T02:18:31.499 INFO:tasks.workunit.client.0.smithi073.stdout:2/323: rmdir d5/d10/d14/d2e/d76 0 2024-04-19T02:18:31.500 INFO:tasks.workunit.client.0.smithi073.stdout:1/326: dwrite f9 [4194304,4194304] 0 2024-04-19T02:18:31.500 INFO:tasks.workunit.client.0.smithi073.stdout:9/368: fsync d0/df/d16/d19/d38/d5d/f84 0 2024-04-19T02:18:31.501 INFO:tasks.workunit.client.0.smithi073.stdout:2/324: mkdir d5/d10/d14/d7a 0 2024-04-19T02:18:31.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/484: dwrite d3/d6/db/d3a/d38/f53 [0,4194304] 0 2024-04-19T02:18:31.502 INFO:tasks.workunit.client.0.smithi073.stdout:9/369: write d0/df/d16/d19/d38/d5d/f4e [864842,25435] 0 2024-04-19T02:18:31.503 INFO:tasks.workunit.client.0.smithi073.stdout:2/325: mknod d5/d10/d29/d66/d67/d72/c7b 0 2024-04-19T02:18:31.503 INFO:tasks.workunit.client.0.smithi073.stdout:5/399: dread d0/d1d/d25/d35/d39/f4c [0,4194304] 0 2024-04-19T02:18:31.503 INFO:tasks.workunit.client.0.smithi073.stdout:2/326: chown d5/d10/d14 5 1 2024-04-19T02:18:31.504 INFO:tasks.workunit.client.0.smithi073.stdout:5/400: fsync d0/d1d/f82 0 2024-04-19T02:18:31.504 INFO:tasks.workunit.client.0.smithi073.stdout:2/327: chown d5/d10/d29/d66/d67/d72 42 1 2024-04-19T02:18:31.505 INFO:tasks.workunit.client.0.smithi073.stdout:2/328: unlink d5/d10/l30 0 2024-04-19T02:18:31.506 INFO:tasks.workunit.client.0.smithi073.stdout:5/401: truncate d0/d1d/d25/d35/d39/f7f 977467 0 2024-04-19T02:18:31.507 INFO:tasks.workunit.client.0.smithi073.stdout:1/327: dwrite db/d1c/d2c/f69 [0,4194304] 0 2024-04-19T02:18:31.508 INFO:tasks.workunit.client.0.smithi073.stdout:5/402: mknod d0/d1d/d64/c8a 0 2024-04-19T02:18:31.508 INFO:tasks.workunit.client.0.smithi073.stdout:2/329: readlink d5/d10/d14/d18/d3e/d2d/l6c 0 2024-04-19T02:18:31.508 INFO:tasks.workunit.client.0.smithi073.stdout:1/328: write db/d1c/f3c [2528584,99974] 0 2024-04-19T02:18:31.509 INFO:tasks.workunit.client.0.smithi073.stdout:1/329: stat db/d1c/d2c/l46 0 2024-04-19T02:18:31.510 INFO:tasks.workunit.client.0.smithi073.stdout:9/370: dwrite d0/df/d16/d19/f73 [0,4194304] 0 2024-04-19T02:18:31.510 INFO:tasks.workunit.client.0.smithi073.stdout:2/330: getdents d5/d10/d29/d66/d67 0 2024-04-19T02:18:31.514 INFO:tasks.workunit.client.0.smithi073.stdout:2/331: dread d5/d10/d29/d66/d67/f48 [0,4194304] 0 2024-04-19T02:18:31.515 INFO:tasks.workunit.client.0.smithi073.stdout:2/332: chown d5/d10/d14/d18 52 1 2024-04-19T02:18:31.516 INFO:tasks.workunit.client.0.smithi073.stdout:2/333: chown d5/c2a 7443 1 2024-04-19T02:18:31.522 INFO:tasks.workunit.client.0.smithi073.stdout:2/334: dwrite d5/d10/d29/d66/d67/f4f [4194304,4194304] 0 2024-04-19T02:18:31.523 INFO:tasks.workunit.client.0.smithi073.stdout:2/335: mkdir d5/d10/d14/d18/d3e/d2d/d63/d7c 0 2024-04-19T02:18:31.525 INFO:tasks.workunit.client.0.smithi073.stdout:7/296: sync 2024-04-19T02:18:31.528 INFO:tasks.workunit.client.0.smithi073.stdout:2/336: dwrite d5/f64 [0,4194304] 0 2024-04-19T02:18:31.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/337: creat d5/d10/f7d x:0 0 0 2024-04-19T02:18:31.530 INFO:tasks.workunit.client.0.smithi073.stdout:0/264: dread d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:31.531 INFO:tasks.workunit.client.0.smithi073.stdout:0/265: write d7/d14/d17/d1a/d20/f4c [111764,92347] 0 2024-04-19T02:18:31.532 INFO:tasks.workunit.client.0.smithi073.stdout:7/297: dwrite d0/d3/f46 [0,4194304] 0 2024-04-19T02:18:31.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/485: truncate d3/d6/f9 627064 0 2024-04-19T02:18:31.533 INFO:tasks.workunit.client.0.smithi073.stdout:0/266: chown d7/d14/d17/d1a/d21/f36 83052836 1 2024-04-19T02:18:31.533 INFO:tasks.workunit.client.0.smithi073.stdout:7/298: link d0/dc/l23 d0/dc/d39/l59 0 2024-04-19T02:18:31.534 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:31.534 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:31.535 INFO:tasks.workunit.client.0.smithi073.stdout:7/299: rename d0/dc/d39/d40/f49 to d0/dc/f5a 0 2024-04-19T02:18:31.535 INFO:tasks.workunit.client.0.smithi073.stdout:7/300: fdatasync d0/f8 0 2024-04-19T02:18:31.536 INFO:tasks.workunit.client.0.smithi073.stdout:7/301: dread - d0/dc/d39/d50/f58 zero size 2024-04-19T02:18:31.537 INFO:tasks.workunit.client.0.smithi073.stdout:7/302: dread - d0/dc/f4c zero size 2024-04-19T02:18:31.538 INFO:tasks.workunit.client.0.smithi073.stdout:7/303: getdents d0/dc/d10/d2a 0 2024-04-19T02:18:31.538 INFO:tasks.workunit.client.0.smithi073.stdout:3/486: dwrite d3/d6/db/d3a/d38/d89/d94/f26 [0,4194304] 0 2024-04-19T02:18:31.538 INFO:tasks.workunit.client.0.smithi073.stdout:7/304: stat d0/dc/f1f 0 2024-04-19T02:18:31.539 INFO:tasks.workunit.client.0.smithi073.stdout:7/305: unlink d0/la 0 2024-04-19T02:18:31.539 INFO:tasks.workunit.client.0.smithi073.stdout:3/487: write d3/d6/db/d3a/d38/d89/d94/d7b/f9b [1484947,117002] 0 2024-04-19T02:18:31.540 INFO:tasks.workunit.client.0.smithi073.stdout:3/488: mkdir d3/d6/db/d3a/d5f/da7 0 2024-04-19T02:18:31.540 INFO:tasks.workunit.client.0.smithi073.stdout:7/306: link d0/dc/f5a d0/dc/d33/d36/f5b 0 2024-04-19T02:18:31.544 INFO:tasks.workunit.client.0.smithi073.stdout:7/307: dread d0/f3c [0,4194304] 0 2024-04-19T02:18:31.544 INFO:tasks.workunit.client.0.smithi073.stdout:7/308: mkdir d0/dc/d5c 0 2024-04-19T02:18:31.545 INFO:tasks.workunit.client.0.smithi073.stdout:7/309: getdents d0/dc/d10/d2a 0 2024-04-19T02:18:31.546 INFO:tasks.workunit.client.0.smithi073.stdout:7/310: readlink d0/dc/d10/l1c 0 2024-04-19T02:18:31.546 INFO:tasks.workunit.client.0.smithi073.stdout:7/311: mkdir d0/dc/d33/d5d 0 2024-04-19T02:18:31.547 INFO:tasks.workunit.client.0.smithi073.stdout:3/489: dwrite d3/d6/db/d3a/d38/d89/d94/f35 [4194304,4194304] 0 2024-04-19T02:18:31.547 INFO:tasks.workunit.client.0.smithi073.stdout:7/312: mknod d0/dc/c5e 0 2024-04-19T02:18:31.548 INFO:tasks.workunit.client.0.smithi073.stdout:5/403: write d0/f1b [1995768,3599] 0 2024-04-19T02:18:31.548 INFO:tasks.workunit.client.0.smithi073.stdout:7/313: chown d0/dc/d10/l1c 39778 1 2024-04-19T02:18:31.549 INFO:tasks.workunit.client.0.smithi073.stdout:5/404: creat d0/d1d/d64/f8b x:0 0 0 2024-04-19T02:18:31.549 INFO:tasks.workunit.client.0.smithi073.stdout:7/314: write d0/dc/d10/d2a/f2b [5777837,93921] 0 2024-04-19T02:18:31.549 INFO:tasks.workunit.client.0.smithi073.stdout:9/371: write d0/df/d16/d19/d38/d5d/d45/f7a [762592,113857] 0 2024-04-19T02:18:31.550 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:31.544+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:31.550 INFO:tasks.workunit.client.0.smithi073.stdout:9/372: write d0/df/f40 [5106355,56721] 0 2024-04-19T02:18:31.551 INFO:tasks.workunit.client.0.smithi073.stdout:7/315: symlink d0/dc/d10/d15/l5f 0 2024-04-19T02:18:31.551 INFO:tasks.workunit.client.0.smithi073.stdout:7/316: write d0/dc/f5a [4069911,67482] 0 2024-04-19T02:18:31.551 INFO:tasks.workunit.client.0.smithi073.stdout:9/373: getdents d0/df/d16/d19/d38/d5d/d5e 0 2024-04-19T02:18:31.552 INFO:tasks.workunit.client.0.smithi073.stdout:9/374: getdents d0/df/d16/d19/d38/d5d/d76/d7d/d88 0 2024-04-19T02:18:31.553 INFO:tasks.workunit.client.0.smithi073.stdout:9/375: fsync d0/df/f11 0 2024-04-19T02:18:31.553 INFO:tasks.workunit.client.0.smithi073.stdout:9/376: symlink d0/d81/l8c 0 2024-04-19T02:18:31.554 INFO:tasks.workunit.client.0.smithi073.stdout:9/377: unlink d0/df/d60/c6e 0 2024-04-19T02:18:31.559 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:31.573 INFO:tasks.workunit.client.0.smithi073.stdout:1/330: dread db/d3e/f3f [0,4194304] 0 2024-04-19T02:18:31.574 INFO:tasks.workunit.client.0.smithi073.stdout:1/331: read db/d1c/d2c/f69 [2434910,123915] 0 2024-04-19T02:18:31.575 INFO:tasks.workunit.client.0.smithi073.stdout:7/317: dread d0/dc/d33/f35 [0,4194304] 0 2024-04-19T02:18:31.575 INFO:tasks.workunit.client.0.smithi073.stdout:1/332: write db/d1c/d2c/d50/f60 [65438,89049] 0 2024-04-19T02:18:31.575 INFO:tasks.workunit.client.0.smithi073.stdout:7/318: write d0/dc/f4c [30436,82845] 0 2024-04-19T02:18:31.576 INFO:tasks.workunit.client.0.smithi073.stdout:7/319: chown d0/dc/f26 708018417 1 2024-04-19T02:18:31.576 INFO:tasks.workunit.client.0.smithi073.stdout:1/333: getdents db/d1c/d2c/d50 0 2024-04-19T02:18:31.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/334: chown db/d3e 4 1 2024-04-19T02:18:31.577 INFO:tasks.workunit.client.0.smithi073.stdout:7/320: unlink d0/dc/d10/d2a/l2d 0 2024-04-19T02:18:31.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/335: fdatasync db/f25 0 2024-04-19T02:18:31.577 INFO:tasks.workunit.client.0.smithi073.stdout:5/405: read d0/f5d [158791,5498] 0 2024-04-19T02:18:31.578 INFO:tasks.workunit.client.0.smithi073.stdout:1/336: mknod db/d1c/d2c/d50/c7b 0 2024-04-19T02:18:31.578 INFO:tasks.workunit.client.0.smithi073.stdout:7/321: rename d0/dc/d10/d15/f3e to d0/dc/d39/d40/f60 0 2024-04-19T02:18:31.578 INFO:tasks.workunit.client.0.smithi073.stdout:5/406: truncate d0/d1d/d25/d35/f4b 642189 0 2024-04-19T02:18:31.580 INFO:tasks.workunit.client.0.smithi073.stdout:7/322: symlink d0/dc/d10/d2a/l61 0 2024-04-19T02:18:31.580 INFO:tasks.workunit.client.0.smithi073.stdout:2/338: truncate d5/d10/d29/d66/d67/f4f 7495007 0 2024-04-19T02:18:31.580 INFO:tasks.workunit.client.0.smithi073.stdout:7/323: creat d0/dc/d39/f62 x:0 0 0 2024-04-19T02:18:31.580 INFO:tasks.workunit.client.0.smithi073.stdout:2/339: mkdir d5/d10/d29/d66/d7e 0 2024-04-19T02:18:31.581 INFO:tasks.workunit.client.0.smithi073.stdout:2/340: write d5/f16 [3242825,120427] 0 2024-04-19T02:18:31.582 INFO:tasks.workunit.client.0.smithi073.stdout:2/341: mknod d5/d10/d14/d18/c7f 0 2024-04-19T02:18:31.583 INFO:tasks.workunit.client.0.smithi073.stdout:5/407: dread d0/d1d/d24/f2e [0,4194304] 0 2024-04-19T02:18:31.583 INFO:tasks.workunit.client.0.smithi073.stdout:2/342: write d5/d10/d14/d2e/f54 [85763,105118] 0 2024-04-19T02:18:31.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/337: rmdir db/d1c 39 2024-04-19T02:18:31.584 INFO:tasks.workunit.client.0.smithi073.stdout:5/408: dread - d0/d1d/d24/d62/f7e zero size 2024-04-19T02:18:31.585 INFO:tasks.workunit.client.0.smithi073.stdout:5/409: creat d0/d1d/d24/d62/f8c x:0 0 0 2024-04-19T02:18:31.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/338: getdents db/d1c/d54 0 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:7/324: dwrite d0/f1d [4194304,4194304] 0 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:7/325: fdatasync d0/dc/f5a 0 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:5/410: link d0/d1d/f4a d0/d1d/d1e/f8d 0 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:7/326: chown d0/dc/d10/d15 145 1 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:5/411: fdatasync d0/d1d/d1e/f33 0 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:5/412: write d0/d1d/d1e/f33 [1598631,96493] 0 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:7/327: mkdir d0/d28/d63 0 2024-04-19T02:18:31.592 INFO:tasks.workunit.client.0.smithi073.stdout:5/413: dread - d0/d1d/d1e/f83 zero size 2024-04-19T02:18:31.593 INFO:tasks.workunit.client.0.smithi073.stdout:7/328: write d0/dc/f4c [461957,67586] 0 2024-04-19T02:18:31.593 INFO:tasks.workunit.client.0.smithi073.stdout:2/343: dread d5/d10/d29/d42/f52 [0,4194304] 0 2024-04-19T02:18:31.593 INFO:tasks.workunit.client.0.smithi073.stdout:7/329: write d0/dc/d10/d2a/d51/f54 [596831,65845] 0 2024-04-19T02:18:31.594 INFO:tasks.workunit.client.0.smithi073.stdout:1/339: dwrite db/d1c/d2c/f69 [0,4194304] 0 2024-04-19T02:18:31.594 INFO:tasks.workunit.client.0.smithi073.stdout:1/340: dread - db/d41/f68 zero size 2024-04-19T02:18:31.597 INFO:tasks.workunit.client.0.smithi073.stdout:7/330: read d0/f8 [133015,112789] 0 2024-04-19T02:18:31.598 INFO:tasks.workunit.client.0.smithi073.stdout:7/331: mknod d0/c64 0 2024-04-19T02:18:31.600 INFO:tasks.workunit.client.0.smithi073.stdout:7/332: read d0/d3/f46 [834885,44960] 0 2024-04-19T02:18:31.600 INFO:tasks.workunit.client.0.smithi073.stdout:2/344: dwrite d5/f64 [4194304,4194304] 0 2024-04-19T02:18:31.601 INFO:tasks.workunit.client.0.smithi073.stdout:2/345: chown d5/d10/d14/d18/d3e/d2d/c6d 127 1 2024-04-19T02:18:31.602 INFO:tasks.workunit.client.0.smithi073.stdout:1/341: dwrite db/d1c/d2c/d50/d62/f79 [0,4194304] 0 2024-04-19T02:18:31.604 INFO:tasks.workunit.client.0.smithi073.stdout:5/414: dread d0/d1d/f20 [4194304,4194304] 0 2024-04-19T02:18:31.604 INFO:tasks.workunit.client.0.smithi073.stdout:7/333: dread d0/dc/d39/f4f [0,4194304] 0 2024-04-19T02:18:31.605 INFO:tasks.workunit.client.0.smithi073.stdout:2/346: symlink d5/d10/d14/d2e/l80 0 2024-04-19T02:18:31.605 INFO:tasks.workunit.client.0.smithi073.stdout:7/334: chown d0/dc/d33/d36 543194 1 2024-04-19T02:18:31.606 INFO:tasks.workunit.client.0.smithi073.stdout:2/347: dread - d5/d10/d29/d42/f68 zero size 2024-04-19T02:18:31.606 INFO:tasks.workunit.client.0.smithi073.stdout:5/415: rename d0/d1d/c21 to d0/d1d/d64/c8e 0 2024-04-19T02:18:31.607 INFO:tasks.workunit.client.0.smithi073.stdout:7/335: creat d0/dc/d10/f65 x:0 0 0 2024-04-19T02:18:31.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/348: write d5/d10/d14/d18/d3e/d2d/d63/f46 [3501636,56193] 0 2024-04-19T02:18:31.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/416: mknod d0/d1d/d1e/c8f 0 2024-04-19T02:18:31.610 INFO:tasks.workunit.client.0.smithi073.stdout:7/336: creat d0/d3/f66 x:0 0 0 2024-04-19T02:18:31.610 INFO:tasks.workunit.client.0.smithi073.stdout:2/349: rename d5/d10/d14/d18/d3e/d2d/d63/d7c to d5/d10/d29/d66/d81 0 2024-04-19T02:18:31.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/417: chown d0/d1d/d24/f5e 14360815 1 2024-04-19T02:18:31.610 INFO:tasks.workunit.client.0.smithi073.stdout:2/350: chown d5/lb 6 1 2024-04-19T02:18:31.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/418: readlink d0/l68 0 2024-04-19T02:18:31.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/419: mkdir d0/d1d/d90 0 2024-04-19T02:18:31.611 INFO:tasks.workunit.client.0.smithi073.stdout:2/351: mknod d5/d10/d14/d18/d3e/d2d/d63/c82 0 2024-04-19T02:18:31.611 INFO:tasks.workunit.client.0.smithi073.stdout:2/352: write d5/d10/d14/d18/d3e/f62 [305356,1071] 0 2024-04-19T02:18:31.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/420: mknod d0/d1d/d25/d35/d88/c91 0 2024-04-19T02:18:31.612 INFO:tasks.workunit.client.0.smithi073.stdout:2/353: mkdir d5/d10/d29/d66/d83 0 2024-04-19T02:18:31.613 INFO:tasks.workunit.client.0.smithi073.stdout:2/354: symlink d5/d10/d14/d18/d3e/d2d/d63/l84 0 2024-04-19T02:18:31.613 INFO:tasks.workunit.client.0.smithi073.stdout:2/355: getdents d5/d10/d29/d66/d83 0 2024-04-19T02:18:31.614 INFO:tasks.workunit.client.0.smithi073.stdout:2/356: dread - d5/d10/d29/d66/d67/d72/f2f zero size 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/421: dread d0/d1d/f7d [0,4194304] 0 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:2/357: creat d5/d10/d14/d18/d3e/f85 x:0 0 0 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:8/316: sync 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:4/340: sync 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:6/322: sync 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:0/267: sync 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:6/323: chown f3 5162 1 2024-04-19T02:18:31.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/422: creat d0/d1d/d24/d62/f92 x:0 0 0 2024-04-19T02:18:31.617 INFO:tasks.workunit.client.0.smithi073.stdout:4/341: dread - da/d27/d36/f5e zero size 2024-04-19T02:18:31.617 INFO:tasks.workunit.client.0.smithi073.stdout:6/324: readlink d8/l44 0 2024-04-19T02:18:31.617 INFO:tasks.workunit.client.0.smithi073.stdout:8/317: creat d14/d27/d29/d31/f5b x:0 0 0 2024-04-19T02:18:31.618 INFO:tasks.workunit.client.0.smithi073.stdout:4/342: write da/d23/d2b/d2f/f63 [217713,104761] 0 2024-04-19T02:18:31.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/423: getdents d0/d1d/d25/d37 0 2024-04-19T02:18:31.618 INFO:tasks.workunit.client.0.smithi073.stdout:8/318: rmdir d14/d27/d50 39 2024-04-19T02:18:31.619 INFO:tasks.workunit.client.0.smithi073.stdout:4/343: fdatasync da/d27/d2c/f3c 0 2024-04-19T02:18:31.619 INFO:tasks.workunit.client.0.smithi073.stdout:8/319: truncate d14/d27/d29/f51 317077 0 2024-04-19T02:18:31.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/344: rename da/d23 to da/d27/d1b/d1d/d72 0 2024-04-19T02:18:31.620 INFO:tasks.workunit.client.0.smithi073.stdout:8/320: write f0 [6891112,83865] 0 2024-04-19T02:18:31.620 INFO:tasks.workunit.client.0.smithi073.stdout:2/358: dread d5/d10/d29/d42/f52 [0,4194304] 0 2024-04-19T02:18:31.621 INFO:tasks.workunit.client.0.smithi073.stdout:4/345: creat da/d27/d3a/f73 x:0 0 0 2024-04-19T02:18:31.621 INFO:tasks.workunit.client.0.smithi073.stdout:8/321: chown d14/d15/f1e 4145615 1 2024-04-19T02:18:31.622 INFO:tasks.workunit.client.0.smithi073.stdout:0/268: dread d7/d14/d17/d1a/d20/f27 [0,4194304] 0 2024-04-19T02:18:31.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/359: dread - d5/d10/d29/d66/d67/d72/f2f zero size 2024-04-19T02:18:31.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/346: read da/d27/d1b/d1d/d72/d2b/d2f/f63 [63384,110739] 0 2024-04-19T02:18:31.624 INFO:tasks.workunit.client.0.smithi073.stdout:4/347: write da/d27/d36/f6e [344459,33768] 0 2024-04-19T02:18:31.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/424: dwrite d0/d1d/d25/d35/d39/f66 [4194304,4194304] 0 2024-04-19T02:18:31.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/425: fdatasync d0/ff 0 2024-04-19T02:18:31.626 INFO:tasks.workunit.client.0.smithi073.stdout:5/426: dread - d0/d1d/d24/d62/f7e zero size 2024-04-19T02:18:31.629 INFO:tasks.workunit.client.0.smithi073.stdout:0/269: dwrite d7/d14/d17/d1a/d21/f36 [0,4194304] 0 2024-04-19T02:18:31.636 INFO:tasks.workunit.client.0.smithi073.stdout:0/270: dwrite d7/d14/d17/d1a/d21/f36 [0,4194304] 0 2024-04-19T02:18:31.636 INFO:tasks.workunit.client.0.smithi073.stdout:1/342: truncate db/d41/f4c 3919126 0 2024-04-19T02:18:31.637 INFO:tasks.workunit.client.0.smithi073.stdout:0/271: rmdir d7 39 2024-04-19T02:18:31.638 INFO:tasks.workunit.client.0.smithi073.stdout:8/322: rmdir d14/d27/d29 39 2024-04-19T02:18:31.638 INFO:tasks.workunit.client.0.smithi073.stdout:1/343: mknod db/d1c/d2c/d50/c7c 0 2024-04-19T02:18:31.638 INFO:tasks.workunit.client.0.smithi073.stdout:2/360: fdatasync d5/d10/d14/d18/d3e/f62 0 2024-04-19T02:18:31.639 INFO:tasks.workunit.client.0.smithi073.stdout:6/325: dread d8/de/f67 [0,4194304] 0 2024-04-19T02:18:31.639 INFO:tasks.workunit.client.0.smithi073.stdout:8/323: chown d14/d15/d17/d48/f59 127 1 2024-04-19T02:18:31.639 INFO:tasks.workunit.client.0.smithi073.stdout:0/272: getdents d7 0 2024-04-19T02:18:31.639 INFO:tasks.workunit.client.0.smithi073.stdout:2/361: fdatasync d5/d10/d29/d66/d67/f43 0 2024-04-19T02:18:31.640 INFO:tasks.workunit.client.0.smithi073.stdout:1/344: readlink db/d1c/d2c/l3a 0 2024-04-19T02:18:31.640 INFO:tasks.workunit.client.0.smithi073.stdout:6/326: write d8/de/d35/f49 [557550,26326] 0 2024-04-19T02:18:31.641 INFO:tasks.workunit.client.0.smithi073.stdout:2/362: write d5/f64 [2530930,67626] 0 2024-04-19T02:18:31.642 INFO:tasks.workunit.client.0.smithi073.stdout:1/345: unlink db/l6e 0 2024-04-19T02:18:31.642 INFO:tasks.workunit.client.0.smithi073.stdout:0/273: mknod d7/d14/d17/d1a/d20/c51 0 2024-04-19T02:18:31.643 INFO:tasks.workunit.client.0.smithi073.stdout:0/274: creat d7/d14/d17/f52 x:0 0 0 2024-04-19T02:18:31.643 INFO:tasks.workunit.client.0.smithi073.stdout:5/427: dwrite d0/f5d [0,4194304] 0 2024-04-19T02:18:31.643 INFO:tasks.workunit.client.0.smithi073.stdout:6/327: rename d8/de/d22/c73 to d8/de/d58/d63/c79 0 2024-04-19T02:18:31.644 INFO:tasks.workunit.client.0.smithi073.stdout:5/428: write d0/f3b [50512,13231] 0 2024-04-19T02:18:31.644 INFO:tasks.workunit.client.0.smithi073.stdout:0/275: creat d7/d14/d17/d1a/d21/f53 x:0 0 0 2024-04-19T02:18:31.645 INFO:tasks.workunit.client.0.smithi073.stdout:7/337: dwrite d0/f8 [0,4194304] 0 2024-04-19T02:18:31.645 INFO:tasks.workunit.client.0.smithi073.stdout:6/328: fdatasync d8/de/d22/f31 0 2024-04-19T02:18:31.647 INFO:tasks.workunit.client.0.smithi073.stdout:6/329: rename d8/l20 to d8/d71/l7a 0 2024-04-19T02:18:31.647 INFO:tasks.workunit.client.0.smithi073.stdout:0/276: chown d7/d14/d17/d1a/d20/f4d 1065055979 1 2024-04-19T02:18:31.647 INFO:tasks.workunit.client.0.smithi073.stdout:0/277: fsync d7/f1c 0 2024-04-19T02:18:31.650 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:31.648+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:31.651 INFO:tasks.workunit.client.0.smithi073.stdout:8/324: dread d14/d15/f35 [0,4194304] 0 2024-04-19T02:18:31.652 INFO:tasks.workunit.client.0.smithi073.stdout:8/325: creat d14/d27/f5c x:0 0 0 2024-04-19T02:18:31.654 INFO:tasks.workunit.client.0.smithi073.stdout:7/338: dwrite d0/dc/d10/f65 [0,4194304] 0 2024-04-19T02:18:31.654 INFO:tasks.workunit.client.0.smithi073.stdout:8/326: write d14/f19 [1180464,115522] 0 2024-04-19T02:18:31.654 INFO:tasks.workunit.client.0.smithi073.stdout:0/278: dwrite d7/d14/d17/f1f [0,4194304] 0 2024-04-19T02:18:31.655 INFO:tasks.workunit.client.0.smithi073.stdout:7/339: chown d0/d28/c41 92090 1 2024-04-19T02:18:31.655 INFO:tasks.workunit.client.0.smithi073.stdout:8/327: fdatasync d14/d27/d29/d31/d34/f3a 0 2024-04-19T02:18:31.655 INFO:tasks.workunit.client.0.smithi073.stdout:0/279: write d7/d14/d17/d1a/d21/f40 [5125783,102692] 0 2024-04-19T02:18:31.657 INFO:tasks.workunit.client.0.smithi073.stdout:8/328: unlink d14/d15/d17/l20 0 2024-04-19T02:18:31.657 INFO:tasks.workunit.client.0.smithi073.stdout:0/280: mknod d7/d14/d17/d1a/d20/c54 0 2024-04-19T02:18:31.657 INFO:tasks.workunit.client.0.smithi073.stdout:7/340: getdents d0/d28/d63 0 2024-04-19T02:18:31.657 INFO:tasks.workunit.client.0.smithi073.stdout:8/329: creat d14/d27/d50/f5d x:0 0 0 2024-04-19T02:18:31.658 INFO:tasks.workunit.client.0.smithi073.stdout:0/281: write d7/d14/f15 [3630693,82440] 0 2024-04-19T02:18:31.659 INFO:tasks.workunit.client.0.smithi073.stdout:0/282: rename d7/d14/d17/f52 to d7/d14/d17/f55 0 2024-04-19T02:18:31.659 INFO:tasks.workunit.client.0.smithi073.stdout:0/283: stat d7/d14/d17/d1a/d20/l3f 0 2024-04-19T02:18:31.659 INFO:tasks.workunit.client.0.smithi073.stdout:8/330: rename d14/d15/d17/f58 to d14/d27/d29/d31/f5e 0 2024-04-19T02:18:31.660 INFO:tasks.workunit.client.0.smithi073.stdout:0/284: readlink d7/l41 0 2024-04-19T02:18:31.660 INFO:tasks.workunit.client.0.smithi073.stdout:8/331: rename d14/d15/l2a to d14/d33/l5f 0 2024-04-19T02:18:31.661 INFO:tasks.workunit.client.0.smithi073.stdout:0/285: read d7/f11 [2962850,6059] 0 2024-04-19T02:18:31.663 INFO:tasks.workunit.client.0.smithi073.stdout:7/341: dwrite d0/d3/f66 [0,4194304] 0 2024-04-19T02:18:31.664 INFO:tasks.workunit.client.0.smithi073.stdout:7/342: unlink d0/dc/d33/d36/f5b 0 2024-04-19T02:18:31.664 INFO:tasks.workunit.client.0.smithi073.stdout:3/490: sync 2024-04-19T02:18:31.664 INFO:tasks.workunit.client.0.smithi073.stdout:9/378: sync 2024-04-19T02:18:31.666 INFO:tasks.workunit.client.0.smithi073.stdout:9/379: chown d0/df/d16/d1a/d2c/d2e/f7f 120729363 1 2024-04-19T02:18:31.666 INFO:tasks.workunit.client.0.smithi073.stdout:3/491: fdatasync d3/d6/f8c 0 2024-04-19T02:18:31.667 INFO:tasks.workunit.client.0.smithi073.stdout:0/286: dwrite d7/d14/f3e [0,4194304] 0 2024-04-19T02:18:31.667 INFO:tasks.workunit.client.0.smithi073.stdout:3/492: write d3/d6/db/d16/d52/f99 [170259,113721] 0 2024-04-19T02:18:31.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/332: rmdir d14 39 2024-04-19T02:18:31.669 INFO:tasks.workunit.client.0.smithi073.stdout:0/287: unlink d7/d14/d17/d1a/d20/f4d 0 2024-04-19T02:18:31.669 INFO:tasks.workunit.client.0.smithi073.stdout:3/493: rename d3/d6/db/d3a/d38/d89/d94/f5b to d3/d6/db/d16/d9e/fa8 0 2024-04-19T02:18:31.670 INFO:tasks.workunit.client.0.smithi073.stdout:9/380: dread d0/f13 [0,4194304] 0 2024-04-19T02:18:31.670 INFO:tasks.workunit.client.0.smithi073.stdout:0/288: read d7/d14/f3e [730613,66893] 0 2024-04-19T02:18:31.670 INFO:tasks.workunit.client.0.smithi073.stdout:7/343: read d0/dc/d33/d36/f3b [4112534,92779] 0 2024-04-19T02:18:31.670 INFO:tasks.workunit.client.0.smithi073.stdout:7/344: fsync d0/f3c 0 2024-04-19T02:18:31.672 INFO:tasks.workunit.client.0.smithi073.stdout:0/289: mkdir d7/d14/d17/d1a/d56 0 2024-04-19T02:18:31.672 INFO:tasks.workunit.client.0.smithi073.stdout:7/345: rename d0/dc/d10 to d0/dc/d67 0 2024-04-19T02:18:31.674 INFO:tasks.workunit.client.0.smithi073.stdout:7/346: creat d0/dc/d39/d50/f68 x:0 0 0 2024-04-19T02:18:31.675 INFO:tasks.workunit.client.0.smithi073.stdout:9/381: dread d0/df/d16/d19/f73 [0,4194304] 0 2024-04-19T02:18:31.675 INFO:tasks.workunit.client.0.smithi073.stdout:7/347: symlink d0/dc/d67/d2a/l69 0 2024-04-19T02:18:31.675 INFO:tasks.workunit.client.0.smithi073.stdout:8/333: dwrite d14/f19 [4194304,4194304] 0 2024-04-19T02:18:31.676 INFO:tasks.workunit.client.0.smithi073.stdout:9/382: write d0/df/d16/d19/f73 [5059187,79902] 0 2024-04-19T02:18:31.677 INFO:tasks.workunit.client.0.smithi073.stdout:7/348: rename d0/dc/d39/d40/f60 to d0/f6a 0 2024-04-19T02:18:31.679 INFO:tasks.workunit.client.0.smithi073.stdout:9/383: creat d0/df/d16/d19/d38/d5d/d5e/f8d x:0 0 0 2024-04-19T02:18:31.679 INFO:tasks.workunit.client.0.smithi073.stdout:8/334: rename d14/d27/d29/d31/c53 to d14/d27/c60 0 2024-04-19T02:18:31.679 INFO:tasks.workunit.client.0.smithi073.stdout:7/349: rmdir d0/dc/d5c 0 2024-04-19T02:18:31.680 INFO:tasks.workunit.client.0.smithi073.stdout:8/335: mknod d14/d15/c61 0 2024-04-19T02:18:31.680 INFO:tasks.workunit.client.0.smithi073.stdout:0/290: dwrite d7/d14/d17/d1a/f46 [0,4194304] 0 2024-04-19T02:18:31.680 INFO:tasks.workunit.client.0.smithi073.stdout:7/350: readlink d0/dc/d67/d15/l48 0 2024-04-19T02:18:31.680 INFO:tasks.workunit.client.0.smithi073.stdout:7/351: readlink d0/dc/d67/d15/l5f 0 2024-04-19T02:18:31.680 INFO:tasks.workunit.client.0.smithi073.stdout:7/352: stat d0/dc/d67 0 2024-04-19T02:18:31.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/330: read d8/de/f28 [577528,84037] 0 2024-04-19T02:18:31.683 INFO:tasks.workunit.client.0.smithi073.stdout:7/353: creat d0/dc/d39/d50/f6b x:0 0 0 2024-04-19T02:18:31.683 INFO:tasks.workunit.client.0.smithi073.stdout:6/331: readlink d8/d4b/l59 0 2024-04-19T02:18:31.684 INFO:tasks.workunit.client.0.smithi073.stdout:7/354: creat d0/dc/d67/d2a/d51/f6c x:0 0 0 2024-04-19T02:18:31.685 INFO:tasks.workunit.client.0.smithi073.stdout:7/355: read d0/f7 [2935508,116232] 0 2024-04-19T02:18:31.686 INFO:tasks.workunit.client.0.smithi073.stdout:8/336: dwrite d14/d15/d17/f3d [0,4194304] 0 2024-04-19T02:18:31.686 INFO:tasks.workunit.client.0.smithi073.stdout:0/291: dwrite f5 [0,4194304] 0 2024-04-19T02:18:31.686 INFO:tasks.workunit.client.0.smithi073.stdout:0/292: stat d7/f25 0 2024-04-19T02:18:31.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/337: dread - d14/d15/d17/d48/f59 zero size 2024-04-19T02:18:31.687 INFO:tasks.workunit.client.0.smithi073.stdout:5/429: dread d0/d1d/d25/d35/f42 [0,4194304] 0 2024-04-19T02:18:31.687 INFO:tasks.workunit.client.0.smithi073.stdout:7/356: creat d0/dc/f6d x:0 0 0 2024-04-19T02:18:31.688 INFO:tasks.workunit.client.0.smithi073.stdout:0/293: symlink d7/d14/d17/d1a/d21/l57 0 2024-04-19T02:18:31.689 INFO:tasks.workunit.client.0.smithi073.stdout:0/294: chown d7/d14/d17/d1a/d21/c26 0 1 2024-04-19T02:18:31.690 INFO:tasks.workunit.client.0.smithi073.stdout:6/332: write d8/de/f1e [158417,43152] 0 2024-04-19T02:18:31.692 INFO:tasks.workunit.client.0.smithi073.stdout:6/333: symlink d8/d77/l7b 0 2024-04-19T02:18:31.695 INFO:tasks.workunit.client.0.smithi073.stdout:6/334: write d8/fb [950552,122280] 0 2024-04-19T02:18:31.696 INFO:tasks.workunit.client.0.smithi073.stdout:9/384: dwrite d0/f50 [4194304,4194304] 0 2024-04-19T02:18:31.696 INFO:tasks.workunit.client.0.smithi073.stdout:7/357: dwrite d0/f3c [0,4194304] 0 2024-04-19T02:18:31.696 INFO:tasks.workunit.client.0.smithi073.stdout:6/335: chown d8/l38 445924477 1 2024-04-19T02:18:31.697 INFO:tasks.workunit.client.0.smithi073.stdout:9/385: write d0/df/f40 [2605208,13832] 0 2024-04-19T02:18:31.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/358: mknod d0/dc/d67/c6e 0 2024-04-19T02:18:31.697 INFO:tasks.workunit.client.0.smithi073.stdout:6/336: fdatasync d8/de/d35/f5d 0 2024-04-19T02:18:31.697 INFO:tasks.workunit.client.0.smithi073.stdout:5/430: dwrite d0/d1d/d25/d37/f77 [0,4194304] 0 2024-04-19T02:18:31.698 INFO:tasks.workunit.client.0.smithi073.stdout:9/386: unlink d0/f8 0 2024-04-19T02:18:31.698 INFO:tasks.workunit.client.0.smithi073.stdout:5/431: stat d0/d1d/c1f 0 2024-04-19T02:18:31.698 INFO:tasks.workunit.client.0.smithi073.stdout:7/359: write d0/dc/d67/d2a/d51/f54 [1314530,3581] 0 2024-04-19T02:18:31.698 INFO:tasks.workunit.client.0.smithi073.stdout:5/432: symlink d0/d1d/d25/d35/d88/l93 0 2024-04-19T02:18:31.699 INFO:tasks.workunit.client.0.smithi073.stdout:7/360: mknod d0/dc/d39/d50/c6f 0 2024-04-19T02:18:31.700 INFO:tasks.workunit.client.0.smithi073.stdout:7/361: link d0/dc/d67/c38 d0/dc/c70 0 2024-04-19T02:18:31.701 INFO:tasks.workunit.client.0.smithi073.stdout:7/362: stat d0/d28/f4b 0 2024-04-19T02:18:31.701 INFO:tasks.workunit.client.0.smithi073.stdout:7/363: unlink d0/dc/f6d 0 2024-04-19T02:18:31.702 INFO:tasks.workunit.client.0.smithi073.stdout:7/364: dread - d0/dc/d39/d50/f6b zero size 2024-04-19T02:18:31.703 INFO:tasks.workunit.client.0.smithi073.stdout:6/337: truncate d8/de/f47 719625 0 2024-04-19T02:18:31.704 INFO:tasks.workunit.client.0.smithi073.stdout:6/338: symlink d8/de/d58/l7c 0 2024-04-19T02:18:31.705 INFO:tasks.workunit.client.0.smithi073.stdout:5/433: dwrite d0/d1d/d25/d35/d39/f86 [0,4194304] 0 2024-04-19T02:18:31.710 INFO:tasks.workunit.client.0.smithi073.stdout:6/339: dwrite d8/f4e [0,4194304] 0 2024-04-19T02:18:31.711 INFO:tasks.workunit.client.0.smithi073.stdout:6/340: truncate d8/de/ff 1787253 0 2024-04-19T02:18:31.711 INFO:tasks.workunit.client.0.smithi073.stdout:5/434: dwrite d0/d1d/d25/d37/d71/f73 [0,4194304] 0 2024-04-19T02:18:31.712 INFO:tasks.workunit.client.0.smithi073.stdout:6/341: mkdir d8/d71/d7d 0 2024-04-19T02:18:31.712 INFO:tasks.workunit.client.0.smithi073.stdout:7/365: read d0/f6a [1402550,39710] 0 2024-04-19T02:18:31.716 INFO:tasks.workunit.client.0.smithi073.stdout:4/348: sync 2024-04-19T02:18:31.717 INFO:tasks.workunit.client.0.smithi073.stdout:1/346: sync 2024-04-19T02:18:31.717 INFO:tasks.workunit.client.0.smithi073.stdout:2/363: sync 2024-04-19T02:18:31.717 INFO:tasks.workunit.client.0.smithi073.stdout:0/295: sync 2024-04-19T02:18:31.717 INFO:tasks.workunit.client.0.smithi073.stdout:5/435: dwrite d0/d1d/d25/d37/d71/f89 [0,4194304] 0 2024-04-19T02:18:31.717 INFO:tasks.workunit.client.0.smithi073.stdout:4/349: mknod da/d27/d36/c74 0 2024-04-19T02:18:31.718 INFO:tasks.workunit.client.0.smithi073.stdout:5/436: mknod d0/d1d/c94 0 2024-04-19T02:18:31.719 INFO:tasks.workunit.client.0.smithi073.stdout:6/342: truncate d8/de/d35/f3d 1132895 0 2024-04-19T02:18:31.719 INFO:tasks.workunit.client.0.smithi073.stdout:0/296: rename d7/d14/d17/f33 to d7/d14/d17/d1a/d21/f58 0 2024-04-19T02:18:31.720 INFO:tasks.workunit.client.0.smithi073.stdout:4/350: symlink da/d27/d36/d4d/l75 0 2024-04-19T02:18:31.720 INFO:tasks.workunit.client.0.smithi073.stdout:2/364: getdents d5/d10/d29/d66/d81 0 2024-04-19T02:18:31.722 INFO:tasks.workunit.client.0.smithi073.stdout:5/437: chown d0/d1d/d24/f2e 20011 1 2024-04-19T02:18:31.722 INFO:tasks.workunit.client.0.smithi073.stdout:1/347: rename db/d1c/d54/c5a to db/d3e/c7d 0 2024-04-19T02:18:31.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/343: truncate d8/f2e 4844820 0 2024-04-19T02:18:31.722 INFO:tasks.workunit.client.0.smithi073.stdout:0/297: write d7/d14/d17/d1a/d20/f4c [3876904,97851] 0 2024-04-19T02:18:31.722 INFO:tasks.workunit.client.0.smithi073.stdout:5/438: symlink d0/d1d/d25/d35/l95 0 2024-04-19T02:18:31.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/344: write d8/f66 [145592,108781] 0 2024-04-19T02:18:31.722 INFO:tasks.workunit.client.0.smithi073.stdout:2/365: link d5/d10/d14/d18/d3e/d2d/f3a d5/d10/d29/d66/d67/f86 0 2024-04-19T02:18:31.723 INFO:tasks.workunit.client.0.smithi073.stdout:0/298: symlink d7/d14/d17/d1a/d20/l59 0 2024-04-19T02:18:31.724 INFO:tasks.workunit.client.0.smithi073.stdout:5/439: write d0/f16 [1863888,29892] 0 2024-04-19T02:18:31.724 INFO:tasks.workunit.client.0.smithi073.stdout:6/345: creat d8/de/d78/f7e x:0 0 0 2024-04-19T02:18:31.724 INFO:tasks.workunit.client.0.smithi073.stdout:8/338: read d14/d27/d29/f52 [4122351,90626] 0 2024-04-19T02:18:31.724 INFO:tasks.workunit.client.0.smithi073.stdout:4/351: rmdir da/d27/d36 39 2024-04-19T02:18:31.724 INFO:tasks.workunit.client.0.smithi073.stdout:8/339: fsync d14/d27/f30 0 2024-04-19T02:18:31.725 INFO:tasks.workunit.client.0.smithi073.stdout:6/346: stat d8/de/d58/f33 0 2024-04-19T02:18:31.725 INFO:tasks.workunit.client.0.smithi073.stdout:2/366: stat d5/d10/d29/d66/d67/c3d 0 2024-04-19T02:18:31.725 INFO:tasks.workunit.client.0.smithi073.stdout:0/299: creat d7/d14/d17/d1a/d56/f5a x:0 0 0 2024-04-19T02:18:31.726 INFO:tasks.workunit.client.0.smithi073.stdout:8/340: fdatasync d14/d27/f2e 0 2024-04-19T02:18:31.726 INFO:tasks.workunit.client.0.smithi073.stdout:6/347: fsync d8/de/d35/f65 0 2024-04-19T02:18:31.727 INFO:tasks.workunit.client.0.smithi073.stdout:2/367: chown d5/d10/d14/d18/d3e/d51/l61 108 1 2024-04-19T02:18:31.727 INFO:tasks.workunit.client.0.smithi073.stdout:0/300: creat d7/d14/d17/d1a/d21/f5b x:0 0 0 2024-04-19T02:18:31.727 INFO:tasks.workunit.client.0.smithi073.stdout:6/348: dread - d8/de/d35/d60/f4f zero size 2024-04-19T02:18:31.728 INFO:tasks.workunit.client.0.smithi073.stdout:1/348: dwrite db/d1c/d2c/f45 [0,4194304] 0 2024-04-19T02:18:31.728 INFO:tasks.workunit.client.0.smithi073.stdout:8/341: creat d14/f62 x:0 0 0 2024-04-19T02:18:31.728 INFO:tasks.workunit.client.0.smithi073.stdout:8/342: dread - d14/d27/f5c zero size 2024-04-19T02:18:31.729 INFO:tasks.workunit.client.0.smithi073.stdout:2/368: rename d5/d10/l77 to d5/d10/d29/l87 0 2024-04-19T02:18:31.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/343: creat d14/d27/d50/f63 x:0 0 0 2024-04-19T02:18:31.730 INFO:tasks.workunit.client.0.smithi073.stdout:1/349: getdents db/d1c/d2c/d50/d62 0 2024-04-19T02:18:31.730 INFO:tasks.workunit.client.0.smithi073.stdout:8/344: chown d14/d27/f5c 241028 1 2024-04-19T02:18:31.732 INFO:tasks.workunit.client.0.smithi073.stdout:2/369: link d5/d10/d14/d2e/f54 d5/d10/d29/d66/d67/f88 0 2024-04-19T02:18:31.732 INFO:tasks.workunit.client.0.smithi073.stdout:1/350: dread db/d1c/f34 [0,4194304] 0 2024-04-19T02:18:31.733 INFO:tasks.workunit.client.0.smithi073.stdout:6/349: rename d8/de/d22/d76 to d8/de/d7f 0 2024-04-19T02:18:31.735 INFO:tasks.workunit.client.0.smithi073.stdout:1/351: chown db/d3e/f3f 23066 1 2024-04-19T02:18:31.735 INFO:tasks.workunit.client.0.smithi073.stdout:2/370: write d5/d10/d14/d18/f4d [498533,117947] 0 2024-04-19T02:18:31.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/301: dwrite d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:31.737 INFO:tasks.workunit.client.0.smithi073.stdout:5/440: dwrite d0/d1d/d25/d35/d39/f66 [4194304,4194304] 0 2024-04-19T02:18:31.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/302: stat d7/d14/d17/d1a/d21/f5b 0 2024-04-19T02:18:31.739 INFO:tasks.workunit.client.0.smithi073.stdout:2/371: symlink d5/d10/d14/d18/d3e/d2d/d63/l89 0 2024-04-19T02:18:31.739 INFO:tasks.workunit.client.0.smithi073.stdout:8/345: dwrite d14/d15/d17/d48/f59 [0,4194304] 0 2024-04-19T02:18:31.742 INFO:tasks.workunit.client.0.smithi073.stdout:9/387: sync 2024-04-19T02:18:31.742 INFO:tasks.workunit.client.0.smithi073.stdout:5/441: truncate d0/d1d/d25/d37/d71/f89 4213849 0 2024-04-19T02:18:31.742 INFO:tasks.workunit.client.0.smithi073.stdout:4/352: sync 2024-04-19T02:18:31.742 INFO:tasks.workunit.client.0.smithi073.stdout:2/372: write d5/f31 [867391,125885] 0 2024-04-19T02:18:31.743 INFO:tasks.workunit.client.0.smithi073.stdout:6/350: dwrite d8/fb [0,4194304] 0 2024-04-19T02:18:31.743 INFO:tasks.workunit.client.0.smithi073.stdout:3/494: dread d3/d6/db/d3a/d38/d89/d94/f5a [0,4194304] 0 2024-04-19T02:18:31.744 INFO:tasks.workunit.client.0.smithi073.stdout:5/442: chown d0/d1d/d24/f38 93377603 1 2024-04-19T02:18:31.744 INFO:tasks.workunit.client.0.smithi073.stdout:5/443: sync 2024-04-19T02:18:31.746 INFO:tasks.workunit.client.0.smithi073.stdout:9/388: truncate d0/fa 3779200 0 2024-04-19T02:18:31.746 INFO:tasks.workunit.client.0.smithi073.stdout:4/353: mknod da/d27/d2c/d60/c76 0 2024-04-19T02:18:31.746 INFO:tasks.workunit.client.0.smithi073.stdout:2/373: write d5/d10/d29/d66/d67/d72/f2f [1006133,88943] 0 2024-04-19T02:18:31.746 INFO:tasks.workunit.client.0.smithi073.stdout:6/351: mknod d8/de/d22/c80 0 2024-04-19T02:18:31.746 INFO:tasks.workunit.client.0.smithi073.stdout:3/495: creat d3/d6/db/d3a/d38/d89/d94/fa9 x:0 0 0 2024-04-19T02:18:31.747 INFO:tasks.workunit.client.0.smithi073.stdout:1/352: dwrite db/d41/f59 [0,4194304] 0 2024-04-19T02:18:31.748 INFO:tasks.workunit.client.0.smithi073.stdout:6/352: fdatasync d8/de/f28 0 2024-04-19T02:18:31.750 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:31.748+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:31.751 INFO:tasks.workunit.client.0.smithi073.stdout:5/444: write d0/d1d/d1e/f80 [206746,71933] 0 2024-04-19T02:18:31.751 INFO:tasks.workunit.client.0.smithi073.stdout:0/303: dwrite d7/f11 [0,4194304] 0 2024-04-19T02:18:31.751 INFO:tasks.workunit.client.0.smithi073.stdout:4/354: getdents da/d27/d2c 0 2024-04-19T02:18:31.752 INFO:tasks.workunit.client.0.smithi073.stdout:4/355: chown da/d27/d1b/d1d/d72/d2b/d2f/f63 1 1 2024-04-19T02:18:31.752 INFO:tasks.workunit.client.0.smithi073.stdout:5/445: chown d0/d1d/d25/d35/d39/f66 1259 1 2024-04-19T02:18:31.753 INFO:tasks.workunit.client.0.smithi073.stdout:5/446: sync 2024-04-19T02:18:31.754 INFO:tasks.workunit.client.0.smithi073.stdout:1/353: unlink db/d1c/d2c/d50/l66 0 2024-04-19T02:18:31.755 INFO:tasks.workunit.client.0.smithi073.stdout:2/374: creat d5/d10/d14/f8a x:0 0 0 2024-04-19T02:18:31.755 INFO:tasks.workunit.client.0.smithi073.stdout:6/353: mknod d8/de/d7f/c81 0 2024-04-19T02:18:31.756 INFO:tasks.workunit.client.0.smithi073.stdout:6/354: chown d8/d71/d7d 34297474 1 2024-04-19T02:18:31.756 INFO:tasks.workunit.client.0.smithi073.stdout:4/356: rename f8 to da/d27/d3a/d50/f77 0 2024-04-19T02:18:31.756 INFO:tasks.workunit.client.0.smithi073.stdout:3/496: creat d3/d6/db/d1a/faa x:0 0 0 2024-04-19T02:18:31.757 INFO:tasks.workunit.client.0.smithi073.stdout:5/447: mkdir d0/d1d/d25/d35/d96 0 2024-04-19T02:18:31.757 INFO:tasks.workunit.client.0.smithi073.stdout:5/448: stat d0/f3b 0 2024-04-19T02:18:31.758 INFO:tasks.workunit.client.0.smithi073.stdout:3/497: read - d3/d6/db/d16/d7c/f92 zero size 2024-04-19T02:18:31.758 INFO:tasks.workunit.client.0.smithi073.stdout:0/304: link d7/d14/c19 d7/d14/d17/d1a/c5c 0 2024-04-19T02:18:31.758 INFO:tasks.workunit.client.0.smithi073.stdout:4/357: creat da/d27/d1b/d1d/d72/d2b/d54/f78 x:0 0 0 2024-04-19T02:18:31.759 INFO:tasks.workunit.client.0.smithi073.stdout:0/305: chown d7/d14/d17/f1f 2997671 1 2024-04-19T02:18:31.760 INFO:tasks.workunit.client.0.smithi073.stdout:4/358: symlink da/d27/d1b/l79 0 2024-04-19T02:18:31.761 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:31.761 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:31.763 INFO:tasks.workunit.client.0.smithi073.stdout:1/354: dwrite db/d1c/d2c/f5c [0,4194304] 0 2024-04-19T02:18:31.763 INFO:tasks.workunit.client.0.smithi073.stdout:2/375: dwrite d5/f11 [4194304,4194304] 0 2024-04-19T02:18:31.764 INFO:tasks.workunit.client.0.smithi073.stdout:0/306: fdatasync d7/d14/d17/d1a/d20/f48 0 2024-04-19T02:18:31.765 INFO:tasks.workunit.client.0.smithi073.stdout:7/366: dread d0/dc/f1f [0,4194304] 0 2024-04-19T02:18:31.767 INFO:tasks.workunit.client.0.smithi073.stdout:7/367: truncate d0/dc/d39/d50/f6b 416212 0 2024-04-19T02:18:31.767 INFO:tasks.workunit.client.0.smithi073.stdout:3/498: dwrite d3/d6/db/d3a/d38/d89/d94/f35 [4194304,4194304] 0 2024-04-19T02:18:31.768 INFO:tasks.workunit.client.0.smithi073.stdout:3/499: sync 2024-04-19T02:18:31.768 INFO:tasks.workunit.client.0.smithi073.stdout:7/368: write d0/dc/d39/f62 [865894,21566] 0 2024-04-19T02:18:31.770 INFO:tasks.workunit.client.0.smithi073.stdout:5/449: truncate d0/d1d/d24/d61/f74 477268 0 2024-04-19T02:18:31.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/307: mknod d7/d14/d17/c5d 0 2024-04-19T02:18:31.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/359: dwrite da/d27/d1b/d1d/d72/d3d/f40 [0,4194304] 0 2024-04-19T02:18:31.771 INFO:tasks.workunit.client.0.smithi073.stdout:7/369: write d0/dc/d67/d2a/f2b [1743458,4325] 0 2024-04-19T02:18:31.772 INFO:tasks.workunit.client.0.smithi073.stdout:2/376: getdents d5/d10/d14/d18 0 2024-04-19T02:18:31.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/360: symlink da/d27/d2c/l7a 0 2024-04-19T02:18:31.773 INFO:tasks.workunit.client.0.smithi073.stdout:7/370: dread - d0/dc/d39/d50/f58 zero size 2024-04-19T02:18:31.775 INFO:tasks.workunit.client.0.smithi073.stdout:2/377: write d5/d10/d29/d66/d67/f45 [3942002,60450] 0 2024-04-19T02:18:31.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/361: mkdir da/d27/d36/d4d/d7b 0 2024-04-19T02:18:31.775 INFO:tasks.workunit.client.0.smithi073.stdout:1/355: dwrite db/d41/f68 [0,4194304] 0 2024-04-19T02:18:31.775 INFO:tasks.workunit.client.0.smithi073.stdout:7/371: rmdir d0/dc/d33/d36 39 2024-04-19T02:18:31.776 INFO:tasks.workunit.client.0.smithi073.stdout:4/362: chown da/f44 45544890 1 2024-04-19T02:18:31.777 INFO:tasks.workunit.client.0.smithi073.stdout:1/356: getdents db/d41 0 2024-04-19T02:18:31.777 INFO:tasks.workunit.client.0.smithi073.stdout:4/363: write da/f11 [551483,24788] 0 2024-04-19T02:18:31.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/450: dwrite d0/f9 [0,4194304] 0 2024-04-19T02:18:31.779 INFO:tasks.workunit.client.0.smithi073.stdout:7/372: getdents d0/dc/d39 0 2024-04-19T02:18:31.779 INFO:tasks.workunit.client.0.smithi073.stdout:2/378: rename d5/d10/d14/c56 to d5/d10/d14/d18/d3e/d2d/c8b 0 2024-04-19T02:18:31.779 INFO:tasks.workunit.client.0.smithi073.stdout:5/451: fdatasync d0/d1d/d25/d37/d71/f89 0 2024-04-19T02:18:31.780 INFO:tasks.workunit.client.0.smithi073.stdout:2/379: creat d5/d10/d29/f8c x:0 0 0 2024-04-19T02:18:31.780 INFO:tasks.workunit.client.0.smithi073.stdout:5/452: symlink d0/d1d/d25/d37/d71/l97 0 2024-04-19T02:18:31.780 INFO:tasks.workunit.client.0.smithi073.stdout:2/380: sync 2024-04-19T02:18:31.781 INFO:tasks.workunit.client.0.smithi073.stdout:5/453: dread - d0/d1d/d25/d37/d71/f7b zero size 2024-04-19T02:18:31.781 INFO:tasks.workunit.client.0.smithi073.stdout:2/381: fdatasync d5/d10/d29/d66/f69 0 2024-04-19T02:18:31.781 INFO:tasks.workunit.client.0.smithi073.stdout:5/454: chown d0/d2d 172300721 1 2024-04-19T02:18:31.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/455: mknod d0/d1d/d24/d62/c98 0 2024-04-19T02:18:31.783 INFO:tasks.workunit.client.0.smithi073.stdout:5/456: write d0/d1d/d25/d37/f3e [5211981,36855] 0 2024-04-19T02:18:31.784 INFO:tasks.workunit.client.0.smithi073.stdout:5/457: mkdir d0/d1d/d25/d35/d99 0 2024-04-19T02:18:31.790 INFO:tasks.workunit.client.0.smithi073.stdout:5/458: dwrite d0/d1d/d25/d35/f4b [0,4194304] 0 2024-04-19T02:18:31.791 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:31.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/459: creat d0/d1d/d25/f9a x:0 0 0 2024-04-19T02:18:31.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/460: chown d0/c31 62533254 1 2024-04-19T02:18:31.793 INFO:tasks.workunit.client.0.smithi073.stdout:2/382: dread d5/d10/d14/d18/f1a [0,4194304] 0 2024-04-19T02:18:31.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/461: dread - d0/d1d/d24/d61/f7c zero size 2024-04-19T02:18:31.793 INFO:tasks.workunit.client.0.smithi073.stdout:2/383: sync 2024-04-19T02:18:31.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/462: fdatasync d0/d1d/d1e/f55 0 2024-04-19T02:18:31.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/384: truncate d5/d10/d14/f8a 138061 0 2024-04-19T02:18:31.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/463: unlink d0/d1d/d1e/c85 0 2024-04-19T02:18:31.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/385: rmdir d5/d10/d29/d66/d81 0 2024-04-19T02:18:31.799 INFO:tasks.workunit.client.0.smithi073.stdout:2/386: rename d5/d10/d29/d42/f52 to d5/d10/d29/f8d 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:2/387: chown d5/d10/d29/d66/d67/f48 346 1 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:5/464: dread d0/d1d/f7d [0,4194304] 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:2/388: creat d5/d10/d14/d18/d3e/d2d/f8e x:0 0 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:5/465: symlink d0/d1d/d25/d37/d71/l9b 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:0/308: truncate d7/d14/f3e 629023 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:5/466: write d0/d1d/d24/f2e [2808883,5326] 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:1/357: truncate db/d1c/d54/f6a 2267697 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:7/373: truncate d0/dc/d67/d2a/f2b 4736039 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:7/374: chown d0/dc/d67/f65 1 1 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:1/358: symlink db/d1c/d2c/d50/d62/l7e 0 2024-04-19T02:18:31.800 INFO:tasks.workunit.client.0.smithi073.stdout:5/467: creat d0/d1d/d25/d35/f9c x:0 0 0 2024-04-19T02:18:31.801 INFO:tasks.workunit.client.0.smithi073.stdout:1/359: readlink db/d41/l4a 0 2024-04-19T02:18:31.802 INFO:tasks.workunit.client.0.smithi073.stdout:7/375: fsync d0/dc/f5a 0 2024-04-19T02:18:31.802 INFO:tasks.workunit.client.0.smithi073.stdout:5/468: chown d0/d1d/d25/d35/f49 2459335 1 2024-04-19T02:18:31.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/309: creat d7/d14/d17/d1a/d21/f5e x:0 0 0 2024-04-19T02:18:31.802 INFO:tasks.workunit.client.0.smithi073.stdout:1/360: mkdir db/d7f 0 2024-04-19T02:18:31.802 INFO:tasks.workunit.client.0.smithi073.stdout:7/376: fsync d0/d28/f4b 0 2024-04-19T02:18:31.802 INFO:tasks.workunit.client.0.smithi073.stdout:1/361: fsync db/d1c/d2c/f45 0 2024-04-19T02:18:31.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/310: creat d7/d14/d17/f5f x:0 0 0 2024-04-19T02:18:31.803 INFO:tasks.workunit.client.0.smithi073.stdout:0/311: rmdir d7/d14 39 2024-04-19T02:18:31.803 INFO:tasks.workunit.client.0.smithi073.stdout:1/362: write db/f2a [4029627,107187] 0 2024-04-19T02:18:31.803 INFO:tasks.workunit.client.0.smithi073.stdout:7/377: creat d0/dc/d67/f71 x:0 0 0 2024-04-19T02:18:31.803 INFO:tasks.workunit.client.0.smithi073.stdout:5/469: rename d0/d1d/d25/d35/d39/c47 to d0/d1d/d25/d35/d39/c9d 0 2024-04-19T02:18:31.804 INFO:tasks.workunit.client.0.smithi073.stdout:7/378: creat d0/dc/d67/f72 x:0 0 0 2024-04-19T02:18:31.804 INFO:tasks.workunit.client.0.smithi073.stdout:0/312: mkdir d7/d14/d17/d1a/d20/d50/d60 0 2024-04-19T02:18:31.805 INFO:tasks.workunit.client.0.smithi073.stdout:7/379: chown d0/dc/d39/d50/f68 1 1 2024-04-19T02:18:31.805 INFO:tasks.workunit.client.0.smithi073.stdout:7/380: unlink d0/dc/c32 0 2024-04-19T02:18:31.805 INFO:tasks.workunit.client.0.smithi073.stdout:0/313: chown d7/d14/f3e 703 1 2024-04-19T02:18:31.805 INFO:tasks.workunit.client.0.smithi073.stdout:7/381: sync 2024-04-19T02:18:31.806 INFO:tasks.workunit.client.0.smithi073.stdout:7/382: chown d0/dc/d67/d15/c45 260937 1 2024-04-19T02:18:31.806 INFO:tasks.workunit.client.0.smithi073.stdout:0/314: mkdir d7/d14/d17/d1a/d21/d61 0 2024-04-19T02:18:31.806 INFO:tasks.workunit.client.0.smithi073.stdout:7/383: chown d0/d3 29663956 1 2024-04-19T02:18:31.807 INFO:tasks.workunit.client.0.smithi073.stdout:7/384: mkdir d0/d73 0 2024-04-19T02:18:31.808 INFO:tasks.workunit.client.0.smithi073.stdout:0/315: creat d7/d14/f62 x:0 0 0 2024-04-19T02:18:31.808 INFO:tasks.workunit.client.0.smithi073.stdout:7/385: stat d0/dc 0 2024-04-19T02:18:31.808 INFO:tasks.workunit.client.0.smithi073.stdout:0/316: read - d7/d14/d17/f55 zero size 2024-04-19T02:18:31.809 INFO:tasks.workunit.client.0.smithi073.stdout:7/386: rename d0/dc/d67/f21 to d0/d3/f74 0 2024-04-19T02:18:31.809 INFO:tasks.workunit.client.0.smithi073.stdout:0/317: chown d7/d14/c19 103535370 1 2024-04-19T02:18:31.810 INFO:tasks.workunit.client.0.smithi073.stdout:1/363: read f6 [1956162,94253] 0 2024-04-19T02:18:31.810 INFO:tasks.workunit.client.0.smithi073.stdout:6/355: dread d8/de/d35/f49 [0,4194304] 0 2024-04-19T02:18:31.810 INFO:tasks.workunit.client.0.smithi073.stdout:5/470: truncate d0/f16 3560515 0 2024-04-19T02:18:31.811 INFO:tasks.workunit.client.0.smithi073.stdout:2/389: dwrite d5/d10/d29/d66/d67/f86 [0,4194304] 0 2024-04-19T02:18:31.811 INFO:tasks.workunit.client.0.smithi073.stdout:0/318: readlink d7/d14/l2a 0 2024-04-19T02:18:31.811 INFO:tasks.workunit.client.0.smithi073.stdout:7/387: chown d0/dc/d67/l1c 384007221 1 2024-04-19T02:18:31.812 INFO:tasks.workunit.client.0.smithi073.stdout:7/388: fdatasync d0/f8 0 2024-04-19T02:18:31.812 INFO:tasks.workunit.client.0.smithi073.stdout:2/390: mknod d5/d10/d14/d18/c8f 0 2024-04-19T02:18:31.812 INFO:tasks.workunit.client.0.smithi073.stdout:1/364: getdents db/d7f 0 2024-04-19T02:18:31.813 INFO:tasks.workunit.client.0.smithi073.stdout:1/365: read db/d1c/d2c/f69 [391334,60449] 0 2024-04-19T02:18:31.813 INFO:tasks.workunit.client.0.smithi073.stdout:0/319: read d7/d14/d17/d1a/f39 [2618366,101654] 0 2024-04-19T02:18:31.814 INFO:tasks.workunit.client.0.smithi073.stdout:0/320: unlink d7/l41 0 2024-04-19T02:18:31.816 INFO:tasks.workunit.client.0.smithi073.stdout:7/389: truncate d0/d3/f46 3210045 0 2024-04-19T02:18:31.816 INFO:tasks.workunit.client.0.smithi073.stdout:0/321: link d7/d14/d17/d1a/f39 d7/d14/d17/d1a/d21/f63 0 2024-04-19T02:18:31.818 INFO:tasks.workunit.client.0.smithi073.stdout:0/322: write d7/d14/d17/d1a/d21/f58 [3040894,32692] 0 2024-04-19T02:18:31.819 INFO:tasks.workunit.client.0.smithi073.stdout:5/471: dwrite d0/d1d/d25/d35/d39/f66 [0,4194304] 0 2024-04-19T02:18:31.821 INFO:tasks.workunit.client.0.smithi073.stdout:7/390: truncate d0/d3/f74 5228764 0 2024-04-19T02:18:31.821 INFO:tasks.workunit.client.0.smithi073.stdout:2/391: dwrite d5/d10/d14/d18/d3e/d2d/d63/f46 [0,4194304] 0 2024-04-19T02:18:31.822 INFO:tasks.workunit.client.0.smithi073.stdout:5/472: unlink d0/d1d/c1f 0 2024-04-19T02:18:31.822 INFO:tasks.workunit.client.0.smithi073.stdout:7/391: chown d0/dc/d39/d50/f58 127739 1 2024-04-19T02:18:31.825 INFO:tasks.workunit.client.0.smithi073.stdout:1/366: dwrite db/d1c/d2c/d50/d62/f79 [0,4194304] 0 2024-04-19T02:18:31.825 INFO:tasks.workunit.client.0.smithi073.stdout:1/367: write db/d1c/d2c/f3d [1317989,96810] 0 2024-04-19T02:18:31.826 INFO:tasks.workunit.client.0.smithi073.stdout:9/389: dread d0/df/d16/d19/f26 [0,4194304] 0 2024-04-19T02:18:31.826 INFO:tasks.workunit.client.0.smithi073.stdout:0/323: dwrite f5 [0,4194304] 0 2024-04-19T02:18:31.828 INFO:tasks.workunit.client.0.smithi073.stdout:5/473: mknod d0/d1d/d25/d35/d96/c9e 0 2024-04-19T02:18:31.828 INFO:tasks.workunit.client.0.smithi073.stdout:0/324: unlink d7/c4b 0 2024-04-19T02:18:31.828 INFO:tasks.workunit.client.0.smithi073.stdout:9/390: mkdir d0/df/d60/d72/d8e 0 2024-04-19T02:18:31.828 INFO:tasks.workunit.client.0.smithi073.stdout:2/392: mknod d5/d10/d29/d66/d7e/c90 0 2024-04-19T02:18:31.828 INFO:tasks.workunit.client.0.smithi073.stdout:7/392: rename d0/d3/l2c to d0/dc/d67/l75 0 2024-04-19T02:18:31.829 INFO:tasks.workunit.client.0.smithi073.stdout:0/325: write d7/d14/f47 [205058,127752] 0 2024-04-19T02:18:31.829 INFO:tasks.workunit.client.0.smithi073.stdout:9/391: write d0/fc [3972317,83993] 0 2024-04-19T02:18:31.830 INFO:tasks.workunit.client.0.smithi073.stdout:5/474: creat d0/d1d/d25/d37/d71/f9f x:0 0 0 2024-04-19T02:18:31.830 INFO:tasks.workunit.client.0.smithi073.stdout:0/326: stat d7/cf 0 2024-04-19T02:18:31.831 INFO:tasks.workunit.client.0.smithi073.stdout:7/393: fdatasync d0/d3/f46 0 2024-04-19T02:18:31.832 INFO:tasks.workunit.client.0.smithi073.stdout:9/392: mknod d0/df/d60/c8f 0 2024-04-19T02:18:31.832 INFO:tasks.workunit.client.0.smithi073.stdout:4/364: dread f1 [0,4194304] 0 2024-04-19T02:18:31.833 INFO:tasks.workunit.client.0.smithi073.stdout:6/356: sync 2024-04-19T02:18:31.833 INFO:tasks.workunit.client.0.smithi073.stdout:7/394: fdatasync d0/d28/f4b 0 2024-04-19T02:18:31.833 INFO:tasks.workunit.client.0.smithi073.stdout:0/327: creat d7/d14/d17/d1a/d21/f64 x:0 0 0 2024-04-19T02:18:31.833 INFO:tasks.workunit.client.0.smithi073.stdout:9/393: write d0/df/d1d/f65 [722163,122166] 0 2024-04-19T02:18:31.834 INFO:tasks.workunit.client.0.smithi073.stdout:7/395: write d0/dc/f1f [6143709,118468] 0 2024-04-19T02:18:31.835 INFO:tasks.workunit.client.0.smithi073.stdout:0/328: truncate d7/d14/d17/f55 1006796 0 2024-04-19T02:18:31.835 INFO:tasks.workunit.client.0.smithi073.stdout:9/394: write d0/df/d16/d1a/f37 [2622472,11989] 0 2024-04-19T02:18:31.836 INFO:tasks.workunit.client.0.smithi073.stdout:5/475: truncate d0/d1d/d24/f2e 789915 0 2024-04-19T02:18:31.836 INFO:tasks.workunit.client.0.smithi073.stdout:9/395: write d0/df/f40 [6068545,105874] 0 2024-04-19T02:18:31.836 INFO:tasks.workunit.client.0.smithi073.stdout:2/393: dwrite d5/d10/f7d [0,4194304] 0 2024-04-19T02:18:31.838 INFO:tasks.workunit.client.0.smithi073.stdout:9/396: creat d0/df/d60/f90 x:0 0 0 2024-04-19T02:18:31.838 INFO:tasks.workunit.client.0.smithi073.stdout:2/394: symlink d5/d10/d29/d66/d67/d72/l91 0 2024-04-19T02:18:31.839 INFO:tasks.workunit.client.0.smithi073.stdout:9/397: mkdir d0/d91 0 2024-04-19T02:18:31.840 INFO:tasks.workunit.client.0.smithi073.stdout:2/395: creat d5/d10/d53/f92 x:0 0 0 2024-04-19T02:18:31.840 INFO:tasks.workunit.client.0.smithi073.stdout:9/398: write d0/f30 [771003,118373] 0 2024-04-19T02:18:31.843 INFO:tasks.workunit.client.0.smithi073.stdout:4/365: dwrite da/d27/f39 [0,4194304] 0 2024-04-19T02:18:31.844 INFO:tasks.workunit.client.0.smithi073.stdout:2/396: write d5/d10/d29/d66/d67/d72/f25 [738520,115733] 0 2024-04-19T02:18:31.844 INFO:tasks.workunit.client.0.smithi073.stdout:9/399: chown d0/df/d16/d19/c5f 21401752 1 2024-04-19T02:18:31.844 INFO:tasks.workunit.client.0.smithi073.stdout:4/366: readlink da/d27/d36/d4d/l75 0 2024-04-19T02:18:31.845 INFO:tasks.workunit.client.0.smithi073.stdout:3/500: dread d3/d6/db/f2d [0,4194304] 0 2024-04-19T02:18:31.846 INFO:tasks.workunit.client.0.smithi073.stdout:2/397: sync 2024-04-19T02:18:31.846 INFO:tasks.workunit.client.0.smithi073.stdout:2/398: sync 2024-04-19T02:18:31.847 INFO:tasks.workunit.client.0.smithi073.stdout:4/367: mknod da/d27/d1b/d26/d2a/c7c 0 2024-04-19T02:18:31.847 INFO:tasks.workunit.client.0.smithi073.stdout:2/399: creat d5/d10/d53/f93 x:0 0 0 2024-04-19T02:18:31.847 INFO:tasks.workunit.client.0.smithi073.stdout:0/329: dwrite d7/d14/d17/d1a/f3d [0,4194304] 0 2024-04-19T02:18:31.848 INFO:tasks.workunit.client.0.smithi073.stdout:3/501: write d3/d6/db/d3a/d5f/fa3 [818310,117806] 0 2024-04-19T02:18:31.849 INFO:tasks.workunit.client.0.smithi073.stdout:2/400: mknod d5/d10/d29/d66/c94 0 2024-04-19T02:18:31.849 INFO:tasks.workunit.client.0.smithi073.stdout:9/400: creat d0/df/d16/d19/d38/d5d/d76/d7d/d88/f92 x:0 0 0 2024-04-19T02:18:31.849 INFO:tasks.workunit.client.0.smithi073.stdout:0/330: read d7/d14/d17/d1a/d20/f27 [594557,931] 0 2024-04-19T02:18:31.849 INFO:tasks.workunit.client.0.smithi073.stdout:5/476: dwrite d0/d1d/f20 [4194304,4194304] 0 2024-04-19T02:18:31.850 INFO:tasks.workunit.client.0.smithi073.stdout:0/331: stat d7/d14/d17/d1a/d20/l28 0 2024-04-19T02:18:31.850 INFO:tasks.workunit.client.0.smithi073.stdout:4/368: getdents da/d27 0 2024-04-19T02:18:31.851 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:31.847+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:31.853 INFO:tasks.workunit.client.0.smithi073.stdout:2/401: chown d5/d10/d29/d66/d67/d72/l3f 58 1 2024-04-19T02:18:31.854 INFO:tasks.workunit.client.0.smithi073.stdout:2/402: read d5/f16 [1241103,30984] 0 2024-04-19T02:18:31.854 INFO:tasks.workunit.client.0.smithi073.stdout:9/401: write d0/df/d1d/f17 [2056124,77204] 0 2024-04-19T02:18:31.854 INFO:tasks.workunit.client.0.smithi073.stdout:3/502: write d3/d6/db/d3a/d38/d89/d94/f2e [1822474,57791] 0 2024-04-19T02:18:31.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/332: chown d7/d14 150 1 2024-04-19T02:18:31.855 INFO:tasks.workunit.client.0.smithi073.stdout:3/503: sync 2024-04-19T02:18:31.855 INFO:tasks.workunit.client.0.smithi073.stdout:1/368: dread db/f25 [0,4194304] 0 2024-04-19T02:18:31.856 INFO:tasks.workunit.client.0.smithi073.stdout:1/369: sync 2024-04-19T02:18:31.857 INFO:tasks.workunit.client.0.smithi073.stdout:2/403: stat d5/d10/d14/d2e 0 2024-04-19T02:18:31.857 INFO:tasks.workunit.client.0.smithi073.stdout:2/404: chown d5/d10/d29/d66/d67/d72/l3f 1706459978 1 2024-04-19T02:18:31.858 INFO:tasks.workunit.client.0.smithi073.stdout:2/405: fsync d5/d10/d29/d66/d67/f86 0 2024-04-19T02:18:31.861 INFO:tasks.workunit.client.0.smithi073.stdout:9/402: dread d0/df/f78 [0,4194304] 0 2024-04-19T02:18:31.862 INFO:tasks.workunit.client.0.smithi073.stdout:3/504: dwrite d3/d6/db/d1a/faa [0,4194304] 0 2024-04-19T02:18:31.868 INFO:tasks.workunit.client.0.smithi073.stdout:4/369: rename da/d27/d2c/l7a to da/d27/d3a/d49/l7d 0 2024-04-19T02:18:31.868 INFO:tasks.workunit.client.0.smithi073.stdout:1/370: mknod db/d1c/d2c/d50/c80 0 2024-04-19T02:18:31.868 INFO:tasks.workunit.client.0.smithi073.stdout:0/333: creat d7/d14/d17/d1a/d56/f65 x:0 0 0 2024-04-19T02:18:31.869 INFO:tasks.workunit.client.0.smithi073.stdout:2/406: mknod d5/d10/d14/d18/d3e/d51/c95 0 2024-04-19T02:18:31.871 INFO:tasks.workunit.client.0.smithi073.stdout:4/370: symlink da/d27/d2c/l7e 0 2024-04-19T02:18:31.872 INFO:tasks.workunit.client.0.smithi073.stdout:9/403: rmdir d0/d91 0 2024-04-19T02:18:31.872 INFO:tasks.workunit.client.0.smithi073.stdout:8/346: dread d14/d27/d29/d31/f3f [0,4194304] 0 2024-04-19T02:18:31.873 INFO:tasks.workunit.client.0.smithi073.stdout:4/371: symlink da/d27/d3a/d49/l7f 0 2024-04-19T02:18:31.873 INFO:tasks.workunit.client.0.smithi073.stdout:7/396: dread d0/dc/d67/d2a/f2b [0,4194304] 0 2024-04-19T02:18:31.873 INFO:tasks.workunit.client.0.smithi073.stdout:8/347: mkdir d14/d27/d29/d64 0 2024-04-19T02:18:31.875 INFO:tasks.workunit.client.0.smithi073.stdout:8/348: chown d14/d27/d29/d31/f5e 2545 1 2024-04-19T02:18:31.875 INFO:tasks.workunit.client.0.smithi073.stdout:7/397: mknod d0/dc/d33/c76 0 2024-04-19T02:18:31.876 INFO:tasks.workunit.client.0.smithi073.stdout:8/349: creat d14/d15/d17/f65 x:0 0 0 2024-04-19T02:18:31.877 INFO:tasks.workunit.client.0.smithi073.stdout:7/398: rmdir d0/d73 0 2024-04-19T02:18:31.877 INFO:tasks.workunit.client.0.smithi073.stdout:0/334: dwrite f5 [0,4194304] 0 2024-04-19T02:18:31.878 INFO:tasks.workunit.client.0.smithi073.stdout:1/371: dwrite db/d1c/d2c/f5c [0,4194304] 0 2024-04-19T02:18:31.878 INFO:tasks.workunit.client.0.smithi073.stdout:8/350: read - d14/d27/d50/f5d zero size 2024-04-19T02:18:31.879 INFO:tasks.workunit.client.0.smithi073.stdout:0/335: unlink d7/f1c 0 2024-04-19T02:18:31.879 INFO:tasks.workunit.client.0.smithi073.stdout:1/372: fdatasync db/f25 0 2024-04-19T02:18:31.880 INFO:tasks.workunit.client.0.smithi073.stdout:6/357: dread d8/de/f28 [0,4194304] 0 2024-04-19T02:18:31.881 INFO:tasks.workunit.client.0.smithi073.stdout:4/372: dwrite da/d27/d1b/f45 [4194304,4194304] 0 2024-04-19T02:18:31.882 INFO:tasks.workunit.client.0.smithi073.stdout:6/358: mkdir d8/de/d58/d63/d82 0 2024-04-19T02:18:31.882 INFO:tasks.workunit.client.0.smithi073.stdout:4/373: mkdir da/d27/d2c/d80 0 2024-04-19T02:18:31.882 INFO:tasks.workunit.client.0.smithi073.stdout:1/373: mkdir db/d1c/d81 0 2024-04-19T02:18:31.883 INFO:tasks.workunit.client.0.smithi073.stdout:1/374: creat db/d3e/f82 x:0 0 0 2024-04-19T02:18:31.883 INFO:tasks.workunit.client.0.smithi073.stdout:4/374: symlink da/d27/d3a/d49/l81 0 2024-04-19T02:18:31.883 INFO:tasks.workunit.client.0.smithi073.stdout:7/399: dread d0/dc/d67/f65 [0,4194304] 0 2024-04-19T02:18:31.884 INFO:tasks.workunit.client.0.smithi073.stdout:0/336: rename d7/d14/d17/d1a/c2b to d7/d14/d17/d1a/d21/c66 0 2024-04-19T02:18:31.885 INFO:tasks.workunit.client.0.smithi073.stdout:4/375: chown da/d27/d1b/d1d/d72/d2b/d54 3885198 1 2024-04-19T02:18:31.885 INFO:tasks.workunit.client.0.smithi073.stdout:1/375: chown db/d1c/d2c/l46 681794 1 2024-04-19T02:18:31.886 INFO:tasks.workunit.client.0.smithi073.stdout:1/376: chown db/d41 3320014 1 2024-04-19T02:18:31.886 INFO:tasks.workunit.client.0.smithi073.stdout:0/337: creat d7/f67 x:0 0 0 2024-04-19T02:18:31.887 INFO:tasks.workunit.client.0.smithi073.stdout:8/351: dwrite d14/d27/d50/f63 [0,4194304] 0 2024-04-19T02:18:31.887 INFO:tasks.workunit.client.0.smithi073.stdout:4/376: fsync da/d27/d1b/d1d/d72/d2b/d2f/f63 0 2024-04-19T02:18:31.887 INFO:tasks.workunit.client.0.smithi073.stdout:1/377: mkdir db/d1c/d81/d83 0 2024-04-19T02:18:31.888 INFO:tasks.workunit.client.0.smithi073.stdout:8/352: write d14/d15/f55 [406202,47428] 0 2024-04-19T02:18:31.888 INFO:tasks.workunit.client.0.smithi073.stdout:0/338: write d7/d14/d17/d1a/d21/f32 [2701350,68718] 0 2024-04-19T02:18:31.889 INFO:tasks.workunit.client.0.smithi073.stdout:1/378: creat db/d41/f84 x:0 0 0 2024-04-19T02:18:31.889 INFO:tasks.workunit.client.0.smithi073.stdout:4/377: mknod da/d27/d1b/d1d/d72/d2b/d2f/d68/c82 0 2024-04-19T02:18:31.889 INFO:tasks.workunit.client.0.smithi073.stdout:1/379: rmdir db/d1c 39 2024-04-19T02:18:31.891 INFO:tasks.workunit.client.0.smithi073.stdout:8/353: link d14/d15/c61 d14/d33/c66 0 2024-04-19T02:18:31.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/380: mknod db/d1c/d81/c85 0 2024-04-19T02:18:31.891 INFO:tasks.workunit.client.0.smithi073.stdout:4/378: rename da/d27/d1b/d1d/d72/d2b/l31 to da/d27/d1b/d26/d2a/d46/l83 0 2024-04-19T02:18:31.891 INFO:tasks.workunit.client.0.smithi073.stdout:8/354: fsync d14/d15/d17/d48/f59 0 2024-04-19T02:18:31.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/381: mkdir db/d1c/d81/d86 0 2024-04-19T02:18:31.892 INFO:tasks.workunit.client.0.smithi073.stdout:8/355: write d14/f19 [3344688,49455] 0 2024-04-19T02:18:31.892 INFO:tasks.workunit.client.0.smithi073.stdout:8/356: mknod d14/d33/c67 0 2024-04-19T02:18:31.892 INFO:tasks.workunit.client.0.smithi073.stdout:8/357: chown d14/c4e 387247 1 2024-04-19T02:18:31.894 INFO:tasks.workunit.client.0.smithi073.stdout:8/358: symlink d14/d27/d50/l68 0 2024-04-19T02:18:31.894 INFO:tasks.workunit.client.0.smithi073.stdout:8/359: chown d14/d27/d50/f63 1684426501 1 2024-04-19T02:18:31.897 INFO:tasks.workunit.client.0.smithi073.stdout:4/379: dwrite da/d27/d1b/d1d/f29 [0,4194304] 0 2024-04-19T02:18:31.898 INFO:tasks.workunit.client.0.smithi073.stdout:4/380: mkdir da/d27/d1b/d1d/d72/d2b/d54/d84 0 2024-04-19T02:18:31.898 INFO:tasks.workunit.client.0.smithi073.stdout:4/381: fdatasync da/d27/d2c/d60/f71 0 2024-04-19T02:18:31.900 INFO:tasks.workunit.client.0.smithi073.stdout:4/382: symlink da/d27/d3a/d50/l85 0 2024-04-19T02:18:31.901 INFO:tasks.workunit.client.0.smithi073.stdout:4/383: creat da/d27/d36/d4d/d7b/f86 x:0 0 0 2024-04-19T02:18:31.916 INFO:tasks.workunit.client.0.smithi073.stdout:5/477: write d0/d1d/d24/d61/f74 [1033069,83643] 0 2024-04-19T02:18:31.916 INFO:tasks.workunit.client.0.smithi073.stdout:1/382: dread db/f30 [0,4194304] 0 2024-04-19T02:18:31.916 INFO:tasks.workunit.client.0.smithi073.stdout:5/478: mkdir d0/d1d/d90/da0 0 2024-04-19T02:18:31.917 INFO:tasks.workunit.client.0.smithi073.stdout:1/383: unlink db/d1c/d2c/d50/c80 0 2024-04-19T02:18:31.917 INFO:tasks.workunit.client.0.smithi073.stdout:1/384: dread - db/f65 zero size 2024-04-19T02:18:31.917 INFO:tasks.workunit.client.0.smithi073.stdout:5/479: creat d0/fa1 x:0 0 0 2024-04-19T02:18:31.918 INFO:tasks.workunit.client.0.smithi073.stdout:1/385: write db/d1c/d2c/d50/f6d [212923,85895] 0 2024-04-19T02:18:31.918 INFO:tasks.workunit.client.0.smithi073.stdout:5/480: truncate d0/d1d/d25/d35/d39/f7f 1019451 0 2024-04-19T02:18:31.918 INFO:tasks.workunit.client.0.smithi073.stdout:1/386: mknod db/d1c/d2c/c87 0 2024-04-19T02:18:31.920 INFO:tasks.workunit.client.0.smithi073.stdout:5/481: write d0/d1d/d1e/f80 [995703,16626] 0 2024-04-19T02:18:31.920 INFO:tasks.workunit.client.0.smithi073.stdout:1/387: write db/d1c/f34 [193776,87455] 0 2024-04-19T02:18:31.920 INFO:tasks.workunit.client.0.smithi073.stdout:5/482: dread - d0/d1d/d64/f7a zero size 2024-04-19T02:18:31.920 INFO:tasks.workunit.client.0.smithi073.stdout:1/388: mknod db/d1c/d81/c88 0 2024-04-19T02:18:31.920 INFO:tasks.workunit.client.0.smithi073.stdout:5/483: readlink d0/d1d/d25/d35/d88/l93 0 2024-04-19T02:18:31.921 INFO:tasks.workunit.client.0.smithi073.stdout:2/407: truncate d5/d10/d14/d18/f22 2344451 0 2024-04-19T02:18:31.921 INFO:tasks.workunit.client.0.smithi073.stdout:9/404: truncate d0/df/d16/d1a/d2c/d2e/f4b 668731 0 2024-04-19T02:18:31.921 INFO:tasks.workunit.client.0.smithi073.stdout:6/359: truncate d8/de/d35/f57 3783964 0 2024-04-19T02:18:31.921 INFO:tasks.workunit.client.0.smithi073.stdout:1/389: fsync db/ff 0 2024-04-19T02:18:31.922 INFO:tasks.workunit.client.0.smithi073.stdout:6/360: fdatasync d8/de/d35/f65 0 2024-04-19T02:18:31.922 INFO:tasks.workunit.client.0.smithi073.stdout:2/408: symlink d5/d10/d14/l96 0 2024-04-19T02:18:31.923 INFO:tasks.workunit.client.0.smithi073.stdout:1/390: creat db/d1c/d2c/f89 x:0 0 0 2024-04-19T02:18:31.924 INFO:tasks.workunit.client.0.smithi073.stdout:2/409: fsync d5/d10/d29/d66/d67/d72/f12 0 2024-04-19T02:18:31.924 INFO:tasks.workunit.client.0.smithi073.stdout:1/391: readlink db/d1c/l49 0 2024-04-19T02:18:31.924 INFO:tasks.workunit.client.0.smithi073.stdout:9/405: getdents d0/df/d16/d19/d38/d5d/d76/d7d 0 2024-04-19T02:18:31.925 INFO:tasks.workunit.client.0.smithi073.stdout:3/505: dwrite d3/d6/db/d1a/d54/f81 [0,4194304] 0 2024-04-19T02:18:31.925 INFO:tasks.workunit.client.0.smithi073.stdout:9/406: fsync d0/df/d16/d19/f3d 0 2024-04-19T02:18:31.925 INFO:tasks.workunit.client.0.smithi073.stdout:2/410: mknod d5/d10/d29/d66/d7e/c97 0 2024-04-19T02:18:31.927 INFO:tasks.workunit.client.0.smithi073.stdout:3/506: stat d3/d6/db/d3a/d38/d43/f6a 0 2024-04-19T02:18:31.927 INFO:tasks.workunit.client.0.smithi073.stdout:6/361: dread d8/de/f47 [0,4194304] 0 2024-04-19T02:18:31.928 INFO:tasks.workunit.client.0.smithi073.stdout:0/339: truncate d7/d14/d17/d1a/f46 1130591 0 2024-04-19T02:18:31.931 INFO:tasks.workunit.client.0.smithi073.stdout:0/340: write d7/d14/d17/d1a/f3d [1481759,88529] 0 2024-04-19T02:18:31.931 INFO:tasks.workunit.client.0.smithi073.stdout:5/484: dwrite d0/f5d [0,4194304] 0 2024-04-19T02:18:31.933 INFO:tasks.workunit.client.0.smithi073.stdout:7/400: dwrite d0/d3/f74 [0,4194304] 0 2024-04-19T02:18:31.933 INFO:tasks.workunit.client.0.smithi073.stdout:8/360: dread d14/d27/d29/f52 [0,4194304] 0 2024-04-19T02:18:31.933 INFO:tasks.workunit.client.0.smithi073.stdout:4/384: sync 2024-04-19T02:18:31.933 INFO:tasks.workunit.client.0.smithi073.stdout:5/485: sync 2024-04-19T02:18:31.933 INFO:tasks.workunit.client.0.smithi073.stdout:1/392: dwrite db/f36 [0,4194304] 0 2024-04-19T02:18:31.936 INFO:tasks.workunit.client.0.smithi073.stdout:0/341: creat d7/d14/f68 x:0 0 0 2024-04-19T02:18:31.937 INFO:tasks.workunit.client.0.smithi073.stdout:6/362: dwrite d8/de/d22/f64 [0,4194304] 0 2024-04-19T02:18:31.937 INFO:tasks.workunit.client.0.smithi073.stdout:8/361: mkdir d14/d27/d29/d69 0 2024-04-19T02:18:31.938 INFO:tasks.workunit.client.0.smithi073.stdout:2/411: truncate d5/d10/d14/d18/d3e/d51/f59 444182 0 2024-04-19T02:18:31.938 INFO:tasks.workunit.client.0.smithi073.stdout:1/393: creat db/d1c/d81/d86/f8a x:0 0 0 2024-04-19T02:18:31.939 INFO:tasks.workunit.client.0.smithi073.stdout:0/342: mkdir d7/d14/d17/d69 0 2024-04-19T02:18:31.939 INFO:tasks.workunit.client.0.smithi073.stdout:7/401: rename d0/dc/d67/d2a/l43 to d0/dc/l77 0 2024-04-19T02:18:31.939 INFO:tasks.workunit.client.0.smithi073.stdout:8/362: unlink d14/d15/d17/f65 0 2024-04-19T02:18:31.939 INFO:tasks.workunit.client.0.smithi073.stdout:2/412: mkdir d5/d10/d14/d18/d98 0 2024-04-19T02:18:31.939 INFO:tasks.workunit.client.0.smithi073.stdout:1/394: mkdir db/d1c/d54/d8b 0 2024-04-19T02:18:31.940 INFO:tasks.workunit.client.0.smithi073.stdout:7/402: symlink d0/dc/d67/d2a/d51/l78 0 2024-04-19T02:18:31.940 INFO:tasks.workunit.client.0.smithi073.stdout:4/385: write da/d27/d3a/d50/f77 [225034,42967] 0 2024-04-19T02:18:31.940 INFO:tasks.workunit.client.0.smithi073.stdout:8/363: write d14/d27/d29/f52 [3646789,36149] 0 2024-04-19T02:18:31.941 INFO:tasks.workunit.client.0.smithi073.stdout:2/413: mknod d5/d10/d53/c99 0 2024-04-19T02:18:31.943 INFO:tasks.workunit.client.0.smithi073.stdout:0/343: read d7/d14/d17/d1a/f39 [605177,122902] 0 2024-04-19T02:18:31.944 INFO:tasks.workunit.client.0.smithi073.stdout:8/364: link d14/d27/l57 d14/d33/l6a 0 2024-04-19T02:18:31.944 INFO:tasks.workunit.client.0.smithi073.stdout:4/386: mknod da/d27/d1b/d26/d2a/c87 0 2024-04-19T02:18:31.944 INFO:tasks.workunit.client.0.smithi073.stdout:7/403: rename d0/dc/d39/d50/f68 to d0/f79 0 2024-04-19T02:18:31.944 INFO:tasks.workunit.client.0.smithi073.stdout:0/344: stat d7/d14/l2a 0 2024-04-19T02:18:31.945 INFO:tasks.workunit.client.0.smithi073.stdout:2/414: link d5/d10/d53/f93 d5/d10/d14/d18/d3e/f9a 0 2024-04-19T02:18:31.946 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:31.946 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:31.947 INFO:tasks.workunit.client.0.smithi073.stdout:5/486: dwrite d0/d1d/d64/f7a [0,4194304] 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/365: chown d14/d27/d29/d31/f3e 35 1 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:6/363: dread d8/fb [0,4194304] 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:4/387: mknod da/d27/d3a/c88 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/366: chown f0 9980 1 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:7/404: mkdir d0/dc/d67/d2a/d51/d7a 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:0/345: rename d7/d14/f62 to d7/d14/d17/d69/f6a 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:5/487: unlink d0/d2d/c54 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:2/415: symlink d5/d10/d14/d18/d3e/d2d/l9b 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:6/364: stat d8/de/d35/f3d 0 2024-04-19T02:18:31.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/367: creat d14/d27/d4c/f6b x:0 0 0 2024-04-19T02:18:31.949 INFO:tasks.workunit.client.0.smithi073.stdout:0/346: mknod d7/c6b 0 2024-04-19T02:18:31.949 INFO:tasks.workunit.client.0.smithi073.stdout:2/416: mkdir d5/d10/d14/d2e/d9c 0 2024-04-19T02:18:31.949 INFO:tasks.workunit.client.0.smithi073.stdout:7/405: mkdir d0/dc/d33/d36/d7b 0 2024-04-19T02:18:31.949 INFO:tasks.workunit.client.0.smithi073.stdout:8/368: mknod d14/c6c 0 2024-04-19T02:18:31.949 INFO:tasks.workunit.client.0.smithi073.stdout:8/369: fdatasync f0 0 2024-04-19T02:18:31.950 INFO:tasks.workunit.client.0.smithi073.stdout:0/347: write d7/d14/d17/d1a/f22 [2321973,36082] 0 2024-04-19T02:18:31.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/370: mknod d14/d33/c6d 0 2024-04-19T02:18:31.951 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:31.948+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:31.952 INFO:tasks.workunit.client.0.smithi073.stdout:5/488: link d0/d1d/d24/c87 d0/d1d/d25/d37/ca2 0 2024-04-19T02:18:31.954 INFO:tasks.workunit.client.0.smithi073.stdout:7/406: link d0/f8 d0/f7c 0 2024-04-19T02:18:31.954 INFO:tasks.workunit.client.0.smithi073.stdout:8/371: write d14/d27/f2e [973427,110641] 0 2024-04-19T02:18:31.956 INFO:tasks.workunit.client.0.smithi073.stdout:8/372: symlink d14/d33/l6e 0 2024-04-19T02:18:31.958 INFO:tasks.workunit.client.0.smithi073.stdout:6/365: dwrite d8/f11 [4194304,4194304] 0 2024-04-19T02:18:31.959 INFO:tasks.workunit.client.0.smithi073.stdout:8/373: creat d14/d27/d50/f6f x:0 0 0 2024-04-19T02:18:31.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/348: dwrite d7/d14/d17/d1a/d21/f3c [4194304,4194304] 0 2024-04-19T02:18:31.960 INFO:tasks.workunit.client.0.smithi073.stdout:2/417: dwrite d5/d10/d14/d18/d3e/f32 [0,4194304] 0 2024-04-19T02:18:31.960 INFO:tasks.workunit.client.0.smithi073.stdout:3/507: dread d3/d6/db/d3a/d38/d43/f84 [0,4194304] 0 2024-04-19T02:18:31.961 INFO:tasks.workunit.client.0.smithi073.stdout:8/374: symlink d14/d27/d29/l70 0 2024-04-19T02:18:31.964 INFO:tasks.workunit.client.0.smithi073.stdout:0/349: creat d7/d14/d17/d1a/d20/f6c x:0 0 0 2024-04-19T02:18:31.964 INFO:tasks.workunit.client.0.smithi073.stdout:7/407: dwrite d0/f79 [0,4194304] 0 2024-04-19T02:18:31.964 INFO:tasks.workunit.client.0.smithi073.stdout:0/350: chown d7/d14/d17/d1a/c5c 29436 1 2024-04-19T02:18:31.964 INFO:tasks.workunit.client.0.smithi073.stdout:8/375: readlink d14/d27/l57 0 2024-04-19T02:18:31.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:31.970 INFO:tasks.workunit.client.0.smithi073.stdout:7/408: write d0/dc/f4c [86384,10440] 0 2024-04-19T02:18:31.970 INFO:tasks.workunit.client.0.smithi073.stdout:0/351: mkdir d7/d6d 0 2024-04-19T02:18:31.970 INFO:tasks.workunit.client.0.smithi073.stdout:8/376: link d14/c49 d14/d27/d29/d31/d34/c71 0 2024-04-19T02:18:31.970 INFO:tasks.workunit.client.0.smithi073.stdout:7/409: write d0/dc/d67/f71 [247785,83215] 0 2024-04-19T02:18:31.970 INFO:tasks.workunit.client.0.smithi073.stdout:0/352: symlink d7/d14/d17/l6e 0 2024-04-19T02:18:31.970 INFO:tasks.workunit.client.0.smithi073.stdout:6/366: dwrite d8/de/d22/f31 [0,4194304] 0 2024-04-19T02:18:31.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/395: dread db/d1c/d2c/d50/f6b [0,4194304] 0 2024-04-19T02:18:31.971 INFO:tasks.workunit.client.0.smithi073.stdout:4/388: sync 2024-04-19T02:18:31.971 INFO:tasks.workunit.client.0.smithi073.stdout:7/410: sync 2024-04-19T02:18:31.972 INFO:tasks.workunit.client.0.smithi073.stdout:1/396: mkdir db/d1c/d78/d8c 0 2024-04-19T02:18:31.972 INFO:tasks.workunit.client.0.smithi073.stdout:3/508: dwrite d3/d6/db/d1a/d54/f81 [0,4194304] 0 2024-04-19T02:18:31.972 INFO:tasks.workunit.client.0.smithi073.stdout:2/418: dwrite d5/d10/d29/d42/f6e [0,4194304] 0 2024-04-19T02:18:31.974 INFO:tasks.workunit.client.0.smithi073.stdout:4/389: fdatasync da/d27/d1b/d1d/f29 0 2024-04-19T02:18:31.974 INFO:tasks.workunit.client.0.smithi073.stdout:8/377: write d14/d27/d4c/f6b [751986,115730] 0 2024-04-19T02:18:31.974 INFO:tasks.workunit.client.0.smithi073.stdout:0/353: rename d7/d14/d17/d1a/d21/d61 to d7/d14/d17/d1a/d56/d6f 0 2024-04-19T02:18:31.974 INFO:tasks.workunit.client.0.smithi073.stdout:6/367: creat d8/de/d58/d63/d82/f83 x:0 0 0 2024-04-19T02:18:31.974 INFO:tasks.workunit.client.0.smithi073.stdout:2/419: write d5/d10/d14/f2c [6625554,50809] 0 2024-04-19T02:18:31.974 INFO:tasks.workunit.client.0.smithi073.stdout:2/420: sync 2024-04-19T02:18:31.974 INFO:tasks.workunit.client.0.smithi073.stdout:1/397: symlink db/d1c/d2c/d50/l8d 0 2024-04-19T02:18:31.975 INFO:tasks.workunit.client.0.smithi073.stdout:8/378: fdatasync d14/d27/d50/f6f 0 2024-04-19T02:18:31.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/421: write d5/f16 [1420180,84369] 0 2024-04-19T02:18:31.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/422: fsync d5/d10/d14/d18/d3e/f85 0 2024-04-19T02:18:31.976 INFO:tasks.workunit.client.0.smithi073.stdout:4/390: readlink da/d27/d1b/d26/l3e 0 2024-04-19T02:18:31.976 INFO:tasks.workunit.client.0.smithi073.stdout:1/398: chown db/l20 13 1 2024-04-19T02:18:31.977 INFO:tasks.workunit.client.0.smithi073.stdout:8/379: mknod d14/d27/d29/d31/c72 0 2024-04-19T02:18:31.977 INFO:tasks.workunit.client.0.smithi073.stdout:0/354: fdatasync d7/d14/d17/d1a/f46 0 2024-04-19T02:18:31.978 INFO:tasks.workunit.client.0.smithi073.stdout:0/355: readlink d7/d14/d17/d1a/d21/l35 0 2024-04-19T02:18:31.978 INFO:tasks.workunit.client.0.smithi073.stdout:8/380: creat d14/d15/d17/f73 x:0 0 0 2024-04-19T02:18:31.978 INFO:tasks.workunit.client.0.smithi073.stdout:4/391: link da/d27/d2c/f3c da/d27/d1b/d1d/d72/d2b/d54/f89 0 2024-04-19T02:18:31.978 INFO:tasks.workunit.client.0.smithi073.stdout:1/399: rename db/d1c/d2c/l3a to db/d1c/d2c/d50/d62/l8e 0 2024-04-19T02:18:31.979 INFO:tasks.workunit.client.0.smithi073.stdout:0/356: dread - d7/d14/d17/d1a/d21/f53 zero size 2024-04-19T02:18:31.979 INFO:tasks.workunit.client.0.smithi073.stdout:8/381: chown d14/d27/d50/l68 419964 1 2024-04-19T02:18:31.980 INFO:tasks.workunit.client.0.smithi073.stdout:4/392: rmdir da/d27/d1b 39 2024-04-19T02:18:31.981 INFO:tasks.workunit.client.0.smithi073.stdout:1/400: stat db/d1c/d2c/f77 0 2024-04-19T02:18:31.981 INFO:tasks.workunit.client.0.smithi073.stdout:2/423: dread d5/d10/d29/d66/d67/f86 [0,4194304] 0 2024-04-19T02:18:31.983 INFO:tasks.workunit.client.0.smithi073.stdout:0/357: getdents d7/d14/d17/d69 0 2024-04-19T02:18:31.983 INFO:tasks.workunit.client.0.smithi073.stdout:1/401: readlink db/l40 0 2024-04-19T02:18:31.983 INFO:tasks.workunit.client.0.smithi073.stdout:8/382: dread d14/d27/d29/d31/f5e [0,4194304] 0 2024-04-19T02:18:31.984 INFO:tasks.workunit.client.0.smithi073.stdout:9/407: dread d0/df/d16/d19/f3d [0,4194304] 0 2024-04-19T02:18:31.984 INFO:tasks.workunit.client.0.smithi073.stdout:2/424: chown d5/d10/d14/d18/d3e/d2d/f5d 55737 1 2024-04-19T02:18:31.984 INFO:tasks.workunit.client.0.smithi073.stdout:0/358: chown d7/d14/f47 637595 1 2024-04-19T02:18:31.984 INFO:tasks.workunit.client.0.smithi073.stdout:6/368: dwrite d8/f18 [0,4194304] 0 2024-04-19T02:18:31.985 INFO:tasks.workunit.client.0.smithi073.stdout:1/402: mknod db/d1c/d78/d8c/c8f 0 2024-04-19T02:18:31.986 INFO:tasks.workunit.client.0.smithi073.stdout:8/383: write d14/d15/d17/f73 [768445,51612] 0 2024-04-19T02:18:31.986 INFO:tasks.workunit.client.0.smithi073.stdout:6/369: fdatasync d8/de/d35/f3d 0 2024-04-19T02:18:31.986 INFO:tasks.workunit.client.0.smithi073.stdout:1/403: fsync db/d1c/d2c/f45 0 2024-04-19T02:18:31.986 INFO:tasks.workunit.client.0.smithi073.stdout:2/425: write d5/d10/d29/d66/d67/d72/f25 [4094212,75182] 0 2024-04-19T02:18:31.987 INFO:tasks.workunit.client.0.smithi073.stdout:3/509: dwrite d3/d6/db/d3a/f70 [4194304,4194304] 0 2024-04-19T02:18:31.988 INFO:tasks.workunit.client.0.smithi073.stdout:9/408: truncate d0/df/d16/d19/d38/d5d/d5e/f8d 372440 0 2024-04-19T02:18:31.988 INFO:tasks.workunit.client.0.smithi073.stdout:1/404: dread db/ff [0,4194304] 0 2024-04-19T02:18:31.988 INFO:tasks.workunit.client.0.smithi073.stdout:3/510: chown d3/d6/db/d3a/d38/d89/d94/d7b 155146 1 2024-04-19T02:18:31.989 INFO:tasks.workunit.client.0.smithi073.stdout:5/489: dread d0/d1d/d25/d35/f42 [0,4194304] 0 2024-04-19T02:18:31.990 INFO:tasks.workunit.client.0.smithi073.stdout:8/384: creat d14/d27/d29/d31/f74 x:0 0 0 2024-04-19T02:18:31.991 INFO:tasks.workunit.client.0.smithi073.stdout:1/405: fdatasync db/d1c/d81/d86/f8a 0 2024-04-19T02:18:31.995 INFO:tasks.workunit.client.0.smithi073.stdout:5/490: creat d0/d1d/d24/d61/fa3 x:0 0 0 2024-04-19T02:18:31.995 INFO:tasks.workunit.client.0.smithi073.stdout:8/385: rename d14/d33 to d14/d27/d4c/d75 0 2024-04-19T02:18:31.995 INFO:tasks.workunit.client.0.smithi073.stdout:1/406: creat db/d1c/d54/f90 x:0 0 0 2024-04-19T02:18:31.995 INFO:tasks.workunit.client.0.smithi073.stdout:2/426: dwrite d5/d10/d14/d18/f6b [0,4194304] 0 2024-04-19T02:18:31.996 INFO:tasks.workunit.client.0.smithi073.stdout:5/491: readlink d0/d1d/l5f 0 2024-04-19T02:18:31.996 INFO:tasks.workunit.client.0.smithi073.stdout:9/409: dwrite d0/df/d1d/f5b [0,4194304] 0 2024-04-19T02:18:31.998 INFO:tasks.workunit.client.0.smithi073.stdout:3/511: dwrite d3/d6/db/f45 [0,4194304] 0 2024-04-19T02:18:31.999 INFO:tasks.workunit.client.0.smithi073.stdout:6/370: truncate d8/de/d22/f37 325261 0 2024-04-19T02:18:31.999 INFO:tasks.workunit.client.0.smithi073.stdout:2/427: truncate d5/d10/d29/d66/d67/f4f 7652582 0 2024-04-19T02:18:31.999 INFO:tasks.workunit.client.0.smithi073.stdout:1/407: mknod db/d1c/d2c/d50/c91 0 2024-04-19T02:18:32.000 INFO:tasks.workunit.client.0.smithi073.stdout:5/492: symlink d0/d1d/d25/d35/la4 0 2024-04-19T02:18:32.000 INFO:tasks.workunit.client.0.smithi073.stdout:6/371: mknod d8/d4b/c84 0 2024-04-19T02:18:32.000 INFO:tasks.workunit.client.0.smithi073.stdout:9/410: link d0/df/c2a d0/df/d16/d19/c93 0 2024-04-19T02:18:32.000 INFO:tasks.workunit.client.0.smithi073.stdout:3/512: symlink d3/d6/db/d1a/d54/lab 0 2024-04-19T02:18:32.000 INFO:tasks.workunit.client.0.smithi073.stdout:1/408: unlink db/d1c/d2c/c55 0 2024-04-19T02:18:32.001 INFO:tasks.workunit.client.0.smithi073.stdout:5/493: fsync d0/fa1 0 2024-04-19T02:18:32.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/359: dread d7/d14/d17/d1a/f46 [0,4194304] 0 2024-04-19T02:18:32.001 INFO:tasks.workunit.client.0.smithi073.stdout:9/411: rmdir d0/d35 39 2024-04-19T02:18:32.001 INFO:tasks.workunit.client.0.smithi073.stdout:6/372: mknod d8/de/d35/c85 0 2024-04-19T02:18:32.001 INFO:tasks.workunit.client.0.smithi073.stdout:6/373: sync 2024-04-19T02:18:32.001 INFO:tasks.workunit.client.0.smithi073.stdout:1/409: creat db/d3e/f92 x:0 0 0 2024-04-19T02:18:32.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/360: mkdir d7/d14/d17/d70 0 2024-04-19T02:18:32.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/494: creat d0/d1d/d24/fa5 x:0 0 0 2024-04-19T02:18:32.002 INFO:tasks.workunit.client.0.smithi073.stdout:2/428: link d5/d10/d29/d66/d67/f4f d5/f9d 0 2024-04-19T02:18:32.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/495: sync 2024-04-19T02:18:32.003 INFO:tasks.workunit.client.0.smithi073.stdout:3/513: write d3/d6/db/f7e [2681454,50160] 0 2024-04-19T02:18:32.003 INFO:tasks.workunit.client.0.smithi073.stdout:0/361: chown l1 1987 1 2024-04-19T02:18:32.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/374: mkdir d8/de/d35/d86 0 2024-04-19T02:18:32.003 INFO:tasks.workunit.client.0.smithi073.stdout:1/410: symlink db/d1c/d2c/l93 0 2024-04-19T02:18:32.004 INFO:tasks.workunit.client.0.smithi073.stdout:5/496: dread d0/d1d/d24/f5e [0,4194304] 0 2024-04-19T02:18:32.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/375: creat d8/d71/d7d/f87 x:0 0 0 2024-04-19T02:18:32.004 INFO:tasks.workunit.client.0.smithi073.stdout:9/412: creat d0/df/d60/d72/d8e/f94 x:0 0 0 2024-04-19T02:18:32.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/514: getdents d3/d6/db/d3a/d38/d43 0 2024-04-19T02:18:32.005 INFO:tasks.workunit.client.0.smithi073.stdout:0/362: rename d7/d14/d17/f1d to d7/d14/d17/d1a/d56/d6f/f71 0 2024-04-19T02:18:32.005 INFO:tasks.workunit.client.0.smithi073.stdout:6/376: rmdir d8/d77 39 2024-04-19T02:18:32.006 INFO:tasks.workunit.client.0.smithi073.stdout:3/515: chown d3/d6/db/d23/c55 54219787 1 2024-04-19T02:18:32.006 INFO:tasks.workunit.client.0.smithi073.stdout:6/377: write d8/d71/d7d/f87 [836282,104499] 0 2024-04-19T02:18:32.007 INFO:tasks.workunit.client.0.smithi073.stdout:6/378: chown d8/de/c41 1 1 2024-04-19T02:18:32.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/516: mkdir d3/d6/db/d3a/d38/d6f/dac 0 2024-04-19T02:18:32.008 INFO:tasks.workunit.client.0.smithi073.stdout:6/379: symlink d8/l88 0 2024-04-19T02:18:32.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/517: symlink d3/d6/db/lad 0 2024-04-19T02:18:32.009 INFO:tasks.workunit.client.0.smithi073.stdout:3/518: chown d3/d6/db/d3a/d38/d43/d4e 9 1 2024-04-19T02:18:32.013 INFO:tasks.workunit.client.0.smithi073.stdout:7/411: read d0/f6a [646980,99501] 0 2024-04-19T02:18:32.013 INFO:tasks.workunit.client.0.smithi073.stdout:0/363: dread d7/d14/d17/d1a/f29 [0,4194304] 0 2024-04-19T02:18:32.014 INFO:tasks.workunit.client.0.smithi073.stdout:3/519: dread d3/d6/db/d3a/d38/d43/f6a [0,4194304] 0 2024-04-19T02:18:32.014 INFO:tasks.workunit.client.0.smithi073.stdout:0/364: fsync d7/f11 0 2024-04-19T02:18:32.014 INFO:tasks.workunit.client.0.smithi073.stdout:7/412: rmdir d0/d3 39 2024-04-19T02:18:32.014 INFO:tasks.workunit.client.0.smithi073.stdout:6/380: dwrite d8/f16 [0,4194304] 0 2024-04-19T02:18:32.015 INFO:tasks.workunit.client.0.smithi073.stdout:3/520: rmdir d3/d6/db/d3a/d38/d57/d88 39 2024-04-19T02:18:32.016 INFO:tasks.workunit.client.0.smithi073.stdout:0/365: truncate d7/d14/d17/d69/f6a 825119 0 2024-04-19T02:18:32.016 INFO:tasks.workunit.client.0.smithi073.stdout:7/413: link d0/d28/c3d d0/dc/d67/c7d 0 2024-04-19T02:18:32.017 INFO:tasks.workunit.client.0.smithi073.stdout:8/386: dread d14/d27/d4c/d75/f44 [0,4194304] 0 2024-04-19T02:18:32.018 INFO:tasks.workunit.client.0.smithi073.stdout:0/366: creat d7/d14/d17/d70/f72 x:0 0 0 2024-04-19T02:18:32.018 INFO:tasks.workunit.client.0.smithi073.stdout:7/414: write d0/dc/d39/d40/f44 [3545585,103476] 0 2024-04-19T02:18:32.018 INFO:tasks.workunit.client.0.smithi073.stdout:7/415: sync 2024-04-19T02:18:32.018 INFO:tasks.workunit.client.0.smithi073.stdout:8/387: readlink d14/d27/l2b 0 2024-04-19T02:18:32.018 INFO:tasks.workunit.client.0.smithi073.stdout:0/367: symlink d7/d6d/l73 0 2024-04-19T02:18:32.019 INFO:tasks.workunit.client.0.smithi073.stdout:7/416: creat d0/d3/f7e x:0 0 0 2024-04-19T02:18:32.019 INFO:tasks.workunit.client.0.smithi073.stdout:0/368: write d7/f11 [5237961,120551] 0 2024-04-19T02:18:32.019 INFO:tasks.workunit.client.0.smithi073.stdout:7/417: sync 2024-04-19T02:18:32.019 INFO:tasks.workunit.client.0.smithi073.stdout:8/388: creat d14/d27/d4c/f76 x:0 0 0 2024-04-19T02:18:32.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/389: write d14/d27/d50/f5d [24451,3797] 0 2024-04-19T02:18:32.020 INFO:tasks.workunit.client.0.smithi073.stdout:0/369: symlink d7/d14/d17/d1a/d20/l74 0 2024-04-19T02:18:32.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/390: chown d14/d27/d29/f51 86066651 1 2024-04-19T02:18:32.021 INFO:tasks.workunit.client.0.smithi073.stdout:0/370: symlink d7/d14/d17/d1a/d56/l75 0 2024-04-19T02:18:32.021 INFO:tasks.workunit.client.0.smithi073.stdout:8/391: write d14/d15/f1e [1799982,104849] 0 2024-04-19T02:18:32.022 INFO:tasks.workunit.client.0.smithi073.stdout:9/413: dread d0/df/d16/d19/d38/d5d/f4e [0,4194304] 0 2024-04-19T02:18:32.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/392: creat d14/d15/d17/f77 x:0 0 0 2024-04-19T02:18:32.022 INFO:tasks.workunit.client.0.smithi073.stdout:9/414: symlink d0/df/d16/d19/l95 0 2024-04-19T02:18:32.023 INFO:tasks.workunit.client.0.smithi073.stdout:8/393: creat d14/d27/d29/d64/f78 x:0 0 0 2024-04-19T02:18:32.023 INFO:tasks.workunit.client.0.smithi073.stdout:8/394: truncate d14/f62 214916 0 2024-04-19T02:18:32.023 INFO:tasks.workunit.client.0.smithi073.stdout:9/415: creat d0/df/d16/d19/d38/f96 x:0 0 0 2024-04-19T02:18:32.024 INFO:tasks.workunit.client.0.smithi073.stdout:8/395: rename d14/d27/f2e to d14/d27/d29/f79 0 2024-04-19T02:18:32.024 INFO:tasks.workunit.client.0.smithi073.stdout:8/396: sync 2024-04-19T02:18:32.025 INFO:tasks.workunit.client.0.smithi073.stdout:8/397: creat d14/f7a x:0 0 0 2024-04-19T02:18:32.025 INFO:tasks.workunit.client.0.smithi073.stdout:8/398: mkdir d14/d27/d7b 0 2024-04-19T02:18:32.026 INFO:tasks.workunit.client.0.smithi073.stdout:8/399: chown d14/d27/d4c/f76 8 1 2024-04-19T02:18:32.027 INFO:tasks.workunit.client.0.smithi073.stdout:4/393: dread da/d27/d1b/d26/f4a [0,4194304] 0 2024-04-19T02:18:32.028 INFO:tasks.workunit.client.0.smithi073.stdout:1/411: dread db/d1c/d2c/f3d [0,4194304] 0 2024-04-19T02:18:32.029 INFO:tasks.workunit.client.0.smithi073.stdout:1/412: readlink db/d1c/d2c/d50/d62/l8e 0 2024-04-19T02:18:32.029 INFO:tasks.workunit.client.0.smithi073.stdout:4/394: getdents da/d27/d2c 0 2024-04-19T02:18:32.029 INFO:tasks.workunit.client.0.smithi073.stdout:1/413: readlink db/d1c/d2c/l57 0 2024-04-19T02:18:32.029 INFO:tasks.workunit.client.0.smithi073.stdout:5/497: dread d0/d1d/d1e/f8d [0,4194304] 0 2024-04-19T02:18:32.030 INFO:tasks.workunit.client.0.smithi073.stdout:4/395: mknod da/d27/d1b/d26/c8a 0 2024-04-19T02:18:32.030 INFO:tasks.workunit.client.0.smithi073.stdout:5/498: chown d0/f13 42310948 1 2024-04-19T02:18:32.030 INFO:tasks.workunit.client.0.smithi073.stdout:4/396: rmdir da/d27/d3a/d50 39 2024-04-19T02:18:32.031 INFO:tasks.workunit.client.0.smithi073.stdout:4/397: write da/d27/d1b/d1d/d72/f62 [44278,56922] 0 2024-04-19T02:18:32.033 INFO:tasks.workunit.client.0.smithi073.stdout:4/398: getdents da/d27/d2c 0 2024-04-19T02:18:32.033 INFO:tasks.workunit.client.0.smithi073.stdout:4/399: unlink da/d27/d1b/l59 0 2024-04-19T02:18:32.035 INFO:tasks.workunit.client.0.smithi073.stdout:4/400: creat da/d27/d3a/d50/f8b x:0 0 0 2024-04-19T02:18:32.035 INFO:tasks.workunit.client.0.smithi073.stdout:2/429: write d5/d10/d14/d18/d3e/d51/f59 [944905,123732] 0 2024-04-19T02:18:32.035 INFO:tasks.workunit.client.0.smithi073.stdout:3/521: truncate d3/d6/db/d3a/d38/d89/d94/f35 2454346 0 2024-04-19T02:18:32.035 INFO:tasks.workunit.client.0.smithi073.stdout:3/522: sync 2024-04-19T02:18:32.036 INFO:tasks.workunit.client.0.smithi073.stdout:7/418: write d0/dc/f5a [5221457,41251] 0 2024-04-19T02:18:32.036 INFO:tasks.workunit.client.0.smithi073.stdout:4/401: mkdir da/d27/d1b/d8c 0 2024-04-19T02:18:32.036 INFO:tasks.workunit.client.0.smithi073.stdout:7/419: chown d0/d28/c2e 910896 1 2024-04-19T02:18:32.037 INFO:tasks.workunit.client.0.smithi073.stdout:6/381: dread d8/f66 [0,4194304] 0 2024-04-19T02:18:32.037 INFO:tasks.workunit.client.0.smithi073.stdout:2/430: rename d5/d10/d14/d2e/l80 to d5/d10/d14/d18/d3e/l9e 0 2024-04-19T02:18:32.037 INFO:tasks.workunit.client.0.smithi073.stdout:8/400: getdents d14/d15/d17 0 2024-04-19T02:18:32.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/382: mknod d8/d71/d7d/c89 0 2024-04-19T02:18:32.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/401: fsync d14/d27/d29/f51 0 2024-04-19T02:18:32.041 INFO:tasks.workunit.client.0.smithi073.stdout:3/523: truncate d3/d6/db/d1a/f9a 935902 0 2024-04-19T02:18:32.041 INFO:tasks.workunit.client.0.smithi073.stdout:6/383: write d8/f2e [639795,91] 0 2024-04-19T02:18:32.041 INFO:tasks.workunit.client.0.smithi073.stdout:2/431: creat d5/d10/d14/d18/d3e/d2d/d63/f9f x:0 0 0 2024-04-19T02:18:32.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/402: symlink d14/d27/l7c 0 2024-04-19T02:18:32.043 INFO:tasks.workunit.client.0.smithi073.stdout:0/371: dwrite d7/d14/f3e [0,4194304] 0 2024-04-19T02:18:32.044 INFO:tasks.workunit.client.0.smithi073.stdout:2/432: write d5/d10/d53/f73 [149485,111562] 0 2024-04-19T02:18:32.044 INFO:tasks.workunit.client.0.smithi073.stdout:8/403: creat d14/d27/d4c/f7d x:0 0 0 2024-04-19T02:18:32.046 INFO:tasks.workunit.client.0.smithi073.stdout:3/524: truncate d3/d6/db/d1a/f9a 1430525 0 2024-04-19T02:18:32.047 INFO:tasks.workunit.client.0.smithi073.stdout:5/499: dwrite d0/d1d/d24/f2e [0,4194304] 0 2024-04-19T02:18:32.048 INFO:tasks.workunit.client.0.smithi073.stdout:8/404: chown d14/d27/d29/f52 48 1 2024-04-19T02:18:32.048 INFO:tasks.workunit.client.0.smithi073.stdout:7/420: dwrite d0/dc/d67/f71 [0,4194304] 0 2024-04-19T02:18:32.049 INFO:tasks.workunit.client.0.smithi073.stdout:8/405: dread - d14/d27/d4c/f4f zero size 2024-04-19T02:18:32.049 INFO:tasks.workunit.client.0.smithi073.stdout:4/402: dwrite da/d27/d2c/f3c [0,4194304] 0 2024-04-19T02:18:32.049 INFO:tasks.workunit.client.0.smithi073.stdout:2/433: mkdir d5/d10/d14/d2e/da0 0 2024-04-19T02:18:32.050 INFO:tasks.workunit.client.0.smithi073.stdout:5/500: creat d0/d1d/d24/d62/fa6 x:0 0 0 2024-04-19T02:18:32.052 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:32.048+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:32.052 INFO:tasks.workunit.client.0.smithi073.stdout:7/421: creat d0/d28/d63/f7f x:0 0 0 2024-04-19T02:18:32.052 INFO:tasks.workunit.client.0.smithi073.stdout:6/384: dwrite d8/de/d22/f31 [4194304,4194304] 0 2024-04-19T02:18:32.053 INFO:tasks.workunit.client.0.smithi073.stdout:8/406: rename d14/f7a to d14/d15/f7e 0 2024-04-19T02:18:32.053 INFO:tasks.workunit.client.0.smithi073.stdout:3/525: truncate d3/f49 1004130 0 2024-04-19T02:18:32.053 INFO:tasks.workunit.client.0.smithi073.stdout:9/416: dread d0/df/d16/f64 [0,4194304] 0 2024-04-19T02:18:32.053 INFO:tasks.workunit.client.0.smithi073.stdout:9/417: stat d0/c1c 0 2024-04-19T02:18:32.057 INFO:tasks.workunit.client.0.smithi073.stdout:2/434: rmdir d5/d10/d29/d66/d67 39 2024-04-19T02:18:32.058 INFO:tasks.workunit.client.0.smithi073.stdout:0/372: write f2 [3476431,65301] 0 2024-04-19T02:18:32.058 INFO:tasks.workunit.client.0.smithi073.stdout:4/403: dread da/d27/d2c/f3c [0,4194304] 0 2024-04-19T02:18:32.058 INFO:tasks.workunit.client.0.smithi073.stdout:3/526: unlink d3/d6/db/d16/f74 0 2024-04-19T02:18:32.059 INFO:tasks.workunit.client.0.smithi073.stdout:7/422: rmdir d0 39 2024-04-19T02:18:32.059 INFO:tasks.workunit.client.0.smithi073.stdout:9/418: mkdir d0/df/d16/d19/d38/d5d/d6d/d97 0 2024-04-19T02:18:32.059 INFO:tasks.workunit.client.0.smithi073.stdout:1/414: dread db/d1c/d2c/f77 [0,4194304] 0 2024-04-19T02:18:32.060 INFO:tasks.workunit.client.0.smithi073.stdout:4/404: dread - da/d27/d36/f5e zero size 2024-04-19T02:18:32.061 INFO:tasks.workunit.client.0.smithi073.stdout:9/419: write d0/df/d16/f1e [408968,41584] 0 2024-04-19T02:18:32.061 INFO:tasks.workunit.client.0.smithi073.stdout:5/501: getdents d0/d1d/d90 0 2024-04-19T02:18:32.061 INFO:tasks.workunit.client.0.smithi073.stdout:0/373: chown d7/d14/d17/d1a/d21/f32 3710044 1 2024-04-19T02:18:32.061 INFO:tasks.workunit.client.0.smithi073.stdout:1/415: write db/f17 [1305248,23008] 0 2024-04-19T02:18:32.062 INFO:tasks.workunit.client.0.smithi073.stdout:8/407: dwrite d14/d27/d29/d31/d34/f3a [0,4194304] 0 2024-04-19T02:18:32.066 INFO:tasks.workunit.client.0.smithi073.stdout:6/385: dwrite d8/de/d35/f65 [0,4194304] 0 2024-04-19T02:18:32.066 INFO:tasks.workunit.client.0.smithi073.stdout:7/423: getdents d0/dc/d33/d36/d7b 0 2024-04-19T02:18:32.066 INFO:tasks.workunit.client.0.smithi073.stdout:1/416: rename db/d41/f68 to db/d1c/d2c/d50/f94 0 2024-04-19T02:18:32.066 INFO:tasks.workunit.client.0.smithi073.stdout:8/408: mknod d14/d27/d29/d31/d34/c7f 0 2024-04-19T02:18:32.066 INFO:tasks.workunit.client.0.smithi073.stdout:5/502: mkdir d0/d1d/d25/d35/d88/da7 0 2024-04-19T02:18:32.067 INFO:tasks.workunit.client.0.smithi073.stdout:0/374: rmdir d7/d14/d17/d1a/d20/d50/d60 0 2024-04-19T02:18:32.067 INFO:tasks.workunit.client.0.smithi073.stdout:0/375: sync 2024-04-19T02:18:32.069 INFO:tasks.workunit.client.0.smithi073.stdout:5/503: chown d0/d1d/d1e/f33 2 1 2024-04-19T02:18:32.069 INFO:tasks.workunit.client.0.smithi073.stdout:1/417: write db/d1c/d2c/f45 [3302197,89257] 0 2024-04-19T02:18:32.069 INFO:tasks.workunit.client.0.smithi073.stdout:8/409: symlink d14/d27/d29/d31/l80 0 2024-04-19T02:18:32.070 INFO:tasks.workunit.client.0.smithi073.stdout:0/376: symlink d7/d14/d17/d1a/d56/l76 0 2024-04-19T02:18:32.070 INFO:tasks.workunit.client.0.smithi073.stdout:3/527: dwrite d3/d6/db/d1a/d2f/f87 [4194304,4194304] 0 2024-04-19T02:18:32.071 INFO:tasks.workunit.client.0.smithi073.stdout:2/435: dwrite d5/d10/d29/d42/f6e [0,4194304] 0 2024-04-19T02:18:32.071 INFO:tasks.workunit.client.0.smithi073.stdout:1/418: mkdir db/d1c/d95 0 2024-04-19T02:18:32.071 INFO:tasks.workunit.client.0.smithi073.stdout:6/386: fdatasync d8/f16 0 2024-04-19T02:18:32.072 INFO:tasks.workunit.client.0.smithi073.stdout:5/504: write d0/d1d/f82 [644493,41308] 0 2024-04-19T02:18:32.072 INFO:tasks.workunit.client.0.smithi073.stdout:0/377: mknod d7/d14/d17/d70/c77 0 2024-04-19T02:18:32.072 INFO:tasks.workunit.client.0.smithi073.stdout:4/405: dread da/d27/d1b/d26/f4a [0,4194304] 0 2024-04-19T02:18:32.072 INFO:tasks.workunit.client.0.smithi073.stdout:8/410: write d14/d27/d29/d31/f3e [1385524,110910] 0 2024-04-19T02:18:32.073 INFO:tasks.workunit.client.0.smithi073.stdout:7/424: dread d0/dc/d39/d40/f44 [0,4194304] 0 2024-04-19T02:18:32.073 INFO:tasks.workunit.client.0.smithi073.stdout:4/406: chown da/d27/d2c 617 1 2024-04-19T02:18:32.073 INFO:tasks.workunit.client.0.smithi073.stdout:9/420: dwrite d0/df/d16/d19/d38/d5d/d45/f7a [0,4194304] 0 2024-04-19T02:18:32.074 INFO:tasks.workunit.client.0.smithi073.stdout:6/387: write d8/de/d35/f65 [3784419,55125] 0 2024-04-19T02:18:32.074 INFO:tasks.workunit.client.0.smithi073.stdout:1/419: rename db/d3e/f82 to db/d3e/f96 0 2024-04-19T02:18:32.074 INFO:tasks.workunit.client.0.smithi073.stdout:7/425: fsync d0/dc/d67/d15/f56 0 2024-04-19T02:18:32.074 INFO:tasks.workunit.client.0.smithi073.stdout:8/411: fsync d14/d15/d17/d48/f59 0 2024-04-19T02:18:32.075 INFO:tasks.workunit.client.0.smithi073.stdout:3/528: mknod d3/d6/db/d23/cae 0 2024-04-19T02:18:32.076 INFO:tasks.workunit.client.0.smithi073.stdout:1/420: creat db/d3e/f97 x:0 0 0 2024-04-19T02:18:32.076 INFO:tasks.workunit.client.0.smithi073.stdout:6/388: unlink d8/de/d35/f49 0 2024-04-19T02:18:32.076 INFO:tasks.workunit.client.0.smithi073.stdout:7/426: write d0/f7 [4630669,70234] 0 2024-04-19T02:18:32.077 INFO:tasks.workunit.client.0.smithi073.stdout:4/407: unlink da/d27/d1b/d26/d2a/d46/l83 0 2024-04-19T02:18:32.077 INFO:tasks.workunit.client.0.smithi073.stdout:8/412: rename d14/d27/c60 to d14/d15/c81 0 2024-04-19T02:18:32.078 INFO:tasks.workunit.client.0.smithi073.stdout:7/427: fdatasync d0/dc/d67/d2a/d51/f54 0 2024-04-19T02:18:32.078 INFO:tasks.workunit.client.0.smithi073.stdout:1/421: symlink db/d1c/d78/l98 0 2024-04-19T02:18:32.079 INFO:tasks.workunit.client.0.smithi073.stdout:3/529: mkdir d3/d6/db/d3a/d38/d6f/daf 0 2024-04-19T02:18:32.079 INFO:tasks.workunit.client.0.smithi073.stdout:4/408: fdatasync f1 0 2024-04-19T02:18:32.079 INFO:tasks.workunit.client.0.smithi073.stdout:7/428: unlink d0/d28/c3d 0 2024-04-19T02:18:32.080 INFO:tasks.workunit.client.0.smithi073.stdout:9/421: getdents d0/df/d16 0 2024-04-19T02:18:32.080 INFO:tasks.workunit.client.0.smithi073.stdout:8/413: truncate d14/d15/d17/f77 297499 0 2024-04-19T02:18:32.080 INFO:tasks.workunit.client.0.smithi073.stdout:1/422: creat db/d1c/d2c/f99 x:0 0 0 2024-04-19T02:18:32.080 INFO:tasks.workunit.client.0.smithi073.stdout:0/378: dwrite d7/f11 [0,4194304] 0 2024-04-19T02:18:32.082 INFO:tasks.workunit.client.0.smithi073.stdout:4/409: rename da/d27/d1b/d1d/d72/d2b/d54 to da/d27/d1b/d1d/d8d 0 2024-04-19T02:18:32.083 INFO:tasks.workunit.client.0.smithi073.stdout:3/530: write d3/d6/db/d1a/d54/f81 [1426953,55763] 0 2024-04-19T02:18:32.084 INFO:tasks.workunit.client.0.smithi073.stdout:0/379: creat d7/d14/d17/d1a/d56/f78 x:0 0 0 2024-04-19T02:18:32.085 INFO:tasks.workunit.client.0.smithi073.stdout:4/410: fdatasync da/f16 0 2024-04-19T02:18:32.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/505: dwrite d0/d1d/d25/d37/d71/f9f [0,4194304] 0 2024-04-19T02:18:32.085 INFO:tasks.workunit.client.0.smithi073.stdout:9/422: rename d0/df/d16/l28 to d0/df/d60/d72/d8e/l98 0 2024-04-19T02:18:32.086 INFO:tasks.workunit.client.0.smithi073.stdout:0/380: dread - d7/d14/d17/d1a/d21/f64 zero size 2024-04-19T02:18:32.086 INFO:tasks.workunit.client.0.smithi073.stdout:4/411: chown da/d27/d1b/d1d/f29 9532379 1 2024-04-19T02:18:32.086 INFO:tasks.workunit.client.0.smithi073.stdout:3/531: truncate d3/d6/db/f66 1940520 0 2024-04-19T02:18:32.086 INFO:tasks.workunit.client.0.smithi073.stdout:4/412: sync 2024-04-19T02:18:32.087 INFO:tasks.workunit.client.0.smithi073.stdout:9/423: dread - d0/df/d16/d1a/d2c/f46 zero size 2024-04-19T02:18:32.088 INFO:tasks.workunit.client.0.smithi073.stdout:3/532: unlink d3/d6/l80 0 2024-04-19T02:18:32.088 INFO:tasks.workunit.client.0.smithi073.stdout:9/424: fdatasync d0/df/d1d/f2f 0 2024-04-19T02:18:32.088 INFO:tasks.workunit.client.0.smithi073.stdout:4/413: fsync da/d27/d2c/f30 0 2024-04-19T02:18:32.089 INFO:tasks.workunit.client.0.smithi073.stdout:2/436: write d5/d10/d14/d18/f22 [448267,108172] 0 2024-04-19T02:18:32.089 INFO:tasks.workunit.client.0.smithi073.stdout:3/533: fsync d3/d6/fd 0 2024-04-19T02:18:32.091 INFO:tasks.workunit.client.0.smithi073.stdout:9/425: readlink d0/df/d16/d19/d38/l59 0 2024-04-19T02:18:32.091 INFO:tasks.workunit.client.0.smithi073.stdout:6/389: dwrite d8/de/d35/f62 [0,4194304] 0 2024-04-19T02:18:32.092 INFO:tasks.workunit.client.0.smithi073.stdout:1/423: dwrite db/d1c/d2c/d50/f6d [0,4194304] 0 2024-04-19T02:18:32.092 INFO:tasks.workunit.client.0.smithi073.stdout:0/381: read d7/d14/d17/d1a/d21/f40 [4328129,96146] 0 2024-04-19T02:18:32.092 INFO:tasks.workunit.client.0.smithi073.stdout:7/429: read d0/dc/d67/f31 [4046038,46302] 0 2024-04-19T02:18:32.092 INFO:tasks.workunit.client.0.smithi073.stdout:2/437: unlink d5/d10/d14/d18/d3e/d2d/d63/l84 0 2024-04-19T02:18:32.093 INFO:tasks.workunit.client.0.smithi073.stdout:6/390: readlink d8/de/d35/d60/l55 0 2024-04-19T02:18:32.093 INFO:tasks.workunit.client.0.smithi073.stdout:3/534: fdatasync d3/d6/f22 0 2024-04-19T02:18:32.094 INFO:tasks.workunit.client.0.smithi073.stdout:2/438: read - d5/d10/d14/d18/d3e/d2d/d63/f9f zero size 2024-04-19T02:18:32.094 INFO:tasks.workunit.client.0.smithi073.stdout:8/414: dwrite d14/d27/d50/f63 [4194304,4194304] 0 2024-04-19T02:18:32.094 INFO:tasks.workunit.client.0.smithi073.stdout:7/430: mkdir d0/dc/d33/d36/d7b/d80 0 2024-04-19T02:18:32.095 INFO:tasks.workunit.client.0.smithi073.stdout:0/382: write d7/d14/d17/d1a/d21/f5e [205103,39507] 0 2024-04-19T02:18:32.095 INFO:tasks.workunit.client.0.smithi073.stdout:6/391: getdents d8/d71/d75 0 2024-04-19T02:18:32.095 INFO:tasks.workunit.client.0.smithi073.stdout:3/535: mknod d3/d6/db/d1a/cb0 0 2024-04-19T02:18:32.095 INFO:tasks.workunit.client.0.smithi073.stdout:9/426: getdents d0/df/d16/d19/d38/d5d/d76 0 2024-04-19T02:18:32.095 INFO:tasks.workunit.client.0.smithi073.stdout:2/439: chown d5/d10/d29/l5c 1044545690 1 2024-04-19T02:18:32.095 INFO:tasks.workunit.client.0.smithi073.stdout:1/424: link db/d1c/d54/l73 db/d1c/d2c/l9a 0 2024-04-19T02:18:32.096 INFO:tasks.workunit.client.0.smithi073.stdout:8/415: rename d14/d27/l7c to d14/d27/d29/d69/l82 0 2024-04-19T02:18:32.096 INFO:tasks.workunit.client.0.smithi073.stdout:2/440: mknod d5/ca1 0 2024-04-19T02:18:32.096 INFO:tasks.workunit.client.0.smithi073.stdout:3/536: readlink d3/d6/db/d1a/l61 0 2024-04-19T02:18:32.096 INFO:tasks.workunit.client.0.smithi073.stdout:9/427: write d0/df/d16/d19/d38/f96 [640932,5187] 0 2024-04-19T02:18:32.097 INFO:tasks.workunit.client.0.smithi073.stdout:1/425: rename db/d1c/d2c/f99 to db/d7f/f9b 0 2024-04-19T02:18:32.098 INFO:tasks.workunit.client.0.smithi073.stdout:9/428: unlink d0/df/d16/d19/d38/f96 0 2024-04-19T02:18:32.101 INFO:tasks.workunit.client.0.smithi073.stdout:0/383: dread d7/f11 [0,4194304] 0 2024-04-19T02:18:32.101 INFO:tasks.workunit.client.0.smithi073.stdout:1/426: chown db/d3e/d6f/l76 1718693 1 2024-04-19T02:18:32.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/429: stat d0/df/d16/d1a/d2c/d2e/f53 0 2024-04-19T02:18:32.101 INFO:tasks.workunit.client.0.smithi073.stdout:7/431: chown d0/dc/d67/d15/c42 1435 1 2024-04-19T02:18:32.101 INFO:tasks.workunit.client.0.smithi073.stdout:1/427: fsync db/d41/f84 0 2024-04-19T02:18:32.103 INFO:tasks.workunit.client.0.smithi073.stdout:7/432: write d0/d28/d63/f7f [839922,16038] 0 2024-04-19T02:18:32.103 INFO:tasks.workunit.client.0.smithi073.stdout:6/392: dwrite d8/de/d35/f5b [0,4194304] 0 2024-04-19T02:18:32.103 INFO:tasks.workunit.client.0.smithi073.stdout:2/441: dread d5/d10/d14/d18/d3e/f32 [0,4194304] 0 2024-04-19T02:18:32.104 INFO:tasks.workunit.client.0.smithi073.stdout:4/414: dwrite da/d27/d2c/f30 [0,4194304] 0 2024-04-19T02:18:32.104 INFO:tasks.workunit.client.0.smithi073.stdout:9/430: creat d0/df/d16/d19/d38/d5d/d5e/d83/f99 x:0 0 0 2024-04-19T02:18:32.104 INFO:tasks.workunit.client.0.smithi073.stdout:7/433: chown d0/l53 88417146 1 2024-04-19T02:18:32.106 INFO:tasks.workunit.client.0.smithi073.stdout:6/393: fdatasync d8/de/f67 0 2024-04-19T02:18:32.108 INFO:tasks.workunit.client.0.smithi073.stdout:7/434: truncate d0/dc/d67/d2a/d51/f6c 512934 0 2024-04-19T02:18:32.109 INFO:tasks.workunit.client.0.smithi073.stdout:2/442: mkdir d5/d10/d14/d18/d3e/d2d/d63/da2 0 2024-04-19T02:18:32.109 INFO:tasks.workunit.client.0.smithi073.stdout:8/416: truncate d14/d27/d29/d31/f3e 269808 0 2024-04-19T02:18:32.109 INFO:tasks.workunit.client.0.smithi073.stdout:7/435: mknod d0/d28/c81 0 2024-04-19T02:18:32.111 INFO:tasks.workunit.client.0.smithi073.stdout:8/417: mknod d14/d27/d4c/d75/c83 0 2024-04-19T02:18:32.111 INFO:tasks.workunit.client.0.smithi073.stdout:0/384: dwrite d7/d14/d17/d1a/d21/f5b [0,4194304] 0 2024-04-19T02:18:32.111 INFO:tasks.workunit.client.0.smithi073.stdout:4/415: dwrite da/d27/d36/f51 [0,4194304] 0 2024-04-19T02:18:32.112 INFO:tasks.workunit.client.0.smithi073.stdout:8/418: mknod d14/d15/d17/c84 0 2024-04-19T02:18:32.114 INFO:tasks.workunit.client.0.smithi073.stdout:0/385: symlink d7/d14/d17/d1a/d56/d6f/l79 0 2024-04-19T02:18:32.114 INFO:tasks.workunit.client.0.smithi073.stdout:7/436: unlink d0/dc/d67/c11 0 2024-04-19T02:18:32.114 INFO:tasks.workunit.client.0.smithi073.stdout:8/419: chown d14/d27/d4c/f7d 49 1 2024-04-19T02:18:32.114 INFO:tasks.workunit.client.0.smithi073.stdout:4/416: link da/d27/d3a/d50/f61 da/d27/d2c/d80/f8e 0 2024-04-19T02:18:32.115 INFO:tasks.workunit.client.0.smithi073.stdout:8/420: chown d14/d15/d17/c22 1428134 1 2024-04-19T02:18:32.116 INFO:tasks.workunit.client.0.smithi073.stdout:4/417: fsync da/d27/d3a/d50/f8b 0 2024-04-19T02:18:32.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/443: rename d5/d10/d29/d66/d67/d72/f37 to d5/d10/d29/d42/fa3 0 2024-04-19T02:18:32.117 INFO:tasks.workunit.client.0.smithi073.stdout:8/421: write d14/d15/f42 [471310,29274] 0 2024-04-19T02:18:32.118 INFO:tasks.workunit.client.0.smithi073.stdout:2/444: dread - d5/d10/d14/d18/d3e/f85 zero size 2024-04-19T02:18:32.118 INFO:tasks.workunit.client.0.smithi073.stdout:8/422: unlink d14/d27/d29/d31/f3f 0 2024-04-19T02:18:32.119 INFO:tasks.workunit.client.0.smithi073.stdout:6/394: dwrite d8/de/f47 [0,4194304] 0 2024-04-19T02:18:32.120 INFO:tasks.workunit.client.0.smithi073.stdout:9/431: dwrite d0/df/d16/d19/d38/d5d/f4e [0,4194304] 0 2024-04-19T02:18:32.120 INFO:tasks.workunit.client.0.smithi073.stdout:2/445: write d5/d10/d14/f21 [365896,78967] 0 2024-04-19T02:18:32.120 INFO:tasks.workunit.client.0.smithi073.stdout:8/423: mkdir d14/d27/d85 0 2024-04-19T02:18:32.120 INFO:tasks.workunit.client.0.smithi073.stdout:6/395: rename d8/de/d22/f31 to d8/d71/d75/f8a 0 2024-04-19T02:18:32.120 INFO:tasks.workunit.client.0.smithi073.stdout:0/386: truncate d7/d14/f15 948346 0 2024-04-19T02:18:32.121 INFO:tasks.workunit.client.0.smithi073.stdout:2/446: write d5/d10/d14/d18/d3e/d51/f79 [1037328,106807] 0 2024-04-19T02:18:32.122 INFO:tasks.workunit.client.0.smithi073.stdout:8/424: symlink d14/d27/d4c/l86 0 2024-04-19T02:18:32.122 INFO:tasks.workunit.client.0.smithi073.stdout:0/387: creat d7/d14/d17/d1a/d20/f7a x:0 0 0 2024-04-19T02:18:32.123 INFO:tasks.workunit.client.0.smithi073.stdout:2/447: link d5/d10/d29/d42/f6e d5/d10/d14/d7a/fa4 0 2024-04-19T02:18:32.123 INFO:tasks.workunit.client.0.smithi073.stdout:0/388: creat d7/d14/d17/d69/f7b x:0 0 0 2024-04-19T02:18:32.123 INFO:tasks.workunit.client.0.smithi073.stdout:9/432: mkdir d0/df/d16/d19/d38/d5d/d5e/d83/d9a 0 2024-04-19T02:18:32.124 INFO:tasks.workunit.client.0.smithi073.stdout:8/425: getdents d14/d27/d29/d31/d34 0 2024-04-19T02:18:32.124 INFO:tasks.workunit.client.0.smithi073.stdout:8/426: write d14/d15/f55 [440540,66750] 0 2024-04-19T02:18:32.125 INFO:tasks.workunit.client.0.smithi073.stdout:0/389: unlink d7/d14/d17/d1a/d56/l75 0 2024-04-19T02:18:32.125 INFO:tasks.workunit.client.0.smithi073.stdout:2/448: link d5/c57 d5/d10/d14/d7a/ca5 0 2024-04-19T02:18:32.125 INFO:tasks.workunit.client.0.smithi073.stdout:8/427: mkdir d14/d87 0 2024-04-19T02:18:32.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/433: rmdir d0/df/d16/d19/d38/d5d/d5e/d89 0 2024-04-19T02:18:32.127 INFO:tasks.workunit.client.0.smithi073.stdout:0/390: write d7/d14/d17/d1a/d21/f58 [2708836,115492] 0 2024-04-19T02:18:32.127 INFO:tasks.workunit.client.0.smithi073.stdout:3/537: dread d3/d6/db/d1a/f9a [0,4194304] 0 2024-04-19T02:18:32.128 INFO:tasks.workunit.client.0.smithi073.stdout:6/396: dwrite d8/de/d35/d60/f4f [0,4194304] 0 2024-04-19T02:18:32.128 INFO:tasks.workunit.client.0.smithi073.stdout:0/391: stat d7/d14/d17/d70/f72 0 2024-04-19T02:18:32.128 INFO:tasks.workunit.client.0.smithi073.stdout:2/449: mknod d5/d10/d14/d18/ca6 0 2024-04-19T02:18:32.129 INFO:tasks.workunit.client.0.smithi073.stdout:7/437: truncate d0/dc/d33/d36/f3b 224397 0 2024-04-19T02:18:32.129 INFO:tasks.workunit.client.0.smithi073.stdout:8/428: creat d14/d27/d29/d31/d34/f88 x:0 0 0 2024-04-19T02:18:32.130 INFO:tasks.workunit.client.0.smithi073.stdout:8/429: write d14/d15/f1e [384136,92096] 0 2024-04-19T02:18:32.130 INFO:tasks.workunit.client.0.smithi073.stdout:0/392: write d7/d14/d17/d1a/d20/f4c [4375456,126721] 0 2024-04-19T02:18:32.131 INFO:tasks.workunit.client.0.smithi073.stdout:2/450: creat d5/d10/fa7 x:0 0 0 2024-04-19T02:18:32.131 INFO:tasks.workunit.client.0.smithi073.stdout:8/430: fsync f12 0 2024-04-19T02:18:32.131 INFO:tasks.workunit.client.0.smithi073.stdout:6/397: rename d8/de/d35/d60/c52 to d8/de/d35/d60/c8b 0 2024-04-19T02:18:32.132 INFO:tasks.workunit.client.0.smithi073.stdout:0/393: write d7/f67 [388991,83103] 0 2024-04-19T02:18:32.132 INFO:tasks.workunit.client.0.smithi073.stdout:3/538: getdents d3/d6/db/d16/d52 0 2024-04-19T02:18:32.132 INFO:tasks.workunit.client.0.smithi073.stdout:8/431: mkdir d14/d15/d17/d48/d89 0 2024-04-19T02:18:32.132 INFO:tasks.workunit.client.0.smithi073.stdout:6/398: chown d8/d71/d7d/f87 247166344 1 2024-04-19T02:18:32.132 INFO:tasks.workunit.client.0.smithi073.stdout:2/451: link d5/ca1 d5/ca8 0 2024-04-19T02:18:32.133 INFO:tasks.workunit.client.0.smithi073.stdout:2/452: readlink d5/d10/d14/l28 0 2024-04-19T02:18:32.133 INFO:tasks.workunit.client.0.smithi073.stdout:6/399: readlink d8/de/d35/d60/l43 0 2024-04-19T02:18:32.134 INFO:tasks.workunit.client.0.smithi073.stdout:8/432: symlink d14/d27/d4c/d75/l8a 0 2024-04-19T02:18:32.134 INFO:tasks.workunit.client.0.smithi073.stdout:0/394: truncate d7/d14/d17/d1a/d21/f63 3917072 0 2024-04-19T02:18:32.134 INFO:tasks.workunit.client.0.smithi073.stdout:6/400: rmdir d8/d4b 39 2024-04-19T02:18:32.134 INFO:tasks.workunit.client.0.smithi073.stdout:6/401: mknod d8/de/d22/c8c 0 2024-04-19T02:18:32.135 INFO:tasks.workunit.client.0.smithi073.stdout:0/395: mkdir d7/d14/d17/d69/d7c 0 2024-04-19T02:18:32.135 INFO:tasks.workunit.client.0.smithi073.stdout:0/396: sync 2024-04-19T02:18:32.135 INFO:tasks.workunit.client.0.smithi073.stdout:5/506: read d0/f9 [582640,99] 0 2024-04-19T02:18:32.135 INFO:tasks.workunit.client.0.smithi073.stdout:6/402: creat d8/d71/d75/f8d x:0 0 0 2024-04-19T02:18:32.137 INFO:tasks.workunit.client.0.smithi073.stdout:3/539: dread d3/d6/db/d16/d52/f8f [0,4194304] 0 2024-04-19T02:18:32.137 INFO:tasks.workunit.client.0.smithi073.stdout:0/397: creat d7/d14/d17/d1a/f7d x:0 0 0 2024-04-19T02:18:32.137 INFO:tasks.workunit.client.0.smithi073.stdout:0/398: readlink d7/l38 0 2024-04-19T02:18:32.139 INFO:tasks.workunit.client.0.smithi073.stdout:3/540: write d3/d6/db/d3a/d5f/fa3 [970368,54294] 0 2024-04-19T02:18:32.139 INFO:tasks.workunit.client.0.smithi073.stdout:0/399: write d7/d14/d17/d1a/d21/f5e [803160,73238] 0 2024-04-19T02:18:32.139 INFO:tasks.workunit.client.0.smithi073.stdout:2/453: dwrite d5/d10/d14/f2c [0,4194304] 0 2024-04-19T02:18:32.140 INFO:tasks.workunit.client.0.smithi073.stdout:0/400: write d7/d14/d17/d1a/d21/f53 [194285,42042] 0 2024-04-19T02:18:32.141 INFO:tasks.workunit.client.0.smithi073.stdout:3/541: symlink d3/d6/db/d3a/d38/d6f/daf/lb1 0 2024-04-19T02:18:32.141 INFO:tasks.workunit.client.0.smithi073.stdout:3/542: unlink d3/f41 0 2024-04-19T02:18:32.142 INFO:tasks.workunit.client.0.smithi073.stdout:0/401: creat d7/d14/d17/d1a/f7e x:0 0 0 2024-04-19T02:18:32.143 INFO:tasks.workunit.client.0.smithi073.stdout:0/402: truncate d7/d14/f2d 1109328 0 2024-04-19T02:18:32.146 INFO:tasks.workunit.client.0.smithi073.stdout:5/507: dwrite d0/d1d/d25/d35/d39/f7f [0,4194304] 0 2024-04-19T02:18:32.147 INFO:tasks.workunit.client.0.smithi073.stdout:5/508: creat d0/d1d/d1e/fa8 x:0 0 0 2024-04-19T02:18:32.148 INFO:tasks.workunit.client.0.smithi073.stdout:5/509: link d0/d1d/d25/d37/l58 d0/d1d/d24/d62/la9 0 2024-04-19T02:18:32.149 INFO:tasks.workunit.client.0.smithi073.stdout:5/510: write d0/d1d/d25/d37/f3e [5172980,87973] 0 2024-04-19T02:18:32.150 INFO:tasks.workunit.client.0.smithi073.stdout:2/454: dwrite d5/d10/d29/d66/d67/d72/f2f [0,4194304] 0 2024-04-19T02:18:32.150 INFO:tasks.workunit.client.0.smithi073.stdout:2/455: fdatasync d5/d10/d53/f92 0 2024-04-19T02:18:32.152 INFO:tasks.workunit.client.0.smithi073.stdout:6/403: truncate d8/d71/d7d/f87 115848 0 2024-04-19T02:18:32.152 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:32.151+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:32.155 INFO:tasks.workunit.client.0.smithi073.stdout:6/404: write d8/de/d35/f5d [805988,115650] 0 2024-04-19T02:18:32.155 INFO:tasks.workunit.client.0.smithi073.stdout:5/511: rename d0/d1d/d1e/c22 to d0/d1d/d25/d37/caa 0 2024-04-19T02:18:32.155 INFO:tasks.workunit.client.0.smithi073.stdout:5/512: rmdir d0/d2d 39 2024-04-19T02:18:32.155 INFO:tasks.workunit.client.0.smithi073.stdout:5/513: dread - d0/d1d/d25/d37/d71/f7b zero size 2024-04-19T02:18:32.155 INFO:tasks.workunit.client.0.smithi073.stdout:5/514: fsync d0/f1b 0 2024-04-19T02:18:32.156 INFO:tasks.workunit.client.0.smithi073.stdout:0/403: dwrite d7/d14/d17/d1a/d21/f63 [0,4194304] 0 2024-04-19T02:18:32.157 INFO:tasks.workunit.client.0.smithi073.stdout:0/404: fsync d7/d14/d17/d1a/f46 0 2024-04-19T02:18:32.158 INFO:tasks.workunit.client.0.smithi073.stdout:0/405: write d7/d14/d17/d1a/d20/f6c [432377,74540] 0 2024-04-19T02:18:32.160 INFO:tasks.workunit.client.0.smithi073.stdout:0/406: symlink d7/d14/d17/l7f 0 2024-04-19T02:18:32.160 INFO:tasks.workunit.client.0.smithi073.stdout:1/428: dread db/d41/f4c [0,4194304] 0 2024-04-19T02:18:32.160 INFO:tasks.workunit.client.0.smithi073.stdout:5/515: dread d0/d1d/d25/d35/f42 [0,4194304] 0 2024-04-19T02:18:32.161 INFO:tasks.workunit.client.0.smithi073.stdout:1/429: symlink db/d1c/d81/d83/l9c 0 2024-04-19T02:18:32.161 INFO:tasks.workunit.client.0.smithi073.stdout:0/407: link d7/d14/d17/d69/f6a d7/d14/d17/d69/f80 0 2024-04-19T02:18:32.161 INFO:tasks.workunit.client.0.smithi073.stdout:5/516: truncate d0/d1d/d24/d62/f92 997305 0 2024-04-19T02:18:32.163 INFO:tasks.workunit.client.0.smithi073.stdout:2/456: write d5/d10/d29/d66/d67/f4f [8081505,112326] 0 2024-04-19T02:18:32.163 INFO:tasks.workunit.client.0.smithi073.stdout:2/457: chown d5/d10/d14 437 1 2024-04-19T02:18:32.164 INFO:tasks.workunit.client.0.smithi073.stdout:6/405: write d8/de/f1f [1153895,42631] 0 2024-04-19T02:18:32.164 INFO:tasks.workunit.client.0.smithi073.stdout:4/418: read da/d27/f39 [1471673,11293] 0 2024-04-19T02:18:32.164 INFO:tasks.workunit.client.0.smithi073.stdout:2/458: symlink d5/d10/la9 0 2024-04-19T02:18:32.165 INFO:tasks.workunit.client.0.smithi073.stdout:9/434: dread d0/df/d16/d1a/d2c/d2e/f53 [0,4194304] 0 2024-04-19T02:18:32.165 INFO:tasks.workunit.client.0.smithi073.stdout:9/435: chown d0 512902805 1 2024-04-19T02:18:32.167 INFO:tasks.workunit.client.0.smithi073.stdout:4/419: chown da/d27/d1b/d26/d2a/d46/c70 130494810 1 2024-04-19T02:18:32.168 INFO:tasks.workunit.client.0.smithi073.stdout:2/459: rename d5/d10/d14/d2e/f54 to d5/d10/d29/d66/d83/faa 0 2024-04-19T02:18:32.170 INFO:tasks.workunit.client.0.smithi073.stdout:5/517: dwrite d0/d1d/d24/d62/f92 [0,4194304] 0 2024-04-19T02:18:32.170 INFO:tasks.workunit.client.0.smithi073.stdout:1/430: dwrite db/f13 [0,4194304] 0 2024-04-19T02:18:32.170 INFO:tasks.workunit.client.0.smithi073.stdout:0/408: dwrite d7/d14/d17/d1a/d20/f6c [0,4194304] 0 2024-04-19T02:18:32.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/420: creat da/d27/d1b/d26/d2a/d46/f8f x:0 0 0 2024-04-19T02:18:32.172 INFO:tasks.workunit.client.0.smithi073.stdout:9/436: rename d0/df/d16/d1a/d2c/d2e/f7b to d0/df/d16/d19/d38/f9b 0 2024-04-19T02:18:32.172 INFO:tasks.workunit.client.0.smithi073.stdout:5/518: fdatasync d0/f4f 0 2024-04-19T02:18:32.172 INFO:tasks.workunit.client.0.smithi073.stdout:9/437: stat d0/df/d16 0 2024-04-19T02:18:32.173 INFO:tasks.workunit.client.0.smithi073.stdout:0/409: unlink d7/d14/d17/l6e 0 2024-04-19T02:18:32.173 INFO:tasks.workunit.client.0.smithi073.stdout:4/421: mknod da/d27/d2c/c90 0 2024-04-19T02:18:32.174 INFO:tasks.workunit.client.0.smithi073.stdout:1/431: mknod db/d1c/d95/c9d 0 2024-04-19T02:18:32.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/406: dwrite d8/de/d58/f33 [0,4194304] 0 2024-04-19T02:18:32.174 INFO:tasks.workunit.client.0.smithi073.stdout:5/519: getdents d0/d69 0 2024-04-19T02:18:32.174 INFO:tasks.workunit.client.0.smithi073.stdout:1/432: sync 2024-04-19T02:18:32.175 INFO:tasks.workunit.client.0.smithi073.stdout:5/520: fsync d0/d1d/d25/d35/f4b 0 2024-04-19T02:18:32.175 INFO:tasks.workunit.client.0.smithi073.stdout:6/407: write d8/de/d58/d63/f74 [830239,19591] 0 2024-04-19T02:18:32.176 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:32.176 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:32.177 INFO:tasks.workunit.client.0.smithi073.stdout:5/521: truncate d0/d1d/d25/f6e 634948 0 2024-04-19T02:18:32.177 INFO:tasks.workunit.client.0.smithi073.stdout:6/408: truncate d8/de/f4d 4434429 0 2024-04-19T02:18:32.178 INFO:tasks.workunit.client.0.smithi073.stdout:5/522: fdatasync d0/d1d/d25/d37/d71/f73 0 2024-04-19T02:18:32.179 INFO:tasks.workunit.client.0.smithi073.stdout:6/409: chown d8/de/d35/f3d 10 1 2024-04-19T02:18:32.180 INFO:tasks.workunit.client.0.smithi073.stdout:5/523: creat d0/d69/fab x:0 0 0 2024-04-19T02:18:32.180 INFO:tasks.workunit.client.0.smithi073.stdout:6/410: stat d8/d4b/c72 0 2024-04-19T02:18:32.181 INFO:tasks.workunit.client.0.smithi073.stdout:9/438: dwrite d0/df/d16/d1a/d2c/d2e/f53 [0,4194304] 0 2024-04-19T02:18:32.181 INFO:tasks.workunit.client.0.smithi073.stdout:8/433: dread d14/d27/d29/d31/d34/f40 [0,4194304] 0 2024-04-19T02:18:32.181 INFO:tasks.workunit.client.0.smithi073.stdout:4/422: dwrite f1 [0,4194304] 0 2024-04-19T02:18:32.181 INFO:tasks.workunit.client.0.smithi073.stdout:5/524: mkdir d0/d2d/dac 0 2024-04-19T02:18:32.182 INFO:tasks.workunit.client.0.smithi073.stdout:6/411: stat d8/de/d22/c5e 0 2024-04-19T02:18:32.182 INFO:tasks.workunit.client.0.smithi073.stdout:8/434: unlink d14/d27/d50/f63 0 2024-04-19T02:18:32.182 INFO:tasks.workunit.client.0.smithi073.stdout:9/439: mknod d0/df/d16/d1a/d2c/c9c 0 2024-04-19T02:18:32.183 INFO:tasks.workunit.client.0.smithi073.stdout:6/412: mknod d8/de/d78/c8e 0 2024-04-19T02:18:32.183 INFO:tasks.workunit.client.0.smithi073.stdout:8/435: creat d14/d27/d4c/f8b x:0 0 0 2024-04-19T02:18:32.183 INFO:tasks.workunit.client.0.smithi073.stdout:8/436: sync 2024-04-19T02:18:32.183 INFO:tasks.workunit.client.0.smithi073.stdout:9/440: symlink d0/df/d16/d1a/d2c/l9d 0 2024-04-19T02:18:32.183 INFO:tasks.workunit.client.0.smithi073.stdout:8/437: chown d14/d27/d4c/f76 31582461 1 2024-04-19T02:18:32.184 INFO:tasks.workunit.client.0.smithi073.stdout:9/441: mknod d0/df/c9e 0 2024-04-19T02:18:32.184 INFO:tasks.workunit.client.0.smithi073.stdout:8/438: write d14/d27/d29/d31/f74 [280285,24669] 0 2024-04-19T02:18:32.184 INFO:tasks.workunit.client.0.smithi073.stdout:8/439: sync 2024-04-19T02:18:32.185 INFO:tasks.workunit.client.0.smithi073.stdout:8/440: truncate f11 732564 0 2024-04-19T02:18:32.186 INFO:tasks.workunit.client.0.smithi073.stdout:8/441: creat d14/d27/d29/d69/f8c x:0 0 0 2024-04-19T02:18:32.187 INFO:tasks.workunit.client.0.smithi073.stdout:8/442: write d14/d15/d17/f77 [4846,128249] 0 2024-04-19T02:18:32.188 INFO:tasks.workunit.client.0.smithi073.stdout:5/525: dwrite d0/d1d/d1e/f55 [0,4194304] 0 2024-04-19T02:18:32.188 INFO:tasks.workunit.client.0.smithi073.stdout:8/443: chown d14/d27/d4c/l86 0 1 2024-04-19T02:18:32.189 INFO:tasks.workunit.client.0.smithi073.stdout:8/444: mkdir d14/d15/d17/d8d 0 2024-04-19T02:18:32.190 INFO:tasks.workunit.client.0.smithi073.stdout:5/526: mknod d0/d1d/d25/d35/d39/cad 0 2024-04-19T02:18:32.191 INFO:tasks.workunit.client.0.smithi073.stdout:8/445: rename d14/d27/d4c/d75/l8a to d14/d27/d29/d69/l8e 0 2024-04-19T02:18:32.191 INFO:tasks.workunit.client.0.smithi073.stdout:9/442: dwrite d0/df/d1d/f33 [0,4194304] 0 2024-04-19T02:18:32.192 INFO:tasks.workunit.client.0.smithi073.stdout:5/527: creat d0/d1d/d24/fae x:0 0 0 2024-04-19T02:18:32.194 INFO:tasks.workunit.client.0.smithi073.stdout:2/460: dread d5/f7 [0,4194304] 0 2024-04-19T02:18:32.197 INFO:tasks.workunit.client.0.smithi073.stdout:2/461: rename d5/lb to d5/d10/d29/d66/d67/d72/lab 0 2024-04-19T02:18:32.201 INFO:tasks.workunit.client.0.smithi073.stdout:0/410: read d7/d14/d17/f55 [226901,64644] 0 2024-04-19T02:18:32.204 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:32.205 INFO:tasks.workunit.client.0.smithi073.stdout:5/528: read d0/f15 [314785,52839] 0 2024-04-19T02:18:32.205 INFO:tasks.workunit.client.0.smithi073.stdout:5/529: write d0/d1d/d25/f9a [717433,737] 0 2024-04-19T02:18:32.206 INFO:tasks.workunit.client.0.smithi073.stdout:5/530: chown d0/d1d/d1e/f2b 1948320 1 2024-04-19T02:18:32.206 INFO:tasks.workunit.client.0.smithi073.stdout:5/531: mkdir d0/d2d/daf 0 2024-04-19T02:18:32.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/543: dread d3/d6/db/f2d [0,4194304] 0 2024-04-19T02:18:32.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/544: chown d3/d6/f6d 16127471 1 2024-04-19T02:18:32.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/545: dread - d3/d6/db/d3a/d38/d40/f77 zero size 2024-04-19T02:18:32.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/546: mknod d3/d6/db/d1a/cb2 0 2024-04-19T02:18:32.211 INFO:tasks.workunit.client.0.smithi073.stdout:3/547: chown d3/d6/db/d1a/d2f/l98 43 1 2024-04-19T02:18:32.211 INFO:tasks.workunit.client.0.smithi073.stdout:3/548: chown d3/d6/db/d3a/d38/d43/d4e 5843 1 2024-04-19T02:18:32.212 INFO:tasks.workunit.client.0.smithi073.stdout:0/411: dread d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:32.212 INFO:tasks.workunit.client.0.smithi073.stdout:3/549: write d3/d6/db/d3a/d38/d89/d94/fa9 [339345,124203] 0 2024-04-19T02:18:32.213 INFO:tasks.workunit.client.0.smithi073.stdout:0/412: chown d7/d14/d17/d1a/d56/f65 9619 1 2024-04-19T02:18:32.214 INFO:tasks.workunit.client.0.smithi073.stdout:0/413: write d7/d14/d17/d1a/d21/f32 [1634885,103904] 0 2024-04-19T02:18:32.214 INFO:tasks.workunit.client.0.smithi073.stdout:0/414: mkdir d7/d14/d81 0 2024-04-19T02:18:32.215 INFO:tasks.workunit.client.0.smithi073.stdout:0/415: stat d7/d14/d17/d69/f80 0 2024-04-19T02:18:32.215 INFO:tasks.workunit.client.0.smithi073.stdout:7/438: dread d0/dc/f1f [4194304,4194304] 0 2024-04-19T02:18:32.216 INFO:tasks.workunit.client.0.smithi073.stdout:0/416: chown d7/d14/d17/d1a/d20/f48 62 1 2024-04-19T02:18:32.216 INFO:tasks.workunit.client.0.smithi073.stdout:7/439: readlink d0/dc/d67/d2a/d51/l78 0 2024-04-19T02:18:32.216 INFO:tasks.workunit.client.0.smithi073.stdout:0/417: fsync d7/f11 0 2024-04-19T02:18:32.216 INFO:tasks.workunit.client.0.smithi073.stdout:7/440: write d0/f6a [257844,46882] 0 2024-04-19T02:18:32.217 INFO:tasks.workunit.client.0.smithi073.stdout:3/550: dread d3/d6/db/f14 [0,4194304] 0 2024-04-19T02:18:32.218 INFO:tasks.workunit.client.0.smithi073.stdout:3/551: mknod d3/d6/db/cb3 0 2024-04-19T02:18:32.220 INFO:tasks.workunit.client.0.smithi073.stdout:3/552: link d3/f5 d3/d6/db/d3a/d38/d6f/daf/fb4 0 2024-04-19T02:18:32.221 INFO:tasks.workunit.client.0.smithi073.stdout:0/418: dread d7/d14/d17/d1a/d20/f27 [0,4194304] 0 2024-04-19T02:18:32.221 INFO:tasks.workunit.client.0.smithi073.stdout:7/441: dread d0/d28/f4b [0,4194304] 0 2024-04-19T02:18:32.222 INFO:tasks.workunit.client.0.smithi073.stdout:3/553: dread d3/d6/db/d16/d52/f93 [0,4194304] 0 2024-04-19T02:18:32.222 INFO:tasks.workunit.client.0.smithi073.stdout:0/419: read d7/d14/d17/d1a/f29 [529650,97027] 0 2024-04-19T02:18:32.222 INFO:tasks.workunit.client.0.smithi073.stdout:7/442: creat d0/d28/d63/f82 x:0 0 0 2024-04-19T02:18:32.223 INFO:tasks.workunit.client.0.smithi073.stdout:3/554: chown d3/d6/db/d16/d75 3046007 1 2024-04-19T02:18:32.223 INFO:tasks.workunit.client.0.smithi073.stdout:7/443: stat d0/d28/f4b 0 2024-04-19T02:18:32.224 INFO:tasks.workunit.client.0.smithi073.stdout:7/444: stat d0/dc/d39/f62 0 2024-04-19T02:18:32.224 INFO:tasks.workunit.client.0.smithi073.stdout:0/420: truncate d7/d14/f15 442718 0 2024-04-19T02:18:32.224 INFO:tasks.workunit.client.0.smithi073.stdout:3/555: dread d3/d6/db/f14 [0,4194304] 0 2024-04-19T02:18:32.225 INFO:tasks.workunit.client.0.smithi073.stdout:7/445: getdents d0/dc/d33/d5d 0 2024-04-19T02:18:32.225 INFO:tasks.workunit.client.0.smithi073.stdout:9/443: dread d0/df/d16/d19/d38/f9b [4194304,4194304] 0 2024-04-19T02:18:32.225 INFO:tasks.workunit.client.0.smithi073.stdout:7/446: mknod d0/d28/c83 0 2024-04-19T02:18:32.226 INFO:tasks.workunit.client.0.smithi073.stdout:1/433: rmdir db 39 2024-04-19T02:18:32.228 INFO:tasks.workunit.client.0.smithi073.stdout:8/446: getdents d14/d27/d4c 0 2024-04-19T02:18:32.228 INFO:tasks.workunit.client.0.smithi073.stdout:6/413: read d8/de/d35/f57 [175101,68099] 0 2024-04-19T02:18:32.228 INFO:tasks.workunit.client.0.smithi073.stdout:2/462: write d5/d10/d53/f93 [670470,110308] 0 2024-04-19T02:18:32.228 INFO:tasks.workunit.client.0.smithi073.stdout:5/532: truncate d0/d1d/d25/d35/d39/f7f 1941503 0 2024-04-19T02:18:32.229 INFO:tasks.workunit.client.0.smithi073.stdout:7/447: mkdir d0/dc/d84 0 2024-04-19T02:18:32.229 INFO:tasks.workunit.client.0.smithi073.stdout:9/444: symlink d0/df/d16/d19/d38/d5d/d45/l9f 0 2024-04-19T02:18:32.230 INFO:tasks.workunit.client.0.smithi073.stdout:7/448: read - d0/dc/d39/d50/f58 zero size 2024-04-19T02:18:32.230 INFO:tasks.workunit.client.0.smithi073.stdout:1/434: write db/f30 [4738690,75334] 0 2024-04-19T02:18:32.230 INFO:tasks.workunit.client.0.smithi073.stdout:9/445: chown d0/df/d16/d1a/d2c/f46 1166 1 2024-04-19T02:18:32.230 INFO:tasks.workunit.client.0.smithi073.stdout:8/447: rename d14/l39 to d14/d27/d29/d69/l8f 0 2024-04-19T02:18:32.231 INFO:tasks.workunit.client.0.smithi073.stdout:5/533: truncate d0/d1d/d24/d62/fa6 107699 0 2024-04-19T02:18:32.231 INFO:tasks.workunit.client.0.smithi073.stdout:2/463: truncate d5/d10/d14/d18/d3e/f62 860463 0 2024-04-19T02:18:32.231 INFO:tasks.workunit.client.0.smithi073.stdout:0/421: dwrite f5 [0,4194304] 0 2024-04-19T02:18:32.232 INFO:tasks.workunit.client.0.smithi073.stdout:2/464: chown d5/d10/d29/d42/f68 28 1 2024-04-19T02:18:32.232 INFO:tasks.workunit.client.0.smithi073.stdout:8/448: unlink d14/d15/c1d 0 2024-04-19T02:18:32.233 INFO:tasks.workunit.client.0.smithi073.stdout:5/534: rename d0/d1d/d64/f7a to d0/d69/fb0 0 2024-04-19T02:18:32.235 INFO:tasks.workunit.client.0.smithi073.stdout:1/435: link db/d1c/d2c/d50/f60 db/d1c/d81/d86/f9e 0 2024-04-19T02:18:32.235 INFO:tasks.workunit.client.0.smithi073.stdout:0/422: mkdir d7/d14/d17/d1a/d56/d6f/d82 0 2024-04-19T02:18:32.235 INFO:tasks.workunit.client.0.smithi073.stdout:2/465: creat d5/d10/d14/d18/d3e/d2d/fac x:0 0 0 2024-04-19T02:18:32.236 INFO:tasks.workunit.client.0.smithi073.stdout:5/535: dread - d0/d1d/d24/d61/fa3 zero size 2024-04-19T02:18:32.236 INFO:tasks.workunit.client.0.smithi073.stdout:9/446: getdents d0/df/d16/d1a/d2c/d6b 0 2024-04-19T02:18:32.236 INFO:tasks.workunit.client.0.smithi073.stdout:1/436: link db/d3e/f47 db/d3e/f9f 0 2024-04-19T02:18:32.237 INFO:tasks.workunit.client.0.smithi073.stdout:2/466: getdents d5/d10/d14/d18/d3e 0 2024-04-19T02:18:32.237 INFO:tasks.workunit.client.0.smithi073.stdout:5/536: link d0/d1d/d25/d35/f9c d0/d1d/d24/d61/fb1 0 2024-04-19T02:18:32.238 INFO:tasks.workunit.client.0.smithi073.stdout:4/423: dread da/d27/d3a/d50/f61 [0,4194304] 0 2024-04-19T02:18:32.239 INFO:tasks.workunit.client.0.smithi073.stdout:2/467: read - d5/d10/fa7 zero size 2024-04-19T02:18:32.242 INFO:tasks.workunit.client.0.smithi073.stdout:8/449: dwrite d14/d15/f1e [0,4194304] 0 2024-04-19T02:18:32.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/424: mkdir da/d27/d1b/d1d/d72/d2b/d2f/d91 0 2024-04-19T02:18:32.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/423: dwrite d7/d14/d17/d1a/d56/f78 [0,4194304] 0 2024-04-19T02:18:32.244 INFO:tasks.workunit.client.0.smithi073.stdout:5/537: rename d0/d1d/d25/d37/d71/f73 to d0/d2d/dac/fb2 0 2024-04-19T02:18:32.244 INFO:tasks.workunit.client.0.smithi073.stdout:2/468: chown d5/d10/d14/d18/d3e/d51/c95 3094543 1 2024-04-19T02:18:32.245 INFO:tasks.workunit.client.0.smithi073.stdout:1/437: dwrite db/f65 [0,4194304] 0 2024-04-19T02:18:32.245 INFO:tasks.workunit.client.0.smithi073.stdout:9/447: dwrite d0/df/d1d/f2f [0,4194304] 0 2024-04-19T02:18:32.245 INFO:tasks.workunit.client.0.smithi073.stdout:0/424: chown d7/cf 469 1 2024-04-19T02:18:32.246 INFO:tasks.workunit.client.0.smithi073.stdout:4/425: chown da/d27/d1b/d1d/d72/f62 2779294 1 2024-04-19T02:18:32.246 INFO:tasks.workunit.client.0.smithi073.stdout:7/449: dwrite d0/f7c [4194304,4194304] 0 2024-04-19T02:18:32.246 INFO:tasks.workunit.client.0.smithi073.stdout:9/448: chown d0/df/d16/d1a/f52 1283 1 2024-04-19T02:18:32.247 INFO:tasks.workunit.client.0.smithi073.stdout:1/438: symlink db/d1c/d95/la0 0 2024-04-19T02:18:32.248 INFO:tasks.workunit.client.0.smithi073.stdout:9/449: write d0/f1f [3614876,97514] 0 2024-04-19T02:18:32.248 INFO:tasks.workunit.client.0.smithi073.stdout:0/425: symlink d7/d14/d81/l83 0 2024-04-19T02:18:32.248 INFO:tasks.workunit.client.0.smithi073.stdout:4/426: creat da/d27/d36/d4d/d7b/f92 x:0 0 0 2024-04-19T02:18:32.249 INFO:tasks.workunit.client.0.smithi073.stdout:8/450: getdents d14/d27/d29 0 2024-04-19T02:18:32.249 INFO:tasks.workunit.client.0.smithi073.stdout:1/439: dread - db/d3e/f47 zero size 2024-04-19T02:18:32.249 INFO:tasks.workunit.client.0.smithi073.stdout:7/450: chown d0/d3/f74 33135865 1 2024-04-19T02:18:32.249 INFO:tasks.workunit.client.0.smithi073.stdout:1/440: stat db/d1c/d2c/d50/f60 0 2024-04-19T02:18:32.250 INFO:tasks.workunit.client.0.smithi073.stdout:0/426: rename d7/d14/d17/l7f to d7/d14/d17/l84 0 2024-04-19T02:18:32.250 INFO:tasks.workunit.client.0.smithi073.stdout:8/451: truncate d14/d27/f5c 98269 0 2024-04-19T02:18:32.250 INFO:tasks.workunit.client.0.smithi073.stdout:7/451: creat d0/dc/d33/d36/d7b/f85 x:0 0 0 2024-04-19T02:18:32.250 INFO:tasks.workunit.client.0.smithi073.stdout:9/450: mkdir d0/df/d16/d19/d38/d5d/d5e/da0 0 2024-04-19T02:18:32.250 INFO:tasks.workunit.client.0.smithi073.stdout:1/441: fdatasync db/d3e/f47 0 2024-04-19T02:18:32.251 INFO:tasks.workunit.client.0.smithi073.stdout:8/452: creat d14/d27/d4c/d75/f90 x:0 0 0 2024-04-19T02:18:32.251 INFO:tasks.workunit.client.0.smithi073.stdout:9/451: creat d0/fa1 x:0 0 0 2024-04-19T02:18:32.251 INFO:tasks.workunit.client.0.smithi073.stdout:1/442: symlink db/d1c/d95/la1 0 2024-04-19T02:18:32.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/427: truncate f4 647473 0 2024-04-19T02:18:32.252 INFO:tasks.workunit.client.0.smithi073.stdout:9/452: truncate d0/f8b 569111 0 2024-04-19T02:18:32.252 INFO:tasks.workunit.client.0.smithi073.stdout:7/452: read d0/dc/f26 [3436448,85502] 0 2024-04-19T02:18:32.253 INFO:tasks.workunit.client.0.smithi073.stdout:8/453: rename d14/d27/d29/d31/d34/f3a to d14/d27/d29/d69/f91 0 2024-04-19T02:18:32.258 INFO:tasks.workunit.client.0.smithi073.stdout:1/443: dwrite db/d7f/f9b [0,4194304] 0 2024-04-19T02:18:32.258 INFO:tasks.workunit.client.0.smithi073.stdout:9/453: dwrite d0/f54 [0,4194304] 0 2024-04-19T02:18:32.263 INFO:tasks.workunit.client.0.smithi073.stdout:4/428: dwrite da/d27/d2c/f3c [0,4194304] 0 2024-04-19T02:18:32.263 INFO:tasks.workunit.client.0.smithi073.stdout:9/454: symlink d0/df/d16/d19/d38/d5d/d76/la2 0 2024-04-19T02:18:32.264 INFO:tasks.workunit.client.0.smithi073.stdout:4/429: chown da/d27/d1b/d1d/d8d 6949 1 2024-04-19T02:18:32.265 INFO:tasks.workunit.client.0.smithi073.stdout:8/454: dwrite d14/d15/d17/f21 [4194304,4194304] 0 2024-04-19T02:18:32.268 INFO:tasks.workunit.client.0.smithi073.stdout:9/455: dread d0/df/d1d/f65 [0,4194304] 0 2024-04-19T02:18:32.268 INFO:tasks.workunit.client.0.smithi073.stdout:9/456: creat d0/fa3 x:0 0 0 2024-04-19T02:18:32.269 INFO:tasks.workunit.client.0.smithi073.stdout:0/427: dread d7/d14/d17/d69/f6a [0,4194304] 0 2024-04-19T02:18:32.269 INFO:tasks.workunit.client.0.smithi073.stdout:0/428: chown d7/d14/d17/d1a/d56 1 1 2024-04-19T02:18:32.270 INFO:tasks.workunit.client.0.smithi073.stdout:0/429: creat d7/d14/d17/d1a/d20/d50/f85 x:0 0 0 2024-04-19T02:18:32.273 INFO:tasks.workunit.client.0.smithi073.stdout:0/430: dread d7/d14/d17/d1a/d21/f5b [0,4194304] 0 2024-04-19T02:18:32.274 INFO:tasks.workunit.client.0.smithi073.stdout:7/453: rmdir d0/dc/d33/d36/d7b 39 2024-04-19T02:18:32.274 INFO:tasks.workunit.client.0.smithi073.stdout:0/431: stat d7/d14/d17/d1a/d20/l74 0 2024-04-19T02:18:32.274 INFO:tasks.workunit.client.0.smithi073.stdout:7/454: unlink d0/dc/f1f 0 2024-04-19T02:18:32.275 INFO:tasks.workunit.client.0.smithi073.stdout:0/432: write d7/d14/f3e [4940467,109713] 0 2024-04-19T02:18:32.275 INFO:tasks.workunit.client.0.smithi073.stdout:7/455: creat d0/dc/d39/d50/f86 x:0 0 0 2024-04-19T02:18:32.275 INFO:tasks.workunit.client.0.smithi073.stdout:0/433: mknod d7/d14/d17/d1a/d21/c86 0 2024-04-19T02:18:32.276 INFO:tasks.workunit.client.0.smithi073.stdout:7/456: creat d0/dc/d67/d15/f87 x:0 0 0 2024-04-19T02:18:32.276 INFO:tasks.workunit.client.0.smithi073.stdout:0/434: write d7/d14/d17/d1a/d56/f5a [276414,798] 0 2024-04-19T02:18:32.277 INFO:tasks.workunit.client.0.smithi073.stdout:7/457: chown d0/dc/d33/d36/d7b/d80 3803952 1 2024-04-19T02:18:32.278 INFO:tasks.workunit.client.0.smithi073.stdout:7/458: symlink d0/dc/d33/l88 0 2024-04-19T02:18:32.278 INFO:tasks.workunit.client.0.smithi073.stdout:2/469: dread d5/d10/d14/d18/d3e/d2d/d63/f46 [0,4194304] 0 2024-04-19T02:18:32.278 INFO:tasks.workunit.client.0.smithi073.stdout:7/459: symlink d0/dc/d33/l89 0 2024-04-19T02:18:32.279 INFO:tasks.workunit.client.0.smithi073.stdout:2/470: mknod d5/d10/d29/d66/cad 0 2024-04-19T02:18:32.287 INFO:tasks.workunit.client.0.smithi073.stdout:3/556: dread d3/d6/db/d3a/d38/f53 [0,4194304] 0 2024-04-19T02:18:32.288 INFO:tasks.workunit.client.0.smithi073.stdout:3/557: mkdir d3/d6/db/d3a/d38/d40/db5 0 2024-04-19T02:18:32.289 INFO:tasks.workunit.client.0.smithi073.stdout:2/471: dread d5/d10/d29/d66/d67/f88 [0,4194304] 0 2024-04-19T02:18:32.291 INFO:tasks.workunit.client.0.smithi073.stdout:7/460: truncate d0/dc/d67/f71 3107162 0 2024-04-19T02:18:32.292 INFO:tasks.workunit.client.0.smithi073.stdout:0/435: sync 2024-04-19T02:18:32.292 INFO:tasks.workunit.client.0.smithi073.stdout:2/472: sync 2024-04-19T02:18:32.292 INFO:tasks.workunit.client.0.smithi073.stdout:8/455: sync 2024-04-19T02:18:32.292 INFO:tasks.workunit.client.0.smithi073.stdout:5/538: sync 2024-04-19T02:18:32.292 INFO:tasks.workunit.client.0.smithi073.stdout:7/461: unlink d0/dc/d39/l4a 0 2024-04-19T02:18:32.293 INFO:tasks.workunit.client.0.smithi073.stdout:1/444: dwrite db/d41/f4c [0,4194304] 0 2024-04-19T02:18:32.295 INFO:tasks.workunit.client.0.smithi073.stdout:5/539: chown d0/d1d/d24/f38 0 1 2024-04-19T02:18:32.295 INFO:tasks.workunit.client.0.smithi073.stdout:9/457: dwrite d0/f8b [0,4194304] 0 2024-04-19T02:18:32.295 INFO:tasks.workunit.client.0.smithi073.stdout:2/473: chown d5/d10/d14/d18/d3e/d2d/f8e 3372837 1 2024-04-19T02:18:32.295 INFO:tasks.workunit.client.0.smithi073.stdout:1/445: write db/d41/f59 [1751838,50746] 0 2024-04-19T02:18:32.296 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:32.295+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:32.296 INFO:tasks.workunit.client.0.smithi073.stdout:5/540: creat d0/d2d/fb3 x:0 0 0 2024-04-19T02:18:32.296 INFO:tasks.workunit.client.0.smithi073.stdout:0/436: dread d7/d14/d17/d1a/d21/f3c [0,4194304] 0 2024-04-19T02:18:32.297 INFO:tasks.workunit.client.0.smithi073.stdout:9/458: write d0/df/d16/d19/d38/f7e [568956,92480] 0 2024-04-19T02:18:32.298 INFO:tasks.workunit.client.0.smithi073.stdout:3/558: dwrite d3/d6/db/d3a/f5c [0,4194304] 0 2024-04-19T02:18:32.300 INFO:tasks.workunit.client.0.smithi073.stdout:9/459: chown d0/d35 337 1 2024-04-19T02:18:32.300 INFO:tasks.workunit.client.0.smithi073.stdout:1/446: mknod db/d1c/d81/ca2 0 2024-04-19T02:18:32.300 INFO:tasks.workunit.client.0.smithi073.stdout:5/541: dread - d0/d1d/d64/f6b zero size 2024-04-19T02:18:32.300 INFO:tasks.workunit.client.0.smithi073.stdout:2/474: creat d5/d10/d14/d18/fae x:0 0 0 2024-04-19T02:18:32.301 INFO:tasks.workunit.client.0.smithi073.stdout:1/447: stat db/d1c/d2c/f45 0 2024-04-19T02:18:32.302 INFO:tasks.workunit.client.0.smithi073.stdout:9/460: chown d0/df/d16/d1a/d2c/d2e/f53 3866 1 2024-04-19T02:18:32.304 INFO:tasks.workunit.client.0.smithi073.stdout:4/430: dread da/d27/d1b/d1d/f42 [0,4194304] 0 2024-04-19T02:18:32.305 INFO:tasks.workunit.client.0.smithi073.stdout:2/475: read d5/d10/d14/d7a/fa4 [3597977,16508] 0 2024-04-19T02:18:32.305 INFO:tasks.workunit.client.0.smithi073.stdout:7/462: dwrite d0/f7c [4194304,4194304] 0 2024-04-19T02:18:32.305 INFO:tasks.workunit.client.0.smithi073.stdout:6/414: dread d8/f10 [0,4194304] 0 2024-04-19T02:18:32.306 INFO:tasks.workunit.client.0.smithi073.stdout:8/456: dwrite d14/d15/d17/f1f [0,4194304] 0 2024-04-19T02:18:32.306 INFO:tasks.workunit.client.0.smithi073.stdout:7/463: fdatasync d0/dc/d39/d50/f6b 0 2024-04-19T02:18:32.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/431: symlink da/d27/d3a/d49/l93 0 2024-04-19T02:18:32.307 INFO:tasks.workunit.client.0.smithi073.stdout:2/476: chown d5/d10/d14/d18/d3e/d2d/d63/da2 5560 1 2024-04-19T02:18:32.308 INFO:tasks.workunit.client.0.smithi073.stdout:7/464: write d0/f7c [851802,9806] 0 2024-04-19T02:18:32.308 INFO:tasks.workunit.client.0.smithi073.stdout:6/415: chown d8/d71/d7d/c89 339715116 1 2024-04-19T02:18:32.309 INFO:tasks.workunit.client.0.smithi073.stdout:2/477: chown d5 540073 1 2024-04-19T02:18:32.309 INFO:tasks.workunit.client.0.smithi073.stdout:0/437: dwrite d7/d14/d17/d1a/d21/f32 [0,4194304] 0 2024-04-19T02:18:32.309 INFO:tasks.workunit.client.0.smithi073.stdout:8/457: mknod d14/d27/d7b/c92 0 2024-04-19T02:18:32.312 INFO:tasks.workunit.client.0.smithi073.stdout:1/448: dread db/d1c/d2c/d50/f6d [0,4194304] 0 2024-04-19T02:18:32.313 INFO:tasks.workunit.client.0.smithi073.stdout:3/559: dwrite d3/d6/db/d3a/d38/d43/f84 [4194304,4194304] 0 2024-04-19T02:18:32.314 INFO:tasks.workunit.client.0.smithi073.stdout:0/438: rmdir d7 39 2024-04-19T02:18:32.314 INFO:tasks.workunit.client.0.smithi073.stdout:2/478: unlink d5/ca8 0 2024-04-19T02:18:32.314 INFO:tasks.workunit.client.0.smithi073.stdout:4/432: write da/d27/d2c/d80/f8e [1208159,26668] 0 2024-04-19T02:18:32.315 INFO:tasks.workunit.client.0.smithi073.stdout:8/458: creat d14/f93 x:0 0 0 2024-04-19T02:18:32.315 INFO:tasks.workunit.client.0.smithi073.stdout:3/560: dread - d3/d6/db/d16/d7c/f92 zero size 2024-04-19T02:18:32.315 INFO:tasks.workunit.client.0.smithi073.stdout:6/416: rename d8/d77 to d8/d4b/d8f 0 2024-04-19T02:18:32.316 INFO:tasks.workunit.client.0.smithi073.stdout:9/461: dwrite d0/f54 [0,4194304] 0 2024-04-19T02:18:32.316 INFO:tasks.workunit.client.0.smithi073.stdout:8/459: readlink d14/d27/d4c/d75/l6e 0 2024-04-19T02:18:32.318 INFO:tasks.workunit.client.0.smithi073.stdout:1/449: link db/d41/f59 db/d1c/d2c/fa3 0 2024-04-19T02:18:32.318 INFO:tasks.workunit.client.0.smithi073.stdout:2/479: mknod d5/d10/d14/d18/d3e/d51/caf 0 2024-04-19T02:18:32.318 INFO:tasks.workunit.client.0.smithi073.stdout:0/439: mkdir d7/d14/d17/d1a/d56/d87 0 2024-04-19T02:18:32.319 INFO:tasks.workunit.client.0.smithi073.stdout:9/462: fsync d0/d81/f4f 0 2024-04-19T02:18:32.320 INFO:tasks.workunit.client.0.smithi073.stdout:8/460: creat d14/d15/d17/d8d/f94 x:0 0 0 2024-04-19T02:18:32.320 INFO:tasks.workunit.client.0.smithi073.stdout:1/450: fdatasync db/d1c/d2c/f72 0 2024-04-19T02:18:32.320 INFO:tasks.workunit.client.0.smithi073.stdout:2/480: dread - d5/d10/d53/f92 zero size 2024-04-19T02:18:32.320 INFO:tasks.workunit.client.0.smithi073.stdout:2/481: readlink d5/d10/d29/l87 0 2024-04-19T02:18:32.320 INFO:tasks.workunit.client.0.smithi073.stdout:1/451: symlink db/d1c/d81/d86/la4 0 2024-04-19T02:18:32.320 INFO:tasks.workunit.client.0.smithi073.stdout:8/461: truncate d14/d27/d50/f5d 335488 0 2024-04-19T02:18:32.320 INFO:tasks.workunit.client.0.smithi073.stdout:7/465: dwrite d0/dc/d67/d2a/d51/f54 [0,4194304] 0 2024-04-19T02:18:32.321 INFO:tasks.workunit.client.0.smithi073.stdout:2/482: mknod d5/d10/d53/cb0 0 2024-04-19T02:18:32.321 INFO:tasks.workunit.client.0.smithi073.stdout:8/462: write d14/d27/d4c/f7d [267063,119889] 0 2024-04-19T02:18:32.321 INFO:tasks.workunit.client.0.smithi073.stdout:1/452: truncate db/d3e/d6f/f75 753971 0 2024-04-19T02:18:32.322 INFO:tasks.workunit.client.0.smithi073.stdout:9/463: link d0/df/d16/d19/d38/d5d/d45/l67 d0/df/d16/d1a/d2c/d2e/la4 0 2024-04-19T02:18:32.322 INFO:tasks.workunit.client.0.smithi073.stdout:2/483: mknod d5/d10/d14/cb1 0 2024-04-19T02:18:32.322 INFO:tasks.workunit.client.0.smithi073.stdout:1/453: symlink db/d3e/la5 0 2024-04-19T02:18:32.323 INFO:tasks.workunit.client.0.smithi073.stdout:8/463: symlink d14/d15/l95 0 2024-04-19T02:18:32.324 INFO:tasks.workunit.client.0.smithi073.stdout:2/484: write d5/d10/d29/d66/d67/d72/f2f [2224526,80105] 0 2024-04-19T02:18:32.325 INFO:tasks.workunit.client.0.smithi073.stdout:8/464: creat d14/d87/f96 x:0 0 0 2024-04-19T02:18:32.325 INFO:tasks.workunit.client.0.smithi073.stdout:0/440: dwrite d7/f11 [4194304,4194304] 0 2024-04-19T02:18:32.326 INFO:tasks.workunit.client.0.smithi073.stdout:8/465: mkdir d14/d15/d17/d48/d89/d97 0 2024-04-19T02:18:32.327 INFO:tasks.workunit.client.0.smithi073.stdout:0/441: creat d7/d6d/f88 x:0 0 0 2024-04-19T02:18:32.329 INFO:tasks.workunit.client.0.smithi073.stdout:0/442: dread - d7/d14/d17/d1a/d56/f65 zero size 2024-04-19T02:18:32.329 INFO:tasks.workunit.client.0.smithi073.stdout:7/466: dwrite d0/dc/d67/d2a/f2b [0,4194304] 0 2024-04-19T02:18:32.330 INFO:tasks.workunit.client.0.smithi073.stdout:7/467: write d0/d28/d63/f82 [478877,72595] 0 2024-04-19T02:18:32.331 INFO:tasks.workunit.client.0.smithi073.stdout:2/485: dwrite d5/f16 [0,4194304] 0 2024-04-19T02:18:32.331 INFO:tasks.workunit.client.0.smithi073.stdout:7/468: creat d0/dc/f8a x:0 0 0 2024-04-19T02:18:32.332 INFO:tasks.workunit.client.0.smithi073.stdout:2/486: sync 2024-04-19T02:18:32.332 INFO:tasks.workunit.client.0.smithi073.stdout:7/469: chown d0/d3 1589875 1 2024-04-19T02:18:32.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/454: dwrite db/d1c/f5d [0,4194304] 0 2024-04-19T02:18:32.333 INFO:tasks.workunit.client.0.smithi073.stdout:3/561: read d3/d6/db/d3a/d38/d89/d94/d7b/f9b [960669,78401] 0 2024-04-19T02:18:32.335 INFO:tasks.workunit.client.0.smithi073.stdout:1/455: write db/f36 [1694050,88741] 0 2024-04-19T02:18:32.335 INFO:tasks.workunit.client.0.smithi073.stdout:3/562: dread d3/d6/db/d1a/f9a [0,4194304] 0 2024-04-19T02:18:32.336 INFO:tasks.workunit.client.0.smithi073.stdout:0/443: dwrite d7/d14/d17/d1a/d20/f7a [0,4194304] 0 2024-04-19T02:18:32.336 INFO:tasks.workunit.client.0.smithi073.stdout:0/444: sync 2024-04-19T02:18:32.336 INFO:tasks.workunit.client.0.smithi073.stdout:3/563: write d3/d6/db/d3a/f29 [2688972,29517] 0 2024-04-19T02:18:32.339 INFO:tasks.workunit.client.0.smithi073.stdout:0/445: rename d7/d14/d17/d1a/d21/f58 to d7/d14/d17/d1a/d20/f89 0 2024-04-19T02:18:32.340 INFO:tasks.workunit.client.0.smithi073.stdout:0/446: rename d7/d14/d17/f55 to d7/d14/d17/d1a/d21/f8a 0 2024-04-19T02:18:32.341 INFO:tasks.workunit.client.0.smithi073.stdout:0/447: rmdir d7/d14/d17/d1a/d56 39 2024-04-19T02:18:32.345 INFO:tasks.workunit.client.0.smithi073.stdout:0/448: dwrite f2 [0,4194304] 0 2024-04-19T02:18:32.354 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:32.351+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:32.356 INFO:tasks.workunit.client.0.smithi073.stdout:4/433: truncate f1 3589026 0 2024-04-19T02:18:32.362 INFO:tasks.workunit.client.0.smithi073.stdout:4/434: dwrite da/d27/d36/d4d/d7b/f92 [0,4194304] 0 2024-04-19T02:18:32.363 INFO:tasks.workunit.client.0.smithi073.stdout:4/435: fsync da/f69 0 2024-04-19T02:18:32.364 INFO:tasks.workunit.client.0.smithi073.stdout:4/436: symlink da/d27/d3a/d50/l94 0 2024-04-19T02:18:32.365 INFO:tasks.workunit.client.0.smithi073.stdout:4/437: mkdir da/d27/d1b/d1d/d72/d3d/d95 0 2024-04-19T02:18:32.366 INFO:tasks.workunit.client.0.smithi073.stdout:4/438: creat da/d27/d1b/d1d/d72/f96 x:0 0 0 2024-04-19T02:18:32.366 INFO:tasks.workunit.client.0.smithi073.stdout:4/439: mkdir da/d27/d3a/d97 0 2024-04-19T02:18:32.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/440: rename da/d27/d36/d4d/d7b/f86 to da/d27/d1b/d1d/d8d/f98 0 2024-04-19T02:18:32.369 INFO:tasks.workunit.client.0.smithi073.stdout:4/441: fsync da/d27/d1b/d1d/d72/d2b/f32 0 2024-04-19T02:18:32.369 INFO:tasks.workunit.client.0.smithi073.stdout:6/417: dread d8/de/d58/d63/f6b [4194304,4194304] 0 2024-04-19T02:18:32.369 INFO:tasks.workunit.client.0.smithi073.stdout:4/442: fdatasync da/d27/d3a/d50/f8b 0 2024-04-19T02:18:32.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/464: write d0/df/d16/d1a/d2c/d2e/f4b [467603,48547] 0 2024-04-19T02:18:32.372 INFO:tasks.workunit.client.0.smithi073.stdout:1/456: getdents db/d3e 0 2024-04-19T02:18:32.373 INFO:tasks.workunit.client.0.smithi073.stdout:9/465: write d0/df/d16/d19/f87 [111337,71299] 0 2024-04-19T02:18:32.373 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:18:32.374 INFO:tasks.workunit.client.0.smithi073.stdout:0/449: truncate d7/d14/f1b 2298576 0 2024-04-19T02:18:32.374 INFO:tasks.workunit.client.0.smithi073.stdout:9/466: write d0/df/d16/d19/d38/d5d/d5e/f8d [531032,33796] 0 2024-04-19T02:18:32.377 INFO:tasks.workunit.client.0.smithi073.stdout:9/467: rename d0/df/d16/d19/c93 to d0/d35/ca5 0 2024-04-19T02:18:32.377 INFO:tasks.workunit.client.0.smithi073.stdout:2/487: dread d5/d10/d29/d42/f6e [0,4194304] 0 2024-04-19T02:18:32.378 INFO:tasks.workunit.client.0.smithi073.stdout:8/466: dwrite f11 [0,4194304] 0 2024-04-19T02:18:32.378 INFO:tasks.workunit.client.0.smithi073.stdout:9/468: mknod d0/df/d16/ca6 0 2024-04-19T02:18:32.378 INFO:tasks.workunit.client.0.smithi073.stdout:7/470: dread d0/dc/f26 [0,4194304] 0 2024-04-19T02:18:32.379 INFO:tasks.workunit.client.0.smithi073.stdout:8/467: creat d14/d27/d29/f98 x:0 0 0 2024-04-19T02:18:32.380 INFO:tasks.workunit.client.0.smithi073.stdout:1/457: dwrite db/d1c/f5d [4194304,4194304] 0 2024-04-19T02:18:32.383 INFO:tasks.workunit.client.0.smithi073.stdout:8/468: rmdir d14/d27/d29/d64 39 2024-04-19T02:18:32.384 INFO:tasks.workunit.client.0.smithi073.stdout:0/450: dwrite d7/d14/d17/d1a/d56/f65 [0,4194304] 0 2024-04-19T02:18:32.385 INFO:tasks.workunit.client.0.smithi073.stdout:1/458: truncate db/d1c/d81/d86/f8a 760368 0 2024-04-19T02:18:32.386 INFO:tasks.workunit.client.0.smithi073.stdout:1/459: readlink db/l20 0 2024-04-19T02:18:32.386 INFO:tasks.workunit.client.0.smithi073.stdout:9/469: rename d0/df/d16/f64 to d0/df/d16/d19/d38/d5d/d5e/fa7 0 2024-04-19T02:18:32.387 INFO:tasks.workunit.client.0.smithi073.stdout:8/469: getdents d14/d27/d29/d31/d34 0 2024-04-19T02:18:32.387 INFO:tasks.workunit.client.0.smithi073.stdout:0/451: creat d7/d14/d17/d69/d7c/f8b x:0 0 0 2024-04-19T02:18:32.387 INFO:tasks.workunit.client.0.smithi073.stdout:1/460: write db/fd [1472014,67574] 0 2024-04-19T02:18:32.388 INFO:tasks.workunit.client.0.smithi073.stdout:6/418: dwrite d8/de/d22/f37 [0,4194304] 0 2024-04-19T02:18:32.389 INFO:tasks.workunit.client.0.smithi073.stdout:1/461: dread - db/d3e/f47 zero size 2024-04-19T02:18:32.389 INFO:tasks.workunit.client.0.smithi073.stdout:1/462: readlink db/d1c/l37 0 2024-04-19T02:18:32.393 INFO:tasks.workunit.client.0.smithi073.stdout:8/470: dwrite d14/d15/f7e [0,4194304] 0 2024-04-19T02:18:32.394 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:32.394 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:8/471: mkdir d14/d15/d17/d99 0 2024-04-19T02:18:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:0/452: dwrite d7/d14/d17/d1a/d20/f4c [0,4194304] 0 2024-04-19T02:18:32.396 INFO:tasks.workunit.client.0.smithi073.stdout:8/472: mkdir d14/d27/d85/d9a 0 2024-04-19T02:18:32.398 INFO:tasks.workunit.client.0.smithi073.stdout:0/453: symlink d7/d14/d17/d1a/d56/d87/l8c 0 2024-04-19T02:18:32.398 INFO:tasks.workunit.client.0.smithi073.stdout:8/473: truncate d14/d27/f30 3800263 0 2024-04-19T02:18:32.399 INFO:tasks.workunit.client.0.smithi073.stdout:5/542: dread d0/f15 [0,4194304] 0 2024-04-19T02:18:32.399 INFO:tasks.workunit.client.0.smithi073.stdout:1/463: dwrite db/d3e/f97 [0,4194304] 0 2024-04-19T02:18:32.401 INFO:tasks.workunit.client.0.smithi073.stdout:0/454: mkdir d7/d14/d17/d1a/d8d 0 2024-04-19T02:18:32.401 INFO:tasks.workunit.client.0.smithi073.stdout:1/464: write db/f13 [6025185,15956] 0 2024-04-19T02:18:32.401 INFO:tasks.workunit.client.0.smithi073.stdout:0/455: unlink d7/d14/d17/d69/f7b 0 2024-04-19T02:18:32.401 INFO:tasks.workunit.client.0.smithi073.stdout:1/465: chown db/l19 0 1 2024-04-19T02:18:32.401 INFO:tasks.workunit.client.0.smithi073.stdout:0/456: chown d7/d14/f15 107201 1 2024-04-19T02:18:32.402 INFO:tasks.workunit.client.0.smithi073.stdout:1/466: creat db/d1c/d81/d86/fa6 x:0 0 0 2024-04-19T02:18:32.408 INFO:tasks.workunit.client.0.smithi073.stdout:1/467: dwrite db/d3e/f3f [0,4194304] 0 2024-04-19T02:18:32.414 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:32.423 INFO:tasks.workunit.client.0.smithi073.stdout:0/457: dread d7/d14/d17/d1a/d56/d6f/f71 [0,4194304] 0 2024-04-19T02:18:32.423 INFO:tasks.workunit.client.0.smithi073.stdout:6/419: dread d8/de/d58/d63/f6b [0,4194304] 0 2024-04-19T02:18:32.424 INFO:tasks.workunit.client.0.smithi073.stdout:0/458: chown d7/d14/d17/l3a 101 1 2024-04-19T02:18:32.424 INFO:tasks.workunit.client.0.smithi073.stdout:6/420: write d8/de/d58/d63/f74 [642350,124187] 0 2024-04-19T02:18:32.424 INFO:tasks.workunit.client.0.smithi073.stdout:6/421: rmdir d8/d4b/d8f 39 2024-04-19T02:18:32.425 INFO:tasks.workunit.client.0.smithi073.stdout:0/459: getdents d7/d14/d17/d1a/d8d 0 2024-04-19T02:18:32.425 INFO:tasks.workunit.client.0.smithi073.stdout:6/422: creat d8/de/d78/f90 x:0 0 0 2024-04-19T02:18:32.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/423: rename d8/f4e to d8/d71/d75/f91 0 2024-04-19T02:18:32.429 INFO:tasks.workunit.client.0.smithi073.stdout:7/471: dread d0/f6a [0,4194304] 0 2024-04-19T02:18:32.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/472: write d0/f79 [1791065,103768] 0 2024-04-19T02:18:32.430 INFO:tasks.workunit.client.0.smithi073.stdout:0/460: dwrite d7/f67 [0,4194304] 0 2024-04-19T02:18:32.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/473: mknod d0/c8b 0 2024-04-19T02:18:32.431 INFO:tasks.workunit.client.0.smithi073.stdout:0/461: truncate f5 4551377 0 2024-04-19T02:18:32.432 INFO:tasks.workunit.client.0.smithi073.stdout:7/474: truncate d0/dc/d39/d50/f58 227644 0 2024-04-19T02:18:32.432 INFO:tasks.workunit.client.0.smithi073.stdout:6/424: dwrite d8/f16 [0,4194304] 0 2024-04-19T02:18:32.433 INFO:tasks.workunit.client.0.smithi073.stdout:7/475: creat d0/dc/d39/d50/f8c x:0 0 0 2024-04-19T02:18:32.435 INFO:tasks.workunit.client.0.smithi073.stdout:4/443: sync 2024-04-19T02:18:32.436 INFO:tasks.workunit.client.0.smithi073.stdout:4/444: mknod da/d27/d36/d4d/d7b/c99 0 2024-04-19T02:18:32.437 INFO:tasks.workunit.client.0.smithi073.stdout:4/445: creat da/d27/d3a/d49/f9a x:0 0 0 2024-04-19T02:18:32.437 INFO:tasks.workunit.client.0.smithi073.stdout:4/446: creat da/d27/d3a/f9b x:0 0 0 2024-04-19T02:18:32.438 INFO:tasks.workunit.client.0.smithi073.stdout:4/447: rmdir da/d27/d2c 39 2024-04-19T02:18:32.439 INFO:tasks.workunit.client.0.smithi073.stdout:4/448: unlink da/d27/d36/c74 0 2024-04-19T02:18:32.440 INFO:tasks.workunit.client.0.smithi073.stdout:4/449: readlink da/d27/d3a/d50/l85 0 2024-04-19T02:18:32.440 INFO:tasks.workunit.client.0.smithi073.stdout:4/450: mkdir da/d27/d3a/d50/d9c 0 2024-04-19T02:18:32.441 INFO:tasks.workunit.client.0.smithi073.stdout:4/451: fsync f4 0 2024-04-19T02:18:32.441 INFO:tasks.workunit.client.0.smithi073.stdout:4/452: readlink da/d27/d36/d4d/l4e 0 2024-04-19T02:18:32.442 INFO:tasks.workunit.client.0.smithi073.stdout:4/453: write da/d27/d3a/d50/f8b [68882,53606] 0 2024-04-19T02:18:32.445 INFO:tasks.workunit.client.0.smithi073.stdout:7/476: dread d0/dc/d39/d40/f44 [4194304,4194304] 0 2024-04-19T02:18:32.446 INFO:tasks.workunit.client.0.smithi073.stdout:7/477: mknod d0/d3/c8d 0 2024-04-19T02:18:32.447 INFO:tasks.workunit.client.0.smithi073.stdout:0/462: dread d7/d14/d17/d1a/d21/f40 [0,4194304] 0 2024-04-19T02:18:32.447 INFO:tasks.workunit.client.0.smithi073.stdout:7/478: mknod d0/dc/d84/c8e 0 2024-04-19T02:18:32.448 INFO:tasks.workunit.client.0.smithi073.stdout:4/454: dwrite da/d27/d1b/d1d/d72/f62 [0,4194304] 0 2024-04-19T02:18:32.448 INFO:tasks.workunit.client.0.smithi073.stdout:0/463: mknod d7/d14/d17/d70/c8e 0 2024-04-19T02:18:32.448 INFO:tasks.workunit.client.0.smithi073.stdout:7/479: mkdir d0/dc/d67/d15/d8f 0 2024-04-19T02:18:32.449 INFO:tasks.workunit.client.0.smithi073.stdout:4/455: creat da/d27/d1b/d26/f9d x:0 0 0 2024-04-19T02:18:32.449 INFO:tasks.workunit.client.0.smithi073.stdout:7/480: unlink d0/dc/d39/d50/f58 0 2024-04-19T02:18:32.452 INFO:tasks.workunit.client.0.smithi073.stdout:7/481: symlink d0/dc/d33/l90 0 2024-04-19T02:18:32.453 INFO:tasks.workunit.client.0.smithi073.stdout:7/482: truncate d0/dc/d33/d36/d7b/f85 3300 0 2024-04-19T02:18:32.454 INFO:tasks.workunit.client.0.smithi073.stdout:4/456: dwrite da/d27/d1b/d1d/d72/d2b/d2f/f63 [0,4194304] 0 2024-04-19T02:18:32.456 INFO:tasks.workunit.client.0.smithi073.stdout:4/457: rename da/f18 to da/d27/d1b/d1d/d8d/d84/f9e 0 2024-04-19T02:18:32.456 INFO:tasks.workunit.client.0.smithi073.stdout:4/458: stat da/d27/d2c/d80/f8e 0 2024-04-19T02:18:32.457 INFO:tasks.workunit.client.0.smithi073.stdout:4/459: fdatasync da/d27/d1b/d1d/d8d/f89 0 2024-04-19T02:18:32.458 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:32.456+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:32.459 INFO:tasks.workunit.client.0.smithi073.stdout:4/460: rename da/f69 to da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f 0 2024-04-19T02:18:32.459 INFO:tasks.workunit.client.0.smithi073.stdout:7/483: dwrite d0/f7 [0,4194304] 0 2024-04-19T02:18:32.459 INFO:tasks.workunit.client.0.smithi073.stdout:9/470: sync 2024-04-19T02:18:32.459 INFO:tasks.workunit.client.0.smithi073.stdout:2/488: sync 2024-04-19T02:18:32.460 INFO:tasks.workunit.client.0.smithi073.stdout:4/461: chown da/d27/d2c/f3c 394723 1 2024-04-19T02:18:32.460 INFO:tasks.workunit.client.0.smithi073.stdout:9/471: write d0/fc [1663807,71225] 0 2024-04-19T02:18:32.460 INFO:tasks.workunit.client.0.smithi073.stdout:4/462: readlink da/d27/d36/l41 0 2024-04-19T02:18:32.461 INFO:tasks.workunit.client.0.smithi073.stdout:9/472: write d0/f6 [10016480,95739] 0 2024-04-19T02:18:32.461 INFO:tasks.workunit.client.0.smithi073.stdout:7/484: truncate d0/dc/d39/d50/f8c 905013 0 2024-04-19T02:18:32.462 INFO:tasks.workunit.client.0.smithi073.stdout:4/463: write da/d27/d1b/d1d/d72/f62 [807457,47775] 0 2024-04-19T02:18:32.462 INFO:tasks.workunit.client.0.smithi073.stdout:9/473: mknod d0/df/d16/d19/d38/ca8 0 2024-04-19T02:18:32.462 INFO:tasks.workunit.client.0.smithi073.stdout:7/485: chown d0/dc/d39/l59 15 1 2024-04-19T02:18:32.462 INFO:tasks.workunit.client.0.smithi073.stdout:6/425: dread d8/de/d35/f62 [0,4194304] 0 2024-04-19T02:18:32.462 INFO:tasks.workunit.client.0.smithi073.stdout:4/464: write da/d27/d1b/d26/f4c [114320,106163] 0 2024-04-19T02:18:32.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/426: dread - d8/de/d78/f7e zero size 2024-04-19T02:18:32.464 INFO:tasks.workunit.client.0.smithi073.stdout:4/465: write da/d27/d1b/d1d/d72/d2b/f32 [4010549,94719] 0 2024-04-19T02:18:32.467 INFO:tasks.workunit.client.0.smithi073.stdout:9/474: dwrite d0/df/d16/d19/d38/d5d/f4e [0,4194304] 0 2024-04-19T02:18:32.468 INFO:tasks.workunit.client.0.smithi073.stdout:6/427: dwrite d8/de/d22/f64 [0,4194304] 0 2024-04-19T02:18:32.470 INFO:tasks.workunit.client.0.smithi073.stdout:4/466: dwrite da/d27/d2c/d80/f8e [4194304,4194304] 0 2024-04-19T02:18:32.471 INFO:tasks.workunit.client.0.smithi073.stdout:4/467: stat da/d27/d1b/d1d/d72/d2b 0 2024-04-19T02:18:32.472 INFO:tasks.workunit.client.0.smithi073.stdout:4/468: creat da/d27/d1b/d1d/d8d/d84/fa0 x:0 0 0 2024-04-19T02:18:32.474 INFO:tasks.workunit.client.0.smithi073.stdout:6/428: dwrite d8/de/d35/d60/f4f [0,4194304] 0 2024-04-19T02:18:32.475 INFO:tasks.workunit.client.0.smithi073.stdout:6/429: chown d8/de/d22/c70 33 1 2024-04-19T02:18:32.475 INFO:tasks.workunit.client.0.smithi073.stdout:6/430: write d8/f11 [4816300,75304] 0 2024-04-19T02:18:32.476 INFO:tasks.workunit.client.0.smithi073.stdout:5/543: write d0/d1d/d24/f5e [250976,37699] 0 2024-04-19T02:18:32.477 INFO:tasks.workunit.client.0.smithi073.stdout:6/431: chown d8/d71/d7d/f87 437515 1 2024-04-19T02:18:32.477 INFO:tasks.workunit.client.0.smithi073.stdout:6/432: symlink d8/de/d58/d63/l92 0 2024-04-19T02:18:32.477 INFO:tasks.workunit.client.0.smithi073.stdout:5/544: creat d0/d1d/d24/d61/fb4 x:0 0 0 2024-04-19T02:18:32.477 INFO:tasks.workunit.client.0.smithi073.stdout:1/468: truncate f9 216295 0 2024-04-19T02:18:32.478 INFO:tasks.workunit.client.0.smithi073.stdout:5/545: mkdir d0/d1d/d25/db5 0 2024-04-19T02:18:32.479 INFO:tasks.workunit.client.0.smithi073.stdout:5/546: getdents d0/d1d/d64 0 2024-04-19T02:18:32.479 INFO:tasks.workunit.client.0.smithi073.stdout:5/547: stat d0/d1d/f2a 0 2024-04-19T02:18:32.480 INFO:tasks.workunit.client.0.smithi073.stdout:5/548: creat d0/d1d/d25/d35/d39/fb6 x:0 0 0 2024-04-19T02:18:32.480 INFO:tasks.workunit.client.0.smithi073.stdout:5/549: mknod d0/d1d/d25/d37/d71/cb7 0 2024-04-19T02:18:32.483 INFO:tasks.workunit.client.0.smithi073.stdout:1/469: dread db/d1c/f34 [0,4194304] 0 2024-04-19T02:18:32.483 INFO:tasks.workunit.client.0.smithi073.stdout:1/470: write db/d41/f84 [11796,26649] 0 2024-04-19T02:18:32.494 INFO:tasks.workunit.client.0.smithi073.stdout:2/489: dread d5/d10/d53/f75 [0,4194304] 0 2024-04-19T02:18:32.495 INFO:tasks.workunit.client.0.smithi073.stdout:7/486: getdents d0/dc/d67/d15 0 2024-04-19T02:18:32.495 INFO:tasks.workunit.client.0.smithi073.stdout:2/490: creat d5/d10/d14/d18/d3e/d2d/d63/da2/fb2 x:0 0 0 2024-04-19T02:18:32.496 INFO:tasks.workunit.client.0.smithi073.stdout:2/491: dread - d5/d10/d14/d18/fae zero size 2024-04-19T02:18:32.498 INFO:tasks.workunit.client.0.smithi073.stdout:0/464: dwrite d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:32.499 INFO:tasks.workunit.client.0.smithi073.stdout:0/465: unlink d7/d14/d17/d1a/d56/l76 0 2024-04-19T02:18:32.500 INFO:tasks.workunit.client.0.smithi073.stdout:2/492: read d5/d10/d29/d66/d67/f48 [208387,33289] 0 2024-04-19T02:18:32.500 INFO:tasks.workunit.client.0.smithi073.stdout:0/466: creat d7/d14/d17/d1a/d56/d87/f8f x:0 0 0 2024-04-19T02:18:32.500 INFO:tasks.workunit.client.0.smithi073.stdout:7/487: dwrite d0/dc/d39/f62 [0,4194304] 0 2024-04-19T02:18:32.501 INFO:tasks.workunit.client.0.smithi073.stdout:2/493: rmdir d5/d10/d29/d66/d83 39 2024-04-19T02:18:32.501 INFO:tasks.workunit.client.0.smithi073.stdout:0/467: chown d7/d14/d17/d1a/d21/f32 2634142 1 2024-04-19T02:18:32.502 INFO:tasks.workunit.client.0.smithi073.stdout:7/488: creat d0/dc/d33/f91 x:0 0 0 2024-04-19T02:18:32.502 INFO:tasks.workunit.client.0.smithi073.stdout:7/489: creat d0/d28/f92 x:0 0 0 2024-04-19T02:18:32.502 INFO:tasks.workunit.client.0.smithi073.stdout:0/468: link d7/d14/d17/d1a/d21/l35 d7/d14/d17/d69/l90 0 2024-04-19T02:18:32.503 INFO:tasks.workunit.client.0.smithi073.stdout:7/490: write d0/dc/d39/d40/f44 [3294636,69013] 0 2024-04-19T02:18:32.504 INFO:tasks.workunit.client.0.smithi073.stdout:0/469: rename d7/d14/d17/d1a/d56/d6f/f71 to d7/d6d/f91 0 2024-04-19T02:18:32.504 INFO:tasks.workunit.client.0.smithi073.stdout:7/491: mkdir d0/dc/d33/d36/d7b/d93 0 2024-04-19T02:18:32.505 INFO:tasks.workunit.client.0.smithi073.stdout:7/492: symlink d0/dc/d39/d50/l94 0 2024-04-19T02:18:32.505 INFO:tasks.workunit.client.0.smithi073.stdout:7/493: creat d0/dc/d67/d2a/d51/d7a/f95 x:0 0 0 2024-04-19T02:18:32.506 INFO:tasks.workunit.client.0.smithi073.stdout:7/494: write d0/f79 [2561589,51838] 0 2024-04-19T02:18:32.506 INFO:tasks.workunit.client.0.smithi073.stdout:7/495: chown d0/dc/d33/l90 5250 1 2024-04-19T02:18:32.507 INFO:tasks.workunit.client.0.smithi073.stdout:7/496: write d0/d28/f92 [892235,117298] 0 2024-04-19T02:18:32.507 INFO:tasks.workunit.client.0.smithi073.stdout:7/497: creat d0/dc/d33/d36/d7b/d80/f96 x:0 0 0 2024-04-19T02:18:32.512 INFO:tasks.workunit.client.0.smithi073.stdout:7/498: dwrite d0/dc/f5a [0,4194304] 0 2024-04-19T02:18:32.512 INFO:tasks.workunit.client.0.smithi073.stdout:7/499: stat d0/dc/d67/l75 0 2024-04-19T02:18:32.513 INFO:tasks.workunit.client.0.smithi073.stdout:7/500: truncate d0/dc/d39/d50/f8c 1232627 0 2024-04-19T02:18:32.514 INFO:tasks.workunit.client.0.smithi073.stdout:7/501: mkdir d0/dc/d33/d36/d7b/d93/d97 0 2024-04-19T02:18:32.514 INFO:tasks.workunit.client.0.smithi073.stdout:7/502: stat d0/dc/d33/f91 0 2024-04-19T02:18:32.517 INFO:tasks.workunit.client.0.smithi073.stdout:7/503: read d0/f8 [667293,109019] 0 2024-04-19T02:18:32.518 INFO:tasks.workunit.client.0.smithi073.stdout:7/504: write d0/dc/d67/d2a/f2b [2762206,106504] 0 2024-04-19T02:18:32.521 INFO:tasks.workunit.client.0.smithi073.stdout:7/505: dread d0/dc/f5a [0,4194304] 0 2024-04-19T02:18:32.521 INFO:tasks.workunit.client.0.smithi073.stdout:7/506: write d0/dc/d67/d2a/d51/f6c [948135,119397] 0 2024-04-19T02:18:32.522 INFO:tasks.workunit.client.0.smithi073.stdout:7/507: write d0/f1d [6160275,28495] 0 2024-04-19T02:18:32.523 INFO:tasks.workunit.client.0.smithi073.stdout:7/508: unlink d0/dc/d39/d50/l94 0 2024-04-19T02:18:32.523 INFO:tasks.workunit.client.0.smithi073.stdout:7/509: mknod d0/dc/d33/d36/d7b/d80/c98 0 2024-04-19T02:18:32.524 INFO:tasks.workunit.client.0.smithi073.stdout:7/510: mkdir d0/dc/d67/d99 0 2024-04-19T02:18:32.529 INFO:tasks.workunit.client.0.smithi073.stdout:7/511: dwrite d0/dc/d39/f4f [0,4194304] 0 2024-04-19T02:18:32.531 INFO:tasks.workunit.client.0.smithi073.stdout:9/475: truncate d0/df/d16/d19/d38/d5d/d45/f48 4966178 0 2024-04-19T02:18:32.531 INFO:tasks.workunit.client.0.smithi073.stdout:4/469: write f4 [1179295,5472] 0 2024-04-19T02:18:32.531 INFO:tasks.workunit.client.0.smithi073.stdout:3/564: dread d3/d6/fd [0,4194304] 0 2024-04-19T02:18:32.533 INFO:tasks.workunit.client.0.smithi073.stdout:3/565: symlink d3/d6/db/d3a/d38/d89/lb6 0 2024-04-19T02:18:32.533 INFO:tasks.workunit.client.0.smithi073.stdout:4/470: rename da/d27/d1b/d1d/f29 to da/d27/d2c/d60/fa1 0 2024-04-19T02:18:32.533 INFO:tasks.workunit.client.0.smithi073.stdout:3/566: mknod d3/d6/db/d23/cb7 0 2024-04-19T02:18:32.533 INFO:tasks.workunit.client.0.smithi073.stdout:4/471: mkdir da/d27/d1b/d26/d2a/da2 0 2024-04-19T02:18:32.534 INFO:tasks.workunit.client.0.smithi073.stdout:3/567: symlink d3/d6/db/d3a/d5f/lb8 0 2024-04-19T02:18:32.534 INFO:tasks.workunit.client.0.smithi073.stdout:4/472: symlink da/d27/d36/d4d/d7b/la3 0 2024-04-19T02:18:32.535 INFO:tasks.workunit.client.0.smithi073.stdout:3/568: creat d3/d6/db/d3a/d38/d89/d94/d7b/fb9 x:0 0 0 2024-04-19T02:18:32.535 INFO:tasks.workunit.client.0.smithi073.stdout:4/473: creat da/d27/d1b/d1d/d72/fa4 x:0 0 0 2024-04-19T02:18:32.537 INFO:tasks.workunit.client.0.smithi073.stdout:3/569: truncate d3/d6/db/d1a/d2f/f9f 215386 0 2024-04-19T02:18:32.537 INFO:tasks.workunit.client.0.smithi073.stdout:4/474: mknod da/d27/d1b/d1d/d72/d2b/d2f/d91/ca5 0 2024-04-19T02:18:32.537 INFO:tasks.workunit.client.0.smithi073.stdout:5/550: dwrite d0/d1d/d24/d61/fb1 [0,4194304] 0 2024-04-19T02:18:32.537 INFO:tasks.workunit.client.0.smithi073.stdout:3/570: chown d3/d6/db/d3a/d38 601211 1 2024-04-19T02:18:32.537 INFO:tasks.workunit.client.0.smithi073.stdout:5/551: creat d0/d1d/d25/d37/d71/fb8 x:0 0 0 2024-04-19T02:18:32.538 INFO:tasks.workunit.client.0.smithi073.stdout:2/494: rmdir d5/d10/d14 39 2024-04-19T02:18:32.538 INFO:tasks.workunit.client.0.smithi073.stdout:5/552: symlink d0/d1d/d25/d37/d71/lb9 0 2024-04-19T02:18:32.539 INFO:tasks.workunit.client.0.smithi073.stdout:3/571: rename d3/d6/db/d3a/d38/d89/d94/c31 to d3/d6/db/d16/d75/cba 0 2024-04-19T02:18:32.539 INFO:tasks.workunit.client.0.smithi073.stdout:2/495: fsync d5/d10/d53/f92 0 2024-04-19T02:18:32.539 INFO:tasks.workunit.client.0.smithi073.stdout:5/553: write d0/d1d/d24/f2e [4701119,80502] 0 2024-04-19T02:18:32.540 INFO:tasks.workunit.client.0.smithi073.stdout:5/554: creat d0/d1d/d90/fba x:0 0 0 2024-04-19T02:18:32.540 INFO:tasks.workunit.client.0.smithi073.stdout:2/496: creat d5/d10/d29/d66/d67/d72/fb3 x:0 0 0 2024-04-19T02:18:32.541 INFO:tasks.workunit.client.0.smithi073.stdout:3/572: rename d3/d6/db/d16/la2 to d3/d6/db/d23/lbb 0 2024-04-19T02:18:32.541 INFO:tasks.workunit.client.0.smithi073.stdout:5/555: chown d0/le 6973451 1 2024-04-19T02:18:32.541 INFO:tasks.workunit.client.0.smithi073.stdout:3/573: dread - d3/d6/db/fa0 zero size 2024-04-19T02:18:32.542 INFO:tasks.workunit.client.0.smithi073.stdout:5/556: mkdir d0/d1d/d90/da0/dbb 0 2024-04-19T02:18:32.542 INFO:tasks.workunit.client.0.smithi073.stdout:4/475: rmdir da/d27/d1b 39 2024-04-19T02:18:32.542 INFO:tasks.workunit.client.0.smithi073.stdout:3/574: unlink d3/d6/db/d3a/d38/d43/l4f 0 2024-04-19T02:18:32.543 INFO:tasks.workunit.client.0.smithi073.stdout:5/557: mknod d0/d1d/d25/d35/d99/cbc 0 2024-04-19T02:18:32.543 INFO:tasks.workunit.client.0.smithi073.stdout:3/575: fdatasync d3/f49 0 2024-04-19T02:18:32.544 INFO:tasks.workunit.client.0.smithi073.stdout:5/558: write d0/d1d/d1e/f2b [3142743,67733] 0 2024-04-19T02:18:32.544 INFO:tasks.workunit.client.0.smithi073.stdout:5/559: readlink d0/d1d/d25/d37/d71/lb9 0 2024-04-19T02:18:32.544 INFO:tasks.workunit.client.0.smithi073.stdout:3/576: link d3/d6/db/f66 d3/d6/db/d3a/d38/d89/d94/d7b/fbc 0 2024-04-19T02:18:32.549 INFO:tasks.workunit.client.0.smithi073.stdout:0/470: dread d7/d14/f3e [0,4194304] 0 2024-04-19T02:18:32.550 INFO:tasks.workunit.client.0.smithi073.stdout:5/560: dwrite d0/d1d/d25/d35/f49 [0,4194304] 0 2024-04-19T02:18:32.551 INFO:tasks.workunit.client.0.smithi073.stdout:0/471: write d7/d14/d17/d1a/d56/f65 [3203141,95295] 0 2024-04-19T02:18:32.551 INFO:tasks.workunit.client.0.smithi073.stdout:4/476: truncate da/d27/d1b/d1d/f37 1497563 0 2024-04-19T02:18:32.551 INFO:tasks.workunit.client.0.smithi073.stdout:5/561: readlink d0/ld 0 2024-04-19T02:18:32.552 INFO:tasks.workunit.client.0.smithi073.stdout:4/477: rmdir da/d27/d1b/d26 39 2024-04-19T02:18:32.552 INFO:tasks.workunit.client.0.smithi073.stdout:2/497: dwrite d5/d10/d14/d18/f1a [0,4194304] 0 2024-04-19T02:18:32.552 INFO:tasks.workunit.client.0.smithi073.stdout:0/472: mkdir d7/d14/d17/d70/d92 0 2024-04-19T02:18:32.552 INFO:tasks.workunit.client.0.smithi073.stdout:5/562: unlink d0/f16 0 2024-04-19T02:18:32.553 INFO:tasks.workunit.client.0.smithi073.stdout:4/478: write da/d27/d1b/d1d/d72/f62 [4237702,72741] 0 2024-04-19T02:18:32.554 INFO:tasks.workunit.client.0.smithi073.stdout:4/479: mkdir da/d27/d2c/da6 0 2024-04-19T02:18:32.554 INFO:tasks.workunit.client.0.smithi073.stdout:2/498: creat d5/d10/d29/d42/fb4 x:0 0 0 2024-04-19T02:18:32.555 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:32.552+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:32.555 INFO:tasks.workunit.client.0.smithi073.stdout:3/577: dread d3/d6/db/d3a/d38/d89/d94/f2e [0,4194304] 0 2024-04-19T02:18:32.555 INFO:tasks.workunit.client.0.smithi073.stdout:2/499: write d5/d10/d29/d42/f68 [184474,34810] 0 2024-04-19T02:18:32.557 INFO:tasks.workunit.client.0.smithi073.stdout:4/480: rename da/f16 to da/d27/fa7 0 2024-04-19T02:18:32.558 INFO:tasks.workunit.client.0.smithi073.stdout:3/578: write d3/d6/db/d3a/d38/d43/f84 [6406190,74638] 0 2024-04-19T02:18:32.558 INFO:tasks.workunit.client.0.smithi073.stdout:8/474: dread d14/d15/d17/f3d [0,4194304] 0 2024-04-19T02:18:32.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/481: chown da/d27/d1b/d26/d2a/l57 3279 1 2024-04-19T02:18:32.560 INFO:tasks.workunit.client.0.smithi073.stdout:2/500: mknod d5/d10/d14/d18/d3e/d2d/cb5 0 2024-04-19T02:18:32.560 INFO:tasks.workunit.client.0.smithi073.stdout:5/563: dwrite d0/d1d/d25/d35/d39/f4c [0,4194304] 0 2024-04-19T02:18:32.560 INFO:tasks.workunit.client.0.smithi073.stdout:2/501: chown d5/d10/d14/d18/d3e/d2d/d63/c82 1964497244 1 2024-04-19T02:18:32.561 INFO:tasks.workunit.client.0.smithi073.stdout:4/482: link da/d27/d36/f6e da/d27/d1b/d1d/d8d/d84/fa8 0 2024-04-19T02:18:32.561 INFO:tasks.workunit.client.0.smithi073.stdout:5/564: write d0/d1d/d1e/f80 [1087474,13651] 0 2024-04-19T02:18:32.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/502: unlink d5/f8 0 2024-04-19T02:18:32.562 INFO:tasks.workunit.client.0.smithi073.stdout:4/483: truncate da/d27/f39 4271600 0 2024-04-19T02:18:32.563 INFO:tasks.workunit.client.0.smithi073.stdout:2/503: mkdir d5/d10/d14/db6 0 2024-04-19T02:18:32.563 INFO:tasks.workunit.client.0.smithi073.stdout:8/475: dread d14/d27/d29/d31/f74 [0,4194304] 0 2024-04-19T02:18:32.563 INFO:tasks.workunit.client.0.smithi073.stdout:0/473: dread d7/d14/d17/d1a/d21/f8a [0,4194304] 0 2024-04-19T02:18:32.564 INFO:tasks.workunit.client.0.smithi073.stdout:4/484: fdatasync da/f44 0 2024-04-19T02:18:32.564 INFO:tasks.workunit.client.0.smithi073.stdout:5/565: read d0/d1d/d25/d35/d39/f66 [6443103,98902] 0 2024-04-19T02:18:32.564 INFO:tasks.workunit.client.0.smithi073.stdout:8/476: mkdir d14/d27/d85/d9b 0 2024-04-19T02:18:32.565 INFO:tasks.workunit.client.0.smithi073.stdout:3/579: dwrite d3/f3d [0,4194304] 0 2024-04-19T02:18:32.565 INFO:tasks.workunit.client.0.smithi073.stdout:2/504: rename d5/d10/d14/c6f to d5/d10/d29/d66/cb7 0 2024-04-19T02:18:32.565 INFO:tasks.workunit.client.0.smithi073.stdout:0/474: write d7/d14/d17/d1a/d20/d50/f85 [819291,23165] 0 2024-04-19T02:18:32.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/566: chown d0/d1d/d25/d35/d88/c91 206 1 2024-04-19T02:18:32.566 INFO:tasks.workunit.client.0.smithi073.stdout:8/477: symlink d14/d15/d17/d48/d89/d97/l9c 0 2024-04-19T02:18:32.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/567: mkdir d0/d1d/d64/dbd 0 2024-04-19T02:18:32.567 INFO:tasks.workunit.client.0.smithi073.stdout:0/475: write d7/d14/d17/d1a/d20/f6c [137212,111435] 0 2024-04-19T02:18:32.567 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:32.568 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:32.568 INFO:tasks.workunit.client.0.smithi073.stdout:5/568: dread - d0/d1d/d24/d62/f7e zero size 2024-04-19T02:18:32.568 INFO:tasks.workunit.client.0.smithi073.stdout:3/580: link d3/d6/db/d23/c8d d3/d6/cbd 0 2024-04-19T02:18:32.568 INFO:tasks.workunit.client.0.smithi073.stdout:0/476: fdatasync d7/d14/d17/d1a/d21/f5e 0 2024-04-19T02:18:32.568 INFO:tasks.workunit.client.0.smithi073.stdout:8/478: link d14/d27/c3c d14/d27/d29/d31/d34/c9d 0 2024-04-19T02:18:32.569 INFO:tasks.workunit.client.0.smithi073.stdout:3/581: write d3/d6/db/d3a/d38/d43/d4e/f91 [568464,42019] 0 2024-04-19T02:18:32.569 INFO:tasks.workunit.client.0.smithi073.stdout:8/479: symlink d14/d15/d17/d99/l9e 0 2024-04-19T02:18:32.569 INFO:tasks.workunit.client.0.smithi073.stdout:8/480: chown d14/d27/d85 3760 1 2024-04-19T02:18:32.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/477: read d7/d14/f2d [155101,99860] 0 2024-04-19T02:18:32.572 INFO:tasks.workunit.client.0.smithi073.stdout:0/478: write d7/d6d/f91 [735686,48115] 0 2024-04-19T02:18:32.572 INFO:tasks.workunit.client.0.smithi073.stdout:0/479: chown d7/d14 275329683 1 2024-04-19T02:18:32.572 INFO:tasks.workunit.client.0.smithi073.stdout:2/505: dwrite d5/d10/d14/d18/f4d [0,4194304] 0 2024-04-19T02:18:32.572 INFO:tasks.workunit.client.0.smithi073.stdout:0/480: fdatasync d7/d14/d17/d1a/d21/f32 0 2024-04-19T02:18:32.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/506: truncate d5/d10/d29/d42/fa3 1691503 0 2024-04-19T02:18:32.575 INFO:tasks.workunit.client.0.smithi073.stdout:2/507: mkdir d5/d10/d14/d18/d3e/d51/db8 0 2024-04-19T02:18:32.575 INFO:tasks.workunit.client.0.smithi073.stdout:8/481: dwrite d14/d15/f1e [0,4194304] 0 2024-04-19T02:18:32.583 INFO:tasks.workunit.client.0.smithi073.stdout:6/433: sync 2024-04-19T02:18:32.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/471: sync 2024-04-19T02:18:32.584 INFO:tasks.workunit.client.0.smithi073.stdout:9/476: sync 2024-04-19T02:18:32.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/472: write db/f36 [4832612,51700] 0 2024-04-19T02:18:32.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/434: rename d8/de/d35 to d8/d4b/d93 0 2024-04-19T02:18:32.585 INFO:tasks.workunit.client.0.smithi073.stdout:1/473: unlink db/d1c/d81/d86/f8a 0 2024-04-19T02:18:32.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/435: write d8/de/d58/d63/d82/f83 [1045305,84156] 0 2024-04-19T02:18:32.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/474: link db/d1c/d81/c88 db/d1c/d78/ca7 0 2024-04-19T02:18:32.586 INFO:tasks.workunit.client.0.smithi073.stdout:6/436: fdatasync d8/de/d22/f3a 0 2024-04-19T02:18:32.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/475: mknod db/d1c/d78/d8c/ca8 0 2024-04-19T02:18:32.586 INFO:tasks.workunit.client.0.smithi073.stdout:6/437: read - d8/de/d78/f90 zero size 2024-04-19T02:18:32.591 INFO:tasks.workunit.client.0.smithi073.stdout:6/438: dwrite f3 [4194304,4194304] 0 2024-04-19T02:18:32.592 INFO:tasks.workunit.client.0.smithi073.stdout:6/439: mknod d8/de/d22/c94 0 2024-04-19T02:18:32.592 INFO:tasks.workunit.client.0.smithi073.stdout:6/440: stat d8/de/f1f 0 2024-04-19T02:18:32.592 INFO:tasks.workunit.client.0.smithi073.stdout:8/482: read d14/d27/d4c/d75/f4b [62847,70734] 0 2024-04-19T02:18:32.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:32.594 INFO:tasks.workunit.client.0.smithi073.stdout:8/483: creat d14/f9f x:0 0 0 2024-04-19T02:18:32.596 INFO:tasks.workunit.client.0.smithi073.stdout:5/569: write d0/d1d/d25/f27 [1856130,59797] 0 2024-04-19T02:18:32.596 INFO:tasks.workunit.client.0.smithi073.stdout:0/481: write d7/d14/d17/d69/f80 [1228448,26891] 0 2024-04-19T02:18:32.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/508: truncate d5/d10/d14/d18/d3e/f49 4015468 0 2024-04-19T02:18:32.597 INFO:tasks.workunit.client.0.smithi073.stdout:5/570: stat d0/d1d/d25/d37/l50 0 2024-04-19T02:18:32.597 INFO:tasks.workunit.client.0.smithi073.stdout:0/482: stat d7/d14/d17/d1a/c5c 0 2024-04-19T02:18:32.598 INFO:tasks.workunit.client.0.smithi073.stdout:2/509: chown d5/d10/d14/d18/d3e 1381 1 2024-04-19T02:18:32.598 INFO:tasks.workunit.client.0.smithi073.stdout:6/441: dwrite d8/de/d22/f34 [0,4194304] 0 2024-04-19T02:18:32.599 INFO:tasks.workunit.client.0.smithi073.stdout:0/483: mknod d7/d14/c93 0 2024-04-19T02:18:32.600 INFO:tasks.workunit.client.0.smithi073.stdout:6/442: rename d8/f66 to d8/d4b/d8f/f95 0 2024-04-19T02:18:32.600 INFO:tasks.workunit.client.0.smithi073.stdout:3/582: dwrite d3/d6/f9 [0,4194304] 0 2024-04-19T02:18:32.601 INFO:tasks.workunit.client.0.smithi073.stdout:6/443: link d8/de/d22/f64 d8/de/f96 0 2024-04-19T02:18:32.603 INFO:tasks.workunit.client.0.smithi073.stdout:2/510: read d5/d10/d29/f8d [2377650,102763] 0 2024-04-19T02:18:32.603 INFO:tasks.workunit.client.0.smithi073.stdout:6/444: write d8/de/f47 [1122646,44304] 0 2024-04-19T02:18:32.604 INFO:tasks.workunit.client.0.smithi073.stdout:3/583: dread d3/d6/db/d1a/f9a [0,4194304] 0 2024-04-19T02:18:32.604 INFO:tasks.workunit.client.0.smithi073.stdout:4/485: dread da/d27/d1b/d1d/d8d/d84/fa8 [0,4194304] 0 2024-04-19T02:18:32.604 INFO:tasks.workunit.client.0.smithi073.stdout:2/511: dread - d5/d10/d14/d18/d3e/f85 zero size 2024-04-19T02:18:32.605 INFO:tasks.workunit.client.0.smithi073.stdout:4/486: chown da/d27/d1b/d1d/d72/d3d/l5d 1507356 1 2024-04-19T02:18:32.606 INFO:tasks.workunit.client.0.smithi073.stdout:3/584: creat d3/d6/db/d3a/d38/d57/d88/fbe x:0 0 0 2024-04-19T02:18:32.606 INFO:tasks.workunit.client.0.smithi073.stdout:0/484: dwrite d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:32.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/512: getdents d5/d10/d29/d66/d83 0 2024-04-19T02:18:32.607 INFO:tasks.workunit.client.0.smithi073.stdout:6/445: truncate d8/de/d22/f3a 5451504 0 2024-04-19T02:18:32.607 INFO:tasks.workunit.client.0.smithi073.stdout:4/487: creat da/d27/d1b/d26/d2a/fa9 x:0 0 0 2024-04-19T02:18:32.607 INFO:tasks.workunit.client.0.smithi073.stdout:9/477: dwrite d0/fa [0,4194304] 0 2024-04-19T02:18:32.608 INFO:tasks.workunit.client.0.smithi073.stdout:3/585: symlink d3/d6/db/d1a/lbf 0 2024-04-19T02:18:32.609 INFO:tasks.workunit.client.0.smithi073.stdout:8/484: write d14/d27/d29/d31/f3e [693777,101956] 0 2024-04-19T02:18:32.609 INFO:tasks.workunit.client.0.smithi073.stdout:0/485: symlink d7/d14/d17/d70/l94 0 2024-04-19T02:18:32.609 INFO:tasks.workunit.client.0.smithi073.stdout:6/446: mkdir d8/de/d78/d97 0 2024-04-19T02:18:32.610 INFO:tasks.workunit.client.0.smithi073.stdout:7/512: sync 2024-04-19T02:18:32.610 INFO:tasks.workunit.client.0.smithi073.stdout:0/486: read d7/d14/f1b [2889160,123112] 0 2024-04-19T02:18:32.611 INFO:tasks.workunit.client.0.smithi073.stdout:9/478: mkdir d0/df/d16/da9 0 2024-04-19T02:18:32.611 INFO:tasks.workunit.client.0.smithi073.stdout:6/447: unlink d8/de/d22/f64 0 2024-04-19T02:18:32.612 INFO:tasks.workunit.client.0.smithi073.stdout:0/487: chown d7/d14/d17/f5f 3289 1 2024-04-19T02:18:32.612 INFO:tasks.workunit.client.0.smithi073.stdout:9/479: mknod d0/df/d16/d19/d38/d5d/d6d/caa 0 2024-04-19T02:18:32.614 INFO:tasks.workunit.client.0.smithi073.stdout:1/476: dwrite db/d3e/f47 [0,4194304] 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:9/480: rename d0/d81/f4f to d0/df/d16/d19/d38/fab 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:6/448: rmdir d8/de/d22 39 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:8/485: write d14/d27/f30 [2417002,98963] 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/586: mkdir d3/d6/db/d3a/d5f/da7/dc0 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/488: dwrite da/d27/d1b/d26/f9d [0,4194304] 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:9/481: write d0/fa1 [99817,65280] 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:1/477: rename db/d1c/d2c/l4b to db/d1c/d2c/d50/la9 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:9/482: readlink d0/df/d16/d19/d38/l3e 0 2024-04-19T02:18:32.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/489: rename da/l6d to da/d27/d1b/d8c/laa 0 2024-04-19T02:18:32.621 INFO:tasks.workunit.client.0.smithi073.stdout:1/478: link db/d1c/l49 db/d1c/d78/laa 0 2024-04-19T02:18:32.621 INFO:tasks.workunit.client.0.smithi073.stdout:2/513: dwrite d5/d10/d53/f75 [4194304,4194304] 0 2024-04-19T02:18:32.621 INFO:tasks.workunit.client.0.smithi073.stdout:3/587: rename d3/d6/db/d3a/d5f/f78 to d3/d6/db/d3a/d38/d6f/dac/fc1 0 2024-04-19T02:18:32.621 INFO:tasks.workunit.client.0.smithi073.stdout:9/483: write d0/df/d16/d1a/f63 [1957664,118759] 0 2024-04-19T02:18:32.622 INFO:tasks.workunit.client.0.smithi073.stdout:1/479: readlink db/d1c/d2c/l9a 0 2024-04-19T02:18:32.622 INFO:tasks.workunit.client.0.smithi073.stdout:3/588: readlink d3/d6/db/d1a/l61 0 2024-04-19T02:18:32.622 INFO:tasks.workunit.client.0.smithi073.stdout:4/490: write da/d27/d1b/d1d/d8d/f78 [275890,59456] 0 2024-04-19T02:18:32.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/514: link d5/d10/d14/d18/d3e/f62 d5/fb9 0 2024-04-19T02:18:32.623 INFO:tasks.workunit.client.0.smithi073.stdout:3/589: chown d3/d6/f15 3265 1 2024-04-19T02:18:32.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/491: mknod da/d27/cab 0 2024-04-19T02:18:32.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/515: chown d5/d10/d29/d66/c94 11190673 1 2024-04-19T02:18:32.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/516: readlink d5/d10/l1c 0 2024-04-19T02:18:32.624 INFO:tasks.workunit.client.0.smithi073.stdout:3/590: write d3/d6/db/d3a/d38/d57/f7a [497458,10336] 0 2024-04-19T02:18:32.625 INFO:tasks.workunit.client.0.smithi073.stdout:4/492: mknod da/d27/d1b/d26/d2a/d46/cac 0 2024-04-19T02:18:32.625 INFO:tasks.workunit.client.0.smithi073.stdout:8/486: dwrite d14/d27/d29/f98 [0,4194304] 0 2024-04-19T02:18:32.625 INFO:tasks.workunit.client.0.smithi073.stdout:4/493: mknod da/cad 0 2024-04-19T02:18:32.625 INFO:tasks.workunit.client.0.smithi073.stdout:3/591: write d3/d6/db/d16/d75/f60 [440494,46786] 0 2024-04-19T02:18:32.626 INFO:tasks.workunit.client.0.smithi073.stdout:8/487: chown d14/d15/d17/d48 6464389 1 2024-04-19T02:18:32.626 INFO:tasks.workunit.client.0.smithi073.stdout:4/494: write da/d27/f6f [526383,10653] 0 2024-04-19T02:18:32.632 INFO:tasks.workunit.client.0.smithi073.stdout:2/517: dwrite d5/d10/d29/d42/fb4 [0,4194304] 0 2024-04-19T02:18:32.632 INFO:tasks.workunit.client.0.smithi073.stdout:3/592: dwrite d3/d6/db/f14 [0,4194304] 0 2024-04-19T02:18:32.634 INFO:tasks.workunit.client.0.smithi073.stdout:8/488: dwrite d14/d27/d29/d31/f74 [0,4194304] 0 2024-04-19T02:18:32.634 INFO:tasks.workunit.client.0.smithi073.stdout:5/571: sync 2024-04-19T02:18:32.635 INFO:tasks.workunit.client.0.smithi073.stdout:2/518: creat d5/d10/d14/d7a/fba x:0 0 0 2024-04-19T02:18:32.636 INFO:tasks.workunit.client.0.smithi073.stdout:5/572: mknod d0/d1d/d25/d35/d39/cbe 0 2024-04-19T02:18:32.636 INFO:tasks.workunit.client.0.smithi073.stdout:8/489: link d14/d27/d29/d31/d34/l4d d14/d15/d17/d48/la0 0 2024-04-19T02:18:32.637 INFO:tasks.workunit.client.0.smithi073.stdout:5/573: unlink d0/d1d/d25/d35/f4b 0 2024-04-19T02:18:32.637 INFO:tasks.workunit.client.0.smithi073.stdout:8/490: mkdir d14/d15/d17/da1 0 2024-04-19T02:18:32.640 INFO:tasks.workunit.client.0.smithi073.stdout:5/574: mkdir d0/d1d/d25/d35/dbf 0 2024-04-19T02:18:32.640 INFO:tasks.workunit.client.0.smithi073.stdout:5/575: fsync d0/d1d/d25/f9a 0 2024-04-19T02:18:32.643 INFO:tasks.workunit.client.0.smithi073.stdout:1/480: dread db/d41/f67 [0,4194304] 0 2024-04-19T02:18:32.644 INFO:tasks.workunit.client.0.smithi073.stdout:8/491: dwrite d14/f93 [0,4194304] 0 2024-04-19T02:18:32.644 INFO:tasks.workunit.client.0.smithi073.stdout:1/481: mkdir db/d1c/d54/d8b/dab 0 2024-04-19T02:18:32.645 INFO:tasks.workunit.client.0.smithi073.stdout:8/492: fdatasync d14/d27/d29/d64/f78 0 2024-04-19T02:18:32.645 INFO:tasks.workunit.client.0.smithi073.stdout:1/482: creat db/fac x:0 0 0 2024-04-19T02:18:32.646 INFO:tasks.workunit.client.0.smithi073.stdout:1/483: rmdir db/d3e/d6f 39 2024-04-19T02:18:32.646 INFO:tasks.workunit.client.0.smithi073.stdout:1/484: dread - db/d1c/d54/f90 zero size 2024-04-19T02:18:32.646 INFO:tasks.workunit.client.0.smithi073.stdout:5/576: dwrite d0/d1d/d25/d37/f3e [4194304,4194304] 0 2024-04-19T02:18:32.655 INFO:tasks.workunit.client.0.smithi073.stdout:1/485: dwrite db/d1c/d2c/d50/f6b [0,4194304] 0 2024-04-19T02:18:32.655 INFO:tasks.workunit.client.0.smithi073.stdout:5/577: dwrite d0/f1b [4194304,4194304] 0 2024-04-19T02:18:32.656 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:32.655+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:32.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/486: rmdir db/d1c/d54 39 2024-04-19T02:18:32.656 INFO:tasks.workunit.client.0.smithi073.stdout:3/593: dwrite d3/d6/db/d3a/d38/d89/d94/f35 [0,4194304] 0 2024-04-19T02:18:32.658 INFO:tasks.workunit.client.0.smithi073.stdout:2/519: truncate d5/d10/d29/d66/d67/d72/f2f 3879586 0 2024-04-19T02:18:32.659 INFO:tasks.workunit.client.0.smithi073.stdout:2/520: write d5/d10/d14/d18/fae [74158,20178] 0 2024-04-19T02:18:32.659 INFO:tasks.workunit.client.0.smithi073.stdout:2/521: stat d5/d10/d53/f73 0 2024-04-19T02:18:32.660 INFO:tasks.workunit.client.0.smithi073.stdout:3/594: mkdir d3/d6/db/d3a/d38/d57/d88/dc2 0 2024-04-19T02:18:32.660 INFO:tasks.workunit.client.0.smithi073.stdout:2/522: chown d5/d10/d14/d18/d3e/f49 795 1 2024-04-19T02:18:32.660 INFO:tasks.workunit.client.0.smithi073.stdout:3/595: fsync d3/f5 0 2024-04-19T02:18:32.661 INFO:tasks.workunit.client.0.smithi073.stdout:2/523: symlink d5/d10/d29/d66/lbb 0 2024-04-19T02:18:32.662 INFO:tasks.workunit.client.0.smithi073.stdout:3/596: write d3/d6/db/d16/d9e/fa8 [921238,41504] 0 2024-04-19T02:18:32.663 INFO:tasks.workunit.client.0.smithi073.stdout:2/524: mkdir d5/d10/d29/d66/d83/dbc 0 2024-04-19T02:18:32.663 INFO:tasks.workunit.client.0.smithi073.stdout:3/597: mknod d3/d6/db/d3a/d38/cc3 0 2024-04-19T02:18:32.663 INFO:tasks.workunit.client.0.smithi073.stdout:3/598: mknod d3/d6/db/d3a/d5f/da7/dc0/cc4 0 2024-04-19T02:18:32.664 INFO:tasks.workunit.client.0.smithi073.stdout:3/599: creat d3/d6/db/d3a/d38/d89/d94/fc5 x:0 0 0 2024-04-19T02:18:32.664 INFO:tasks.workunit.client.0.smithi073.stdout:5/578: read d0/d1d/d24/f5e [198249,23548] 0 2024-04-19T02:18:32.665 INFO:tasks.workunit.client.0.smithi073.stdout:5/579: read - d0/d1d/d24/d61/fb4 zero size 2024-04-19T02:18:32.665 INFO:tasks.workunit.client.0.smithi073.stdout:3/600: chown d3/d6/db/d3a/d5f/lb8 6 1 2024-04-19T02:18:32.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/493: dread d14/d27/d29/f79 [0,4194304] 0 2024-04-19T02:18:32.668 INFO:tasks.workunit.client.0.smithi073.stdout:6/449: dread d8/de/f1e [0,4194304] 0 2024-04-19T02:18:32.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/494: rename d14/c4e to d14/d27/d29/ca2 0 2024-04-19T02:18:32.670 INFO:tasks.workunit.client.0.smithi073.stdout:8/495: creat d14/d27/d29/d31/fa3 x:0 0 0 2024-04-19T02:18:32.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/496: chown d14/d87 1 1 2024-04-19T02:18:32.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/497: mkdir d14/d27/da4 0 2024-04-19T02:18:32.674 INFO:tasks.workunit.client.0.smithi073.stdout:6/450: dwrite d8/de/d78/f90 [0,4194304] 0 2024-04-19T02:18:32.676 INFO:tasks.workunit.client.0.smithi073.stdout:7/513: dread d0/dc/d67/f65 [0,4194304] 0 2024-04-19T02:18:32.676 INFO:tasks.workunit.client.0.smithi073.stdout:9/484: dread d0/df/d16/d1a/f37 [0,4194304] 0 2024-04-19T02:18:32.677 INFO:tasks.workunit.client.0.smithi073.stdout:7/514: write d0/f8 [4057137,15843] 0 2024-04-19T02:18:32.677 INFO:tasks.workunit.client.0.smithi073.stdout:7/515: fsync d0/f7 0 2024-04-19T02:18:32.678 INFO:tasks.workunit.client.0.smithi073.stdout:7/516: mknod d0/dc/d33/c9a 0 2024-04-19T02:18:32.680 INFO:tasks.workunit.client.0.smithi073.stdout:4/495: dread da/d27/d1b/d1d/d72/d3d/f40 [0,4194304] 0 2024-04-19T02:18:32.682 INFO:tasks.workunit.client.0.smithi073.stdout:4/496: symlink da/d27/d36/lae 0 2024-04-19T02:18:32.682 INFO:tasks.workunit.client.0.smithi073.stdout:9/485: dwrite d0/df/d1d/f33 [4194304,4194304] 0 2024-04-19T02:18:32.684 INFO:tasks.workunit.client.0.smithi073.stdout:7/517: dwrite d0/f7c [0,4194304] 0 2024-04-19T02:18:32.684 INFO:tasks.workunit.client.0.smithi073.stdout:4/497: rename da/d27/d3a/d50/f61 to da/d27/d1b/d1d/d72/d2b/faf 0 2024-04-19T02:18:32.685 INFO:tasks.workunit.client.0.smithi073.stdout:8/498: dread d14/d15/d17/f77 [0,4194304] 0 2024-04-19T02:18:32.685 INFO:tasks.workunit.client.0.smithi073.stdout:9/486: creat d0/df/d16/d19/d38/d5d/d76/d7d/d88/fac x:0 0 0 2024-04-19T02:18:32.685 INFO:tasks.workunit.client.0.smithi073.stdout:3/601: dread d3/d6/db/d3a/d38/d40/f6e [0,4194304] 0 2024-04-19T02:18:32.686 INFO:tasks.workunit.client.0.smithi073.stdout:8/499: creat d14/d27/d50/fa5 x:0 0 0 2024-04-19T02:18:32.686 INFO:tasks.workunit.client.0.smithi073.stdout:3/602: stat d3/d6/da6 0 2024-04-19T02:18:32.686 INFO:tasks.workunit.client.0.smithi073.stdout:4/498: dread - da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f zero size 2024-04-19T02:18:32.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/500: stat d14/d27/d7b/c92 0 2024-04-19T02:18:32.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/501: fdatasync d14/d27/d4c/f76 0 2024-04-19T02:18:32.687 INFO:tasks.workunit.client.0.smithi073.stdout:4/499: creat da/d27/d1b/d8c/fb0 x:0 0 0 2024-04-19T02:18:32.688 INFO:tasks.workunit.client.0.smithi073.stdout:8/502: dread - d14/d27/d29/d69/f8c zero size 2024-04-19T02:18:32.688 INFO:tasks.workunit.client.0.smithi073.stdout:8/503: readlink d14/d27/d50/l68 0 2024-04-19T02:18:32.689 INFO:tasks.workunit.client.0.smithi073.stdout:8/504: mknod d14/d15/d17/da1/ca6 0 2024-04-19T02:18:32.690 INFO:tasks.workunit.client.0.smithi073.stdout:8/505: symlink d14/d27/la7 0 2024-04-19T02:18:32.690 INFO:tasks.workunit.client.0.smithi073.stdout:8/506: fsync d14/d15/d17/f2c 0 2024-04-19T02:18:32.691 INFO:tasks.workunit.client.0.smithi073.stdout:8/507: link d14/d15/f35 d14/d27/d29/d31/d34/fa8 0 2024-04-19T02:18:32.691 INFO:tasks.workunit.client.0.smithi073.stdout:4/500: dread da/d27/d1b/d1d/d8d/f78 [0,4194304] 0 2024-04-19T02:18:32.692 INFO:tasks.workunit.client.0.smithi073.stdout:4/501: mknod da/d27/d3a/cb1 0 2024-04-19T02:18:32.693 INFO:tasks.workunit.client.0.smithi073.stdout:4/502: symlink da/d27/d3a/lb2 0 2024-04-19T02:18:32.694 INFO:tasks.workunit.client.0.smithi073.stdout:4/503: rmdir da/d27/d1b 39 2024-04-19T02:18:32.694 INFO:tasks.workunit.client.0.smithi073.stdout:0/488: dread d7/d14/d17/d1a/f22 [0,4194304] 0 2024-04-19T02:18:32.695 INFO:tasks.workunit.client.0.smithi073.stdout:7/518: read d0/dc/d67/d2a/d51/f6c [7855,106346] 0 2024-04-19T02:18:32.696 INFO:tasks.workunit.client.0.smithi073.stdout:7/519: fsync d0/dc/d67/d15/f87 0 2024-04-19T02:18:32.696 INFO:tasks.workunit.client.0.smithi073.stdout:4/504: truncate da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f 868765 0 2024-04-19T02:18:32.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/520: creat d0/dc/d67/d15/d8f/f9b x:0 0 0 2024-04-19T02:18:32.698 INFO:tasks.workunit.client.0.smithi073.stdout:4/505: read da/d27/d1b/d1d/d8d/f89 [1363591,52798] 0 2024-04-19T02:18:32.700 INFO:tasks.workunit.client.0.smithi073.stdout:0/489: dwrite f2 [0,4194304] 0 2024-04-19T02:18:32.701 INFO:tasks.workunit.client.0.smithi073.stdout:5/580: dread d0/d1d/d1e/f2b [0,4194304] 0 2024-04-19T02:18:32.702 INFO:tasks.workunit.client.0.smithi073.stdout:5/581: rmdir d0/d1d/d24/d62 39 2024-04-19T02:18:32.705 INFO:tasks.workunit.client.0.smithi073.stdout:7/521: dwrite d0/dc/d39/d40/f44 [0,4194304] 0 2024-04-19T02:18:32.706 INFO:tasks.workunit.client.0.smithi073.stdout:7/522: readlink d0/dc/l77 0 2024-04-19T02:18:32.706 INFO:tasks.workunit.client.0.smithi073.stdout:4/506: dwrite da/f11 [0,4194304] 0 2024-04-19T02:18:32.707 INFO:tasks.workunit.client.0.smithi073.stdout:0/490: dwrite d7/d14/d17/d1a/f7e [0,4194304] 0 2024-04-19T02:18:32.707 INFO:tasks.workunit.client.0.smithi073.stdout:7/523: link d0/d3/f74 d0/dc/d67/d2a/f9c 0 2024-04-19T02:18:32.708 INFO:tasks.workunit.client.0.smithi073.stdout:0/491: dread - d7/d14/d17/d1a/f7d zero size 2024-04-19T02:18:32.708 INFO:tasks.workunit.client.0.smithi073.stdout:7/524: read - d0/dc/d33/f91 zero size 2024-04-19T02:18:32.708 INFO:tasks.workunit.client.0.smithi073.stdout:4/507: rename da/d27/d1b/d1d/f37 to da/d27/d1b/d1d/d8d/fb3 0 2024-04-19T02:18:32.709 INFO:tasks.workunit.client.0.smithi073.stdout:4/508: getdents da/d27/d3a/d50/d9c 0 2024-04-19T02:18:32.709 INFO:tasks.workunit.client.0.smithi073.stdout:7/525: mknod d0/dc/d33/d36/d7b/d93/d97/c9d 0 2024-04-19T02:18:32.710 INFO:tasks.workunit.client.0.smithi073.stdout:4/509: getdents da/d27/d3a/d50/d9c 0 2024-04-19T02:18:32.712 INFO:tasks.workunit.client.0.smithi073.stdout:8/508: dread d14/d15/f7e [0,4194304] 0 2024-04-19T02:18:32.712 INFO:tasks.workunit.client.0.smithi073.stdout:7/526: sync 2024-04-19T02:18:32.713 INFO:tasks.workunit.client.0.smithi073.stdout:7/527: creat d0/d28/d63/f9e x:0 0 0 2024-04-19T02:18:32.715 INFO:tasks.workunit.client.0.smithi073.stdout:7/528: mkdir d0/dc/d67/d2a/d51/d7a/d9f 0 2024-04-19T02:18:32.717 INFO:tasks.workunit.client.0.smithi073.stdout:8/509: dwrite f11 [0,4194304] 0 2024-04-19T02:18:32.718 INFO:tasks.workunit.client.0.smithi073.stdout:8/510: sync 2024-04-19T02:18:32.719 INFO:tasks.workunit.client.0.smithi073.stdout:8/511: creat d14/d27/d85/d9b/fa9 x:0 0 0 2024-04-19T02:18:32.719 INFO:tasks.workunit.client.0.smithi073.stdout:8/512: creat d14/d27/d29/d31/d34/faa x:0 0 0 2024-04-19T02:18:32.720 INFO:tasks.workunit.client.0.smithi073.stdout:8/513: symlink d14/d15/lab 0 2024-04-19T02:18:32.720 INFO:tasks.workunit.client.0.smithi073.stdout:1/487: truncate db/d1c/d2c/d50/f6b 997316 0 2024-04-19T02:18:32.721 INFO:tasks.workunit.client.0.smithi073.stdout:2/525: write d5/d10/d29/d66/d83/faa [603171,127908] 0 2024-04-19T02:18:32.721 INFO:tasks.workunit.client.0.smithi073.stdout:8/514: creat d14/d27/d7b/fac x:0 0 0 2024-04-19T02:18:32.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/451: write d8/de/f96 [545100,11754] 0 2024-04-19T02:18:32.723 INFO:tasks.workunit.client.0.smithi073.stdout:4/510: getdents da/d27/d1b/d8c 0 2024-04-19T02:18:32.723 INFO:tasks.workunit.client.0.smithi073.stdout:1/488: mkdir db/d1c/d81/d83/dad 0 2024-04-19T02:18:32.723 INFO:tasks.workunit.client.0.smithi073.stdout:2/526: fsync d5/d10/d29/d42/fb4 0 2024-04-19T02:18:32.723 INFO:tasks.workunit.client.0.smithi073.stdout:6/452: mknod d8/d4b/c98 0 2024-04-19T02:18:32.724 INFO:tasks.workunit.client.0.smithi073.stdout:4/511: creat da/d27/d1b/d26/d2a/d46/fb4 x:0 0 0 2024-04-19T02:18:32.724 INFO:tasks.workunit.client.0.smithi073.stdout:6/453: mknod d8/d71/d7d/c99 0 2024-04-19T02:18:32.724 INFO:tasks.workunit.client.0.smithi073.stdout:1/489: rename db/d3e/d6f to db/d1c/d81/d86/dae 0 2024-04-19T02:18:32.725 INFO:tasks.workunit.client.0.smithi073.stdout:2/527: getdents d5/d10/d14/d18/d98 0 2024-04-19T02:18:32.725 INFO:tasks.workunit.client.0.smithi073.stdout:4/512: mknod da/d27/d1b/d1d/d72/d3d/d95/cb5 0 2024-04-19T02:18:32.726 INFO:tasks.workunit.client.0.smithi073.stdout:2/528: creat d5/d10/d14/d18/fbd x:0 0 0 2024-04-19T02:18:32.726 INFO:tasks.workunit.client.0.smithi073.stdout:4/513: write da/d27/d1b/d1d/d8d/f98 [585659,56599] 0 2024-04-19T02:18:32.728 INFO:tasks.workunit.client.0.smithi073.stdout:4/514: fsync da/d27/d1b/d1d/d8d/f89 0 2024-04-19T02:18:32.728 INFO:tasks.workunit.client.0.smithi073.stdout:2/529: link d5/d10/d14/f2c d5/d10/d14/db6/fbe 0 2024-04-19T02:18:32.728 INFO:tasks.workunit.client.0.smithi073.stdout:1/490: dread db/d1c/d2c/d50/f60 [0,4194304] 0 2024-04-19T02:18:32.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/515: dread d14/d27/d29/d31/f74 [0,4194304] 0 2024-04-19T02:18:32.729 INFO:tasks.workunit.client.0.smithi073.stdout:2/530: readlink d5/d10/d29/d66/d67/d72/l3b 0 2024-04-19T02:18:32.730 INFO:tasks.workunit.client.0.smithi073.stdout:1/491: symlink db/d1c/d54/laf 0 2024-04-19T02:18:32.730 INFO:tasks.workunit.client.0.smithi073.stdout:4/515: rename da/d27/d1b/d26/c48 to da/d27/d3a/d50/cb6 0 2024-04-19T02:18:32.731 INFO:tasks.workunit.client.0.smithi073.stdout:2/531: chown d5/d10/d29/d66/d83/dbc 9161 1 2024-04-19T02:18:32.732 INFO:tasks.workunit.client.0.smithi073.stdout:8/516: getdents d14/d15/d17/d99 0 2024-04-19T02:18:32.732 INFO:tasks.workunit.client.0.smithi073.stdout:6/454: dwrite d8/de/d58/d63/d82/f83 [0,4194304] 0 2024-04-19T02:18:32.732 INFO:tasks.workunit.client.0.smithi073.stdout:0/492: dwrite d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:32.733 INFO:tasks.workunit.client.0.smithi073.stdout:2/532: stat d5/d10/d29/d42/fb4 0 2024-04-19T02:18:32.734 INFO:tasks.workunit.client.0.smithi073.stdout:8/517: mknod d14/d27/d7b/cad 0 2024-04-19T02:18:32.734 INFO:tasks.workunit.client.0.smithi073.stdout:0/493: fsync d7/d14/d17/d1a/d20/f48 0 2024-04-19T02:18:32.735 INFO:tasks.workunit.client.0.smithi073.stdout:3/603: dread d3/d6/db/d3a/f70 [4194304,4194304] 0 2024-04-19T02:18:32.735 INFO:tasks.workunit.client.0.smithi073.stdout:2/533: creat d5/d10/d14/d18/d3e/d51/fbf x:0 0 0 2024-04-19T02:18:32.735 INFO:tasks.workunit.client.0.smithi073.stdout:8/518: symlink d14/d15/lae 0 2024-04-19T02:18:32.735 INFO:tasks.workunit.client.0.smithi073.stdout:2/534: fdatasync d5/d10/d14/f21 0 2024-04-19T02:18:32.736 INFO:tasks.workunit.client.0.smithi073.stdout:0/494: mknod d7/d14/d17/d69/d7c/c95 0 2024-04-19T02:18:32.736 INFO:tasks.workunit.client.0.smithi073.stdout:3/604: write d3/d6/db/f2d [909327,127049] 0 2024-04-19T02:18:32.737 INFO:tasks.workunit.client.0.smithi073.stdout:2/535: mkdir d5/d10/d14/d2e/da0/dc0 0 2024-04-19T02:18:32.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/495: creat d7/d14/d17/d1a/d8d/f96 x:0 0 0 2024-04-19T02:18:32.737 INFO:tasks.workunit.client.0.smithi073.stdout:9/487: dread d0/df/d16/d19/d38/d5d/d45/f48 [0,4194304] 0 2024-04-19T02:18:32.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/496: fsync f5 0 2024-04-19T02:18:32.738 INFO:tasks.workunit.client.0.smithi073.stdout:3/605: creat d3/d6/db/d1a/d2f/fc6 x:0 0 0 2024-04-19T02:18:32.739 INFO:tasks.workunit.client.0.smithi073.stdout:2/536: truncate d5/d10/fa7 922859 0 2024-04-19T02:18:32.740 INFO:tasks.workunit.client.0.smithi073.stdout:2/537: rmdir d5/d10/d14 39 2024-04-19T02:18:32.740 INFO:tasks.workunit.client.0.smithi073.stdout:7/529: write d0/dc/d33/d36/f3b [396854,11032] 0 2024-04-19T02:18:32.741 INFO:tasks.workunit.client.0.smithi073.stdout:2/538: rename d5/d10/d29/d66/d67/d72/f25 to d5/d10/d14/d18/d3e/d2d/fc1 0 2024-04-19T02:18:32.742 INFO:tasks.workunit.client.0.smithi073.stdout:7/530: chown d0/dc/d67/d15/c52 731020 1 2024-04-19T02:18:32.743 INFO:tasks.workunit.client.0.smithi073.stdout:8/519: dwrite d14/d27/d29/d31/d34/f40 [0,4194304] 0 2024-04-19T02:18:32.744 INFO:tasks.workunit.client.0.smithi073.stdout:7/531: write d0/dc/d39/d40/f44 [2847240,70301] 0 2024-04-19T02:18:32.745 INFO:tasks.workunit.client.0.smithi073.stdout:3/606: dwrite d3/d6/db/d16/d75/f60 [0,4194304] 0 2024-04-19T02:18:32.745 INFO:tasks.workunit.client.0.smithi073.stdout:9/488: dwrite d0/df/d60/f90 [0,4194304] 0 2024-04-19T02:18:32.747 INFO:tasks.workunit.client.0.smithi073.stdout:3/607: chown d3/d6/db/d3a/d38/d43/f84 111238 1 2024-04-19T02:18:32.747 INFO:tasks.workunit.client.0.smithi073.stdout:3/608: sync 2024-04-19T02:18:32.748 INFO:tasks.workunit.client.0.smithi073.stdout:3/609: chown d3/d6/db/d1a/faa 724 1 2024-04-19T02:18:32.748 INFO:tasks.workunit.client.0.smithi073.stdout:3/610: fdatasync d3/d6/db/f14 0 2024-04-19T02:18:32.749 INFO:tasks.workunit.client.0.smithi073.stdout:2/539: dwrite d5/d10/d14/d18/d3e/d2d/d63/f9f [0,4194304] 0 2024-04-19T02:18:32.750 INFO:tasks.workunit.client.0.smithi073.stdout:3/611: rename d3/d6/db/d3a/d5f/fa3 to d3/d6/db/d3a/d38/d89/d94/fc7 0 2024-04-19T02:18:32.753 INFO:tasks.workunit.client.0.smithi073.stdout:9/489: dwrite d0/df/d1d/f17 [0,4194304] 0 2024-04-19T02:18:32.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/490: rmdir d0/df/d16/d19/d38/d5d/d5e/d83/d9a 0 2024-04-19T02:18:32.757 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:32.752+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:32.757 INFO:tasks.workunit.client.0.smithi073.stdout:2/540: dwrite d5/d10/d29/f8c [0,4194304] 0 2024-04-19T02:18:32.757 INFO:tasks.workunit.client.0.smithi073.stdout:2/541: readlink d5/d10/d29/l87 0 2024-04-19T02:18:32.763 INFO:tasks.workunit.client.0.smithi073.stdout:2/542: dwrite d5/d10/d53/f92 [0,4194304] 0 2024-04-19T02:18:32.765 INFO:tasks.workunit.client.0.smithi073.stdout:2/543: symlink d5/d10/d29/d66/d83/lc2 0 2024-04-19T02:18:32.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/497: truncate d7/d14/d17/d1a/d20/f6c 3928577 0 2024-04-19T02:18:32.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/498: chown d7/d14/d17/d1a/d20/f6c 200368154 1 2024-04-19T02:18:32.772 INFO:tasks.workunit.client.0.smithi073.stdout:8/520: truncate d14/d27/d29/d31/f3e 766328 0 2024-04-19T02:18:32.773 INFO:tasks.workunit.client.0.smithi073.stdout:0/499: rmdir d7/d14/d17/d70/d92 0 2024-04-19T02:18:32.778 INFO:tasks.workunit.client.0.smithi073.stdout:0/500: dwrite d7/d14/d17/f5f [0,4194304] 0 2024-04-19T02:18:32.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/582: dread d0/d1d/d24/f30 [0,4194304] 0 2024-04-19T02:18:32.780 INFO:tasks.workunit.client.0.smithi073.stdout:0/501: symlink d7/d14/d17/d1a/d56/d87/l97 0 2024-04-19T02:18:32.780 INFO:tasks.workunit.client.0.smithi073.stdout:5/583: write d0/f4f [4102483,77903] 0 2024-04-19T02:18:32.780 INFO:tasks.workunit.client.0.smithi073.stdout:0/502: sync 2024-04-19T02:18:32.780 INFO:tasks.workunit.client.0.smithi073.stdout:5/584: mknod d0/d1d/d25/d35/d99/cc0 0 2024-04-19T02:18:32.780 INFO:tasks.workunit.client.0.smithi073.stdout:0/503: write d7/d14/d17/d1a/d21/f5b [5206102,114341] 0 2024-04-19T02:18:32.781 INFO:tasks.workunit.client.0.smithi073.stdout:5/585: creat d0/d1d/d25/d35/d96/fc1 x:0 0 0 2024-04-19T02:18:32.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/586: unlink d0/d1d/d25/d35/f36 0 2024-04-19T02:18:32.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/587: sync 2024-04-19T02:18:32.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/588: dread - d0/d1d/d24/fa5 zero size 2024-04-19T02:18:32.787 INFO:tasks.workunit.client.0.smithi073.stdout:0/504: dwrite d7/d14/d17/d69/f6a [0,4194304] 0 2024-04-19T02:18:32.788 INFO:tasks.workunit.client.0.smithi073.stdout:0/505: stat d7/d14/d17/d1a/d20/c54 0 2024-04-19T02:18:32.788 INFO:tasks.workunit.client.0.smithi073.stdout:5/589: dwrite d0/f13 [0,4194304] 0 2024-04-19T02:18:32.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/506: getdents d7/d14/d17/d69/d7c 0 2024-04-19T02:18:32.789 INFO:tasks.workunit.client.0.smithi073.stdout:5/590: write d0/d1d/d1e/f55 [5052791,73404] 0 2024-04-19T02:18:32.790 INFO:tasks.workunit.client.0.smithi073.stdout:0/507: link d7/d14/d17/d70/c77 d7/d14/d17/d69/c98 0 2024-04-19T02:18:32.790 INFO:tasks.workunit.client.0.smithi073.stdout:0/508: fsync d7/d14/d17/d1a/d56/f65 0 2024-04-19T02:18:32.791 INFO:tasks.workunit.client.0.smithi073.stdout:0/509: write d7/d14/d17/d1a/d20/f48 [496711,114337] 0 2024-04-19T02:18:32.792 INFO:tasks.workunit.client.0.smithi073.stdout:0/510: getdents d7/d14 0 2024-04-19T02:18:32.792 INFO:tasks.workunit.client.0.smithi073.stdout:0/511: sync 2024-04-19T02:18:32.793 INFO:tasks.workunit.client.0.smithi073.stdout:0/512: read - d7/d14/d17/d69/d7c/f8b zero size 2024-04-19T02:18:32.796 INFO:tasks.workunit.client.0.smithi073.stdout:0/513: dread d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:32.798 INFO:tasks.workunit.client.0.smithi073.stdout:0/514: mkdir d7/d14/d17/d1a/d20/d50/d99 0 2024-04-19T02:18:32.799 INFO:tasks.workunit.client.0.smithi073.stdout:6/455: dread d8/d4b/d93/d60/f3f [0,4194304] 0 2024-04-19T02:18:32.799 INFO:tasks.workunit.client.0.smithi073.stdout:0/515: write f2 [3974852,118613] 0 2024-04-19T02:18:32.799 INFO:tasks.workunit.client.0.smithi073.stdout:6/456: write d8/de/d58/f33 [2385538,68461] 0 2024-04-19T02:18:32.799 INFO:tasks.workunit.client.0.smithi073.stdout:0/516: creat d7/d14/d17/d70/f9a x:0 0 0 2024-04-19T02:18:32.800 INFO:tasks.workunit.client.0.smithi073.stdout:4/516: dread da/d27/d1b/d1d/d72/d2b/f32 [0,4194304] 0 2024-04-19T02:18:32.800 INFO:tasks.workunit.client.0.smithi073.stdout:6/457: rmdir d8/de 39 2024-04-19T02:18:32.800 INFO:tasks.workunit.client.0.smithi073.stdout:0/517: link d7/d14/d17/f5f d7/d6d/f9b 0 2024-04-19T02:18:32.800 INFO:tasks.workunit.client.0.smithi073.stdout:4/517: mkdir da/d27/d1b/d8c/db7 0 2024-04-19T02:18:32.801 INFO:tasks.workunit.client.0.smithi073.stdout:4/518: mknod da/d27/d1b/d26/cb8 0 2024-04-19T02:18:32.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/518: rename d7/d14/d17/d1a/d20/l74 to d7/d14/d17/d1a/d56/l9c 0 2024-04-19T02:18:32.803 INFO:tasks.workunit.client.0.smithi073.stdout:0/519: read d7/d14/d17/d1a/d21/f8a [299323,25525] 0 2024-04-19T02:18:32.805 INFO:tasks.workunit.client.0.smithi073.stdout:6/458: dwrite d8/de/d78/f90 [0,4194304] 0 2024-04-19T02:18:32.807 INFO:tasks.workunit.client.0.smithi073.stdout:6/459: truncate d8/de/d58/d63/f74 1409059 0 2024-04-19T02:18:32.808 INFO:tasks.workunit.client.0.smithi073.stdout:6/460: rename d8/d71/d7d/c89 to d8/d4b/d93/c9a 0 2024-04-19T02:18:32.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:32.810 INFO:tasks.workunit.client.0.smithi073.stdout:0/520: dwrite d7/d6d/f91 [0,4194304] 0 2024-04-19T02:18:32.810 INFO:tasks.workunit.client.0.smithi073.stdout:6/461: write d8/d71/d75/f91 [2953162,88321] 0 2024-04-19T02:18:32.812 INFO:tasks.workunit.client.0.smithi073.stdout:0/521: write d7/d14/d17/d1a/d56/f78 [3701847,77138] 0 2024-04-19T02:18:32.816 INFO:tasks.workunit.client.0.smithi073.stdout:5/591: rmdir d0/d1d/d25 39 2024-04-19T02:18:32.821 INFO:tasks.workunit.client.0.smithi073.stdout:7/532: dread d0/dc/d67/f31 [0,4194304] 0 2024-04-19T02:18:32.823 INFO:tasks.workunit.client.0.smithi073.stdout:7/533: rename d0/dc/d67/c38 to d0/dc/d33/d36/d7b/d80/ca0 0 2024-04-19T02:18:32.826 INFO:tasks.workunit.client.0.smithi073.stdout:7/534: mkdir d0/dc/d33/d36/d7b/d80/da1 0 2024-04-19T02:18:32.826 INFO:tasks.workunit.client.0.smithi073.stdout:6/462: read d8/de/f2a [502534,43260] 0 2024-04-19T02:18:32.826 INFO:tasks.workunit.client.0.smithi073.stdout:7/535: write d0/dc/f5a [4874700,24553] 0 2024-04-19T02:18:32.826 INFO:tasks.workunit.client.0.smithi073.stdout:8/521: dwrite d14/d27/d29/d31/f3e [0,4194304] 0 2024-04-19T02:18:32.827 INFO:tasks.workunit.client.0.smithi073.stdout:6/463: rmdir d8/d4b/d93 39 2024-04-19T02:18:32.828 INFO:tasks.workunit.client.0.smithi073.stdout:6/464: rmdir d8 39 2024-04-19T02:18:32.828 INFO:tasks.workunit.client.0.smithi073.stdout:7/536: write d0/d3/f74 [4778812,15076] 0 2024-04-19T02:18:32.828 INFO:tasks.workunit.client.0.smithi073.stdout:2/544: dread d5/d10/d29/d66/d67/f86 [0,4194304] 0 2024-04-19T02:18:32.830 INFO:tasks.workunit.client.0.smithi073.stdout:7/537: creat d0/d28/d63/fa2 x:0 0 0 2024-04-19T02:18:32.831 INFO:tasks.workunit.client.0.smithi073.stdout:7/538: chown d0/dc/l16 13371 1 2024-04-19T02:18:32.831 INFO:tasks.workunit.client.0.smithi073.stdout:2/545: rmdir d5/d10 39 2024-04-19T02:18:32.831 INFO:tasks.workunit.client.0.smithi073.stdout:4/519: truncate da/d27/fa7 4475564 0 2024-04-19T02:18:32.832 INFO:tasks.workunit.client.0.smithi073.stdout:0/522: truncate d7/f67 658328 0 2024-04-19T02:18:32.833 INFO:tasks.workunit.client.0.smithi073.stdout:4/520: write da/d27/d36/f5e [847405,61303] 0 2024-04-19T02:18:32.834 INFO:tasks.workunit.client.0.smithi073.stdout:2/546: write d5/d10/d29/d42/fb4 [4233076,112031] 0 2024-04-19T02:18:32.834 INFO:tasks.workunit.client.0.smithi073.stdout:8/522: dwrite d14/d27/d50/f6f [0,4194304] 0 2024-04-19T02:18:32.835 INFO:tasks.workunit.client.0.smithi073.stdout:0/523: rename d7/d14/d17/d1a/c44 to d7/d6d/c9d 0 2024-04-19T02:18:32.835 INFO:tasks.workunit.client.0.smithi073.stdout:8/523: write f12 [3879646,32004] 0 2024-04-19T02:18:32.835 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:32.835 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:32.836 INFO:tasks.workunit.client.0.smithi073.stdout:0/524: chown d7/d14/f1b 1995 1 2024-04-19T02:18:32.836 INFO:tasks.workunit.client.0.smithi073.stdout:2/547: write d5/d10/d14/d7a/fba [20490,111947] 0 2024-04-19T02:18:32.836 INFO:tasks.workunit.client.0.smithi073.stdout:8/524: creat d14/d27/d50/faf x:0 0 0 2024-04-19T02:18:32.837 INFO:tasks.workunit.client.0.smithi073.stdout:0/525: write d7/d14/d17/d1a/f22 [47059,107477] 0 2024-04-19T02:18:32.839 INFO:tasks.workunit.client.0.smithi073.stdout:6/465: dwrite d8/d71/d75/f8a [4194304,4194304] 0 2024-04-19T02:18:32.839 INFO:tasks.workunit.client.0.smithi073.stdout:8/525: link d14/f62 d14/d27/d29/fb0 0 2024-04-19T02:18:32.839 INFO:tasks.workunit.client.0.smithi073.stdout:0/526: mkdir d7/d14/d17/d1a/d56/d9e 0 2024-04-19T02:18:32.839 INFO:tasks.workunit.client.0.smithi073.stdout:8/526: write d14/d27/d29/d31/f5e [213152,53273] 0 2024-04-19T02:18:32.840 INFO:tasks.workunit.client.0.smithi073.stdout:8/527: chown d14/d15/c54 256370897 1 2024-04-19T02:18:32.840 INFO:tasks.workunit.client.0.smithi073.stdout:8/528: dread - d14/d27/d4c/f4f zero size 2024-04-19T02:18:32.845 INFO:tasks.workunit.client.0.smithi073.stdout:4/521: read da/d27/d36/d4d/d7b/f92 [2837691,112706] 0 2024-04-19T02:18:32.845 INFO:tasks.workunit.client.0.smithi073.stdout:3/612: dread d3/d6/db/f45 [0,4194304] 0 2024-04-19T02:18:32.845 INFO:tasks.workunit.client.0.smithi073.stdout:7/539: truncate d0/d3/f66 3565980 0 2024-04-19T02:18:32.846 INFO:tasks.workunit.client.0.smithi073.stdout:5/592: dread d0/d1d/d1e/f55 [0,4194304] 0 2024-04-19T02:18:32.846 INFO:tasks.workunit.client.0.smithi073.stdout:7/540: rmdir d0/dc/d39 39 2024-04-19T02:18:32.847 INFO:tasks.workunit.client.0.smithi073.stdout:4/522: write da/d27/d1b/d1d/d8d/d84/fa8 [1139262,16794] 0 2024-04-19T02:18:32.847 INFO:tasks.workunit.client.0.smithi073.stdout:8/529: dwrite d14/d15/d17/f3d [0,4194304] 0 2024-04-19T02:18:32.847 INFO:tasks.workunit.client.0.smithi073.stdout:3/613: unlink d3/d6/db/d3a/d38/d6f/daf/fb4 0 2024-04-19T02:18:32.848 INFO:tasks.workunit.client.0.smithi073.stdout:4/523: stat da/d27/d36/d4d/d7b/f92 0 2024-04-19T02:18:32.849 INFO:tasks.workunit.client.0.smithi073.stdout:6/466: dwrite d8/de/ff [0,4194304] 0 2024-04-19T02:18:32.849 INFO:tasks.workunit.client.0.smithi073.stdout:7/541: mkdir d0/dc/d39/d50/da3 0 2024-04-19T02:18:32.849 INFO:tasks.workunit.client.0.smithi073.stdout:3/614: symlink d3/d6/db/d1a/lc8 0 2024-04-19T02:18:32.850 INFO:tasks.workunit.client.0.smithi073.stdout:4/524: creat da/d27/d1b/d1d/d72/d3d/d95/fb9 x:0 0 0 2024-04-19T02:18:32.851 INFO:tasks.workunit.client.0.smithi073.stdout:3/615: write d3/d6/f22 [2888449,94995] 0 2024-04-19T02:18:32.851 INFO:tasks.workunit.client.0.smithi073.stdout:6/467: creat d8/de/d58/d63/d82/f9b x:0 0 0 2024-04-19T02:18:32.851 INFO:tasks.workunit.client.0.smithi073.stdout:3/616: chown d3/d6/f15 1917989603 1 2024-04-19T02:18:32.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/525: mkdir da/d27/d3a/d50/d9c/dba 0 2024-04-19T02:18:32.852 INFO:tasks.workunit.client.0.smithi073.stdout:6/468: creat d8/de/d78/f9c x:0 0 0 2024-04-19T02:18:32.852 INFO:tasks.workunit.client.0.smithi073.stdout:7/542: getdents d0/dc/d33/d36/d7b/d80 0 2024-04-19T02:18:32.852 INFO:tasks.workunit.client.0.smithi073.stdout:7/543: stat d0/dc/f26 0 2024-04-19T02:18:32.852 INFO:tasks.workunit.client.0.smithi073.stdout:4/526: unlink da/d27/d1b/d26/d2a/d46/c70 0 2024-04-19T02:18:32.852 INFO:tasks.workunit.client.0.smithi073.stdout:7/544: chown d0/dc/d67 176 1 2024-04-19T02:18:32.857 INFO:tasks.workunit.client.0.smithi073.stdout:7/545: chown d0/d28/d63 41 1 2024-04-19T02:18:32.858 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:32.855+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:32.858 INFO:tasks.workunit.client.0.smithi073.stdout:7/546: truncate d0/dc/d67/f65 4521912 0 2024-04-19T02:18:32.861 INFO:tasks.workunit.client.0.smithi073.stdout:9/491: dread d0/df/d1d/f2f [0,4194304] 0 2024-04-19T02:18:32.862 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:32.864 INFO:tasks.workunit.client.0.smithi073.stdout:9/492: dread d0/df/d16/d19/d38/f7e [0,4194304] 0 2024-04-19T02:18:32.865 INFO:tasks.workunit.client.0.smithi073.stdout:9/493: write d0/df/d16/d1a/d2c/d2e/f4b [1424617,116602] 0 2024-04-19T02:18:32.869 INFO:tasks.workunit.client.0.smithi073.stdout:7/547: mknod d0/dc/d33/d36/d7b/d93/ca4 0 2024-04-19T02:18:32.869 INFO:tasks.workunit.client.0.smithi073.stdout:3/617: dread d3/d6/db/d3a/d38/d89/d94/fa9 [0,4194304] 0 2024-04-19T02:18:32.870 INFO:tasks.workunit.client.0.smithi073.stdout:7/548: truncate d0/dc/d39/d50/f86 671906 0 2024-04-19T02:18:32.870 INFO:tasks.workunit.client.0.smithi073.stdout:3/618: mkdir d3/d6/db/d3a/d38/d6f/dac/dc9 0 2024-04-19T02:18:32.871 INFO:tasks.workunit.client.0.smithi073.stdout:7/549: creat d0/dc/d67/d2a/d51/d7a/fa5 x:0 0 0 2024-04-19T02:18:32.872 INFO:tasks.workunit.client.0.smithi073.stdout:7/550: write d0/dc/d67/d15/f87 [310585,105986] 0 2024-04-19T02:18:32.874 INFO:tasks.workunit.client.0.smithi073.stdout:3/619: dread d3/d6/db/f14 [0,4194304] 0 2024-04-19T02:18:32.874 INFO:tasks.workunit.client.0.smithi073.stdout:3/620: dread - d3/d6/f8c zero size 2024-04-19T02:18:32.875 INFO:tasks.workunit.client.0.smithi073.stdout:3/621: mkdir d3/d6/db/d3a/d5f/dca 0 2024-04-19T02:18:32.878 INFO:tasks.workunit.client.0.smithi073.stdout:7/551: dwrite d0/dc/d67/d2a/f2b [0,4194304] 0 2024-04-19T02:18:32.879 INFO:tasks.workunit.client.0.smithi073.stdout:1/492: dread db/d1c/d2c/f69 [0,4194304] 0 2024-04-19T02:18:32.880 INFO:tasks.workunit.client.0.smithi073.stdout:1/493: chown db/d1c/d81/d86/dae/f75 2060766 1 2024-04-19T02:18:32.881 INFO:tasks.workunit.client.0.smithi073.stdout:1/494: creat db/d1c/d54/d8b/dab/fb0 x:0 0 0 2024-04-19T02:18:32.882 INFO:tasks.workunit.client.0.smithi073.stdout:5/593: dread d0/d1d/d25/d37/d71/f9f [0,4194304] 0 2024-04-19T02:18:32.882 INFO:tasks.workunit.client.0.smithi073.stdout:1/495: unlink db/d1c/d95/c9d 0 2024-04-19T02:18:32.883 INFO:tasks.workunit.client.0.smithi073.stdout:1/496: unlink db/f13 0 2024-04-19T02:18:32.883 INFO:tasks.workunit.client.0.smithi073.stdout:5/594: write d0/d1d/d1e/f40 [440378,35788] 0 2024-04-19T02:18:32.884 INFO:tasks.workunit.client.0.smithi073.stdout:5/595: unlink d0/d1d/d25/d35/d88/l81 0 2024-04-19T02:18:32.889 INFO:tasks.workunit.client.0.smithi073.stdout:5/596: dwrite d0/d1d/d24/d61/fb4 [0,4194304] 0 2024-04-19T02:18:32.890 INFO:tasks.workunit.client.0.smithi073.stdout:5/597: write d0/d1d/d1e/f33 [1130976,76788] 0 2024-04-19T02:18:32.891 INFO:tasks.workunit.client.0.smithi073.stdout:5/598: mknod d0/d1d/d25/d35/d88/cc2 0 2024-04-19T02:18:32.892 INFO:tasks.workunit.client.0.smithi073.stdout:5/599: chown d0/d1d/d1e/f83 7 1 2024-04-19T02:18:32.897 INFO:tasks.workunit.client.0.smithi073.stdout:5/600: dwrite d0/d1d/d24/d61/f7c [0,4194304] 0 2024-04-19T02:18:32.898 INFO:tasks.workunit.client.0.smithi073.stdout:5/601: creat d0/d1d/d25/d35/d88/fc3 x:0 0 0 2024-04-19T02:18:32.899 INFO:tasks.workunit.client.0.smithi073.stdout:5/602: dread - d0/d1d/d25/d37/d71/f7b zero size 2024-04-19T02:18:32.900 INFO:tasks.workunit.client.0.smithi073.stdout:5/603: mknod d0/d1d/d90/da0/dbb/cc4 0 2024-04-19T02:18:32.902 INFO:tasks.workunit.client.0.smithi073.stdout:6/469: write d8/d4b/d93/f57 [2940327,121912] 0 2024-04-19T02:18:32.903 INFO:tasks.workunit.client.0.smithi073.stdout:5/604: dread d0/d1d/d24/d62/fa6 [0,4194304] 0 2024-04-19T02:18:32.903 INFO:tasks.workunit.client.0.smithi073.stdout:6/470: truncate d8/de/f67 1899918 0 2024-04-19T02:18:32.904 INFO:tasks.workunit.client.0.smithi073.stdout:3/622: dread d3/d6/db/d16/d52/f99 [0,4194304] 0 2024-04-19T02:18:32.904 INFO:tasks.workunit.client.0.smithi073.stdout:3/623: stat d3/d6/db/d1a/cb2 0 2024-04-19T02:18:32.905 INFO:tasks.workunit.client.0.smithi073.stdout:3/624: unlink d3/d6/db/d3a/d38/d43/d4e/c48 0 2024-04-19T02:18:32.906 INFO:tasks.workunit.client.0.smithi073.stdout:3/625: chown d3/d6/db/d3a/d38/d43/d4e/l96 68502573 1 2024-04-19T02:18:32.907 INFO:tasks.workunit.client.0.smithi073.stdout:5/605: dread d0/d1d/d25/d37/d71/f9f [0,4194304] 0 2024-04-19T02:18:32.908 INFO:tasks.workunit.client.0.smithi073.stdout:3/626: getdents d3/d6/db/d3a/d38/d57/d88 0 2024-04-19T02:18:32.908 INFO:tasks.workunit.client.0.smithi073.stdout:5/606: creat d0/d1d/d25/d35/d99/fc5 x:0 0 0 2024-04-19T02:18:32.909 INFO:tasks.workunit.client.0.smithi073.stdout:5/607: chown d0/d1d/f4a 26058547 1 2024-04-19T02:18:32.909 INFO:tasks.workunit.client.0.smithi073.stdout:3/627: creat d3/d6/db/d3a/d38/d89/d94/fcb x:0 0 0 2024-04-19T02:18:32.909 INFO:tasks.workunit.client.0.smithi073.stdout:5/608: mknod d0/d1d/d25/d35/d96/cc6 0 2024-04-19T02:18:32.909 INFO:tasks.workunit.client.0.smithi073.stdout:3/628: symlink d3/d6/db/d23/lcc 0 2024-04-19T02:18:32.910 INFO:tasks.workunit.client.0.smithi073.stdout:5/609: chown d0/d1d/d25/d37/l50 668688740 1 2024-04-19T02:18:32.917 INFO:tasks.workunit.client.0.smithi073.stdout:2/548: sync 2024-04-19T02:18:32.917 INFO:tasks.workunit.client.0.smithi073.stdout:9/494: sync 2024-04-19T02:18:32.918 INFO:tasks.workunit.client.0.smithi073.stdout:9/495: fdatasync d0/df/f21 0 2024-04-19T02:18:32.919 INFO:tasks.workunit.client.0.smithi073.stdout:0/527: dread d7/d14/d17/d1a/d56/f65 [0,4194304] 0 2024-04-19T02:18:32.920 INFO:tasks.workunit.client.0.smithi073.stdout:5/610: dwrite d0/d2d/fb3 [0,4194304] 0 2024-04-19T02:18:32.921 INFO:tasks.workunit.client.0.smithi073.stdout:9/496: fsync d0/df/d16/d19/d38/d5d/d76/d7d/d88/f92 0 2024-04-19T02:18:32.924 INFO:tasks.workunit.client.0.smithi073.stdout:2/549: truncate f3 4703458 0 2024-04-19T02:18:32.925 INFO:tasks.workunit.client.0.smithi073.stdout:4/527: truncate da/d27/d1b/d1d/d8d/d84/f9e 2341377 0 2024-04-19T02:18:32.925 INFO:tasks.workunit.client.0.smithi073.stdout:7/552: truncate d0/f8 1430981 0 2024-04-19T02:18:32.925 INFO:tasks.workunit.client.0.smithi073.stdout:5/611: chown d0/d1d/f20 46330826 1 2024-04-19T02:18:32.926 INFO:tasks.workunit.client.0.smithi073.stdout:6/471: truncate d8/de/d58/f33 3352179 0 2024-04-19T02:18:32.926 INFO:tasks.workunit.client.0.smithi073.stdout:4/528: readlink da/d27/d3a/d50/l94 0 2024-04-19T02:18:32.927 INFO:tasks.workunit.client.0.smithi073.stdout:0/528: unlink d7/d14/c19 0 2024-04-19T02:18:32.927 INFO:tasks.workunit.client.0.smithi073.stdout:9/497: mkdir d0/dad 0 2024-04-19T02:18:32.927 INFO:tasks.workunit.client.0.smithi073.stdout:7/553: truncate d0/dc/d33/f91 784821 0 2024-04-19T02:18:32.928 INFO:tasks.workunit.client.0.smithi073.stdout:4/529: chown da/d27/d1b/d1d/d72/d2b/d2f/f63 495949142 1 2024-04-19T02:18:32.928 INFO:tasks.workunit.client.0.smithi073.stdout:0/529: write d7/f25 [1736145,45319] 0 2024-04-19T02:18:32.930 INFO:tasks.workunit.client.0.smithi073.stdout:6/472: mknod d8/d71/d7d/c9d 0 2024-04-19T02:18:32.930 INFO:tasks.workunit.client.0.smithi073.stdout:9/498: rmdir d0/df/d16/d1a 39 2024-04-19T02:18:32.930 INFO:tasks.workunit.client.0.smithi073.stdout:1/497: dwrite db/f25 [0,4194304] 0 2024-04-19T02:18:32.931 INFO:tasks.workunit.client.0.smithi073.stdout:4/530: unlink da/d27/d1b/d8c/fb0 0 2024-04-19T02:18:32.932 INFO:tasks.workunit.client.0.smithi073.stdout:6/473: chown d8/de/d58/d63/d82/f83 407 1 2024-04-19T02:18:32.933 INFO:tasks.workunit.client.0.smithi073.stdout:3/629: dread d3/d6/f22 [0,4194304] 0 2024-04-19T02:18:32.934 INFO:tasks.workunit.client.0.smithi073.stdout:4/531: creat da/d27/d3a/d97/fbb x:0 0 0 2024-04-19T02:18:32.937 INFO:tasks.workunit.client.0.smithi073.stdout:9/499: fdatasync d0/df/d16/d1a/d2c/d2e/f53 0 2024-04-19T02:18:32.937 INFO:tasks.workunit.client.0.smithi073.stdout:6/474: rename d8/l88 to d8/de/d78/l9e 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:4/532: fsync da/d27/d1b/d1d/d72/fa4 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:2/550: dwrite d5/d10/d14/db6/fbe [4194304,4194304] 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:9/500: mknod d0/dad/cae 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:4/533: stat da/d27/d1b/d1d/d72/d2b 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:2/551: symlink d5/d10/d14/d18/d3e/d2d/lc3 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:9/501: mknod d0/df/d60/d72/caf 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:4/534: symlink da/d27/d1b/d1d/d72/d3d/lbc 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:6/475: write d8/d4b/d93/f57 [3721232,113306] 0 2024-04-19T02:18:32.939 INFO:tasks.workunit.client.0.smithi073.stdout:2/552: chown d5/d10/d14/d18/d3e/d51/fbf 181327431 1 2024-04-19T02:18:32.940 INFO:tasks.workunit.client.0.smithi073.stdout:9/502: mkdir d0/df/d60/db0 0 2024-04-19T02:18:32.940 INFO:tasks.workunit.client.0.smithi073.stdout:4/535: write da/d27/d1b/d26/f6a [880827,125850] 0 2024-04-19T02:18:32.940 INFO:tasks.workunit.client.0.smithi073.stdout:9/503: chown d0/df/f11 45017 1 2024-04-19T02:18:32.940 INFO:tasks.workunit.client.0.smithi073.stdout:4/536: creat da/d27/d1b/fbd x:0 0 0 2024-04-19T02:18:32.940 INFO:tasks.workunit.client.0.smithi073.stdout:0/530: dread d7/d14/d17/f1f [0,4194304] 0 2024-04-19T02:18:32.940 INFO:tasks.workunit.client.0.smithi073.stdout:4/537: write da/d27/d1b/d26/f4a [5732726,32935] 0 2024-04-19T02:18:32.942 INFO:tasks.workunit.client.0.smithi073.stdout:1/498: dread f6 [0,4194304] 0 2024-04-19T02:18:32.943 INFO:tasks.workunit.client.0.smithi073.stdout:9/504: dread d0/df/d16/d19/f87 [0,4194304] 0 2024-04-19T02:18:32.943 INFO:tasks.workunit.client.0.smithi073.stdout:1/499: truncate f6 1115934 0 2024-04-19T02:18:32.943 INFO:tasks.workunit.client.0.smithi073.stdout:6/476: dwrite d8/d4b/d93/f65 [0,4194304] 0 2024-04-19T02:18:32.944 INFO:tasks.workunit.client.0.smithi073.stdout:2/553: dwrite d5/d10/d29/d66/d67/d72/fb3 [0,4194304] 0 2024-04-19T02:18:32.946 INFO:tasks.workunit.client.0.smithi073.stdout:8/530: sync 2024-04-19T02:18:32.946 INFO:tasks.workunit.client.0.smithi073.stdout:2/554: write d5/d10/d14/f8a [225908,61643] 0 2024-04-19T02:18:32.946 INFO:tasks.workunit.client.0.smithi073.stdout:4/538: sync 2024-04-19T02:18:32.947 INFO:tasks.workunit.client.0.smithi073.stdout:9/505: rename d0/df/d16/d1a to d0/df/d16/d19/db1 0 2024-04-19T02:18:32.947 INFO:tasks.workunit.client.0.smithi073.stdout:8/531: dread - d14/d27/d29/d64/f78 zero size 2024-04-19T02:18:32.947 INFO:tasks.workunit.client.0.smithi073.stdout:5/612: truncate d0/d1d/d24/f38 1954846 0 2024-04-19T02:18:32.948 INFO:tasks.workunit.client.0.smithi073.stdout:4/539: creat da/d27/d3a/d50/fbe x:0 0 0 2024-04-19T02:18:32.949 INFO:tasks.workunit.client.0.smithi073.stdout:1/500: getdents db/d1c/d81 0 2024-04-19T02:18:32.949 INFO:tasks.workunit.client.0.smithi073.stdout:9/506: symlink d0/df/d16/d19/db1/d2c/d2e/lb2 0 2024-04-19T02:18:32.950 INFO:tasks.workunit.client.0.smithi073.stdout:4/540: chown da/d27/d1b/d1d/d72/d2b/f32 6 1 2024-04-19T02:18:32.950 INFO:tasks.workunit.client.0.smithi073.stdout:5/613: mkdir d0/d1d/d25/d35/dc7 0 2024-04-19T02:18:32.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/532: link d14/d15/f42 d14/d27/da4/fb1 0 2024-04-19T02:18:32.951 INFO:tasks.workunit.client.0.smithi073.stdout:4/541: symlink da/d27/d1b/d1d/d72/d2b/d2f/lbf 0 2024-04-19T02:18:32.952 INFO:tasks.workunit.client.0.smithi073.stdout:6/477: dwrite d8/de/d78/f9c [0,4194304] 0 2024-04-19T02:18:32.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/533: creat d14/d27/d85/d9a/fb2 x:0 0 0 2024-04-19T02:18:32.954 INFO:tasks.workunit.client.0.smithi073.stdout:5/614: getdents d0/d1d/d25/d35/d88/da7 0 2024-04-19T02:18:32.955 INFO:tasks.workunit.client.0.smithi073.stdout:6/478: mknod d8/d4b/d93/d86/c9f 0 2024-04-19T02:18:32.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/542: dread - da/d27/d1b/d26/d2a/fa9 zero size 2024-04-19T02:18:32.956 INFO:tasks.workunit.client.0.smithi073.stdout:6/479: fdatasync d8/d71/d7d/f87 0 2024-04-19T02:18:32.958 INFO:tasks.workunit.client.0.smithi073.stdout:3/630: dwrite d3/d6/db/f66 [0,4194304] 0 2024-04-19T02:18:32.958 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:32.955+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:32.959 INFO:tasks.workunit.client.0.smithi073.stdout:4/543: write da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f [196662,61769] 0 2024-04-19T02:18:32.959 INFO:tasks.workunit.client.0.smithi073.stdout:7/554: dread d0/dc/d39/f3f [0,4194304] 0 2024-04-19T02:18:32.959 INFO:tasks.workunit.client.0.smithi073.stdout:6/480: getdents d8/de/d78/d97 0 2024-04-19T02:18:32.960 INFO:tasks.workunit.client.0.smithi073.stdout:1/501: truncate db/d1c/d2c/d50/d62/f79 461013 0 2024-04-19T02:18:32.960 INFO:tasks.workunit.client.0.smithi073.stdout:9/507: truncate d0/df/d16/d19/db1/f37 1452771 0 2024-04-19T02:18:32.960 INFO:tasks.workunit.client.0.smithi073.stdout:6/481: stat d8/de/f1e 0 2024-04-19T02:18:32.960 INFO:tasks.workunit.client.0.smithi073.stdout:4/544: write da/d27/d1b/d1d/d72/f62 [1873056,31498] 0 2024-04-19T02:18:32.961 INFO:tasks.workunit.client.0.smithi073.stdout:7/555: creat d0/dc/d39/fa6 x:0 0 0 2024-04-19T02:18:32.961 INFO:tasks.workunit.client.0.smithi073.stdout:1/502: mkdir db/d1c/d81/d83/dad/db1 0 2024-04-19T02:18:32.962 INFO:tasks.workunit.client.0.smithi073.stdout:4/545: creat da/d27/d1b/d8c/fc0 x:0 0 0 2024-04-19T02:18:32.962 INFO:tasks.workunit.client.0.smithi073.stdout:7/556: dread - d0/d28/d63/f9e zero size 2024-04-19T02:18:32.963 INFO:tasks.workunit.client.0.smithi073.stdout:1/503: unlink db/d1c/d78/ca7 0 2024-04-19T02:18:32.964 INFO:tasks.workunit.client.0.smithi073.stdout:1/504: chown db/d1c/d2c/f45 164451 1 2024-04-19T02:18:32.964 INFO:tasks.workunit.client.0.smithi073.stdout:7/557: mkdir d0/dc/d33/da7 0 2024-04-19T02:18:32.965 INFO:tasks.workunit.client.0.smithi073.stdout:4/546: truncate da/d27/d1b/d1d/d8d/fb3 1624173 0 2024-04-19T02:18:32.966 INFO:tasks.workunit.client.0.smithi073.stdout:1/505: getdents db/d1c/d2c 0 2024-04-19T02:18:32.966 INFO:tasks.workunit.client.0.smithi073.stdout:3/631: dwrite d3/d6/db/f66 [0,4194304] 0 2024-04-19T02:18:32.966 INFO:tasks.workunit.client.0.smithi073.stdout:7/558: mkdir d0/dc/d33/da8 0 2024-04-19T02:18:32.968 INFO:tasks.workunit.client.0.smithi073.stdout:8/534: write d14/d27/d29/fb0 [837899,22073] 0 2024-04-19T02:18:32.969 INFO:tasks.workunit.client.0.smithi073.stdout:3/632: chown d3/d6/db/d3a/d38/d89/d94/d7b/fbc 226 1 2024-04-19T02:18:32.970 INFO:tasks.workunit.client.0.smithi073.stdout:7/559: write d0/dc/d39/f4f [4033741,55724] 0 2024-04-19T02:18:32.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/506: creat db/d1c/d78/fb2 x:0 0 0 2024-04-19T02:18:32.970 INFO:tasks.workunit.client.0.smithi073.stdout:8/535: mknod d14/d15/d17/da1/cb3 0 2024-04-19T02:18:32.971 INFO:tasks.workunit.client.0.smithi073.stdout:3/633: dread - d3/d6/db/d16/d7c/f92 zero size 2024-04-19T02:18:32.972 INFO:tasks.workunit.client.0.smithi073.stdout:1/507: mkdir db/d1c/db3 0 2024-04-19T02:18:32.972 INFO:tasks.workunit.client.0.smithi073.stdout:3/634: stat d3/d6/db/d16/l69 0 2024-04-19T02:18:32.973 INFO:tasks.workunit.client.0.smithi073.stdout:4/547: dwrite da/f11 [0,4194304] 0 2024-04-19T02:18:32.973 INFO:tasks.workunit.client.0.smithi073.stdout:3/635: mknod d3/d6/db/d23/ccd 0 2024-04-19T02:18:32.973 INFO:tasks.workunit.client.0.smithi073.stdout:1/508: creat db/d1c/d81/fb4 x:0 0 0 2024-04-19T02:18:32.973 INFO:tasks.workunit.client.0.smithi073.stdout:8/536: rmdir d14/d15/d17/d48/d89/d97 39 2024-04-19T02:18:32.976 INFO:tasks.workunit.client.0.smithi073.stdout:4/548: fdatasync da/d27/d1b/d26/d2a/d46/fb4 0 2024-04-19T02:18:32.977 INFO:tasks.workunit.client.0.smithi073.stdout:9/508: truncate d0/df/d60/f90 3690282 0 2024-04-19T02:18:32.977 INFO:tasks.workunit.client.0.smithi073.stdout:7/560: dwrite d0/dc/d67/f31 [0,4194304] 0 2024-04-19T02:18:32.978 INFO:tasks.workunit.client.0.smithi073.stdout:9/509: readlink d0/l4 0 2024-04-19T02:18:32.979 INFO:tasks.workunit.client.0.smithi073.stdout:9/510: fdatasync d0/df/d16/d19/d38/d5d/f4e 0 2024-04-19T02:18:32.979 INFO:tasks.workunit.client.0.smithi073.stdout:3/636: mknod d3/d6/db/d3a/d5f/dca/cce 0 2024-04-19T02:18:32.980 INFO:tasks.workunit.client.0.smithi073.stdout:4/549: mkdir da/d27/d2c/dc1 0 2024-04-19T02:18:32.980 INFO:tasks.workunit.client.0.smithi073.stdout:1/509: rename db/d1c/d54/f6a to db/d1c/d81/d83/dad/fb5 0 2024-04-19T02:18:32.982 INFO:tasks.workunit.client.0.smithi073.stdout:7/561: creat d0/dc/d33/d36/d7b/fa9 x:0 0 0 2024-04-19T02:18:32.982 INFO:tasks.workunit.client.0.smithi073.stdout:3/637: symlink d3/d6/db/d3a/d38/d89/d94/d7b/lcf 0 2024-04-19T02:18:32.982 INFO:tasks.workunit.client.0.smithi073.stdout:8/537: dwrite d14/f93 [0,4194304] 0 2024-04-19T02:18:32.984 INFO:tasks.workunit.client.0.smithi073.stdout:2/555: dread d5/d10/d29/d66/d67/f4f [0,4194304] 0 2024-04-19T02:18:32.984 INFO:tasks.workunit.client.0.smithi073.stdout:8/538: write d14/d27/d29/d69/f8c [241717,97211] 0 2024-04-19T02:18:32.984 INFO:tasks.workunit.client.0.smithi073.stdout:2/556: readlink d5/d10/d14/l28 0 2024-04-19T02:18:32.984 INFO:tasks.workunit.client.0.smithi073.stdout:4/550: rename da/d27/d1b/d1d/d72/l64 to da/d27/d1b/d1d/d72/d2b/d2f/d68/lc2 0 2024-04-19T02:18:32.985 INFO:tasks.workunit.client.0.smithi073.stdout:3/638: unlink d3/d6/db/d16/l69 0 2024-04-19T02:18:32.985 INFO:tasks.workunit.client.0.smithi073.stdout:8/539: unlink d14/d27/d29/d69/l82 0 2024-04-19T02:18:32.986 INFO:tasks.workunit.client.0.smithi073.stdout:8/540: chown d14/d15/d17/d8d 14369290 1 2024-04-19T02:18:32.987 INFO:tasks.workunit.client.0.smithi073.stdout:3/639: write d3/d6/db/d16/d52/f8f [1809806,117552] 0 2024-04-19T02:18:32.988 INFO:tasks.workunit.client.0.smithi073.stdout:8/541: rename d14/d15/d17/d99/l9e to d14/d87/lb4 0 2024-04-19T02:18:32.990 INFO:tasks.workunit.client.0.smithi073.stdout:7/562: dwrite d0/dc/d67/d2a/d51/f54 [4194304,4194304] 0 2024-04-19T02:18:32.990 INFO:tasks.workunit.client.0.smithi073.stdout:8/542: fsync d14/d27/d50/faf 0 2024-04-19T02:18:32.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/563: fdatasync d0/d28/d63/f9e 0 2024-04-19T02:18:32.991 INFO:tasks.workunit.client.0.smithi073.stdout:8/543: write d14/d27/f5c [227043,89148] 0 2024-04-19T02:18:32.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/564: readlink d0/dc/l22 0 2024-04-19T02:18:32.992 INFO:tasks.workunit.client.0.smithi073.stdout:0/531: dread d7/d14/d17/d1a/d20/f7a [0,4194304] 0 2024-04-19T02:18:32.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/565: stat d0/d28/d63/f9e 0 2024-04-19T02:18:32.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/566: stat d0/f3c 0 2024-04-19T02:18:32.992 INFO:tasks.workunit.client.0.smithi073.stdout:8/544: write d14/d15/f7e [1767148,106704] 0 2024-04-19T02:18:32.993 INFO:tasks.workunit.client.0.smithi073.stdout:8/545: readlink d14/d27/d50/l68 0 2024-04-19T02:18:32.994 INFO:tasks.workunit.client.0.smithi073.stdout:8/546: mknod d14/d27/d29/d69/cb5 0 2024-04-19T02:18:32.994 INFO:tasks.workunit.client.0.smithi073.stdout:0/532: link d7/d14/d17/d1a/d21/c86 d7/d14/d17/d1a/d20/c9f 0 2024-04-19T02:18:32.994 INFO:tasks.workunit.client.0.smithi073.stdout:7/567: link d0/dc/d33/l89 d0/dc/d33/d36/d7b/d80/laa 0 2024-04-19T02:18:32.994 INFO:tasks.workunit.client.0.smithi073.stdout:8/547: chown d14/d27/d85/d9a 5191 1 2024-04-19T02:18:32.995 INFO:tasks.workunit.client.0.smithi073.stdout:1/510: read db/d1c/d2c/fa3 [3365895,114241] 0 2024-04-19T02:18:32.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/568: fdatasync d0/dc/d67/d2a/d51/f6c 0 2024-04-19T02:18:32.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/569: stat d0/f1d 0 2024-04-19T02:18:32.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/548: getdents d14/d27/d4c 0 2024-04-19T02:18:32.997 INFO:tasks.workunit.client.0.smithi073.stdout:7/570: write d0/dc/d39/d50/f86 [486126,89407] 0 2024-04-19T02:18:32.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/549: chown d14/d15/d17/f2c 65762 1 2024-04-19T02:18:32.997 INFO:tasks.workunit.client.0.smithi073.stdout:6/482: dread d8/de/d22/f34 [0,4194304] 0 2024-04-19T02:18:32.997 INFO:tasks.workunit.client.0.smithi073.stdout:6/483: rmdir d8/de/d22 39 2024-04-19T02:18:32.998 INFO:tasks.workunit.client.0.smithi073.stdout:8/550: creat d14/d27/fb6 x:0 0 0 2024-04-19T02:18:32.998 INFO:tasks.workunit.client.0.smithi073.stdout:0/533: dread d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:32.998 INFO:tasks.workunit.client.0.smithi073.stdout:6/484: creat d8/de/d7f/fa0 x:0 0 0 2024-04-19T02:18:32.999 INFO:tasks.workunit.client.0.smithi073.stdout:6/485: creat d8/fa1 x:0 0 0 2024-04-19T02:18:33.000 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:33.000 INFO:tasks.workunit.client.0.smithi073.stdout:6/486: chown d8/l44 58595708 1 2024-04-19T02:18:33.000 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:33.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/534: rename d7/d14/d17/d1a/f46 to d7/d14/d17/d1a/fa0 0 2024-04-19T02:18:33.001 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:33.001 INFO:tasks.workunit.client.0.smithi073.stdout:6/487: chown d8/d4b/d93/f3d 0 1 2024-04-19T02:18:33.002 INFO:tasks.workunit.client.0.smithi073.stdout:6/488: write d8/de/d22/f37 [1547220,610] 0 2024-04-19T02:18:33.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/489: chown d8/d4b/d93/f65 0 1 2024-04-19T02:18:33.004 INFO:tasks.workunit.client.0.smithi073.stdout:5/615: dread d0/d1d/f7d [0,4194304] 0 2024-04-19T02:18:33.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/490: rename d8/de/d58/d63/l92 to d8/de/d78/la2 0 2024-04-19T02:18:33.005 INFO:tasks.workunit.client.0.smithi073.stdout:8/551: dwrite d14/d27/d4c/f7d [0,4194304] 0 2024-04-19T02:18:33.006 INFO:tasks.workunit.client.0.smithi073.stdout:6/491: mknod d8/de/d58/d63/d82/ca3 0 2024-04-19T02:18:33.006 INFO:tasks.workunit.client.0.smithi073.stdout:5/616: truncate d0/d1d/d24/d61/f74 2048327 0 2024-04-19T02:18:33.006 INFO:tasks.workunit.client.0.smithi073.stdout:8/552: write d14/d27/f30 [1886037,111348] 0 2024-04-19T02:18:33.007 INFO:tasks.workunit.client.0.smithi073.stdout:6/492: chown d8/d71/d7d/c99 1019722 1 2024-04-19T02:18:33.007 INFO:tasks.workunit.client.0.smithi073.stdout:5/617: unlink d0/d1d/d1e/l76 0 2024-04-19T02:18:33.008 INFO:tasks.workunit.client.0.smithi073.stdout:8/553: creat d14/d27/d29/d31/fb7 x:0 0 0 2024-04-19T02:18:33.008 INFO:tasks.workunit.client.0.smithi073.stdout:5/618: rename d0/d1d/d25/d35/l95 to d0/d1d/d1e/lc8 0 2024-04-19T02:18:33.009 INFO:tasks.workunit.client.0.smithi073.stdout:8/554: rename d14/d15/d17/f77 to d14/d27/d4c/d75/fb8 0 2024-04-19T02:18:33.010 INFO:tasks.workunit.client.0.smithi073.stdout:1/511: truncate db/d1c/d2c/f69 3028155 0 2024-04-19T02:18:33.010 INFO:tasks.workunit.client.0.smithi073.stdout:5/619: rename d0/d2d/c78 to d0/d1d/d25/d35/d99/cc9 0 2024-04-19T02:18:33.015 INFO:tasks.workunit.client.0.smithi073.stdout:9/511: dread d0/df/d16/d19/db1/d2c/d2e/f7f [0,4194304] 0 2024-04-19T02:18:33.016 INFO:tasks.workunit.client.0.smithi073.stdout:8/555: dwrite d14/d27/d4c/d75/fb8 [0,4194304] 0 2024-04-19T02:18:33.017 INFO:tasks.workunit.client.0.smithi073.stdout:9/512: creat d0/fb3 x:0 0 0 2024-04-19T02:18:33.017 INFO:tasks.workunit.client.0.smithi073.stdout:8/556: write d14/d27/d4c/d75/f44 [244553,37907] 0 2024-04-19T02:18:33.018 INFO:tasks.workunit.client.0.smithi073.stdout:9/513: mknod d0/df/d16/cb4 0 2024-04-19T02:18:33.018 INFO:tasks.workunit.client.0.smithi073.stdout:8/557: stat d14/d27/d7b/cad 0 2024-04-19T02:18:33.019 INFO:tasks.workunit.client.0.smithi073.stdout:8/558: chown d14/d27/d4c/f76 53515 1 2024-04-19T02:18:33.019 INFO:tasks.workunit.client.0.smithi073.stdout:8/559: mkdir d14/d15/d17/da1/db9 0 2024-04-19T02:18:33.020 INFO:tasks.workunit.client.0.smithi073.stdout:9/514: read d0/df/d16/d19/db1/f3b [3262128,7274] 0 2024-04-19T02:18:33.021 INFO:tasks.workunit.client.0.smithi073.stdout:8/560: mknod d14/d15/d17/d48/d89/d97/cba 0 2024-04-19T02:18:33.021 INFO:tasks.workunit.client.0.smithi073.stdout:9/515: write d0/fa3 [10108,68770] 0 2024-04-19T02:18:33.022 INFO:tasks.workunit.client.0.smithi073.stdout:7/571: dread d0/dc/d33/f35 [0,4194304] 0 2024-04-19T02:18:33.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/561: mkdir d14/d27/d4c/d75/dbb 0 2024-04-19T02:18:33.023 INFO:tasks.workunit.client.0.smithi073.stdout:2/557: dread d5/f64 [4194304,4194304] 0 2024-04-19T02:18:33.023 INFO:tasks.workunit.client.0.smithi073.stdout:7/572: fsync d0/dc/d67/d15/f87 0 2024-04-19T02:18:33.023 INFO:tasks.workunit.client.0.smithi073.stdout:9/516: rename d0/df/d1d/f33 to d0/fb5 0 2024-04-19T02:18:33.024 INFO:tasks.workunit.client.0.smithi073.stdout:2/558: symlink d5/d10/d14/db6/lc4 0 2024-04-19T02:18:33.025 INFO:tasks.workunit.client.0.smithi073.stdout:9/517: symlink d0/df/d16/d19/d38/d5d/d5e/d83/lb6 0 2024-04-19T02:18:33.025 INFO:tasks.workunit.client.0.smithi073.stdout:9/518: chown d0/d81/l8c 42058700 1 2024-04-19T02:18:33.026 INFO:tasks.workunit.client.0.smithi073.stdout:2/559: rename d5/d10/d14/d18/d3e/d2d/d63/l89 to d5/d10/d14/d2e/lc5 0 2024-04-19T02:18:33.026 INFO:tasks.workunit.client.0.smithi073.stdout:9/519: unlink d0/df/d16/d19/d38/d5d/d6d/f80 0 2024-04-19T02:18:33.029 INFO:tasks.workunit.client.0.smithi073.stdout:9/520: stat d0/df/d16/d19/db1/d2c/d2e/f4b 0 2024-04-19T02:18:33.030 INFO:tasks.workunit.client.0.smithi073.stdout:2/560: rmdir d5/d10/d14/d18/d3e/d51/db8 0 2024-04-19T02:18:33.030 INFO:tasks.workunit.client.0.smithi073.stdout:9/521: getdents d0 0 2024-04-19T02:18:33.030 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:33.031 INFO:tasks.workunit.client.0.smithi073.stdout:9/522: creat d0/dad/fb7 x:0 0 0 2024-04-19T02:18:33.032 INFO:tasks.workunit.client.0.smithi073.stdout:9/523: truncate d0/df/f41 4370931 0 2024-04-19T02:18:33.034 INFO:tasks.workunit.client.0.smithi073.stdout:3/640: dread d3/d6/db/d16/d52/f8f [0,4194304] 0 2024-04-19T02:18:33.035 INFO:tasks.workunit.client.0.smithi073.stdout:2/561: dwrite d5/d10/d14/d18/d3e/d2d/fc1 [0,4194304] 0 2024-04-19T02:18:33.035 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:33.036 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:33.036 INFO:tasks.workunit.client.0.smithi073.stdout:4/551: sync 2024-04-19T02:18:33.036 INFO:tasks.workunit.client.0.smithi073.stdout:3/641: write d3/f47 [3462744,41819] 0 2024-04-19T02:18:33.036 INFO:tasks.workunit.client.0.smithi073.stdout:0/535: dread f2 [0,4194304] 0 2024-04-19T02:18:33.036 INFO:tasks.workunit.client.0.smithi073.stdout:2/562: creat d5/d10/d14/d18/d98/fc6 x:0 0 0 2024-04-19T02:18:33.037 INFO:tasks.workunit.client.0.smithi073.stdout:3/642: creat d3/d6/db/d3a/d38/d57/d88/dc2/fd0 x:0 0 0 2024-04-19T02:18:33.039 INFO:tasks.workunit.client.0.smithi073.stdout:9/524: dwrite d0/df/f21 [0,4194304] 0 2024-04-19T02:18:33.040 INFO:tasks.workunit.client.0.smithi073.stdout:4/552: dread da/d27/d1b/d1d/d72/d2b/f32 [0,4194304] 0 2024-04-19T02:18:33.041 INFO:tasks.workunit.client.0.smithi073.stdout:4/553: chown da/d27/d1b/d1d/d72/d3d 12199651 1 2024-04-19T02:18:33.042 INFO:tasks.workunit.client.0.smithi073.stdout:2/563: dread d5/f64 [4194304,4194304] 0 2024-04-19T02:18:33.042 INFO:tasks.workunit.client.0.smithi073.stdout:9/525: rename d0/df/d16/d19/d38/f7e to d0/df/d16/d19/d38/d5d/d76/d7d/d88/fb8 0 2024-04-19T02:18:33.043 INFO:tasks.workunit.client.0.smithi073.stdout:4/554: mknod da/d27/d1b/cc3 0 2024-04-19T02:18:33.044 INFO:tasks.workunit.client.0.smithi073.stdout:0/536: dwrite d7/d14/f3e [0,4194304] 0 2024-04-19T02:18:33.045 INFO:tasks.workunit.client.0.smithi073.stdout:3/643: dwrite d3/d6/db/d1a/faa [4194304,4194304] 0 2024-04-19T02:18:33.046 INFO:tasks.workunit.client.0.smithi073.stdout:3/644: stat d3/l8 0 2024-04-19T02:18:33.046 INFO:tasks.workunit.client.0.smithi073.stdout:6/493: dread d8/de/d22/f37 [0,4194304] 0 2024-04-19T02:18:33.047 INFO:tasks.workunit.client.0.smithi073.stdout:6/494: creat d8/fa4 x:0 0 0 2024-04-19T02:18:33.047 INFO:tasks.workunit.client.0.smithi073.stdout:2/564: dread d5/d10/d14/d18/d3e/f3c [0,4194304] 0 2024-04-19T02:18:33.048 INFO:tasks.workunit.client.0.smithi073.stdout:3/645: getdents d3/d6/db/d1a/d54 0 2024-04-19T02:18:33.050 INFO:tasks.workunit.client.0.smithi073.stdout:0/537: dread d7/d14/d17/d1a/f29 [0,4194304] 0 2024-04-19T02:18:33.051 INFO:tasks.workunit.client.0.smithi073.stdout:3/646: rename d3/d6/db/d3a/d38/cc3 to d3/d6/db/d3a/d38/d57/d88/cd1 0 2024-04-19T02:18:33.051 INFO:tasks.workunit.client.0.smithi073.stdout:9/526: dread d0/df/f41 [4194304,4194304] 0 2024-04-19T02:18:33.051 INFO:tasks.workunit.client.0.smithi073.stdout:6/495: read d8/d4b/d93/f5d [337289,33404] 0 2024-04-19T02:18:33.052 INFO:tasks.workunit.client.0.smithi073.stdout:0/538: link d7/d6d/l73 d7/d14/d17/d1a/d20/d50/la1 0 2024-04-19T02:18:33.052 INFO:tasks.workunit.client.0.smithi073.stdout:3/647: mknod d3/d6/db/d3a/d38/d40/db5/cd2 0 2024-04-19T02:18:33.052 INFO:tasks.workunit.client.0.smithi073.stdout:4/555: dwrite da/f44 [0,4194304] 0 2024-04-19T02:18:33.053 INFO:tasks.workunit.client.0.smithi073.stdout:3/648: fdatasync d3/d6/db/d3a/f29 0 2024-04-19T02:18:33.055 INFO:tasks.workunit.client.0.smithi073.stdout:9/527: link d0/df/d1d/c61 d0/df/d16/d19/d38/d5d/d76/d7d/d88/cb9 0 2024-04-19T02:18:33.055 INFO:tasks.workunit.client.0.smithi073.stdout:0/539: link d7/d14/d17/c5d d7/d14/d17/d1a/d20/d50/ca2 0 2024-04-19T02:18:33.055 INFO:tasks.workunit.client.0.smithi073.stdout:0/540: stat d7/f25 0 2024-04-19T02:18:33.055 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:33.055 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.699848166999999, 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.056 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:33.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:33.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.686620103999999, 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:33.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.686525389, 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.066 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:33.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.685143613000001, 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:33.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:33.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.680493474999999, 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:33.075 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.664088867, 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.080 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:33.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.654870683999999, 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.085 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:33.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:33.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.652059984000001, 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:33.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:33.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:33.095 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.643073902000001, 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:33.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.640501097000001, 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.633273800000001, 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.104 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:33.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.628046534999999, 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.110 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:33.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:33.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.616294401000001, 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:33.115 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:33.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.120 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.609119231000001, 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:33.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.8927397500000001, 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.127 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.131 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.880455387, 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.132 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:33.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:33.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7778087760000001, 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:33.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:33.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.776607067, 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:33.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:33.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7731207169999998, 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:33.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7727688050000001, 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:33.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:33.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:33.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:33.157 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:33.157 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:33.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:33.163 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:33.155+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:33.170 INFO:tasks.workunit.client.0.smithi073.stdout:3/649: rename d3/d6/db/d3a/d38/d43/l4a to d3/d6/db/d16/d75/ld3 0 2024-04-19T02:18:33.170 INFO:tasks.workunit.client.0.smithi073.stdout:0/541: symlink d7/d14/d81/la3 0 2024-04-19T02:18:33.170 INFO:tasks.workunit.client.0.smithi073.stdout:9/528: rename d0/df/d16/d19/db1/d2c/c9c to d0/df/d16/d19/d38/d5d/d5e/cba 0 2024-04-19T02:18:33.170 INFO:tasks.workunit.client.0.smithi073.stdout:3/650: unlink d3/d6/db/d3a/d38/d89/d94/d7b/fb9 0 2024-04-19T02:18:33.170 INFO:tasks.workunit.client.0.smithi073.stdout:4/556: dwrite da/d27/d1b/d1d/d72/f62 [0,4194304] 0 2024-04-19T02:18:33.170 INFO:tasks.workunit.client.0.smithi073.stdout:0/542: dread d7/d14/d17/d1a/d56/f65 [0,4194304] 0 2024-04-19T02:18:33.170 INFO:tasks.workunit.client.0.smithi073.stdout:3/651: mknod d3/d6/db/d3a/d38/d43/cd4 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/557: dwrite da/d27/d1b/d26/d2a/fa9 [0,4194304] 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:3/652: creat d3/d6/db/d3a/d38/d57/fd5 x:0 0 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/558: getdents da 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:3/653: creat d3/d6/db/d3a/fd6 x:0 0 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:3/654: mkdir d3/d6/db/d3a/d5f/da7/dd7 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/559: rename da/d27/d1b/d1d/d8d/d84/fa8 to da/d27/d3a/d49/fc4 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:3/655: chown d3/d6/db/d1a/d54/f81 358 1 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/560: write da/d27/d1b/fbd [624462,46639] 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/561: dread da/d27/d1b/fbd [0,4194304] 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:6/496: dread d8/f18 [0,4194304] 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:6/497: mkdir d8/de/d7f/da5 0 2024-04-19T02:18:33.171 INFO:tasks.workunit.client.0.smithi073.stdout:3/656: dread d3/d6/db/d3a/d38/d43/f84 [0,4194304] 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/562: dwrite da/d27/d1b/d1d/d8d/d84/f9e [0,4194304] 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/498: rmdir d8 39 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/657: creat d3/d6/db/d3a/d5f/da7/dd7/fd8 x:0 0 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/563: symlink da/d27/d1b/d8c/db7/lc5 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:2/565: dread d5/d10/d29/d66/d67/f48 [0,4194304] 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/499: rename d8/d4b/d93/d60/f3f to d8/d4b/d93/d86/fa6 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/658: getdents d3/d6/db/d3a/d38/d57 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/564: link da/d27/d1b/d1d/d72/f62 da/d27/d3a/d50/d9c/fc6 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/659: dread d3/d6/db/f45 [0,4194304] 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:2/566: dwrite d5/d10/d29/d66/d67/d72/f12 [8388608,4194304] 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/500: dwrite d8/de/d78/f90 [0,4194304] 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:2/567: write d5/d10/d53/f73 [250951,1871] 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/660: truncate d3/f5 1668165 0 2024-04-19T02:18:33.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/501: symlink d8/d71/d7d/la7 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:2/568: mknod d5/d10/cc7 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/661: unlink d3/d6/db/d3a/d38/f53 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/662: creat d3/d6/db/d16/d9e/fd9 x:0 0 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/663: link d3/d6/fd d3/d6/fda 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/664: write d3/f3d [4156201,31290] 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/665: readlink d3/d6/db/d3a/d5f/lb8 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/666: symlink d3/d6/db/d3a/ldb 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/502: dwrite d8/de/f1e [4194304,4194304] 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/503: mkdir d8/de/d22/da8 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/504: mknod d8/de/d22/da8/ca9 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/505: rmdir d8/de/d78/d97 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/506: dwrite d8/d71/d75/f8d [0,4194304] 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/507: dwrite d8/de/d58/d63/d82/f9b [0,4194304] 0 2024-04-19T02:18:33.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/508: truncate d8/de/d58/d63/f6b 1832742 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/509: link d8/de/d22/c5e d8/de/caa 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/510: dread d8/de/d22/f37 [0,4194304] 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:9/529: dread d0/df/f41 [0,4194304] 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/511: mkdir d8/d71/d7d/dab 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:9/530: write d0/df/d16/d19/db1/d2c/f77 [1960150,11608] 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:9/531: stat d0/df/d60/f90 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/512: truncate d8/de/d58/d63/d82/f9b 1337538 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/569: dread d5/d10/d29/f8c [0,4194304] 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/570: getdents d5/d10/d14/d2e 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/571: rmdir d5/d10/d29/d66/d67/d72 39 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/572: symlink d5/d10/d29/d42/lc8 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/573: rename d5/f31 to d5/d10/d29/d66/d83/fc9 0 2024-04-19T02:18:33.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/574: read d5/d10/d14/d18/d3e/f3c [44060,50431] 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:2/575: fsync d5/d10/d14/d18/d3e/d2d/d63/da2/fb2 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:2/576: dread - d5/d10/d29/d66/f69 zero size 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:7/573: sync 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:5/620: sync 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:8/562: sync 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:1/512: sync 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:8/563: chown d14/d27/d85/d9a 739057 1 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:8/564: mkdir d14/dbc 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:2/577: dwrite d5/d10/d53/f75 [0,4194304] 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:5/621: rename d0/d1d/d1e/l29 to d0/d1d/d25/d35/lca 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:7/574: link d0/dc/d67/d2a/l69 d0/dc/d39/d50/da3/lab 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:2/578: fsync d5/d10/d14/f8a 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:5/622: rename d0/ld to d0/d1d/d90/da0/lcb 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:2/579: stat d5/d10/d14/d18/d3e/d51/f79 0 2024-04-19T02:18:33.175 INFO:tasks.workunit.client.0.smithi073.stdout:2/580: chown d5/d10/d14/d18/d3e/d2d/d63/c78 203255727 1 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/565: dread d14/f93 [0,4194304] 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/566: creat d14/d87/fbd x:0 0 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/567: stat d14/d27/d7b/cad 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/568: link d14/d15/d17/da1/ca6 d14/d15/d17/da1/db9/cbe 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/569: mknod d14/d27/d29/d69/cbf 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/570: fdatasync d14/d27/d29/d31/d34/f40 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/571: dread - d14/d87/f96 zero size 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/572: fsync d14/d15/d17/d8d/f94 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:5/623: dread d0/d1d/d1e/f40 [0,4194304] 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:1/513: truncate db/f17 1221372 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:7/575: truncate d0/f3c 1900276 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:2/581: truncate d5/d10/d29/d66/d67/d72/f12 92856 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/573: read f0 [3415131,83238] 0 2024-04-19T02:18:33.176 INFO:tasks.workunit.client.0.smithi073.stdout:1/514: unlink db/d1c/d2c/d50/d62/l7e 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/576: write d0/dc/d67/d2a/f2b [5009375,16153] 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:2/582: symlink d5/d10/d29/d66/d83/dbc/lca 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:1/515: fdatasync f9 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:8/574: symlink d14/d27/d4c/d75/dbb/lc0 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/577: fdatasync d0/dc/d33/d36/d7b/f85 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:2/583: write d5/d10/d53/f92 [794675,24945] 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/578: symlink d0/d28/d63/lac 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:8/575: symlink d14/d15/d17/da1/lc1 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:8/576: symlink d14/d15/d17/d48/d89/lc2 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/579: getdents d0/dc/d84 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/580: write d0/dc/d39/d50/f6b [713071,85716] 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/581: link d0/dc/d67/d15/c42 d0/dc/d39/d40/cad 0 2024-04-19T02:18:33.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/582: read d0/f6a [20431,12078] 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:8/577: dread d14/d27/d4c/d75/f44 [0,4194304] 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:9/532: dread d0/df/d16/d19/d38/d5d/d5e/fa7 [0,4194304] 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:9/533: creat d0/d35/fbb x:0 0 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:9/534: write d0/df/d1d/f2f [3305933,104999] 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:9/535: write d0/df/d16/d19/d38/f66 [991896,98328] 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:2/584: truncate d5/d10/d29/d66/d67/f4f 924719 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:1/516: dwrite db/d1c/d2c/d50/d62/f79 [0,4194304] 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:8/578: dwrite f11 [0,4194304] 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:1/517: truncate db/d41/f67 430933 0 2024-04-19T02:18:33.178 INFO:tasks.workunit.client.0.smithi073.stdout:8/579: creat d14/d27/da4/fc3 x:0 0 0 2024-04-19T02:18:33.179 INFO:tasks.workunit.client.0.smithi073.stdout:1/518: link db/f2a db/d1c/d2c/d50/d62/fb6 0 2024-04-19T02:18:33.179 INFO:tasks.workunit.client.0.smithi073.stdout:2/585: dwrite d5/d10/f7d [0,4194304] 0 2024-04-19T02:18:33.179 INFO:tasks.workunit.client.0.smithi073.stdout:2/586: mkdir d5/d10/d29/dcb 0 2024-04-19T02:18:33.179 INFO:tasks.workunit.client.0.smithi073.stdout:2/587: creat d5/d10/d14/d2e/fcc x:0 0 0 2024-04-19T02:18:33.179 INFO:tasks.workunit.client.0.smithi073.stdout:2/588: creat d5/d10/d29/d66/d83/fcd x:0 0 0 2024-04-19T02:18:33.180 INFO:tasks.workunit.client.0.smithi073.stdout:5/624: dread d0/d1d/d25/d35/d39/f66 [0,4194304] 0 2024-04-19T02:18:33.183 INFO:tasks.workunit.client.0.smithi073.stdout:7/583: dread d0/f7c [0,4194304] 0 2024-04-19T02:18:33.185 INFO:tasks.workunit.client.0.smithi073.stdout:5/625: truncate d0/d2d/f60 2958009 0 2024-04-19T02:18:33.204 INFO:tasks.workunit.client.0.smithi073.stdout:2/589: dread d5/d10/d14/d18/f4d [0,4194304] 0 2024-04-19T02:18:33.204 INFO:tasks.workunit.client.0.smithi073.stdout:2/590: chown d5/d10/d14/db6/lc4 12 1 2024-04-19T02:18:33.205 INFO:tasks.workunit.client.0.smithi073.stdout:2/591: symlink d5/d10/d29/d66/d67/d72/lce 0 2024-04-19T02:18:33.209 INFO:tasks.workunit.client.0.smithi073.stdout:5/626: dread d0/d1d/d24/d62/f92 [0,4194304] 0 2024-04-19T02:18:33.210 INFO:tasks.workunit.client.0.smithi073.stdout:0/543: sync 2024-04-19T02:18:33.210 INFO:tasks.workunit.client.0.smithi073.stdout:0/544: chown d7/cf 18158090 1 2024-04-19T02:18:33.210 INFO:tasks.workunit.client.0.smithi073.stdout:5/627: write d0/d1d/d64/f8b [916722,81224] 0 2024-04-19T02:18:33.210 INFO:tasks.workunit.client.0.smithi073.stdout:5/628: chown d0/d1d/d25/d37 3771 1 2024-04-19T02:18:33.211 INFO:tasks.workunit.client.0.smithi073.stdout:5/629: mknod d0/d1d/d25/d37/d71/ccc 0 2024-04-19T02:18:33.212 INFO:tasks.workunit.client.0.smithi073.stdout:5/630: symlink d0/d1d/d25/db5/lcd 0 2024-04-19T02:18:33.213 INFO:tasks.workunit.client.0.smithi073.stdout:5/631: mkdir d0/d1d/d24/d61/dce 0 2024-04-19T02:18:33.216 INFO:tasks.workunit.client.0.smithi073.stdout:0/545: dread d7/f67 [0,4194304] 0 2024-04-19T02:18:33.218 INFO:tasks.workunit.client.0.smithi073.stdout:0/546: rename d7/d14/d17/d1a/d20/l3f to d7/d14/d17/d69/la4 0 2024-04-19T02:18:33.218 INFO:tasks.workunit.client.0.smithi073.stdout:5/632: dwrite d0/d2d/dac/fb2 [0,4194304] 0 2024-04-19T02:18:33.219 INFO:tasks.workunit.client.0.smithi073.stdout:5/633: write d0/f5d [2283310,49073] 0 2024-04-19T02:18:33.222 INFO:tasks.workunit.client.0.smithi073.stdout:5/634: write d0/d1d/d25/d35/d39/f4c [1328344,75403] 0 2024-04-19T02:18:33.223 INFO:tasks.workunit.client.0.smithi073.stdout:5/635: dread - d0/d1d/d24/fa5 zero size 2024-04-19T02:18:33.223 INFO:tasks.workunit.client.0.smithi073.stdout:5/636: fsync d0/d1d/d24/d62/f8c 0 2024-04-19T02:18:33.224 INFO:tasks.workunit.client.0.smithi073.stdout:2/592: dread d5/d10/d14/d18/f1a [0,4194304] 0 2024-04-19T02:18:33.224 INFO:tasks.workunit.client.0.smithi073.stdout:5/637: chown d0/d1d/d1e/fa8 4 1 2024-04-19T02:18:33.224 INFO:tasks.workunit.client.0.smithi073.stdout:2/593: creat d5/d10/d14/d2e/fcf x:0 0 0 2024-04-19T02:18:33.225 INFO:tasks.workunit.client.0.smithi073.stdout:5/638: getdents d0/d1d/d25/d37/d71 0 2024-04-19T02:18:33.225 INFO:tasks.workunit.client.0.smithi073.stdout:2/594: unlink d5/d10/d14/db6/lc4 0 2024-04-19T02:18:33.229 INFO:tasks.workunit.client.0.smithi073.stdout:5/639: truncate d0/d1d/d24/d61/f74 1976643 0 2024-04-19T02:18:33.230 INFO:tasks.workunit.client.0.smithi073.stdout:2/595: dwrite d5/d10/d14/d18/f22 [0,4194304] 0 2024-04-19T02:18:33.233 INFO:tasks.workunit.client.0.smithi073.stdout:5/640: getdents d0/d1d/d25/d35/d88 0 2024-04-19T02:18:33.233 INFO:tasks.workunit.client.0.smithi073.stdout:2/596: write d5/d10/d14/d18/f22 [4441060,42563] 0 2024-04-19T02:18:33.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/597: truncate d5/d10/d14/d18/d3e/d2d/f3a 2304080 0 2024-04-19T02:18:33.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/598: stat d5/d10/d14/d18/d98/fc6 0 2024-04-19T02:18:33.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/599: mknod d5/d10/d14/cd0 0 2024-04-19T02:18:33.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/600: mkdir d5/d10/d14/d7a/dd1 0 2024-04-19T02:18:33.235 INFO:tasks.workunit.client.0.smithi073.stdout:2/601: creat d5/d10/d14/d7a/fd2 x:0 0 0 2024-04-19T02:18:33.240 INFO:tasks.workunit.client.0.smithi073.stdout:2/602: dwrite d5/d10/d29/d66/d83/fcd [0,4194304] 0 2024-04-19T02:18:33.241 INFO:tasks.workunit.client.0.smithi073.stdout:2/603: getdents d5/d10/d29/dcb 0 2024-04-19T02:18:33.241 INFO:tasks.workunit.client.0.smithi073.stdout:2/604: truncate d5/d10/f7d 4783789 0 2024-04-19T02:18:33.242 INFO:tasks.workunit.client.0.smithi073.stdout:2/605: mknod d5/d10/d14/d2e/da0/dc0/cd3 0 2024-04-19T02:18:33.242 INFO:tasks.workunit.client.0.smithi073.stdout:2/606: read - d5/d10/d14/d18/d3e/d51/fbf zero size 2024-04-19T02:18:33.251 INFO:tasks.workunit.client.0.smithi073.stdout:0/547: dread d7/d14/d17/d1a/f7e [0,4194304] 0 2024-04-19T02:18:33.251 INFO:tasks.workunit.client.0.smithi073.stdout:2/607: truncate d5/d10/d14/d18/d3e/f32 3930813 0 2024-04-19T02:18:33.252 INFO:tasks.workunit.client.0.smithi073.stdout:2/608: rmdir d5/d10/d14/d18/d3e/d51 39 2024-04-19T02:18:33.252 INFO:tasks.workunit.client.0.smithi073.stdout:0/548: creat d7/d14/d17/d1a/d21/fa5 x:0 0 0 2024-04-19T02:18:33.252 INFO:tasks.workunit.client.0.smithi073.stdout:2/609: mkdir d5/d10/d29/dd4 0 2024-04-19T02:18:33.253 INFO:tasks.workunit.client.0.smithi073.stdout:2/610: rename d5/d10/d14/d18/d3e/d2d/fac to d5/fd5 0 2024-04-19T02:18:33.255 INFO:tasks.workunit.client.0.smithi073.stdout:2/611: link d5/d10/d29/d66/lbb d5/d10/d14/d18/d98/ld6 0 2024-04-19T02:18:33.255 INFO:tasks.workunit.client.0.smithi073.stdout:0/549: dread d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:33.255 INFO:tasks.workunit.client.0.smithi073.stdout:2/612: readlink d5/d10/la9 0 2024-04-19T02:18:33.256 INFO:tasks.workunit.client.0.smithi073.stdout:0/550: write f2 [4676438,3151] 0 2024-04-19T02:18:33.256 INFO:tasks.workunit.client.0.smithi073.stdout:2/613: chown d5/d10/d14/d18/c38 12812 1 2024-04-19T02:18:33.256 INFO:tasks.workunit.client.0.smithi073.stdout:0/551: symlink d7/d14/d81/la6 0 2024-04-19T02:18:33.257 INFO:tasks.workunit.client.0.smithi073.stdout:2/614: creat d5/d10/d14/d18/d3e/d2d/d63/fd7 x:0 0 0 2024-04-19T02:18:33.257 INFO:tasks.workunit.client.0.smithi073.stdout:0/552: fdatasync d7/d14/f2d 0 2024-04-19T02:18:33.257 INFO:tasks.workunit.client.0.smithi073.stdout:2/615: chown d5/d10/d14/d2e/c40 7605401 1 2024-04-19T02:18:33.258 INFO:tasks.workunit.client.0.smithi073.stdout:2/616: readlink d5/d10/d14/d2e/lc5 0 2024-04-19T02:18:33.258 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:33.255+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:33.258 INFO:tasks.workunit.client.0.smithi073.stdout:2/617: fsync d5/d10/d14/d18/d3e/d2d/f3a 0 2024-04-19T02:18:33.259 INFO:tasks.workunit.client.0.smithi073.stdout:2/618: rmdir d5/d10/d29/d42 39 2024-04-19T02:18:33.260 INFO:tasks.workunit.client.0.smithi073.stdout:2/619: creat d5/d10/d29/fd8 x:0 0 0 2024-04-19T02:18:33.261 INFO:tasks.workunit.client.0.smithi073.stdout:2/620: symlink d5/d10/d29/d42/ld9 0 2024-04-19T02:18:33.262 INFO:tasks.workunit.client.0.smithi073.stdout:2/621: chown d5/d10/d14/d18/d3e/d2d/cb5 91 1 2024-04-19T02:18:33.262 INFO:tasks.workunit.client.0.smithi073.stdout:0/553: dwrite d7/d6d/f88 [0,4194304] 0 2024-04-19T02:18:33.263 INFO:tasks.workunit.client.0.smithi073.stdout:5/641: dread d0/d2d/fb3 [0,4194304] 0 2024-04-19T02:18:33.263 INFO:tasks.workunit.client.0.smithi073.stdout:2/622: write d5/d10/d29/d66/d67/f88 [1472611,5625] 0 2024-04-19T02:18:33.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/642: symlink d0/d1d/d25/d37/d71/lcf 0 2024-04-19T02:18:33.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/643: chown d0/l1 14407 1 2024-04-19T02:18:33.265 INFO:tasks.workunit.client.0.smithi073.stdout:5/644: chown d0/d1d/d64/f6b 216 1 2024-04-19T02:18:33.267 INFO:tasks.workunit.client.0.smithi073.stdout:4/565: sync 2024-04-19T02:18:33.267 INFO:tasks.workunit.client.0.smithi073.stdout:3/667: sync 2024-04-19T02:18:33.267 INFO:tasks.workunit.client.0.smithi073.stdout:6/513: sync 2024-04-19T02:18:33.267 INFO:tasks.workunit.client.0.smithi073.stdout:7/584: sync 2024-04-19T02:18:33.267 INFO:tasks.workunit.client.0.smithi073.stdout:1/519: sync 2024-04-19T02:18:33.267 INFO:tasks.workunit.client.0.smithi073.stdout:8/580: sync 2024-04-19T02:18:33.267 INFO:tasks.workunit.client.0.smithi073.stdout:9/536: sync 2024-04-19T02:18:33.269 INFO:tasks.workunit.client.0.smithi073.stdout:9/537: write d0/f50 [3570953,84227] 0 2024-04-19T02:18:33.269 INFO:tasks.workunit.client.0.smithi073.stdout:8/581: chown d14/d27/d29/d31/c72 0 1 2024-04-19T02:18:33.269 INFO:tasks.workunit.client.0.smithi073.stdout:1/520: mkdir db/d1c/d81/d83/dad/db7 0 2024-04-19T02:18:33.270 INFO:tasks.workunit.client.0.smithi073.stdout:3/668: write d3/d6/db/d1a/d54/f81 [3215096,31478] 0 2024-04-19T02:18:33.270 INFO:tasks.workunit.client.0.smithi073.stdout:4/566: truncate da/d27/d3a/d49/f9a 437267 0 2024-04-19T02:18:33.271 INFO:tasks.workunit.client.0.smithi073.stdout:1/521: write db/f25 [449561,52615] 0 2024-04-19T02:18:33.271 INFO:tasks.workunit.client.0.smithi073.stdout:9/538: fdatasync d0/df/d16/d19/d38/f66 0 2024-04-19T02:18:33.272 INFO:tasks.workunit.client.0.smithi073.stdout:2/623: dwrite d5/d10/d14/d18/d3e/d2d/f5d [0,4194304] 0 2024-04-19T02:18:33.272 INFO:tasks.workunit.client.0.smithi073.stdout:7/585: link d0/dc/d67/d15/l48 d0/dc/d67/d99/lae 0 2024-04-19T02:18:33.273 INFO:tasks.workunit.client.0.smithi073.stdout:4/567: creat da/d27/d1b/d26/d2a/d46/fc7 x:0 0 0 2024-04-19T02:18:33.273 INFO:tasks.workunit.client.0.smithi073.stdout:3/669: mknod d3/d6/db/d1a/d54/cdc 0 2024-04-19T02:18:33.274 INFO:tasks.workunit.client.0.smithi073.stdout:5/645: dwrite d0/d1d/d24/fa5 [0,4194304] 0 2024-04-19T02:18:33.274 INFO:tasks.workunit.client.0.smithi073.stdout:2/624: chown d5/d10/d14/d18/c7f 5514279 1 2024-04-19T02:18:33.274 INFO:tasks.workunit.client.0.smithi073.stdout:1/522: rename db/d1c/d81/d83/dad/db7 to db/d1c/d81/d83/db8 0 2024-04-19T02:18:33.275 INFO:tasks.workunit.client.0.smithi073.stdout:7/586: mknod d0/dc/d33/d36/d7b/d93/caf 0 2024-04-19T02:18:33.276 INFO:tasks.workunit.client.0.smithi073.stdout:4/568: write da/d27/d1b/d26/f4c [937165,108848] 0 2024-04-19T02:18:33.277 INFO:tasks.workunit.client.0.smithi073.stdout:3/670: mkdir d3/d6/db/d3a/d38/d43/d4e/ddd 0 2024-04-19T02:18:33.277 INFO:tasks.workunit.client.0.smithi073.stdout:7/587: write d0/dc/f8a [510037,34655] 0 2024-04-19T02:18:33.277 INFO:tasks.workunit.client.0.smithi073.stdout:1/523: write db/d7f/f9b [2398114,86684] 0 2024-04-19T02:18:33.280 INFO:tasks.workunit.client.0.smithi073.stdout:4/569: chown da/d27/d1b/d1d/d8d/c65 110028 1 2024-04-19T02:18:33.280 INFO:tasks.workunit.client.0.smithi073.stdout:7/588: unlink d0/dc/d67/d15/c52 0 2024-04-19T02:18:33.280 INFO:tasks.workunit.client.0.smithi073.stdout:3/671: mkdir d3/d6/db/d3a/d5f/dca/dde 0 2024-04-19T02:18:33.280 INFO:tasks.workunit.client.0.smithi073.stdout:8/582: dwrite d14/d15/f7e [0,4194304] 0 2024-04-19T02:18:33.280 INFO:tasks.workunit.client.0.smithi073.stdout:1/524: creat db/d1c/d78/fb9 x:0 0 0 2024-04-19T02:18:33.281 INFO:tasks.workunit.client.0.smithi073.stdout:0/554: dwrite d7/d14/d17/d1a/fa0 [0,4194304] 0 2024-04-19T02:18:33.281 INFO:tasks.workunit.client.0.smithi073.stdout:4/570: readlink da/d27/d1b/l1c 0 2024-04-19T02:18:33.281 INFO:tasks.workunit.client.0.smithi073.stdout:4/571: chown da/d27/d1b 210972827 1 2024-04-19T02:18:33.281 INFO:tasks.workunit.client.0.smithi073.stdout:8/583: symlink d14/d15/d17/d48/lc4 0 2024-04-19T02:18:33.281 INFO:tasks.workunit.client.0.smithi073.stdout:7/589: mkdir d0/dc/d33/d5d/db0 0 2024-04-19T02:18:33.282 INFO:tasks.workunit.client.0.smithi073.stdout:0/555: rename d7/d14/d17/d1a/d56 to d7/d14/d17/d1a/d20/d50/d99/da7 0 2024-04-19T02:18:33.283 INFO:tasks.workunit.client.0.smithi073.stdout:4/572: getdents da/d27/d1b/d1d/d72/d2b/d2f/d91 0 2024-04-19T02:18:33.284 INFO:tasks.workunit.client.0.smithi073.stdout:0/556: creat d7/d14/d17/fa8 x:0 0 0 2024-04-19T02:18:33.284 INFO:tasks.workunit.client.0.smithi073.stdout:5/646: dwrite d0/d2d/dac/fb2 [0,4194304] 0 2024-04-19T02:18:33.284 INFO:tasks.workunit.client.0.smithi073.stdout:5/647: dread - d0/d1d/d1e/fa8 zero size 2024-04-19T02:18:33.284 INFO:tasks.workunit.client.0.smithi073.stdout:4/573: symlink da/d27/d3a/d49/lc8 0 2024-04-19T02:18:33.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/557: symlink d7/d14/d17/d1a/d20/d50/d99/la9 0 2024-04-19T02:18:33.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/558: fsync f2 0 2024-04-19T02:18:33.285 INFO:tasks.workunit.client.0.smithi073.stdout:5/648: write d0/d1d/d25/f6e [1287385,112684] 0 2024-04-19T02:18:33.286 INFO:tasks.workunit.client.0.smithi073.stdout:4/574: write da/d27/d2c/d60/f71 [645392,129181] 0 2024-04-19T02:18:33.292 INFO:tasks.workunit.client.0.smithi073.stdout:4/575: dwrite da/d27/d1b/d26/f4a [4194304,4194304] 0 2024-04-19T02:18:33.293 INFO:tasks.workunit.client.0.smithi073.stdout:4/576: mknod da/d27/d1b/d1d/d8d/d84/cc9 0 2024-04-19T02:18:33.294 INFO:tasks.workunit.client.0.smithi073.stdout:4/577: rename da/d27/d36/d4d/l4e to da/d27/d3a/d97/lca 0 2024-04-19T02:18:33.295 INFO:tasks.workunit.client.0.smithi073.stdout:4/578: creat da/d27/d1b/d8c/db7/fcb x:0 0 0 2024-04-19T02:18:33.295 INFO:tasks.workunit.client.0.smithi073.stdout:4/579: fdatasync da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f 0 2024-04-19T02:18:33.297 INFO:tasks.workunit.client.0.smithi073.stdout:2/625: symlink d5/d10/d29/dd4/lda 0 2024-04-19T02:18:33.299 INFO:tasks.workunit.client.0.smithi073.stdout:2/626: write d5/f64 [6299571,37564] 0 2024-04-19T02:18:33.301 INFO:tasks.workunit.client.0.smithi073.stdout:2/627: creat d5/d10/d29/dcb/fdb x:0 0 0 2024-04-19T02:18:33.301 INFO:tasks.workunit.client.0.smithi073.stdout:4/580: dwrite da/d27/d1b/d1d/d8d/f78 [0,4194304] 0 2024-04-19T02:18:33.301 INFO:tasks.workunit.client.0.smithi073.stdout:7/590: write d0/f3c [1354281,32679] 0 2024-04-19T02:18:33.302 INFO:tasks.workunit.client.0.smithi073.stdout:2/628: mknod d5/d10/d14/d2e/cdc 0 2024-04-19T02:18:33.302 INFO:tasks.workunit.client.0.smithi073.stdout:7/591: write d0/dc/d67/d2a/f2b [3565811,62964] 0 2024-04-19T02:18:33.302 INFO:tasks.workunit.client.0.smithi073.stdout:4/581: mkdir da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc 0 2024-04-19T02:18:33.302 INFO:tasks.workunit.client.0.smithi073.stdout:7/592: chown d0/dc/d67/d15 15 1 2024-04-19T02:18:33.303 INFO:tasks.workunit.client.0.smithi073.stdout:2/629: creat d5/d10/d29/d66/d67/fdd x:0 0 0 2024-04-19T02:18:33.303 INFO:tasks.workunit.client.0.smithi073.stdout:4/582: creat da/d27/d2c/da6/fcd x:0 0 0 2024-04-19T02:18:33.304 INFO:tasks.workunit.client.0.smithi073.stdout:2/630: mkdir d5/d10/d14/d7a/dde 0 2024-04-19T02:18:33.304 INFO:tasks.workunit.client.0.smithi073.stdout:7/593: link d0/dc/d67/d15/c45 d0/dc/d84/cb1 0 2024-04-19T02:18:33.305 INFO:tasks.workunit.client.0.smithi073.stdout:4/583: creat da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/fce x:0 0 0 2024-04-19T02:18:33.305 INFO:tasks.workunit.client.0.smithi073.stdout:4/584: mkdir da/d27/d2c/d80/dcf 0 2024-04-19T02:18:33.306 INFO:tasks.workunit.client.0.smithi073.stdout:4/585: dread - da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/fce zero size 2024-04-19T02:18:33.307 INFO:tasks.workunit.client.0.smithi073.stdout:0/559: truncate d7/d14/f15 700657 0 2024-04-19T02:18:33.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/586: mkdir da/d27/d1b/d1d/d72/d3d/dd0 0 2024-04-19T02:18:33.307 INFO:tasks.workunit.client.0.smithi073.stdout:9/539: truncate d0/df/d16/d19/db1/d2c/f77 3540891 0 2024-04-19T02:18:33.308 INFO:tasks.workunit.client.0.smithi073.stdout:9/540: unlink d0/c14 0 2024-04-19T02:18:33.308 INFO:tasks.workunit.client.0.smithi073.stdout:3/672: sync 2024-04-19T02:18:33.308 INFO:tasks.workunit.client.0.smithi073.stdout:1/525: sync 2024-04-19T02:18:33.309 INFO:tasks.workunit.client.0.smithi073.stdout:9/541: rmdir d0/df/d16/d19/d38/d5d 39 2024-04-19T02:18:33.309 INFO:tasks.workunit.client.0.smithi073.stdout:1/526: readlink db/d1c/d95/la1 0 2024-04-19T02:18:33.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/673: stat d3/d6/db/d3a/d5f/da7/dd7/fd8 0 2024-04-19T02:18:33.310 INFO:tasks.workunit.client.0.smithi073.stdout:1/527: chown db/d1c/l26 1997784 1 2024-04-19T02:18:33.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/674: chown d3/f5 251 1 2024-04-19T02:18:33.310 INFO:tasks.workunit.client.0.smithi073.stdout:1/528: symlink db/d1c/d2c/d50/lba 0 2024-04-19T02:18:33.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/675: unlink d3/d6/f15 0 2024-04-19T02:18:33.311 INFO:tasks.workunit.client.0.smithi073.stdout:3/676: mkdir d3/d6/db/d3a/d38/d57/ddf 0 2024-04-19T02:18:33.313 INFO:tasks.workunit.client.0.smithi073.stdout:0/560: dwrite d7/d14/d17/d1a/d21/f5b [0,4194304] 0 2024-04-19T02:18:33.315 INFO:tasks.workunit.client.0.smithi073.stdout:0/561: rename f2 to d7/faa 0 2024-04-19T02:18:33.316 INFO:tasks.workunit.client.0.smithi073.stdout:9/542: dwrite d0/df/d16/d19/db1/d2c/d2e/f82 [0,4194304] 0 2024-04-19T02:18:33.316 INFO:tasks.workunit.client.0.smithi073.stdout:0/562: stat d7/d14/d17/d69 0 2024-04-19T02:18:33.316 INFO:tasks.workunit.client.0.smithi073.stdout:9/543: stat d0/df/d16/d19/l95 0 2024-04-19T02:18:33.318 INFO:tasks.workunit.client.0.smithi073.stdout:9/544: unlink d0/df/d16/d19/d38/d5d/d76/l85 0 2024-04-19T02:18:33.319 INFO:tasks.workunit.client.0.smithi073.stdout:3/677: dwrite d3/d6/db/d16/d52/f56 [0,4194304] 0 2024-04-19T02:18:33.319 INFO:tasks.workunit.client.0.smithi073.stdout:9/545: write d0/f1f [996371,40035] 0 2024-04-19T02:18:33.320 INFO:tasks.workunit.client.0.smithi073.stdout:3/678: getdents d3/d6/db/d1a/d54 0 2024-04-19T02:18:33.321 INFO:tasks.workunit.client.0.smithi073.stdout:3/679: getdents d3/d6/db/d3a/d5f/da7/dd7 0 2024-04-19T02:18:33.322 INFO:tasks.workunit.client.0.smithi073.stdout:6/514: dread d8/de/f1e [0,4194304] 0 2024-04-19T02:18:33.323 INFO:tasks.workunit.client.0.smithi073.stdout:6/515: fsync d8/de/d22/f34 0 2024-04-19T02:18:33.323 INFO:tasks.workunit.client.0.smithi073.stdout:6/516: creat d8/d71/d75/fac x:0 0 0 2024-04-19T02:18:33.327 INFO:tasks.workunit.client.0.smithi073.stdout:7/594: write d0/f8 [1762597,84840] 0 2024-04-19T02:18:33.329 INFO:tasks.workunit.client.0.smithi073.stdout:6/517: dwrite d8/d4b/d93/d86/fa6 [0,4194304] 0 2024-04-19T02:18:33.329 INFO:tasks.workunit.client.0.smithi073.stdout:1/529: rmdir db 39 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13140 4.36 4:6ea7c10a:::100000034f5.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.278661+0000", 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.051749626999999999, 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051772645999999999, 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.331 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13140 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278661+0000", 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278661+0000", 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278660+0000", 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.282373+0000", 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037134989999999999 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.282393+0000", 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9355e-05 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.282404+0000", 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.129e-05 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.282441+0000", 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7580000000000003e-05 2024-04-19T02:18:33.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.282599+0000", 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157515 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.282744+0000", 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014474999999999999 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.308048+0000", 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025304638000000001 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1789 3.18 e64/15 3:1e8917d7:::200.0000000e:head v 64'247, mlcod=64'241)", 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.320886+0000", 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0095239880000000006, 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0096030219999999993, 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.320886+0000", 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.320886+0000", 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.320886+0000", 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.320900+0000", 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3878e-05 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.320907+0000", 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8020000000000003e-06 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.320911+0000", 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6870000000000002e-06 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.325199+0000", 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042872550000000002 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.325217+0000", 2024-04-19T02:18:33.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8678e-05 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13166 4.1f 4:f9f4c912:::1000000347d.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.317314+0000", 2024-04-19T02:18:33.340 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013096816000000001, 2024-04-19T02:18:33.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013214475, 2024-04-19T02:18:33.341 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.341 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.341 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.341 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.341 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.341 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13166 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.317314+0000", 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.317314+0000", 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.317256+0000", 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999423 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.322926+0000", 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056699339999999997 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.322948+0000", 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1957999999999999e-05 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.322959+0000", 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1617000000000001e-05 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.323016+0000", 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6994999999999999e-05 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.323178+0000", 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016210199999999999 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.344 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:13149 4.1 e64/38 4:813adf10:::1000000335f.00000000:head v 64'200, mlcod=64'198)", 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.289658+0000", 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.040752612000000001, 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040908202999999997, 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.289658+0000", 2024-04-19T02:18:33.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.289658+0000", 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.289656+0000", 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.289829+0000", 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017259 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.289841+0000", 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1834000000000001e-05 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.290987+0000", 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001146045 2024-04-19T02:18:33.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.291046+0000", 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9605000000000003e-05 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.291083+0000", 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6557000000000003e-05 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1790 3.18 e64/15 3:1e8917d7:::200.0000000e:head v 64'248, mlcod=64'241)", 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.324229+0000", 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0061812660000000004, 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063881420000000003, 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.324229+0000", 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.324229+0000", 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.324228+0000", 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.324249+0000", 2024-04-19T02:18:33.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0746000000000001e-05 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.324262+0000", 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2937e-05 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.324270+0000", 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1799999999999996e-06 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.325677+0000", 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001407602 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.325695+0000", 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7110000000000001e-05 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1791 3.18 e64/15 3:1e8917d7:::200.0000000e:head v 64'249, mlcod=64'241)", 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.328024+0000", 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0023867150000000002, 2024-04-19T02:18:33.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026570230000000001, 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328024+0000", 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328024+0000", 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328023+0000", 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328033+0000", 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0764999999999999e-05 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328043+0000", 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0189e-05 2024-04-19T02:18:33.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328053+0000", 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6229999999999992e-06 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328118+0000", 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4564000000000001e-05 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328140+0000", 2024-04-19T02:18:33.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.215e-05 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13171 4.e 4.1d30b58e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.323408+0000", 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0070024379999999997, 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073312230000000004, 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.356 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13171 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.323408+0000", 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.323408+0000", 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.323407+0000", 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.327975+0000", 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045678170000000001 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328270+0000", 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00029459799999999997 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328282+0000", 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2058999999999999e-05 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13146 4.3f 4:fe0184fd:::100000033ea.00000000:head [write 0~4194304 [2@1130591] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.287481+0000", 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.042929182000000003, 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043321879000000001, 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13146 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.287481+0000", 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.287481+0000", 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.287480+0000", 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.291740+0000", 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042606140000000002 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.291755+0000", 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4564e-05 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.291763+0000", 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.763e-06 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.291818+0000", 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5247999999999997e-05 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.291915+0000", 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6953000000000005e-05 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.292060+0000", 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144733 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.327637+0000", 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035577242000000002 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.363 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13172 4.2a 4:55eb608e:::1000000318d.00000000:head [write 996371~40035 in=40035b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.328294+0000", 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0021162640000000001, 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026004539999999999, 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13172 2024-04-19T02:18:33.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328294+0000", 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328294+0000", 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328293+0000", 2024-04-19T02:18:33.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328326+0000", 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2956000000000001e-05 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328336+0000", 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0419e-05 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328342+0000", 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.536e-06 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328399+0000", 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6962000000000001e-05 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328493+0000", 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4728999999999994e-05 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13174 4.2a 4:55063679:::1000000327f.00000000:head [read 262144~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.328353+0000", 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0020577210000000002, 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002611482, 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13174 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328353+0000", 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328353+0000", 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328352+0000", 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328355+0000", 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1209999999999998e-06 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328363+0000", 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.605e-06 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.328369+0000", 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8440000000000003e-06 2024-04-19T02:18:33.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329409+0000", 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001039924 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329502+0000", 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3114000000000003e-05 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:1792 4.3 4:c3e59f12:::100000031d5.00000000:head [trimtrunc 4@700657] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.329244+0000", 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001166322, 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001790577, 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329244+0000", 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329244+0000", 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329243+0000", 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329249+0000", 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2280000000000003e-06 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329262+0000", 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3037000000000001e-05 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329270+0000", 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329341+0000", 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0908999999999995e-05 2024-04-19T02:18:33.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.329433+0000", 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2544e-05 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13148 4.31 4:8d7a49a4:::10000003244.00000000:head [write 0~4194304 [3@1954846] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.292995+0000", 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.037415209999999997, 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038105933000000002, 2024-04-19T02:18:33.375 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13148 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.292995+0000", 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.292995+0000", 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.292995+0000", 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.297898+0000", 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049032570000000003 2024-04-19T02:18:33.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.297911+0000", 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2976000000000001e-05 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.297922+0000", 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1078e-05 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.317940+0000", 2024-04-19T02:18:33.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020018393999999998 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.318127+0000", 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186813 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1793 3.18 e64/15 3:1e8917d7:::200.0000000e:head v 64'250, mlcod=64'244)", 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.330015+0000", 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00039589900000000001, 2024-04-19T02:18:33.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011634740000000001, 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330015+0000", 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330015+0000", 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330014+0000", 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330088+0000", 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3898000000000003e-05 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330098+0000", 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0553999999999999e-05 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330106+0000", 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330149+0000", 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2930999999999999e-05 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330169+0000", 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0639e-05 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1794 4.2f e64/16 4:f633d486:::1000000311d.00000000:head v 64'189, mlcod=64'187)", 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.330587+0000", 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9998236, 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00065453400000000002, 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330587+0000", 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330587+0000", 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330586+0000", 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330596+0000", 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0096e-05 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330606+0000", 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4080000000000004e-06 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330612+0000", 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6919999999999999e-06 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330678+0000", 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6740000000000001e-05 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.330702+0000", 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3884e-05 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.386 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13153 4.1c 4:3b5874b5:::1000000329f.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.298028+0000", 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032382658000000002, 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033283339000000002, 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13153 2024-04-19T02:18:33.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.298028+0000", 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.298028+0000", 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.298027+0000", 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.302177+0000", 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041499290000000001 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.302196+0000", 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9157999999999999e-05 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.302206+0000", 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0093e-05 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.302279+0000", 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2957e-05 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.302379+0000", 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9393000000000002e-05 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.302541+0000", 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000162227 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:13158 4.1 e64/38 4:81a73ebf:::1000000330a.00000000:head v 64'201, mlcod=64'198)", 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.304402+0000", 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026008389, 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026984759000000001, 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.304402+0000", 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.304402+0000", 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.304401+0000", 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.304485+0000", 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3594e-05 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.304495+0000", 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0159999999999999e-05 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.304502+0000", 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1579999999999999e-06 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.317543+0000", 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013040847 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.317576+0000", 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2638999999999997e-05 2024-04-19T02:18:33.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13157 4.3e 4:7cdb7427:::10000003488.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.303613+0000", 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026797428000000002, 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027841799, 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.395 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13157 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.303613+0000", 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.303613+0000", 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.303612+0000", 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.310329+0000", 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0067161929999999996 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.310344+0000", 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5472999999999999e-05 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.310354+0000", 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5000000000000005e-06 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.310417+0000", 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2984999999999994e-05 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.310530+0000", 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011395099999999999 2024-04-19T02:18:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.310718+0000", 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018716699999999999 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13162 4.3e 4.336e88fe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.311597+0000", 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018813386000000001, 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019933879000000002, 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.399 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13162 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.311597+0000", 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.311597+0000", 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.311596+0000", 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.311600+0000", 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7570000000000002e-06 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.311609+0000", 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3250000000000008e-06 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.311614+0000", 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8309999999999997e-06 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13139 4.31 4:8f5d6475:::10000003388.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.274588+0000", 2024-04-19T02:18:33.402 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.055822339999999998, 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.057003146999999997, 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13139 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.274588+0000", 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.274588+0000", 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.274587+0000", 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278622+0000", 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040352620000000004 2024-04-19T02:18:33.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278638+0000", 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5722e-05 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278646+0000", 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1210000000000007e-06 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278699+0000", 2024-04-19T02:18:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2568999999999998e-05 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.278809+0000", 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011032 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 19 2024-04-19T02:18:33.406 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:33.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:33.409 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:33.407+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/530: write db/d7f/f9b [1119542,65747] 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:2/631: dread d5/fb9 [0,4194304] 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/531: creat db/d1c/d78/fbb x:0 0 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/532: fdatasync db/d41/f4c 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:3/680: truncate d3/d6/db/d3a/f70 3421828 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:2/632: unlink d5/d10/d29/d66/d67/d72/lab 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/533: creat db/d1c/d81/d86/fbc x:0 0 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:7/595: dwrite d0/dc/d33/f35 [0,4194304] 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:2/633: mkdir d5/d10/ddf 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:0/563: link d7/d14/d17/d1a/d21/f3c d7/d14/d17/d1a/d8d/fab 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/534: fsync db/d1c/d2c/fa3 0 2024-04-19T02:18:33.418 INFO:tasks.workunit.client.0.smithi073.stdout:3/681: symlink d3/d6/db/d3a/d38/d6f/dac/dc9/le0 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:1/535: creat db/d1c/d81/d86/fbd x:0 0 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:0/564: creat d7/d14/d17/d1a/fac x:0 0 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:3/682: creat d3/d6/db/d3a/d38/d6f/fe1 x:0 0 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:0/565: mknod d7/d14/d17/cad 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:1/536: creat db/d1c/d81/d83/db8/fbe x:0 0 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:6/518: dwrite d8/d4b/d8f/f95 [0,4194304] 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:0/566: getdents d7/d14/d17/d69 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:0/567: rename d7/d14/d17/d1a/d20/c4f to d7/d6d/cae 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:1/537: write db/d1c/d81/d83/db8/fbe [427734,106933] 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:7/596: dwrite d0/f79 [0,4194304] 0 2024-04-19T02:18:33.419 INFO:tasks.workunit.client.0.smithi073.stdout:1/538: readlink db/d1c/d2c/l9a 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:5/649: dread d0/d1d/d24/d61/fb4 [0,4194304] 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:0/568: fsync d7/d14/d17/d1a/d21/f8a 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:7/597: symlink d0/dc/d84/lb2 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:2/634: dwrite d5/d10/d14/d18/d3e/d51/f59 [0,4194304] 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:7/598: fsync d0/dc/d67/d15/f87 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:5/650: truncate d0/d1d/d25/d35/d96/fc1 158913 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:3/683: dwrite d3/d6/db/d3a/d38/d57/f7a [0,4194304] 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:7/599: chown d0/f7 815 1 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:4/587: dread da/d27/d1b/d1d/f42 [0,4194304] 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:1/539: dwrite db/d41/f74 [0,4194304] 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:1/540: rename db/d41/c56 to db/d1c/d81/cbf 0 2024-04-19T02:18:33.420 INFO:tasks.workunit.client.0.smithi073.stdout:1/541: dread - db/d1c/d78/fb2 zero size 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:7/600: dwrite d0/dc/d33/f35 [0,4194304] 0 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:7/601: readlink d0/dc/d39/l57 0 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:0/569: dread d7/f25 [0,4194304] 0 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:1/542: rename db/d1c/d81/d83/dad to db/d1c/d2c/d50/d62/dc0 0 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:0/570: link d7/d14/d17/d1a/d20/f48 d7/d14/d17/d1a/d20/faf 0 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:4/588: dwrite da/d27/d36/f6e [0,4194304] 0 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:0/571: creat d7/d14/d17/d1a/fb0 x:0 0 0 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:0/572: dread - d7/d14/d17/d1a/fac zero size 2024-04-19T02:18:33.421 INFO:tasks.workunit.client.0.smithi073.stdout:5/651: truncate d0/d1d/d25/d35/f42 3093508 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:0/573: unlink d7/d14/d81/la3 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/652: symlink d0/d1d/d25/d35/ld0 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:0/574: dread - d7/d14/d17/d70/f72 zero size 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/602: dwrite d0/d28/d63/f9e [0,4194304] 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/653: creat d0/d1d/d64/dbd/fd1 x:0 0 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/603: chown d0/d3/c8d 1852410857 1 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:0/575: write d7/d14/d17/d1a/d21/f64 [993474,118319] 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/604: creat d0/d3/fb3 x:0 0 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/654: getdents d0/d1d/d64 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/605: mkdir d0/dc/d33/d36/d7b/db4 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/655: unlink d0/d69/fb0 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/606: readlink d0/dc/l22 0 2024-04-19T02:18:33.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/607: write d0/d3/f74 [873512,68030] 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:5/656: getdents d0/d1d/d25/d35/d88/da7 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:7/608: unlink d0/dc/d67/f72 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:3/684: sync 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:7/609: symlink d0/dc/d33/d5d/lb5 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:9/546: dread d0/df/d16/d19/d38/d5d/d45/f7a [0,4194304] 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:4/589: read f1 [1127629,73770] 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:5/657: read d0/d1d/d1e/f2b [3128182,15253] 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:1/543: dread db/f21 [0,4194304] 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:5/658: mkdir d0/d2d/dd2 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:1/544: write db/d1c/d81/d86/fbc [591812,124921] 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:3/685: dwrite d3/d6/db/d16/d52/f8f [4194304,4194304] 0 2024-04-19T02:18:33.423 INFO:tasks.workunit.client.0.smithi073.stdout:5/659: mkdir d0/d1d/d25/d35/d96/dd3 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:1/545: chown db/d41/f4c 1 1 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/610: dwrite d0/dc/d67/d2a/d51/d7a/fa5 [0,4194304] 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:5/660: truncate d0/ff 4042393 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/611: rename d0/dc/c70 to d0/dc/d33/d36/cb6 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:9/547: dwrite d0/df/d16/d19/d38/fab [0,4194304] 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:1/546: rename db/d1c/c32 to db/d1c/d2c/d50/d62/cc1 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/612: rmdir d0/dc/d33/da8 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:1/547: creat db/d1c/fc2 x:0 0 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:9/548: getdents d0/df/d16/d19/d38 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/613: stat d0/dc/d67/d15 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/614: mkdir d0/dc/db7 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:1/548: symlink db/d1c/d54/d8b/dab/lc3 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/615: write d0/dc/f5a [1403028,75826] 0 2024-04-19T02:18:33.424 INFO:tasks.workunit.client.0.smithi073.stdout:3/686: dwrite d3/f49 [0,4194304] 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/616: fsync d0/f7 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/617: fdatasync d0/d28/d63/f82 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/687: mknod d3/d6/db/d3a/d38/d89/ce2 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/618: chown d0/dc/l23 1934 1 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/619: write d0/d28/d63/f9e [5112570,91793] 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/688: mknod d3/d6/db/d16/d75/ce3 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/620: fsync d0/f8 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/621: write d0/dc/f8a [820926,48534] 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/689: write d3/d6/db/d3a/d38/d43/f6a [4260288,34298] 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/690: rmdir d3/d6/db/d3a/d38/d57/ddf 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:9/549: dwrite d0/f50 [0,4194304] 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/691: creat d3/d6/db/d3a/d38/d6f/daf/fe4 x:0 0 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/692: creat d3/d6/db/d3a/d38/d89/d94/d7b/fe5 x:0 0 0 2024-04-19T02:18:33.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/622: dwrite d0/dc/d33/d36/d7b/fa9 [0,4194304] 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:3/693: link d3/d6/db/d3a/d38/d89/ce2 d3/d6/db/d3a/d38/d43/d4e/ce6 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/519: dread d8/de/f96 [0,4194304] 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/520: write d8/de/f32 [339471,48365] 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/521: creat d8/de/d7f/da5/fad x:0 0 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:8/584: dread d14/d15/d17/d48/f59 [0,4194304] 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:8/585: creat d14/d27/d29/d64/fc5 x:0 0 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:8/586: dwrite d14/d27/d29/d31/d34/f88 [0,4194304] 0 2024-04-19T02:18:33.426 INFO:tasks.workunit.client.0.smithi073.stdout:4/590: dread f4 [0,4194304] 0 2024-04-19T02:18:33.427 INFO:tasks.workunit.client.0.smithi073.stdout:4/591: creat da/d27/d1b/d8c/db7/fd1 x:0 0 0 2024-04-19T02:18:33.427 INFO:tasks.workunit.client.0.smithi073.stdout:4/592: mknod da/d27/d1b/d1d/d72/d2b/d2f/d91/cd2 0 2024-04-19T02:18:33.428 INFO:tasks.workunit.client.0.smithi073.stdout:5/661: truncate d0/d1d/d25/d35/f9c 3079321 0 2024-04-19T02:18:33.428 INFO:tasks.workunit.client.0.smithi073.stdout:5/662: creat d0/d1d/d90/da0/dbb/fd4 x:0 0 0 2024-04-19T02:18:33.428 INFO:tasks.workunit.client.0.smithi073.stdout:4/593: write da/d27/d1b/d1d/d72/f62 [2314361,13738] 0 2024-04-19T02:18:33.429 INFO:tasks.workunit.client.0.smithi073.stdout:5/663: symlink d0/d1d/ld5 0 2024-04-19T02:18:33.429 INFO:tasks.workunit.client.0.smithi073.stdout:4/594: creat da/d27/fd3 x:0 0 0 2024-04-19T02:18:33.431 INFO:tasks.workunit.client.0.smithi073.stdout:6/522: write d8/d4b/d93/f3d [2137386,27455] 0 2024-04-19T02:18:33.431 INFO:tasks.workunit.client.0.smithi073.stdout:4/595: unlink da/d27/d1b/d1d/d72/d2b/f2d 0 2024-04-19T02:18:33.431 INFO:tasks.workunit.client.0.smithi073.stdout:6/523: rmdir d8/de/d78 39 2024-04-19T02:18:33.432 INFO:tasks.workunit.client.0.smithi073.stdout:6/524: readlink d8/d4b/d93/l61 0 2024-04-19T02:18:33.432 INFO:tasks.workunit.client.0.smithi073.stdout:6/525: fdatasync d8/de/f1e 0 2024-04-19T02:18:33.433 INFO:tasks.workunit.client.0.smithi073.stdout:6/526: rmdir d8 39 2024-04-19T02:18:33.433 INFO:tasks.workunit.client.0.smithi073.stdout:9/550: dwrite d0/df/f40 [0,4194304] 0 2024-04-19T02:18:33.434 INFO:tasks.workunit.client.0.smithi073.stdout:6/527: mkdir d8/de/d7f/da5/dae 0 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:9/551: rmdir d0/df/d16/d19/d38/d5d 39 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:6/528: rmdir d8/de/d22 39 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:9/552: chown d0/df/d16/d19/f73 13325965 1 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:6/529: mkdir d8/d71/d7d/dab/daf 0 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:6/530: creat d8/de/d58/d63/d82/fb0 x:0 0 0 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:6/531: fdatasync d8/de/f96 0 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:8/587: dread d14/d15/d17/f2c [0,4194304] 0 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:8/588: symlink d14/d27/d4c/lc6 0 2024-04-19T02:18:33.439 INFO:tasks.workunit.client.0.smithi073.stdout:6/532: write d8/de/f47 [5108640,87040] 0 2024-04-19T02:18:33.440 INFO:tasks.workunit.client.0.smithi073.stdout:8/589: fdatasync d14/d27/d29/d69/f91 0 2024-04-19T02:18:33.440 INFO:tasks.workunit.client.0.smithi073.stdout:6/533: getdents d8/d4b/d93 0 2024-04-19T02:18:33.440 INFO:tasks.workunit.client.0.smithi073.stdout:8/590: fdatasync d14/d27/da4/fb1 0 2024-04-19T02:18:33.440 INFO:tasks.workunit.client.0.smithi073.stdout:6/534: read d8/d4b/d8f/f95 [1305750,31980] 0 2024-04-19T02:18:33.441 INFO:tasks.workunit.client.0.smithi073.stdout:6/535: creat d8/d71/d7d/fb1 x:0 0 0 2024-04-19T02:18:33.445 INFO:tasks.workunit.client.0.smithi073.stdout:2/635: dread d5/d10/d14/db6/fbe [0,4194304] 0 2024-04-19T02:18:33.446 INFO:tasks.workunit.client.0.smithi073.stdout:2/636: write d5/d10/d29/fd8 [435451,56705] 0 2024-04-19T02:18:33.446 INFO:tasks.workunit.client.0.smithi073.stdout:2/637: read d5/d10/d14/d18/f1a [2087480,73401] 0 2024-04-19T02:18:33.448 INFO:tasks.workunit.client.0.smithi073.stdout:8/591: fsync d14/d27/d29/d31/d34/f88 0 2024-04-19T02:18:33.448 INFO:tasks.workunit.client.0.smithi073.stdout:2/638: getdents d5/d10/d14/d2e/da0/dc0 0 2024-04-19T02:18:33.449 INFO:tasks.workunit.client.0.smithi073.stdout:6/536: truncate d8/f10 3910816 0 2024-04-19T02:18:33.449 INFO:tasks.workunit.client.0.smithi073.stdout:1/549: dread db/f2a [0,4194304] 0 2024-04-19T02:18:33.450 INFO:tasks.workunit.client.0.smithi073.stdout:6/537: creat d8/de/d22/fb2 x:0 0 0 2024-04-19T02:18:33.450 INFO:tasks.workunit.client.0.smithi073.stdout:6/538: fsync d8/de/f67 0 2024-04-19T02:18:33.451 INFO:tasks.workunit.client.0.smithi073.stdout:1/550: mkdir db/d1c/d2c/d50/d62/dc0/db1/dc4 0 2024-04-19T02:18:33.451 INFO:tasks.workunit.client.0.smithi073.stdout:6/539: write d8/d4b/d93/f4a [4878974,27655] 0 2024-04-19T02:18:33.452 INFO:tasks.workunit.client.0.smithi073.stdout:1/551: rename db/d1c/d95 to db/d41/dc5 0 2024-04-19T02:18:33.452 INFO:tasks.workunit.client.0.smithi073.stdout:2/639: truncate d5/d10/f7d 3843862 0 2024-04-19T02:18:33.452 INFO:tasks.workunit.client.0.smithi073.stdout:1/552: chown db/d1c/d54/f90 3356952 1 2024-04-19T02:18:33.454 INFO:tasks.workunit.client.0.smithi073.stdout:1/553: creat db/d1c/d81/d83/fc6 x:0 0 0 2024-04-19T02:18:33.454 INFO:tasks.workunit.client.0.smithi073.stdout:1/554: dread - db/d1c/d2c/f89 zero size 2024-04-19T02:18:33.455 INFO:tasks.workunit.client.0.smithi073.stdout:1/555: creat db/d1c/d2c/d50/d62/dc0/db1/fc7 x:0 0 0 2024-04-19T02:18:33.456 INFO:tasks.workunit.client.0.smithi073.stdout:1/556: getdents db/d1c/d2c/d50/d62/dc0/db1/dc4 0 2024-04-19T02:18:33.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/640: read d5/d10/d29/d66/d67/d72/fb3 [3738847,51904] 0 2024-04-19T02:18:33.457 INFO:tasks.workunit.client.0.smithi073.stdout:8/592: dread d14/f62 [0,4194304] 0 2024-04-19T02:18:33.457 INFO:tasks.workunit.client.0.smithi073.stdout:6/540: dwrite d8/f2e [4194304,4194304] 0 2024-04-19T02:18:33.458 INFO:tasks.workunit.client.0.smithi073.stdout:6/541: dread - d8/de/d22/fb2 zero size 2024-04-19T02:18:33.459 INFO:tasks.workunit.client.0.smithi073.stdout:9/553: dread d0/f54 [0,4194304] 0 2024-04-19T02:18:33.460 INFO:tasks.workunit.client.0.smithi073.stdout:9/554: mkdir d0/df/d16/d19/d38/d5d/d76/dbc 0 2024-04-19T02:18:33.463 INFO:tasks.workunit.client.0.smithi073.stdout:8/593: dwrite d14/d27/d29/f52 [0,4194304] 0 2024-04-19T02:18:33.465 INFO:tasks.workunit.client.0.smithi073.stdout:9/555: dread d0/df/d16/d19/d38/fab [0,4194304] 0 2024-04-19T02:18:33.468 INFO:tasks.workunit.client.0.smithi073.stdout:1/557: dwrite f6 [0,4194304] 0 2024-04-19T02:18:33.468 INFO:tasks.workunit.client.0.smithi073.stdout:9/556: rename d0/df/d16/d19/d38/d5d/d76/d7d/d88/fb8 to d0/df/d16/d19/db1/fbd 0 2024-04-19T02:18:33.468 INFO:tasks.workunit.client.0.smithi073.stdout:8/594: dread d14/d15/d17/f2c [0,4194304] 0 2024-04-19T02:18:33.469 INFO:tasks.workunit.client.0.smithi073.stdout:9/557: rmdir d0/df/d16/d19/d38 39 2024-04-19T02:18:33.469 INFO:tasks.workunit.client.0.smithi073.stdout:1/558: rename db/d1c/d2c/d50/f6b to db/d1c/d2c/d50/d62/dc0/db1/dc4/fc8 0 2024-04-19T02:18:33.470 INFO:tasks.workunit.client.0.smithi073.stdout:2/641: dread d5/d10/d29/d66/d67/f86 [0,4194304] 0 2024-04-19T02:18:33.471 INFO:tasks.workunit.client.0.smithi073.stdout:9/558: link d0/d81/d5c/c79 d0/df/d16/d19/db1/d2c/d6b/cbe 0 2024-04-19T02:18:33.471 INFO:tasks.workunit.client.0.smithi073.stdout:2/642: chown d5/d10/d14/d7a/dd1 8315100 1 2024-04-19T02:18:33.472 INFO:tasks.workunit.client.0.smithi073.stdout:2/643: write d5/d10/d14/d18/f1a [1860251,104472] 0 2024-04-19T02:18:33.472 INFO:tasks.workunit.client.0.smithi073.stdout:9/559: link d0/df/d16/d19/db1/f63 d0/df/fbf 0 2024-04-19T02:18:33.473 INFO:tasks.workunit.client.0.smithi073.stdout:2/644: read d5/d10/d14/d18/d3e/d51/f59 [1484920,10869] 0 2024-04-19T02:18:33.473 INFO:tasks.workunit.client.0.smithi073.stdout:9/560: mknod d0/df/d16/d19/d38/d5d/d76/cc0 0 2024-04-19T02:18:33.474 INFO:tasks.workunit.client.0.smithi073.stdout:9/561: symlink d0/dad/lc1 0 2024-04-19T02:18:33.477 INFO:tasks.workunit.client.0.smithi073.stdout:4/596: dread da/d27/d2c/d60/fa1 [0,4194304] 0 2024-04-19T02:18:33.478 INFO:tasks.workunit.client.0.smithi073.stdout:1/559: truncate db/d1c/f5d 5177768 0 2024-04-19T02:18:33.478 INFO:tasks.workunit.client.0.smithi073.stdout:4/597: symlink da/d27/d3a/ld4 0 2024-04-19T02:18:33.478 INFO:tasks.workunit.client.0.smithi073.stdout:1/560: dread - db/d1c/fc2 zero size 2024-04-19T02:18:33.479 INFO:tasks.workunit.client.0.smithi073.stdout:1/561: readlink db/l40 0 2024-04-19T02:18:33.479 INFO:tasks.workunit.client.0.smithi073.stdout:4/598: fdatasync da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/fce 0 2024-04-19T02:18:33.480 INFO:tasks.workunit.client.0.smithi073.stdout:9/562: dwrite d0/df/d16/d19/d38/d5d/d45/f48 [4194304,4194304] 0 2024-04-19T02:18:33.480 INFO:tasks.workunit.client.0.smithi073.stdout:4/599: readlink da/d27/d3a/lb2 0 2024-04-19T02:18:33.480 INFO:tasks.workunit.client.0.smithi073.stdout:0/576: sync 2024-04-19T02:18:33.481 INFO:tasks.workunit.client.0.smithi073.stdout:9/563: fdatasync d0/f8b 0 2024-04-19T02:18:33.482 INFO:tasks.workunit.client.0.smithi073.stdout:9/564: mkdir d0/df/d60/db0/dc2 0 2024-04-19T02:18:33.483 INFO:tasks.workunit.client.0.smithi073.stdout:9/565: rename d0/f6 to d0/df/d16/d19/db1/d2c/d2e/fc3 0 2024-04-19T02:18:33.484 INFO:tasks.workunit.client.0.smithi073.stdout:1/562: write db/f21 [404984,46932] 0 2024-04-19T02:18:33.484 INFO:tasks.workunit.client.0.smithi073.stdout:0/577: truncate d7/d6d/f9b 1343593 0 2024-04-19T02:18:33.486 INFO:tasks.workunit.client.0.smithi073.stdout:4/600: dwrite da/d27/d1b/d8c/db7/fd1 [0,4194304] 0 2024-04-19T02:18:33.489 INFO:tasks.workunit.client.0.smithi073.stdout:9/566: dwrite d0/df/d16/d19/d38/d5d/f4e [0,4194304] 0 2024-04-19T02:18:33.492 INFO:tasks.workunit.client.0.smithi073.stdout:9/567: mknod d0/df/d16/d19/db1/cc4 0 2024-04-19T02:18:33.492 INFO:tasks.workunit.client.0.smithi073.stdout:0/578: dwrite d7/d14/f68 [0,4194304] 0 2024-04-19T02:18:33.493 INFO:tasks.workunit.client.0.smithi073.stdout:1/563: dwrite db/d1c/d2c/f89 [0,4194304] 0 2024-04-19T02:18:33.495 INFO:tasks.workunit.client.0.smithi073.stdout:1/564: symlink db/d41/lc9 0 2024-04-19T02:18:33.496 INFO:tasks.workunit.client.0.smithi073.stdout:4/601: dwrite da/d27/d1b/fbd [0,4194304] 0 2024-04-19T02:18:33.496 INFO:tasks.workunit.client.0.smithi073.stdout:0/579: creat d7/d14/d17/d1a/fb1 x:0 0 0 2024-04-19T02:18:33.497 INFO:tasks.workunit.client.0.smithi073.stdout:4/602: truncate da/d27/d1b/d26/f4c 1632080 0 2024-04-19T02:18:33.498 INFO:tasks.workunit.client.0.smithi073.stdout:0/580: creat d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/fb2 x:0 0 0 2024-04-19T02:18:33.499 INFO:tasks.workunit.client.0.smithi073.stdout:4/603: chown da/d27/d1b/d26/d2a/fa9 32725181 1 2024-04-19T02:18:33.499 INFO:tasks.workunit.client.0.smithi073.stdout:4/604: write da/d27/d2c/f3c [2731524,83137] 0 2024-04-19T02:18:33.501 INFO:tasks.workunit.client.0.smithi073.stdout:8/595: dread f11 [0,4194304] 0 2024-04-19T02:18:33.501 INFO:tasks.workunit.client.0.smithi073.stdout:4/605: mkdir da/d27/d1b/d1d/d72/dd5 0 2024-04-19T02:18:33.501 INFO:tasks.workunit.client.0.smithi073.stdout:8/596: creat d14/d27/d4c/d75/dbb/fc7 x:0 0 0 2024-04-19T02:18:33.502 INFO:tasks.workunit.client.0.smithi073.stdout:9/568: dwrite d0/df/f11 [8388608,4194304] 0 2024-04-19T02:18:33.502 INFO:tasks.workunit.client.0.smithi073.stdout:8/597: write d14/d27/d29/f51 [715740,118338] 0 2024-04-19T02:18:33.503 INFO:tasks.workunit.client.0.smithi073.stdout:9/569: symlink d0/df/d16/d19/d38/d5d/d76/d7d/lc5 0 2024-04-19T02:18:33.506 INFO:tasks.workunit.client.0.smithi073.stdout:8/598: dread d14/d15/f7e [0,4194304] 0 2024-04-19T02:18:33.508 INFO:tasks.workunit.client.0.smithi073.stdout:8/599: creat d14/d15/d17/d8d/fc8 x:0 0 0 2024-04-19T02:18:33.508 INFO:tasks.workunit.client.0.smithi073.stdout:4/606: dwrite da/d27/d3a/d49/fc4 [4194304,4194304] 0 2024-04-19T02:18:33.508 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:33.504+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:33.508 INFO:tasks.workunit.client.0.smithi073.stdout:0/581: rmdir d7/d14/d17/d1a 39 2024-04-19T02:18:33.509 INFO:tasks.workunit.client.0.smithi073.stdout:8/600: creat d14/d15/d17/d48/d89/d97/fc9 x:0 0 0 2024-04-19T02:18:33.510 INFO:tasks.workunit.client.0.smithi073.stdout:4/607: rename da/d27/d36/lae to da/d27/d2c/da6/ld6 0 2024-04-19T02:18:33.510 INFO:tasks.workunit.client.0.smithi073.stdout:0/582: creat d7/d14/d17/d1a/d8d/fb3 x:0 0 0 2024-04-19T02:18:33.511 INFO:tasks.workunit.client.0.smithi073.stdout:0/583: write d7/d14/d17/d1a/d21/f64 [1154240,127802] 0 2024-04-19T02:18:33.512 INFO:tasks.workunit.client.0.smithi073.stdout:0/584: symlink d7/d14/lb4 0 2024-04-19T02:18:33.513 INFO:tasks.workunit.client.0.smithi073.stdout:8/601: dread d14/d27/d29/d31/d34/f88 [0,4194304] 0 2024-04-19T02:18:33.513 INFO:tasks.workunit.client.0.smithi073.stdout:0/585: creat d7/d14/d17/d69/d7c/fb5 x:0 0 0 2024-04-19T02:18:33.514 INFO:tasks.workunit.client.0.smithi073.stdout:8/602: write d14/d27/d29/d69/f91 [2677638,122628] 0 2024-04-19T02:18:33.514 INFO:tasks.workunit.client.0.smithi073.stdout:0/586: mknod d7/d14/d17/d1a/d20/d50/d99/cb6 0 2024-04-19T02:18:33.514 INFO:tasks.workunit.client.0.smithi073.stdout:8/603: readlink d14/d27/d4c/lc6 0 2024-04-19T02:18:33.515 INFO:tasks.workunit.client.0.smithi073.stdout:4/608: dwrite da/f44 [0,4194304] 0 2024-04-19T02:18:33.516 INFO:tasks.workunit.client.0.smithi073.stdout:0/587: rmdir d7/d14/d17/d1a/d20/d50/d99/da7 39 2024-04-19T02:18:33.516 INFO:tasks.workunit.client.0.smithi073.stdout:8/604: creat d14/d15/d17/d48/d89/d97/fca x:0 0 0 2024-04-19T02:18:33.517 INFO:tasks.workunit.client.0.smithi073.stdout:8/605: creat d14/d27/d29/d31/d34/fcb x:0 0 0 2024-04-19T02:18:33.517 INFO:tasks.workunit.client.0.smithi073.stdout:4/609: rename da/d27/d3a/d49/f9a to da/d27/fd7 0 2024-04-19T02:18:33.517 INFO:tasks.workunit.client.0.smithi073.stdout:8/606: mkdir d14/d27/dcc 0 2024-04-19T02:18:33.518 INFO:tasks.workunit.client.0.smithi073.stdout:0/588: link d7/d14/d17/d1a/d21/l37 d7/d14/d17/d1a/lb7 0 2024-04-19T02:18:33.518 INFO:tasks.workunit.client.0.smithi073.stdout:8/607: rmdir d14/d15/d17/d48 39 2024-04-19T02:18:33.519 INFO:tasks.workunit.client.0.smithi073.stdout:3/694: sync 2024-04-19T02:18:33.519 INFO:tasks.workunit.client.0.smithi073.stdout:7/623: sync 2024-04-19T02:18:33.519 INFO:tasks.workunit.client.0.smithi073.stdout:4/610: mkdir da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/dd8 0 2024-04-19T02:18:33.519 INFO:tasks.workunit.client.0.smithi073.stdout:8/608: creat d14/d15/d17/d99/fcd x:0 0 0 2024-04-19T02:18:33.519 INFO:tasks.workunit.client.0.smithi073.stdout:7/624: symlink d0/dc/d33/d36/d7b/d93/lb8 0 2024-04-19T02:18:33.519 INFO:tasks.workunit.client.0.smithi073.stdout:4/611: creat da/d27/d1b/d1d/d72/fd9 x:0 0 0 2024-04-19T02:18:33.520 INFO:tasks.workunit.client.0.smithi073.stdout:0/589: rename d7/d14/d17/d1a/d21/fa5 to d7/d14/d17/d1a/d20/d50/d99/fb8 0 2024-04-19T02:18:33.520 INFO:tasks.workunit.client.0.smithi073.stdout:4/612: symlink da/d27/d2c/dc1/lda 0 2024-04-19T02:18:33.521 INFO:tasks.workunit.client.0.smithi073.stdout:4/613: fdatasync da/d27/d2c/d60/f71 0 2024-04-19T02:18:33.525 INFO:tasks.workunit.client.0.smithi073.stdout:8/609: dwrite d14/d15/f26 [0,4194304] 0 2024-04-19T02:18:33.526 INFO:tasks.workunit.client.0.smithi073.stdout:0/590: dwrite d7/d14/d17/d1a/d21/f36 [4194304,4194304] 0 2024-04-19T02:18:33.526 INFO:tasks.workunit.client.0.smithi073.stdout:8/610: rmdir d14/d15/d17/d48 39 2024-04-19T02:18:33.527 INFO:tasks.workunit.client.0.smithi073.stdout:0/591: creat d7/d14/d17/d70/fb9 x:0 0 0 2024-04-19T02:18:33.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/611: chown d14/d27/d29/d31/d34/c71 466 1 2024-04-19T02:18:33.528 INFO:tasks.workunit.client.0.smithi073.stdout:0/592: write d7/d14/d17/d1a/d21/f53 [1074273,105209] 0 2024-04-19T02:18:33.528 INFO:tasks.workunit.client.0.smithi073.stdout:8/612: symlink d14/d27/d29/d31/lce 0 2024-04-19T02:18:33.528 INFO:tasks.workunit.client.0.smithi073.stdout:8/613: fsync d14/d27/d29/d64/fc5 0 2024-04-19T02:18:33.529 INFO:tasks.workunit.client.0.smithi073.stdout:0/593: mkdir d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba 0 2024-04-19T02:18:33.530 INFO:tasks.workunit.client.0.smithi073.stdout:0/594: mknod d7/cbb 0 2024-04-19T02:18:33.531 INFO:tasks.workunit.client.0.smithi073.stdout:0/595: mknod d7/d6d/cbc 0 2024-04-19T02:18:33.531 INFO:tasks.workunit.client.0.smithi073.stdout:0/596: mkdir d7/d6d/dbd 0 2024-04-19T02:18:33.532 INFO:tasks.workunit.client.0.smithi073.stdout:0/597: readlink d7/d14/d17/d1a/l34 0 2024-04-19T02:18:33.533 INFO:tasks.workunit.client.0.smithi073.stdout:0/598: chown d7/d14/d17/d1a/d21/f64 15327 1 2024-04-19T02:18:33.533 INFO:tasks.workunit.client.0.smithi073.stdout:0/599: fdatasync d7/d14/f47 0 2024-04-19T02:18:33.534 INFO:tasks.workunit.client.0.smithi073.stdout:8/614: dwrite d14/d15/d17/d48/f59 [0,4194304] 0 2024-04-19T02:18:33.537 INFO:tasks.workunit.client.0.smithi073.stdout:1/565: dread db/ff [0,4194304] 0 2024-04-19T02:18:33.538 INFO:tasks.workunit.client.0.smithi073.stdout:1/566: rename db/l1e to db/d1c/d2c/d50/d62/dc0/db1/lca 0 2024-04-19T02:18:33.539 INFO:tasks.workunit.client.0.smithi073.stdout:1/567: rename db/d1c/d81/d83/l9c to db/d1c/d78/lcb 0 2024-04-19T02:18:33.540 INFO:tasks.workunit.client.0.smithi073.stdout:1/568: mknod db/d1c/d2c/ccc 0 2024-04-19T02:18:33.540 INFO:tasks.workunit.client.0.smithi073.stdout:1/569: read - db/d1c/d81/d83/fc6 zero size 2024-04-19T02:18:33.549 INFO:tasks.workunit.client.0.smithi073.stdout:7/625: dread d0/dc/d33/f91 [0,4194304] 0 2024-04-19T02:18:33.549 INFO:tasks.workunit.client.0.smithi073.stdout:7/626: rename d0/dc/d67/l75 to d0/dc/lb9 0 2024-04-19T02:18:33.555 INFO:tasks.workunit.client.0.smithi073.stdout:2/645: dread d5/d10/d14/d18/d3e/d2d/fc1 [0,4194304] 0 2024-04-19T02:18:33.556 INFO:tasks.workunit.client.0.smithi073.stdout:2/646: symlink d5/d10/d14/d18/d98/le0 0 2024-04-19T02:18:33.556 INFO:tasks.workunit.client.0.smithi073.stdout:4/614: dread da/d27/d3a/d50/f77 [0,4194304] 0 2024-04-19T02:18:33.557 INFO:tasks.workunit.client.0.smithi073.stdout:2/647: mkdir d5/d10/d14/d18/d3e/de1 0 2024-04-19T02:18:33.557 INFO:tasks.workunit.client.0.smithi073.stdout:4/615: write da/d27/d1b/d1d/d72/f62 [3476803,63633] 0 2024-04-19T02:18:33.558 INFO:tasks.workunit.client.0.smithi073.stdout:2/648: creat d5/d10/d14/d7a/dd1/fe2 x:0 0 0 2024-04-19T02:18:33.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/616: fdatasync da/d27/d3a/d97/fbb 0 2024-04-19T02:18:33.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/617: rmdir da/d27/d1b/d26/d2a/da2 0 2024-04-19T02:18:33.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/618: mkdir da/d27/d2c/ddb 0 2024-04-19T02:18:33.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/649: dread d5/d10/d14/d18/d3e/d2d/f3a [0,4194304] 0 2024-04-19T02:18:33.561 INFO:tasks.workunit.client.0.smithi073.stdout:4/619: fsync da/d27/d36/f51 0 2024-04-19T02:18:33.561 INFO:tasks.workunit.client.0.smithi073.stdout:3/695: dwrite d3/d6/db/d3a/f70 [0,4194304] 0 2024-04-19T02:18:33.562 INFO:tasks.workunit.client.0.smithi073.stdout:3/696: fsync d3/f49 0 2024-04-19T02:18:33.562 INFO:tasks.workunit.client.0.smithi073.stdout:4/620: truncate da/d27/d1b/d1d/d8d/f98 1339430 0 2024-04-19T02:18:33.562 INFO:tasks.workunit.client.0.smithi073.stdout:2/650: rename d5/d10/d14/f21 to d5/d10/d14/db6/fe3 0 2024-04-19T02:18:33.563 INFO:tasks.workunit.client.0.smithi073.stdout:3/697: creat d3/d6/da6/fe7 x:0 0 0 2024-04-19T02:18:33.566 INFO:tasks.workunit.client.0.smithi073.stdout:3/698: dread - d3/d6/db/d3a/d38/d89/d94/fc5 zero size 2024-04-19T02:18:33.567 INFO:tasks.workunit.client.0.smithi073.stdout:6/542: sync 2024-04-19T02:18:33.567 INFO:tasks.workunit.client.0.smithi073.stdout:5/664: sync 2024-04-19T02:18:33.567 INFO:tasks.workunit.client.0.smithi073.stdout:8/615: sync 2024-04-19T02:18:33.568 INFO:tasks.workunit.client.0.smithi073.stdout:5/665: dread - d0/d1d/d24/d61/fa3 zero size 2024-04-19T02:18:33.569 INFO:tasks.workunit.client.0.smithi073.stdout:8/616: dread - d14/d15/d17/d8d/f94 zero size 2024-04-19T02:18:33.569 INFO:tasks.workunit.client.0.smithi073.stdout:6/543: truncate f3 1542844 0 2024-04-19T02:18:33.569 INFO:tasks.workunit.client.0.smithi073.stdout:2/651: dwrite d5/f7 [0,4194304] 0 2024-04-19T02:18:33.569 INFO:tasks.workunit.client.0.smithi073.stdout:4/621: dwrite da/d27/d2c/f3c [4194304,4194304] 0 2024-04-19T02:18:33.570 INFO:tasks.workunit.client.0.smithi073.stdout:6/544: fsync d8/fb 0 2024-04-19T02:18:33.571 INFO:tasks.workunit.client.0.smithi073.stdout:2/652: write d5/d10/d29/d66/d83/fcd [912869,27612] 0 2024-04-19T02:18:33.571 INFO:tasks.workunit.client.0.smithi073.stdout:5/666: unlink d0/d1d/d25/d35/d39/fb6 0 2024-04-19T02:18:33.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/622: creat da/d27/d1b/d1d/d72/d3d/fdc x:0 0 0 2024-04-19T02:18:33.573 INFO:tasks.workunit.client.0.smithi073.stdout:9/570: dread d0/df/fbf [0,4194304] 0 2024-04-19T02:18:33.574 INFO:tasks.workunit.client.0.smithi073.stdout:6/545: getdents d8/de/d22 0 2024-04-19T02:18:33.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/600: write d7/d14/d17/d69/f6a [4439704,13724] 0 2024-04-19T02:18:33.574 INFO:tasks.workunit.client.0.smithi073.stdout:1/570: write db/d1c/d2c/d50/f94 [4225220,115209] 0 2024-04-19T02:18:33.575 INFO:tasks.workunit.client.0.smithi073.stdout:2/653: creat d5/d10/d29/d66/d67/d72/fe4 x:0 0 0 2024-04-19T02:18:33.576 INFO:tasks.workunit.client.0.smithi073.stdout:9/571: creat d0/d35/fc6 x:0 0 0 2024-04-19T02:18:33.576 INFO:tasks.workunit.client.0.smithi073.stdout:6/546: chown d8/d4b/d93/d86 66926447 1 2024-04-19T02:18:33.576 INFO:tasks.workunit.client.0.smithi073.stdout:0/601: chown d7/cbb 2750528 1 2024-04-19T02:18:33.576 INFO:tasks.workunit.client.0.smithi073.stdout:1/571: stat db/d1c/d2c/d50/d62/dc0/fb5 0 2024-04-19T02:18:33.577 INFO:tasks.workunit.client.0.smithi073.stdout:2/654: mknod d5/d10/ddf/ce5 0 2024-04-19T02:18:33.577 INFO:tasks.workunit.client.0.smithi073.stdout:7/627: dwrite d0/d3/f66 [0,4194304] 0 2024-04-19T02:18:33.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/572: stat db/d1c/d81/fb4 0 2024-04-19T02:18:33.578 INFO:tasks.workunit.client.0.smithi073.stdout:7/628: mkdir d0/d28/dba 0 2024-04-19T02:18:33.578 INFO:tasks.workunit.client.0.smithi073.stdout:2/655: readlink d5/d10/d29/d66/d83/lc2 0 2024-04-19T02:18:33.578 INFO:tasks.workunit.client.0.smithi073.stdout:0/602: mkdir d7/d14/d17/d69/d7c/dbe 0 2024-04-19T02:18:33.579 INFO:tasks.workunit.client.0.smithi073.stdout:5/667: dwrite d0/d1d/d64/f8b [0,4194304] 0 2024-04-19T02:18:33.580 INFO:tasks.workunit.client.0.smithi073.stdout:9/572: truncate d0/df/d16/d19/db1/d2c/f56 90627 0 2024-04-19T02:18:33.580 INFO:tasks.workunit.client.0.smithi073.stdout:0/603: mkdir d7/d14/d17/d69/dbf 0 2024-04-19T02:18:33.580 INFO:tasks.workunit.client.0.smithi073.stdout:9/573: stat d0/df/d60/c6f 0 2024-04-19T02:18:33.580 INFO:tasks.workunit.client.0.smithi073.stdout:5/668: truncate d0/d1d/d24/d62/f7e 184746 0 2024-04-19T02:18:33.581 INFO:tasks.workunit.client.0.smithi073.stdout:9/574: rmdir d0/df/d16/d19/db1 39 2024-04-19T02:18:33.581 INFO:tasks.workunit.client.0.smithi073.stdout:5/669: rmdir d0/d69 39 2024-04-19T02:18:33.582 INFO:tasks.workunit.client.0.smithi073.stdout:9/575: stat d0/df/d16/d19/db1/d2c/d2e/f53 0 2024-04-19T02:18:33.582 INFO:tasks.workunit.client.0.smithi073.stdout:5/670: rmdir d0/d1d/d90/da0 39 2024-04-19T02:18:33.583 INFO:tasks.workunit.client.0.smithi073.stdout:5/671: chown d0/d1d/d24/d62/f7e 245552 1 2024-04-19T02:18:33.583 INFO:tasks.workunit.client.0.smithi073.stdout:9/576: mknod d0/df/d16/d19/d38/d5d/d76/d7d/cc7 0 2024-04-19T02:18:33.584 INFO:tasks.workunit.client.0.smithi073.stdout:9/577: symlink d0/df/d16/d19/d38/d5d/d5e/d83/lc8 0 2024-04-19T02:18:33.585 INFO:tasks.workunit.client.0.smithi073.stdout:9/578: write d0/fa3 [815486,109436] 0 2024-04-19T02:18:33.586 INFO:tasks.workunit.client.0.smithi073.stdout:0/604: dread d7/d14/d17/d1a/d21/f8a [0,4194304] 0 2024-04-19T02:18:33.591 INFO:tasks.workunit.client.0.smithi073.stdout:0/605: dwrite d7/d14/d17/d1a/d21/f53 [0,4194304] 0 2024-04-19T02:18:33.591 INFO:tasks.workunit.client.0.smithi073.stdout:8/617: dread d14/d27/d29/f51 [0,4194304] 0 2024-04-19T02:18:33.597 INFO:tasks.workunit.client.0.smithi073.stdout:8/618: dwrite d14/d27/d85/d9b/fa9 [0,4194304] 0 2024-04-19T02:18:33.599 INFO:tasks.workunit.client.0.smithi073.stdout:8/619: write d14/d27/d29/d31/f74 [4797044,109377] 0 2024-04-19T02:18:33.599 INFO:tasks.workunit.client.0.smithi073.stdout:8/620: write d14/d15/d17/f21 [462557,21679] 0 2024-04-19T02:18:33.600 INFO:tasks.workunit.client.0.smithi073.stdout:8/621: mknod d14/d27/d29/d64/ccf 0 2024-04-19T02:18:33.601 INFO:tasks.workunit.client.0.smithi073.stdout:8/622: symlink d14/d27/d85/d9b/ld0 0 2024-04-19T02:18:33.602 INFO:tasks.workunit.client.0.smithi073.stdout:8/623: symlink d14/d27/d29/d31/d34/ld1 0 2024-04-19T02:18:33.604 INFO:tasks.workunit.client.0.smithi073.stdout:3/699: dread d3/f5 [0,4194304] 0 2024-04-19T02:18:33.605 INFO:tasks.workunit.client.0.smithi073.stdout:3/700: creat d3/d6/db/d1a/d54/fe8 x:0 0 0 2024-04-19T02:18:33.606 INFO:tasks.workunit.client.0.smithi073.stdout:3/701: fsync d3/d6/db/d1a/f9a 0 2024-04-19T02:18:33.606 INFO:tasks.workunit.client.0.smithi073.stdout:3/702: dread - d3/d6/db/d3a/d38/d89/d94/d7b/f8b zero size 2024-04-19T02:18:33.609 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:33.607+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:33.610 INFO:tasks.workunit.client.0.smithi073.stdout:4/623: rename da/d27/d1b/d1d/d72/d3d to da/d27/d2c/d80/dcf/ddd 0 2024-04-19T02:18:33.611 INFO:tasks.workunit.client.0.smithi073.stdout:7/629: rename d0/dc/d33/d36/d7b/d80 to d0/d3/dbb 0 2024-04-19T02:18:33.611 INFO:tasks.workunit.client.0.smithi073.stdout:4/624: chown da/d27/d2c/d80/dcf 418 1 2024-04-19T02:18:33.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/672: rename d0/d1d/d24/d62 to d0/d1d/d25/d37/d71/dd6 0 2024-04-19T02:18:33.611 INFO:tasks.workunit.client.0.smithi073.stdout:7/630: mkdir d0/dc/d39/d50/dbc 0 2024-04-19T02:18:33.613 INFO:tasks.workunit.client.0.smithi073.stdout:5/673: symlink d0/d1d/d25/ld7 0 2024-04-19T02:18:33.613 INFO:tasks.workunit.client.0.smithi073.stdout:3/703: dwrite d3/d6/f1d [0,4194304] 0 2024-04-19T02:18:33.614 INFO:tasks.workunit.client.0.smithi073.stdout:5/674: chown d0/d1d/d25/d37/l50 47894787 1 2024-04-19T02:18:33.615 INFO:tasks.workunit.client.0.smithi073.stdout:5/675: readlink d0/l17 0 2024-04-19T02:18:33.615 INFO:tasks.workunit.client.0.smithi073.stdout:3/704: write d3/d6/db/d16/d9e/fa8 [65090,69392] 0 2024-04-19T02:18:33.615 INFO:tasks.workunit.client.0.smithi073.stdout:5/676: readlink d0/d1d/d25/d37/d71/l9b 0 2024-04-19T02:18:33.615 INFO:tasks.workunit.client.0.smithi073.stdout:3/705: chown d3/d6/f1e 117046 1 2024-04-19T02:18:33.616 INFO:tasks.workunit.client.0.smithi073.stdout:4/625: dread da/d27/d2c/f3c [4194304,4194304] 0 2024-04-19T02:18:33.616 INFO:tasks.workunit.client.0.smithi073.stdout:4/626: write da/d27/d36/f5e [1956468,88220] 0 2024-04-19T02:18:33.618 INFO:tasks.workunit.client.0.smithi073.stdout:4/627: getdents da/d27/d36/d4d/d7b 0 2024-04-19T02:18:33.618 INFO:tasks.workunit.client.0.smithi073.stdout:6/547: dread d8/f11 [0,4194304] 0 2024-04-19T02:18:33.619 INFO:tasks.workunit.client.0.smithi073.stdout:4/628: fdatasync da/d27/d2c/f3c 0 2024-04-19T02:18:33.619 INFO:tasks.workunit.client.0.smithi073.stdout:4/629: mkdir da/d27/d36/d4d/dde 0 2024-04-19T02:18:33.620 INFO:tasks.workunit.client.0.smithi073.stdout:6/548: symlink d8/de/d7f/da5/dae/lb3 0 2024-04-19T02:18:33.620 INFO:tasks.workunit.client.0.smithi073.stdout:6/549: unlink d8/l38 0 2024-04-19T02:18:33.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/630: stat da/d27/d3a/d49/c67 0 2024-04-19T02:18:33.621 INFO:tasks.workunit.client.0.smithi073.stdout:2/656: dread d5/d10/f7d [0,4194304] 0 2024-04-19T02:18:33.621 INFO:tasks.workunit.client.0.smithi073.stdout:6/550: rename d8/de/d58/c40 to d8/de/d58/cb4 0 2024-04-19T02:18:33.622 INFO:tasks.workunit.client.0.smithi073.stdout:6/551: dread - d8/de/d7f/fa0 zero size 2024-04-19T02:18:33.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/657: creat d5/d10/d14/db6/fe6 x:0 0 0 2024-04-19T02:18:33.622 INFO:tasks.workunit.client.0.smithi073.stdout:3/706: dread d3/d6/db/d16/d52/f99 [0,4194304] 0 2024-04-19T02:18:33.623 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:33.623 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:33.623 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:33.623 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:33.623 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:33.624 INFO:tasks.workunit.client.0.smithi073.stdout:9/579: write d0/df/d16/d19/db1/d2c/f56 [164801,96335] 0 2024-04-19T02:18:33.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/658: truncate d5/d10/d29/d66/f69 805663 0 2024-04-19T02:18:33.624 INFO:tasks.workunit.client.0.smithi073.stdout:7/631: dread d0/dc/d33/d36/f3b [0,4194304] 0 2024-04-19T02:18:33.625 INFO:tasks.workunit.client.0.smithi073.stdout:3/707: truncate d3/d6/db/d3a/d38/d89/d94/fc5 355995 0 2024-04-19T02:18:33.625 INFO:tasks.workunit.client.0.smithi073.stdout:2/659: dread - d5/d10/d14/d18/d3e/d51/fbf zero size 2024-04-19T02:18:33.626 INFO:tasks.workunit.client.0.smithi073.stdout:7/632: fdatasync d0/dc/d67/d2a/d51/d7a/fa5 0 2024-04-19T02:18:33.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/580: creat d0/df/d16/d19/d38/fc9 x:0 0 0 2024-04-19T02:18:33.626 INFO:tasks.workunit.client.0.smithi073.stdout:3/708: creat d3/d6/da6/fe9 x:0 0 0 2024-04-19T02:18:33.627 INFO:tasks.workunit.client.0.smithi073.stdout:7/633: chown d0/dc/d67/d2a/d51 79883 1 2024-04-19T02:18:33.627 INFO:tasks.workunit.client.0.smithi073.stdout:7/634: fsync d0/d28/f4b 0 2024-04-19T02:18:33.628 INFO:tasks.workunit.client.0.smithi073.stdout:7/635: read - d0/d3/f7e zero size 2024-04-19T02:18:33.628 INFO:tasks.workunit.client.0.smithi073.stdout:3/709: rename d3/d6/db/c72 to d3/d6/db/d3a/d38/d43/d4e/cea 0 2024-04-19T02:18:33.628 INFO:tasks.workunit.client.0.smithi073.stdout:6/552: dwrite d8/fb [4194304,4194304] 0 2024-04-19T02:18:33.629 INFO:tasks.workunit.client.0.smithi073.stdout:7/636: fdatasync d0/f6a 0 2024-04-19T02:18:33.629 INFO:tasks.workunit.client.0.smithi073.stdout:7/637: readlink d0/d3/l24 0 2024-04-19T02:18:33.631 INFO:tasks.workunit.client.0.smithi073.stdout:1/573: sync 2024-04-19T02:18:33.633 INFO:tasks.workunit.client.0.smithi073.stdout:1/574: rename db/d7f/f9b to db/d1c/d81/d86/dae/fcd 0 2024-04-19T02:18:33.634 INFO:tasks.workunit.client.0.smithi073.stdout:1/575: creat db/d1c/d2c/d50/d62/dc0/db1/fce x:0 0 0 2024-04-19T02:18:33.638 INFO:tasks.workunit.client.0.smithi073.stdout:7/638: read d0/dc/d39/f4f [3574526,106377] 0 2024-04-19T02:18:33.642 INFO:tasks.workunit.client.0.smithi073.stdout:3/710: truncate d3/d6/db/d3a/d38/d43/f6a 212076 0 2024-04-19T02:18:33.642 INFO:tasks.workunit.client.0.smithi073.stdout:7/639: creat d0/d28/fbd x:0 0 0 2024-04-19T02:18:33.642 INFO:tasks.workunit.client.0.smithi073.stdout:3/711: creat d3/d6/db/d3a/d38/d43/d4e/feb x:0 0 0 2024-04-19T02:18:33.642 INFO:tasks.workunit.client.0.smithi073.stdout:7/640: link d0/c64 d0/d28/d63/cbe 0 2024-04-19T02:18:33.642 INFO:tasks.workunit.client.0.smithi073.stdout:3/712: dread - d3/d6/db/d3a/d38/d43/d4e/feb zero size 2024-04-19T02:18:33.642 INFO:tasks.workunit.client.0.smithi073.stdout:1/576: dwrite db/d1c/d2c/f45 [0,4194304] 0 2024-04-19T02:18:33.643 INFO:tasks.workunit.client.0.smithi073.stdout:7/641: rename d0/dc/d33/l90 to d0/dc/d33/d36/d7b/d93/lbf 0 2024-04-19T02:18:33.643 INFO:tasks.workunit.client.0.smithi073.stdout:1/577: write db/ff [5194326,100108] 0 2024-04-19T02:18:33.644 INFO:tasks.workunit.client.0.smithi073.stdout:3/713: mknod d3/d6/db/d16/d52/cec 0 2024-04-19T02:18:33.644 INFO:tasks.workunit.client.0.smithi073.stdout:7/642: dread - d0/d3/f7e zero size 2024-04-19T02:18:33.644 INFO:tasks.workunit.client.0.smithi073.stdout:1/578: rmdir db/d1c/d2c/d50/d62 39 2024-04-19T02:18:33.644 INFO:tasks.workunit.client.0.smithi073.stdout:3/714: chown d3/d6/db/d23/lcc 573 1 2024-04-19T02:18:33.644 INFO:tasks.workunit.client.0.smithi073.stdout:1/579: mkdir db/d1c/d78/dcf 0 2024-04-19T02:18:33.644 INFO:tasks.workunit.client.0.smithi073.stdout:7/643: truncate d0/dc/d67/d2a/d51/f54 9365163 0 2024-04-19T02:18:33.645 INFO:tasks.workunit.client.0.smithi073.stdout:6/553: dwrite f3 [0,4194304] 0 2024-04-19T02:18:33.645 INFO:tasks.workunit.client.0.smithi073.stdout:3/715: symlink d3/d6/db/d3a/d38/d6f/dac/dc9/led 0 2024-04-19T02:18:33.646 INFO:tasks.workunit.client.0.smithi073.stdout:7/644: creat d0/dc/d33/d36/d7b/d93/fc0 x:0 0 0 2024-04-19T02:18:33.646 INFO:tasks.workunit.client.0.smithi073.stdout:1/580: creat db/d1c/d78/dcf/fd0 x:0 0 0 2024-04-19T02:18:33.646 INFO:tasks.workunit.client.0.smithi073.stdout:6/554: read - d8/de/d7f/fa0 zero size 2024-04-19T02:18:33.647 INFO:tasks.workunit.client.0.smithi073.stdout:7/645: unlink d0/dc/d39/f62 0 2024-04-19T02:18:33.647 INFO:tasks.workunit.client.0.smithi073.stdout:1/581: write db/d1c/d78/fb9 [922373,7797] 0 2024-04-19T02:18:33.647 INFO:tasks.workunit.client.0.smithi073.stdout:6/555: creat d8/de/d7f/da5/dae/fb5 x:0 0 0 2024-04-19T02:18:33.648 INFO:tasks.workunit.client.0.smithi073.stdout:1/582: mkdir db/d1c/d81/d83/db8/dd1 0 2024-04-19T02:18:33.648 INFO:tasks.workunit.client.0.smithi073.stdout:3/716: stat d3/d6/db/d16/d52/cec 0 2024-04-19T02:18:33.649 INFO:tasks.workunit.client.0.smithi073.stdout:6/556: chown d8/de/d58/d63/f74 34986925 1 2024-04-19T02:18:33.649 INFO:tasks.workunit.client.0.smithi073.stdout:3/717: write d3/d6/db/d23/f27 [2400276,68486] 0 2024-04-19T02:18:33.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:33.651 INFO:tasks.workunit.client.0.smithi073.stdout:1/583: write db/d1c/d2c/d50/d62/f79 [2073883,42100] 0 2024-04-19T02:18:33.651 INFO:tasks.workunit.client.0.smithi073.stdout:1/584: creat db/d1c/d81/fd2 x:0 0 0 2024-04-19T02:18:33.651 INFO:tasks.workunit.client.0.smithi073.stdout:3/718: rename d3/d6/db/d1a/l58 to d3/d6/db/d3a/lee 0 2024-04-19T02:18:33.651 INFO:tasks.workunit.client.0.smithi073.stdout:5/677: dread d0/d1d/f4a [0,4194304] 0 2024-04-19T02:18:33.651 INFO:tasks.workunit.client.0.smithi073.stdout:1/585: symlink db/d1c/d78/ld3 0 2024-04-19T02:18:33.651 INFO:tasks.workunit.client.0.smithi073.stdout:3/719: write d3/d6/f1d [39129,97120] 0 2024-04-19T02:18:33.651 INFO:tasks.workunit.client.0.smithi073.stdout:5/678: fsync d0/d1d/f7d 0 2024-04-19T02:18:33.652 INFO:tasks.workunit.client.0.smithi073.stdout:1/586: symlink db/d41/ld4 0 2024-04-19T02:18:33.652 INFO:tasks.workunit.client.0.smithi073.stdout:5/679: read - d0/fa1 zero size 2024-04-19T02:18:33.653 INFO:tasks.workunit.client.0.smithi073.stdout:4/631: dread da/d27/d1b/d1d/f42 [0,4194304] 0 2024-04-19T02:18:33.653 INFO:tasks.workunit.client.0.smithi073.stdout:3/720: rename d3/d6/db/le to d3/d6/db/d23/lef 0 2024-04-19T02:18:33.653 INFO:tasks.workunit.client.0.smithi073.stdout:5/680: rmdir d0/d1d/d24/d61/dce 0 2024-04-19T02:18:33.653 INFO:tasks.workunit.client.0.smithi073.stdout:1/587: rename db/d1c/d2c to db/d1c/d78/d8c/dd5 0 2024-04-19T02:18:33.654 INFO:tasks.workunit.client.0.smithi073.stdout:4/632: symlink da/d27/d2c/d80/ldf 0 2024-04-19T02:18:33.654 INFO:tasks.workunit.client.0.smithi073.stdout:1/588: stat db/d1c/d78/dcf/fd0 0 2024-04-19T02:18:33.655 INFO:tasks.workunit.client.0.smithi073.stdout:1/589: dread - db/d1c/d78/fb2 zero size 2024-04-19T02:18:33.655 INFO:tasks.workunit.client.0.smithi073.stdout:4/633: mknod da/d27/d3a/ce0 0 2024-04-19T02:18:33.656 INFO:tasks.workunit.client.0.smithi073.stdout:4/634: mkdir da/d27/d2c/d80/dcf/de1 0 2024-04-19T02:18:33.656 INFO:tasks.workunit.client.0.smithi073.stdout:2/660: dread d5/d10/d14/d18/d3e/d2d/d63/f9f [0,4194304] 0 2024-04-19T02:18:33.657 INFO:tasks.workunit.client.0.smithi073.stdout:4/635: rename da/cad to da/d27/d36/d4d/dde/ce2 0 2024-04-19T02:18:33.657 INFO:tasks.workunit.client.0.smithi073.stdout:5/681: truncate d0/d1d/d25/d35/f49 399843 0 2024-04-19T02:18:33.657 INFO:tasks.workunit.client.0.smithi073.stdout:1/590: link db/d1c/d78/d8c/dd5/c4d db/d1c/d78/d8c/dd5/d50/d62/dc0/cd6 0 2024-04-19T02:18:33.658 INFO:tasks.workunit.client.0.smithi073.stdout:4/636: dread - da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/fce zero size 2024-04-19T02:18:33.658 INFO:tasks.workunit.client.0.smithi073.stdout:1/591: rename f3 to db/d1c/d81/d83/db8/fd7 0 2024-04-19T02:18:33.659 INFO:tasks.workunit.client.0.smithi073.stdout:2/661: link d5/d10/d29/d66/c94 d5/d10/d14/d2e/d9c/ce7 0 2024-04-19T02:18:33.659 INFO:tasks.workunit.client.0.smithi073.stdout:4/637: creat da/d27/d1b/d1d/d72/dd5/fe3 x:0 0 0 2024-04-19T02:18:33.660 INFO:tasks.workunit.client.0.smithi073.stdout:2/662: symlink d5/d10/d14/d18/d3e/d2d/d63/le8 0 2024-04-19T02:18:33.660 INFO:tasks.workunit.client.0.smithi073.stdout:1/592: link db/d1c/d78/d8c/dd5/f63 db/d3e/fd8 0 2024-04-19T02:18:33.660 INFO:tasks.workunit.client.0.smithi073.stdout:8/624: sync 2024-04-19T02:18:33.660 INFO:tasks.workunit.client.0.smithi073.stdout:0/606: sync 2024-04-19T02:18:33.661 INFO:tasks.workunit.client.0.smithi073.stdout:9/581: sync 2024-04-19T02:18:33.661 INFO:tasks.workunit.client.0.smithi073.stdout:1/593: write db/d3e/f97 [3708882,92184] 0 2024-04-19T02:18:33.661 INFO:tasks.workunit.client.0.smithi073.stdout:5/682: write d0/d1d/d24/d61/fb1 [1006699,74965] 0 2024-04-19T02:18:33.662 INFO:tasks.workunit.client.0.smithi073.stdout:4/638: getdents da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/dd8 0 2024-04-19T02:18:33.662 INFO:tasks.workunit.client.0.smithi073.stdout:2/663: truncate d5/d10/d14/db6/fe3 891979 0 2024-04-19T02:18:33.662 INFO:tasks.workunit.client.0.smithi073.stdout:8/625: creat d14/d27/d85/d9b/fd2 x:0 0 0 2024-04-19T02:18:33.662 INFO:tasks.workunit.client.0.smithi073.stdout:9/582: symlink d0/df/d16/d19/d38/d5d/d45/lca 0 2024-04-19T02:18:33.663 INFO:tasks.workunit.client.0.smithi073.stdout:9/583: chown d0/d81/d5c 146468 1 2024-04-19T02:18:33.663 INFO:tasks.workunit.client.0.smithi073.stdout:5/683: truncate d0/d1d/d90/fba 57031 0 2024-04-19T02:18:33.664 INFO:tasks.workunit.client.0.smithi073.stdout:0/607: symlink d7/d14/d17/d1a/d20/d50/d99/da7/d9e/lc0 0 2024-04-19T02:18:33.664 INFO:tasks.workunit.client.0.smithi073.stdout:5/684: chown d0/d1d/f4a 882593 1 2024-04-19T02:18:33.664 INFO:tasks.workunit.client.0.smithi073.stdout:2/664: link d5/d10/d29/f8c d5/d10/d29/d42/fe9 0 2024-04-19T02:18:33.664 INFO:tasks.workunit.client.0.smithi073.stdout:9/584: unlink d0/df/d60/c8f 0 2024-04-19T02:18:33.665 INFO:tasks.workunit.client.0.smithi073.stdout:0/608: chown d7/d14/d17/d1a/d21/f36 12 1 2024-04-19T02:18:33.665 INFO:tasks.workunit.client.0.smithi073.stdout:4/639: getdents da/d27/d1b/d1d/d72/d2b/d2f 0 2024-04-19T02:18:33.666 INFO:tasks.workunit.client.0.smithi073.stdout:5/685: mkdir d0/d1d/d25/d35/d39/dd8 0 2024-04-19T02:18:33.666 INFO:tasks.workunit.client.0.smithi073.stdout:2/665: symlink d5/d10/d14/d18/d3e/lea 0 2024-04-19T02:18:33.666 INFO:tasks.workunit.client.0.smithi073.stdout:4/640: fsync da/f11 0 2024-04-19T02:18:33.666 INFO:tasks.workunit.client.0.smithi073.stdout:0/609: write d7/d14/d17/d1a/f39 [5150740,86809] 0 2024-04-19T02:18:33.667 INFO:tasks.workunit.client.0.smithi073.stdout:9/585: truncate d0/df/d16/d19/d38/d5d/d5e/f75 794632 0 2024-04-19T02:18:33.668 INFO:tasks.workunit.client.0.smithi073.stdout:5/686: link d0/d1d/d1e/l48 d0/d1d/ld9 0 2024-04-19T02:18:33.668 INFO:tasks.workunit.client.0.smithi073.stdout:0/610: stat d7/d14/d17/d1a/d20/d50/d99/da7/d9e/lc0 0 2024-04-19T02:18:33.668 INFO:tasks.workunit.client.0.smithi073.stdout:9/586: fsync d0/df/f11 0 2024-04-19T02:18:33.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/626: dread d14/d27/d85/d9b/fa9 [0,4194304] 0 2024-04-19T02:18:33.668 INFO:tasks.workunit.client.0.smithi073.stdout:5/687: creat d0/d1d/d1e/fda x:0 0 0 2024-04-19T02:18:33.669 INFO:tasks.workunit.client.0.smithi073.stdout:0/611: fdatasync d7/d14/d17/d69/d7c/f8b 0 2024-04-19T02:18:33.669 INFO:tasks.workunit.client.0.smithi073.stdout:9/587: fdatasync d0/df/d16/d19/db1/f3a 0 2024-04-19T02:18:33.669 INFO:tasks.workunit.client.0.smithi073.stdout:8/627: truncate d14/d87/fbd 343559 0 2024-04-19T02:18:33.670 INFO:tasks.workunit.client.0.smithi073.stdout:5/688: write d0/d1d/d64/dbd/fd1 [541560,34894] 0 2024-04-19T02:18:33.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/628: creat d14/d87/fd3 x:0 0 0 2024-04-19T02:18:33.671 INFO:tasks.workunit.client.0.smithi073.stdout:9/588: symlink d0/df/d16/d19/d38/d5d/d5e/lcb 0 2024-04-19T02:18:33.671 INFO:tasks.workunit.client.0.smithi073.stdout:0/612: write d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/fb2 [113965,7119] 0 2024-04-19T02:18:33.672 INFO:tasks.workunit.client.0.smithi073.stdout:9/589: dread - d0/dad/fb7 zero size 2024-04-19T02:18:33.672 INFO:tasks.workunit.client.0.smithi073.stdout:7/646: dread d0/d3/f46 [0,4194304] 0 2024-04-19T02:18:33.673 INFO:tasks.workunit.client.0.smithi073.stdout:2/666: write d5/d10/d29/d66/d67/f86 [86241,96832] 0 2024-04-19T02:18:33.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/689: chown d0/d1d/d24/d61/fb4 72010374 1 2024-04-19T02:18:33.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/594: dwrite db/d1c/f5d [4194304,4194304] 0 2024-04-19T02:18:33.673 INFO:tasks.workunit.client.0.smithi073.stdout:8/629: dread d14/d27/d29/fb0 [0,4194304] 0 2024-04-19T02:18:33.674 INFO:tasks.workunit.client.0.smithi073.stdout:9/590: write d0/d35/fc6 [287000,106556] 0 2024-04-19T02:18:33.675 INFO:tasks.workunit.client.0.smithi073.stdout:1/595: write db/f28 [4926935,99719] 0 2024-04-19T02:18:33.675 INFO:tasks.workunit.client.0.smithi073.stdout:8/630: readlink d14/d27/d29/l2d 0 2024-04-19T02:18:33.675 INFO:tasks.workunit.client.0.smithi073.stdout:9/591: write d0/df/d16/d19/d38/d5d/f4a [421690,97810] 0 2024-04-19T02:18:33.676 INFO:tasks.workunit.client.0.smithi073.stdout:5/690: creat d0/d1d/d64/dbd/fdb x:0 0 0 2024-04-19T02:18:33.677 INFO:tasks.workunit.client.0.smithi073.stdout:7/647: rmdir d0/dc/d67/d15/d8f 39 2024-04-19T02:18:33.680 INFO:tasks.workunit.client.0.smithi073.stdout:7/648: truncate d0/d3/f7e 636195 0 2024-04-19T02:18:33.681 INFO:tasks.workunit.client.0.smithi073.stdout:5/691: rename d0/d1d/d25/d35/d39/cad to d0/d1d/d90/da0/dbb/cdc 0 2024-04-19T02:18:33.682 INFO:tasks.workunit.client.0.smithi073.stdout:2/667: dwrite d5/f16 [0,4194304] 0 2024-04-19T02:18:33.683 INFO:tasks.workunit.client.0.smithi073.stdout:8/631: dread d14/d27/d29/d31/f5e [0,4194304] 0 2024-04-19T02:18:33.685 INFO:tasks.workunit.client.0.smithi073.stdout:0/613: dwrite d7/d14/d17/d69/d7c/fb5 [0,4194304] 0 2024-04-19T02:18:33.685 INFO:tasks.workunit.client.0.smithi073.stdout:6/557: dread d8/de/ff [4194304,4194304] 0 2024-04-19T02:18:33.687 INFO:tasks.workunit.client.0.smithi073.stdout:6/558: readlink d8/d4b/l6a 0 2024-04-19T02:18:33.687 INFO:tasks.workunit.client.0.smithi073.stdout:2/668: write d5/d10/d14/d18/d3e/d2d/d63/fd7 [37725,61887] 0 2024-04-19T02:18:33.687 INFO:tasks.workunit.client.0.smithi073.stdout:1/596: dwrite db/fd [0,4194304] 0 2024-04-19T02:18:33.690 INFO:tasks.workunit.client.0.smithi073.stdout:6/559: chown d8/de/l48 807 1 2024-04-19T02:18:33.690 INFO:tasks.workunit.client.0.smithi073.stdout:9/592: dwrite d0/df/d16/d19/d38/f66 [0,4194304] 0 2024-04-19T02:18:33.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/692: dread d0/d1d/d1e/f8d [0,4194304] 0 2024-04-19T02:18:33.692 INFO:tasks.workunit.client.0.smithi073.stdout:3/721: sync 2024-04-19T02:18:33.692 INFO:tasks.workunit.client.0.smithi073.stdout:6/560: dread - d8/de/d7f/fa0 zero size 2024-04-19T02:18:33.692 INFO:tasks.workunit.client.0.smithi073.stdout:4/641: dread da/f11 [0,4194304] 0 2024-04-19T02:18:33.692 INFO:tasks.workunit.client.0.smithi073.stdout:1/597: mknod db/d1c/d78/d8c/dd5/d50/cd9 0 2024-04-19T02:18:33.694 INFO:tasks.workunit.client.0.smithi073.stdout:7/649: truncate d0/f79 1984892 0 2024-04-19T02:18:33.694 INFO:tasks.workunit.client.0.smithi073.stdout:0/614: write d7/d14/f15 [1454882,98634] 0 2024-04-19T02:18:33.695 INFO:tasks.workunit.client.0.smithi073.stdout:8/632: dwrite d14/d27/d50/faf [0,4194304] 0 2024-04-19T02:18:33.695 INFO:tasks.workunit.client.0.smithi073.stdout:2/669: truncate d5/d10/d29/d66/d67/f4f 413682 0 2024-04-19T02:18:33.695 INFO:tasks.workunit.client.0.smithi073.stdout:6/561: mknod d8/d4b/cb6 0 2024-04-19T02:18:33.696 INFO:tasks.workunit.client.0.smithi073.stdout:4/642: write da/d27/fd7 [10199,123511] 0 2024-04-19T02:18:33.696 INFO:tasks.workunit.client.0.smithi073.stdout:9/593: rmdir d0/df/d16/d19/d38/d5d/d6d/d97 0 2024-04-19T02:18:33.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/650: link d0/dc/d33/d36/d7b/d93/lb8 d0/dc/d39/d50/dbc/lc1 0 2024-04-19T02:18:33.697 INFO:tasks.workunit.client.0.smithi073.stdout:0/615: getdents d7/d14/d17/d1a/d8d 0 2024-04-19T02:18:33.697 INFO:tasks.workunit.client.0.smithi073.stdout:2/670: write d5/d10/d14/d7a/dd1/fe2 [987717,7922] 0 2024-04-19T02:18:33.698 INFO:tasks.workunit.client.0.smithi073.stdout:4/643: rename da/d27/d1b/d26/f6a to da/d27/d3a/d97/fe4 0 2024-04-19T02:18:33.699 INFO:tasks.workunit.client.0.smithi073.stdout:7/651: creat d0/dc/fc2 x:0 0 0 2024-04-19T02:18:33.700 INFO:tasks.workunit.client.0.smithi073.stdout:8/633: link d14/d15/d17/c22 d14/d27/d50/cd4 0 2024-04-19T02:18:33.700 INFO:tasks.workunit.client.0.smithi073.stdout:5/693: dwrite d0/d1d/d25/f72 [0,4194304] 0 2024-04-19T02:18:33.700 INFO:tasks.workunit.client.0.smithi073.stdout:9/594: link d0/df/d16/cb4 d0/df/d16/d19/db1/d2c/d2e/ccc 0 2024-04-19T02:18:33.702 INFO:tasks.workunit.client.0.smithi073.stdout:0/616: chown d7/d14/d17/d1a/d21/c66 108956 1 2024-04-19T02:18:33.702 INFO:tasks.workunit.client.0.smithi073.stdout:4/644: mkdir da/d27/d1b/d1d/d72/d2b/d2f/d68/de5 0 2024-04-19T02:18:33.703 INFO:tasks.workunit.client.0.smithi073.stdout:8/634: fsync d14/d27/d4c/d75/f44 0 2024-04-19T02:18:33.703 INFO:tasks.workunit.client.0.smithi073.stdout:7/652: mknod d0/d3/dbb/cc3 0 2024-04-19T02:18:33.703 INFO:tasks.workunit.client.0.smithi073.stdout:9/595: mknod d0/df/d16/d19/ccd 0 2024-04-19T02:18:33.704 INFO:tasks.workunit.client.0.smithi073.stdout:3/722: dwrite d3/d6/db/f14 [0,4194304] 0 2024-04-19T02:18:33.704 INFO:tasks.workunit.client.0.smithi073.stdout:4/645: chown da/d27/d3a/ld4 0 1 2024-04-19T02:18:33.704 INFO:tasks.workunit.client.0.smithi073.stdout:0/617: creat d7/d14/d17/d1a/d21/fc1 x:0 0 0 2024-04-19T02:18:33.705 INFO:tasks.workunit.client.0.smithi073.stdout:6/562: dwrite d8/de/d58/d63/d82/fb0 [0,4194304] 0 2024-04-19T02:18:33.706 INFO:tasks.workunit.client.0.smithi073.stdout:7/653: truncate d0/d28/d63/f82 663890 0 2024-04-19T02:18:33.706 INFO:tasks.workunit.client.0.smithi073.stdout:9/596: fdatasync d0/df/d16/d19/d38/d5d/d5e/fa7 0 2024-04-19T02:18:33.706 INFO:tasks.workunit.client.0.smithi073.stdout:0/618: readlink d7/d14/d17/d1a/d20/d50/d99/da7/d87/l8c 0 2024-04-19T02:18:33.707 INFO:tasks.workunit.client.0.smithi073.stdout:7/654: mknod d0/cc4 0 2024-04-19T02:18:33.707 INFO:tasks.workunit.client.0.smithi073.stdout:0/619: chown d7/d14/d17/d1a/d8d/fb3 435357173 1 2024-04-19T02:18:33.707 INFO:tasks.workunit.client.0.smithi073.stdout:9/597: chown d0/df/d16/d19/d38/f9b 0 1 2024-04-19T02:18:33.708 INFO:tasks.workunit.client.0.smithi073.stdout:7/655: mknod d0/dc/d33/d36/d7b/d93/cc5 0 2024-04-19T02:18:33.709 INFO:tasks.workunit.client.0.smithi073.stdout:0/620: mkdir d7/d14/d17/d1a/d20/d50/dc2 0 2024-04-19T02:18:33.709 INFO:tasks.workunit.client.0.smithi073.stdout:6/563: read d8/de/f1f [488958,51549] 0 2024-04-19T02:18:33.709 INFO:tasks.workunit.client.0.smithi073.stdout:9/598: unlink d0/df/d16/d19/db1/d2c/l55 0 2024-04-19T02:18:33.709 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:33.704+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:33.710 INFO:tasks.workunit.client.0.smithi073.stdout:6/564: creat d8/de/d7f/fb7 x:0 0 0 2024-04-19T02:18:33.710 INFO:tasks.workunit.client.0.smithi073.stdout:4/646: dread da/d27/d1b/d8c/db7/fd1 [0,4194304] 0 2024-04-19T02:18:33.710 INFO:tasks.workunit.client.0.smithi073.stdout:0/621: chown d7/d14/d17/d1a/d20/d50/d99/fb8 3963 1 2024-04-19T02:18:33.710 INFO:tasks.workunit.client.0.smithi073.stdout:7/656: link d0/dc/l23 d0/dc/d33/d36/d7b/db4/lc6 0 2024-04-19T02:18:33.710 INFO:tasks.workunit.client.0.smithi073.stdout:9/599: getdents d0/d35 0 2024-04-19T02:18:33.711 INFO:tasks.workunit.client.0.smithi073.stdout:6/565: fdatasync d8/de/d78/f7e 0 2024-04-19T02:18:33.712 INFO:tasks.workunit.client.0.smithi073.stdout:7/657: read - d0/dc/d67/d15/d8f/f9b zero size 2024-04-19T02:18:33.712 INFO:tasks.workunit.client.0.smithi073.stdout:9/600: mkdir d0/df/d60/db0/dc2/dce 0 2024-04-19T02:18:33.713 INFO:tasks.workunit.client.0.smithi073.stdout:4/647: link da/d27/d1b/d1d/d72/d2b/d2f/d68/c82 da/d27/d2c/d80/dcf/ddd/d95/ce6 0 2024-04-19T02:18:33.714 INFO:tasks.workunit.client.0.smithi073.stdout:9/601: rename d0/df/d16/d19/d38/d5d/d6d/caa to d0/df/ccf 0 2024-04-19T02:18:33.715 INFO:tasks.workunit.client.0.smithi073.stdout:9/602: creat d0/df/d16/d19/d38/d5d/d76/dbc/fd0 x:0 0 0 2024-04-19T02:18:33.715 INFO:tasks.workunit.client.0.smithi073.stdout:9/603: mknod d0/df/d60/cd1 0 2024-04-19T02:18:33.719 INFO:tasks.workunit.client.0.smithi073.stdout:6/566: dwrite d8/f18 [0,4194304] 0 2024-04-19T02:18:33.721 INFO:tasks.workunit.client.0.smithi073.stdout:7/658: dread d0/d28/d63/f9e [4194304,4194304] 0 2024-04-19T02:18:33.721 INFO:tasks.workunit.client.0.smithi073.stdout:7/659: sync 2024-04-19T02:18:33.722 INFO:tasks.workunit.client.0.smithi073.stdout:7/660: creat d0/d28/fc7 x:0 0 0 2024-04-19T02:18:33.723 INFO:tasks.workunit.client.0.smithi073.stdout:7/661: getdents d0/dc/d67/d99 0 2024-04-19T02:18:33.724 INFO:tasks.workunit.client.0.smithi073.stdout:1/598: fsync db/d41/f67 0 2024-04-19T02:18:33.725 INFO:tasks.workunit.client.0.smithi073.stdout:1/599: symlink db/d1c/d78/d8c/dd5/lda 0 2024-04-19T02:18:33.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/600: chown db/d1c/d78/lcb 783564 1 2024-04-19T02:18:33.727 INFO:tasks.workunit.client.0.smithi073.stdout:8/635: write d14/d27/da4/fb1 [951560,1356] 0 2024-04-19T02:18:33.727 INFO:tasks.workunit.client.0.smithi073.stdout:5/694: truncate d0/d1d/d24/d61/fb1 1866011 0 2024-04-19T02:18:33.728 INFO:tasks.workunit.client.0.smithi073.stdout:8/636: rename d14/d27/d29/d31/f74 to d14/fd5 0 2024-04-19T02:18:33.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/637: sync 2024-04-19T02:18:33.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/638: fdatasync d14/d27/d29/d31/fa3 0 2024-04-19T02:18:33.732 INFO:tasks.workunit.client.0.smithi073.stdout:6/567: dread d8/de/f2a [0,4194304] 0 2024-04-19T02:18:33.732 INFO:tasks.workunit.client.0.smithi073.stdout:0/622: truncate d7/d14/d17/d1a/f3d 3836192 0 2024-04-19T02:18:33.734 INFO:tasks.workunit.client.0.smithi073.stdout:0/623: write d7/d14/d17/d1a/d8d/f96 [886436,65291] 0 2024-04-19T02:18:33.734 INFO:tasks.workunit.client.0.smithi073.stdout:5/695: dwrite d0/d1d/d24/d61/fb4 [0,4194304] 0 2024-04-19T02:18:33.735 INFO:tasks.workunit.client.0.smithi073.stdout:6/568: truncate d8/de/d58/f33 3181413 0 2024-04-19T02:18:33.735 INFO:tasks.workunit.client.0.smithi073.stdout:4/648: write f1 [1312989,83785] 0 2024-04-19T02:18:33.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/624: unlink d7/d14/d17/d1a/d21/f5b 0 2024-04-19T02:18:33.737 INFO:tasks.workunit.client.0.smithi073.stdout:5/696: symlink d0/d1d/d25/d35/dc7/ldd 0 2024-04-19T02:18:33.737 INFO:tasks.workunit.client.0.smithi073.stdout:8/639: dwrite d14/d15/d17/d48/d89/d97/fc9 [0,4194304] 0 2024-04-19T02:18:33.737 INFO:tasks.workunit.client.0.smithi073.stdout:4/649: mkdir da/d27/d1b/d1d/d72/dd5/de7 0 2024-04-19T02:18:33.738 INFO:tasks.workunit.client.0.smithi073.stdout:5/697: mknod d0/d1d/d64/cde 0 2024-04-19T02:18:33.739 INFO:tasks.workunit.client.0.smithi073.stdout:8/640: mkdir d14/d15/d17/d48/d89/dd6 0 2024-04-19T02:18:33.740 INFO:tasks.workunit.client.0.smithi073.stdout:4/650: symlink da/d27/d1b/d1d/d72/dd5/le8 0 2024-04-19T02:18:33.742 INFO:tasks.workunit.client.0.smithi073.stdout:8/641: chown d14/d27/l37 694830 1 2024-04-19T02:18:33.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/625: mknod d7/d6d/dbd/cc3 0 2024-04-19T02:18:33.742 INFO:tasks.workunit.client.0.smithi073.stdout:8/642: read d14/d27/d29/d31/d34/f88 [1238363,87111] 0 2024-04-19T02:18:33.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/626: readlink d7/d14/d17/l23 0 2024-04-19T02:18:33.742 INFO:tasks.workunit.client.0.smithi073.stdout:4/651: chown da/d27/d36/d4d/d7b/f92 282072 1 2024-04-19T02:18:33.742 INFO:tasks.workunit.client.0.smithi073.stdout:4/652: write f1 [2268372,91475] 0 2024-04-19T02:18:33.742 INFO:tasks.workunit.client.0.smithi073.stdout:8/643: chown d14/d27/d85/d9b/fd2 3362 1 2024-04-19T02:18:33.743 INFO:tasks.workunit.client.0.smithi073.stdout:0/627: unlink d7/d14/d17/d69/d7c/fb5 0 2024-04-19T02:18:33.743 INFO:tasks.workunit.client.0.smithi073.stdout:5/698: dread d0/d1d/f4a [0,4194304] 0 2024-04-19T02:18:33.743 INFO:tasks.workunit.client.0.smithi073.stdout:4/653: chown da/d27/d2c/d80/dcf/ddd/d95 2750 1 2024-04-19T02:18:33.744 INFO:tasks.workunit.client.0.smithi073.stdout:8/644: rmdir d14/d27/d4c/d75/dbb 39 2024-04-19T02:18:33.744 INFO:tasks.workunit.client.0.smithi073.stdout:0/628: unlink d7/d14/d17/d1a/d21/f3c 0 2024-04-19T02:18:33.744 INFO:tasks.workunit.client.0.smithi073.stdout:8/645: symlink d14/d87/ld7 0 2024-04-19T02:18:33.744 INFO:tasks.workunit.client.0.smithi073.stdout:5/699: write d0/d1d/d64/dbd/fd1 [1237034,23597] 0 2024-04-19T02:18:33.745 INFO:tasks.workunit.client.0.smithi073.stdout:0/629: fdatasync d7/d14/d17/d1a/d21/f64 0 2024-04-19T02:18:33.745 INFO:tasks.workunit.client.0.smithi073.stdout:9/604: dread d0/df/f41 [0,4194304] 0 2024-04-19T02:18:33.745 INFO:tasks.workunit.client.0.smithi073.stdout:8/646: chown d14/d27/d29/f52 2 1 2024-04-19T02:18:33.746 INFO:tasks.workunit.client.0.smithi073.stdout:8/647: symlink d14/d27/d29/d64/ld8 0 2024-04-19T02:18:33.746 INFO:tasks.workunit.client.0.smithi073.stdout:9/605: creat d0/df/d16/d19/d38/d5d/d5e/d83/fd2 x:0 0 0 2024-04-19T02:18:33.746 INFO:tasks.workunit.client.0.smithi073.stdout:5/700: read d0/f15 [1407718,68584] 0 2024-04-19T02:18:33.746 INFO:tasks.workunit.client.0.smithi073.stdout:8/648: symlink d14/d27/d85/d9a/ld9 0 2024-04-19T02:18:33.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/606: symlink d0/df/ld3 0 2024-04-19T02:18:33.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/607: chown d0/df/d60 185 1 2024-04-19T02:18:33.749 INFO:tasks.workunit.client.0.smithi073.stdout:5/701: rename d0/d1d/d25/d37/d71/dd6/c6c to d0/d69/cdf 0 2024-04-19T02:18:33.749 INFO:tasks.workunit.client.0.smithi073.stdout:9/608: fdatasync d0/df/d16/d19/db1/d2c/d2e/f82 0 2024-04-19T02:18:33.749 INFO:tasks.workunit.client.0.smithi073.stdout:8/649: getdents d14/d15/d17/da1/db9 0 2024-04-19T02:18:33.750 INFO:tasks.workunit.client.0.smithi073.stdout:5/702: chown d0/d1d/d24/c87 15976999 1 2024-04-19T02:18:33.750 INFO:tasks.workunit.client.0.smithi073.stdout:5/703: dread - d0/fa1 zero size 2024-04-19T02:18:33.751 INFO:tasks.workunit.client.0.smithi073.stdout:0/630: dwrite d7/d14/d17/d1a/f7e [0,4194304] 0 2024-04-19T02:18:33.752 INFO:tasks.workunit.client.0.smithi073.stdout:8/650: creat d14/d27/d7b/fda x:0 0 0 2024-04-19T02:18:33.753 INFO:tasks.workunit.client.0.smithi073.stdout:5/704: chown d0/d1d/d1e/f55 0 1 2024-04-19T02:18:33.753 INFO:tasks.workunit.client.0.smithi073.stdout:6/569: truncate d8/d4b/d93/f4a 809047 0 2024-04-19T02:18:33.754 INFO:tasks.workunit.client.0.smithi073.stdout:5/705: mkdir d0/d1d/d24/de0 0 2024-04-19T02:18:33.755 INFO:tasks.workunit.client.0.smithi073.stdout:8/651: read d14/d27/d29/d31/f3e [103321,2097] 0 2024-04-19T02:18:33.757 INFO:tasks.workunit.client.0.smithi073.stdout:2/671: dread d5/d10/d53/f75 [4194304,4194304] 0 2024-04-19T02:18:33.757 INFO:tasks.workunit.client.0.smithi073.stdout:7/662: dread d0/d28/d63/f9e [0,4194304] 0 2024-04-19T02:18:33.758 INFO:tasks.workunit.client.0.smithi073.stdout:0/631: getdents d7/d14/d17/d1a/d21 0 2024-04-19T02:18:33.758 INFO:tasks.workunit.client.0.smithi073.stdout:5/706: creat d0/d1d/d25/d35/d39/dd8/fe1 x:0 0 0 2024-04-19T02:18:33.758 INFO:tasks.workunit.client.0.smithi073.stdout:2/672: truncate d5/f16 5078101 0 2024-04-19T02:18:33.758 INFO:tasks.workunit.client.0.smithi073.stdout:8/652: truncate d14/d27/d4c/d75/f44 1305388 0 2024-04-19T02:18:33.759 INFO:tasks.workunit.client.0.smithi073.stdout:0/632: symlink d7/d14/d17/d1a/d20/d50/d99/lc4 0 2024-04-19T02:18:33.759 INFO:tasks.workunit.client.0.smithi073.stdout:8/653: write d14/d15/d17/d8d/fc8 [356288,46374] 0 2024-04-19T02:18:33.760 INFO:tasks.workunit.client.0.smithi073.stdout:2/673: symlink d5/d10/d14/d18/d3e/de1/leb 0 2024-04-19T02:18:33.760 INFO:tasks.workunit.client.0.smithi073.stdout:0/633: readlink d7/d14/d17/d1a/d21/l57 0 2024-04-19T02:18:33.760 INFO:tasks.workunit.client.0.smithi073.stdout:3/723: dread d3/d6/db/d3a/f29 [0,4194304] 0 2024-04-19T02:18:33.760 INFO:tasks.workunit.client.0.smithi073.stdout:2/674: creat d5/d10/fec x:0 0 0 2024-04-19T02:18:33.762 INFO:tasks.workunit.client.0.smithi073.stdout:0/634: getdents d7/d14/d17/d1a 0 2024-04-19T02:18:33.763 INFO:tasks.workunit.client.0.smithi073.stdout:2/675: creat d5/d10/d29/d42/fed x:0 0 0 2024-04-19T02:18:33.765 INFO:tasks.workunit.client.0.smithi073.stdout:1/601: dread db/d3e/f9f [0,4194304] 0 2024-04-19T02:18:33.765 INFO:tasks.workunit.client.0.smithi073.stdout:7/663: dread d0/dc/d67/d15/f87 [0,4194304] 0 2024-04-19T02:18:33.766 INFO:tasks.workunit.client.0.smithi073.stdout:3/724: dread d3/d6/fd [0,4194304] 0 2024-04-19T02:18:33.767 INFO:tasks.workunit.client.0.smithi073.stdout:1/602: write db/f65 [986023,11648] 0 2024-04-19T02:18:33.768 INFO:tasks.workunit.client.0.smithi073.stdout:0/635: truncate d7/d14/d17/d1a/d21/f5e 1827371 0 2024-04-19T02:18:33.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/676: creat d5/d10/d29/d66/d67/fee x:0 0 0 2024-04-19T02:18:33.771 INFO:tasks.workunit.client.0.smithi073.stdout:5/707: dwrite d0/d1d/d25/d35/d39/f4c [0,4194304] 0 2024-04-19T02:18:33.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/636: chown d7/d14/d17/d69 73 1 2024-04-19T02:18:33.771 INFO:tasks.workunit.client.0.smithi073.stdout:9/609: dwrite d0/df/f78 [0,4194304] 0 2024-04-19T02:18:33.772 INFO:tasks.workunit.client.0.smithi073.stdout:1/603: chown db/d1c/d78/d8c/dd5/lda 24 1 2024-04-19T02:18:33.772 INFO:tasks.workunit.client.0.smithi073.stdout:8/654: dwrite d14/d15/f42 [0,4194304] 0 2024-04-19T02:18:33.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/677: creat d5/d10/d14/d18/d3e/fef x:0 0 0 2024-04-19T02:18:33.774 INFO:tasks.workunit.client.0.smithi073.stdout:3/725: read d3/d6/db/d1a/f7d [560595,4712] 0 2024-04-19T02:18:33.774 INFO:tasks.workunit.client.0.smithi073.stdout:9/610: mkdir d0/df/d16/d19/db1/dd4 0 2024-04-19T02:18:33.774 INFO:tasks.workunit.client.0.smithi073.stdout:5/708: rename d0/d1d/d64/cde to d0/d1d/d25/d35/d88/ce2 0 2024-04-19T02:18:33.775 INFO:tasks.workunit.client.0.smithi073.stdout:3/726: dread - d3/d6/da6/fe7 zero size 2024-04-19T02:18:33.775 INFO:tasks.workunit.client.0.smithi073.stdout:5/709: write d0/d1d/d1e/fda [780667,44173] 0 2024-04-19T02:18:33.776 INFO:tasks.workunit.client.0.smithi073.stdout:7/664: dwrite d0/f1d [8388608,4194304] 0 2024-04-19T02:18:33.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/655: creat d14/dbc/fdb x:0 0 0 2024-04-19T02:18:33.777 INFO:tasks.workunit.client.0.smithi073.stdout:0/637: creat d7/d14/d17/d1a/d20/d50/d99/da7/d6f/fc5 x:0 0 0 2024-04-19T02:18:33.777 INFO:tasks.workunit.client.0.smithi073.stdout:5/710: creat d0/d1d/d25/d35/dc7/fe3 x:0 0 0 2024-04-19T02:18:33.777 INFO:tasks.workunit.client.0.smithi073.stdout:7/665: creat d0/d3/fc8 x:0 0 0 2024-04-19T02:18:33.778 INFO:tasks.workunit.client.0.smithi073.stdout:2/678: getdents d5/d10/d14/d7a 0 2024-04-19T02:18:33.778 INFO:tasks.workunit.client.0.smithi073.stdout:0/638: fdatasync d7/faa 0 2024-04-19T02:18:33.779 INFO:tasks.workunit.client.0.smithi073.stdout:5/711: write d0/f1b [4612881,100021] 0 2024-04-19T02:18:33.779 INFO:tasks.workunit.client.0.smithi073.stdout:6/570: dread d8/d4b/d93/f3d [0,4194304] 0 2024-04-19T02:18:33.780 INFO:tasks.workunit.client.0.smithi073.stdout:0/639: creat d7/d14/d17/d1a/fc6 x:0 0 0 2024-04-19T02:18:33.780 INFO:tasks.workunit.client.0.smithi073.stdout:1/604: dwrite db/d1c/f3c [0,4194304] 0 2024-04-19T02:18:33.781 INFO:tasks.workunit.client.0.smithi073.stdout:7/666: getdents d0/dc/d67/d99 0 2024-04-19T02:18:33.781 INFO:tasks.workunit.client.0.smithi073.stdout:7/667: fdatasync d0/d3/f66 0 2024-04-19T02:18:33.783 INFO:tasks.workunit.client.0.smithi073.stdout:7/668: chown d0/d28/d63/f7f 403 1 2024-04-19T02:18:33.784 INFO:tasks.workunit.client.0.smithi073.stdout:8/656: mknod d14/d27/dcc/cdc 0 2024-04-19T02:18:33.784 INFO:tasks.workunit.client.0.smithi073.stdout:8/657: dread - d14/d27/d85/d9b/fd2 zero size 2024-04-19T02:18:33.784 INFO:tasks.workunit.client.0.smithi073.stdout:9/611: dwrite d0/fa1 [0,4194304] 0 2024-04-19T02:18:33.785 INFO:tasks.workunit.client.0.smithi073.stdout:9/612: dread - d0/d35/fbb zero size 2024-04-19T02:18:33.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/605: rmdir db/d1c/d54/d8b/dab 39 2024-04-19T02:18:33.785 INFO:tasks.workunit.client.0.smithi073.stdout:6/571: fsync d8/de/d22/f37 0 2024-04-19T02:18:33.786 INFO:tasks.workunit.client.0.smithi073.stdout:8/658: rmdir d14/d27/d85 39 2024-04-19T02:18:33.786 INFO:tasks.workunit.client.0.smithi073.stdout:7/669: mkdir d0/dc/d39/d50/da3/dc9 0 2024-04-19T02:18:33.787 INFO:tasks.workunit.client.0.smithi073.stdout:7/670: write d0/f7 [2528405,17161] 0 2024-04-19T02:18:33.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/679: dwrite d5/d10/d14/d18/d3e/fef [0,4194304] 0 2024-04-19T02:18:33.787 INFO:tasks.workunit.client.0.smithi073.stdout:5/712: getdents d0/d2d 0 2024-04-19T02:18:33.787 INFO:tasks.workunit.client.0.smithi073.stdout:9/613: fsync d0/df/d16/d19/d38/d5d/d45/f6a 0 2024-04-19T02:18:33.787 INFO:tasks.workunit.client.0.smithi073.stdout:6/572: fsync d8/de/d58/f33 0 2024-04-19T02:18:33.788 INFO:tasks.workunit.client.0.smithi073.stdout:8/659: getdents d14/d27/d29/d69 0 2024-04-19T02:18:33.789 INFO:tasks.workunit.client.0.smithi073.stdout:7/671: creat d0/dc/d33/d5d/db0/fca x:0 0 0 2024-04-19T02:18:33.789 INFO:tasks.workunit.client.0.smithi073.stdout:6/573: fdatasync d8/de/f28 0 2024-04-19T02:18:33.789 INFO:tasks.workunit.client.0.smithi073.stdout:9/614: unlink d0/df/d1d/c71 0 2024-04-19T02:18:33.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/680: symlink d5/d10/d14/d18/d3e/d2d/d63/lf0 0 2024-04-19T02:18:33.790 INFO:tasks.workunit.client.0.smithi073.stdout:6/574: creat d8/d71/d75/fb8 x:0 0 0 2024-04-19T02:18:33.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/615: readlink d0/df/d16/d19/d38/d5d/d76/d7d/lc5 0 2024-04-19T02:18:33.790 INFO:tasks.workunit.client.0.smithi073.stdout:2/681: sync 2024-04-19T02:18:33.790 INFO:tasks.workunit.client.0.smithi073.stdout:7/672: fsync d0/dc/d33/f35 0 2024-04-19T02:18:33.792 INFO:tasks.workunit.client.0.smithi073.stdout:7/673: rename d0/dc/l23 to d0/dc/d33/d36/d7b/d93/d97/lcb 0 2024-04-19T02:18:33.793 INFO:tasks.workunit.client.0.smithi073.stdout:2/682: mkdir d5/d10/d29/d66/d67/df1 0 2024-04-19T02:18:33.793 INFO:tasks.workunit.client.0.smithi073.stdout:1/606: dwrite db/d3e/f9f [0,4194304] 0 2024-04-19T02:18:33.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/683: readlink d5/d10/d29/d66/d83/dbc/lca 0 2024-04-19T02:18:33.794 INFO:tasks.workunit.client.0.smithi073.stdout:7/674: symlink d0/dc/d39/d50/dbc/lcc 0 2024-04-19T02:18:33.794 INFO:tasks.workunit.client.0.smithi073.stdout:1/607: fdatasync db/d1c/f34 0 2024-04-19T02:18:33.794 INFO:tasks.workunit.client.0.smithi073.stdout:7/675: fsync d0/d28/d63/f9e 0 2024-04-19T02:18:33.795 INFO:tasks.workunit.client.0.smithi073.stdout:2/684: chown d5/d10/d14/d18/d3e/d2d/d63/c78 741745 1 2024-04-19T02:18:33.795 INFO:tasks.workunit.client.0.smithi073.stdout:7/676: chown d0/dc/d84 246 1 2024-04-19T02:18:33.796 INFO:tasks.workunit.client.0.smithi073.stdout:1/608: mknod db/d1c/d54/d8b/dab/cdb 0 2024-04-19T02:18:33.797 INFO:tasks.workunit.client.0.smithi073.stdout:6/575: dwrite d8/de/f96 [0,4194304] 0 2024-04-19T02:18:33.797 INFO:tasks.workunit.client.0.smithi073.stdout:1/609: fsync db/d3e/fd8 0 2024-04-19T02:18:33.797 INFO:tasks.workunit.client.0.smithi073.stdout:6/576: sync 2024-04-19T02:18:33.798 INFO:tasks.workunit.client.0.smithi073.stdout:7/677: rename d0/d28/f4b to d0/dc/d33/fcd 0 2024-04-19T02:18:33.798 INFO:tasks.workunit.client.0.smithi073.stdout:1/610: unlink f6 0 2024-04-19T02:18:33.798 INFO:tasks.workunit.client.0.smithi073.stdout:1/611: fdatasync db/d1c/f39 0 2024-04-19T02:18:33.798 INFO:tasks.workunit.client.0.smithi073.stdout:7/678: chown d0/d3/dbb/ca0 0 1 2024-04-19T02:18:33.799 INFO:tasks.workunit.client.0.smithi073.stdout:6/577: mknod d8/d71/d7d/dab/daf/cb9 0 2024-04-19T02:18:33.799 INFO:tasks.workunit.client.0.smithi073.stdout:2/685: fdatasync d5/d10/f7d 0 2024-04-19T02:18:33.800 INFO:tasks.workunit.client.0.smithi073.stdout:4/654: dread da/d27/d2c/f30 [0,4194304] 0 2024-04-19T02:18:33.801 INFO:tasks.workunit.client.0.smithi073.stdout:2/686: rename d5/d10/d29/d66/d67/f43 to d5/d10/d14/d18/d3e/de1/ff2 0 2024-04-19T02:18:33.802 INFO:tasks.workunit.client.0.smithi073.stdout:9/616: read d0/df/f21 [2825481,47884] 0 2024-04-19T02:18:33.803 INFO:tasks.workunit.client.0.smithi073.stdout:2/687: mknod d5/d10/d29/cf3 0 2024-04-19T02:18:33.804 INFO:tasks.workunit.client.0.smithi073.stdout:9/617: symlink d0/df/d60/db0/ld5 0 2024-04-19T02:18:33.806 INFO:tasks.workunit.client.0.smithi073.stdout:6/578: dwrite d8/de/d7f/fb7 [0,4194304] 0 2024-04-19T02:18:33.806 INFO:tasks.workunit.client.0.smithi073.stdout:9/618: write d0/d81/f51 [4246921,56397] 0 2024-04-19T02:18:33.806 INFO:tasks.workunit.client.0.smithi073.stdout:4/655: dread da/f11 [0,4194304] 0 2024-04-19T02:18:33.806 INFO:tasks.workunit.client.0.smithi073.stdout:7/679: dwrite d0/dc/d67/f65 [0,4194304] 0 2024-04-19T02:18:33.807 INFO:tasks.workunit.client.0.smithi073.stdout:2/688: link d5/d10/d14/d18/c7f d5/d10/d29/d42/cf4 0 2024-04-19T02:18:33.807 INFO:tasks.workunit.client.0.smithi073.stdout:2/689: write d5/d10/d14/db6/fe6 [234551,6790] 0 2024-04-19T02:18:33.807 INFO:tasks.workunit.client.0.smithi073.stdout:4/656: readlink da/d27/d36/d4d/d7b/la3 0 2024-04-19T02:18:33.808 INFO:tasks.workunit.client.0.smithi073.stdout:6/579: creat d8/d4b/d93/fba x:0 0 0 2024-04-19T02:18:33.808 INFO:tasks.workunit.client.0.smithi073.stdout:2/690: dread - d5/d10/d14/d18/d3e/d2d/f8e zero size 2024-04-19T02:18:33.809 INFO:tasks.workunit.client.0.smithi073.stdout:2/691: fsync d5/d10/d14/d18/d3e/d51/f79 0 2024-04-19T02:18:33.809 INFO:tasks.workunit.client.0.smithi073.stdout:4/657: mknod da/d27/d2c/d80/dcf/ddd/d95/ce9 0 2024-04-19T02:18:33.810 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:33.807+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:33.810 INFO:tasks.workunit.client.0.smithi073.stdout:2/692: unlink d5/d10/d29/d42/ld9 0 2024-04-19T02:18:33.810 INFO:tasks.workunit.client.0.smithi073.stdout:4/658: mknod da/d27/d3a/d50/d9c/cea 0 2024-04-19T02:18:33.812 INFO:tasks.workunit.client.0.smithi073.stdout:7/680: dread - d0/dc/d67/d2a/d51/d7a/f95 zero size 2024-04-19T02:18:33.812 INFO:tasks.workunit.client.0.smithi073.stdout:2/693: link d5/d10/fec d5/d10/d29/dd4/ff5 0 2024-04-19T02:18:33.813 INFO:tasks.workunit.client.0.smithi073.stdout:4/659: write da/d27/d1b/d1d/f42 [5104295,104217] 0 2024-04-19T02:18:33.813 INFO:tasks.workunit.client.0.smithi073.stdout:3/727: dread d3/d6/db/f2d [0,4194304] 0 2024-04-19T02:18:33.814 INFO:tasks.workunit.client.0.smithi073.stdout:9/619: dwrite d0/d35/fc6 [0,4194304] 0 2024-04-19T02:18:33.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/620: creat d0/df/d60/db0/fd6 x:0 0 0 2024-04-19T02:18:33.815 INFO:tasks.workunit.client.0.smithi073.stdout:3/728: creat d3/d6/db/d3a/d38/d43/ff0 x:0 0 0 2024-04-19T02:18:33.816 INFO:tasks.workunit.client.0.smithi073.stdout:9/621: creat d0/df/d60/fd7 x:0 0 0 2024-04-19T02:18:33.817 INFO:tasks.workunit.client.0.smithi073.stdout:3/729: symlink d3/d6/db/d3a/lf1 0 2024-04-19T02:18:33.817 INFO:tasks.workunit.client.0.smithi073.stdout:3/730: sync 2024-04-19T02:18:33.820 INFO:tasks.workunit.client.0.smithi073.stdout:9/622: mkdir d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8 0 2024-04-19T02:18:33.820 INFO:tasks.workunit.client.0.smithi073.stdout:6/580: dwrite d8/de/f1e [4194304,4194304] 0 2024-04-19T02:18:33.821 INFO:tasks.workunit.client.0.smithi073.stdout:6/581: chown d8/de/d58/d63 494124 1 2024-04-19T02:18:33.821 INFO:tasks.workunit.client.0.smithi073.stdout:7/681: dwrite d0/d3/f74 [0,4194304] 0 2024-04-19T02:18:33.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/623: creat d0/d35/fd9 x:0 0 0 2024-04-19T02:18:33.823 INFO:tasks.workunit.client.0.smithi073.stdout:4/660: dwrite da/d27/d3a/d50/d9c/fc6 [4194304,4194304] 0 2024-04-19T02:18:33.823 INFO:tasks.workunit.client.0.smithi073.stdout:3/731: write d3/d6/db/d3a/d38/d89/d94/fa9 [1188990,2933] 0 2024-04-19T02:18:33.823 INFO:tasks.workunit.client.0.smithi073.stdout:9/624: mkdir d0/d81/dda 0 2024-04-19T02:18:33.823 INFO:tasks.workunit.client.0.smithi073.stdout:4/661: stat da/d27/d1b/d26/c8a 0 2024-04-19T02:18:33.823 INFO:tasks.workunit.client.0.smithi073.stdout:3/732: mkdir d3/d6/db/d3a/d38/d6f/df2 0 2024-04-19T02:18:33.824 INFO:tasks.workunit.client.0.smithi073.stdout:7/682: mkdir d0/dc/d33/d36/dce 0 2024-04-19T02:18:33.824 INFO:tasks.workunit.client.0.smithi073.stdout:4/662: creat da/d27/feb x:0 0 0 2024-04-19T02:18:33.825 INFO:tasks.workunit.client.0.smithi073.stdout:7/683: write d0/f7 [4955114,125630] 0 2024-04-19T02:18:33.825 INFO:tasks.workunit.client.0.smithi073.stdout:0/640: chown d7/d14/d17/d1a/d20/d50 37 1 2024-04-19T02:18:33.825 INFO:tasks.workunit.client.0.smithi073.stdout:0/641: stat d7/f67 0 2024-04-19T02:18:33.826 INFO:tasks.workunit.client.0.smithi073.stdout:4/663: dread - da/d27/d2c/da6/fcd zero size 2024-04-19T02:18:33.826 INFO:tasks.workunit.client.0.smithi073.stdout:7/684: sync 2024-04-19T02:18:33.826 INFO:tasks.workunit.client.0.smithi073.stdout:4/664: fdatasync da/d27/d3a/d49/fc4 0 2024-04-19T02:18:33.827 INFO:tasks.workunit.client.0.smithi073.stdout:7/685: rename d0/d3/f7e to d0/dc/d33/d36/dce/fcf 0 2024-04-19T02:18:33.827 INFO:tasks.workunit.client.0.smithi073.stdout:5/713: write d0/d1d/d25/d35/f49 [884685,84731] 0 2024-04-19T02:18:33.827 INFO:tasks.workunit.client.0.smithi073.stdout:7/686: chown d0/dc/d39/l57 318586210 1 2024-04-19T02:18:33.828 INFO:tasks.workunit.client.0.smithi073.stdout:4/665: rename da/d27/d1b/d8c/db7/fcb to da/d27/d1b/d1d/d8d/fec 0 2024-04-19T02:18:33.828 INFO:tasks.workunit.client.0.smithi073.stdout:5/714: unlink d0/d1d/d25/d37/caa 0 2024-04-19T02:18:33.829 INFO:tasks.workunit.client.0.smithi073.stdout:5/715: sync 2024-04-19T02:18:33.829 INFO:tasks.workunit.client.0.smithi073.stdout:1/612: write db/d3e/fd8 [87446,8611] 0 2024-04-19T02:18:33.829 INFO:tasks.workunit.client.0.smithi073.stdout:7/687: rename d0/dc/d67/d2a/c55 to d0/dc/d39/d50/cd0 0 2024-04-19T02:18:33.830 INFO:tasks.workunit.client.0.smithi073.stdout:5/716: link d0/c31 d0/d1d/ce4 0 2024-04-19T02:18:33.830 INFO:tasks.workunit.client.0.smithi073.stdout:1/613: rename db/d1c/f3c to db/d1c/d78/d8c/fdc 0 2024-04-19T02:18:33.832 INFO:tasks.workunit.client.0.smithi073.stdout:7/688: chown d0/dc/d33/d36/d7b/d93/lbf 154327 1 2024-04-19T02:18:33.832 INFO:tasks.workunit.client.0.smithi073.stdout:5/717: fdatasync d0/d1d/d24/d61/f7c 0 2024-04-19T02:18:33.832 INFO:tasks.workunit.client.0.smithi073.stdout:3/733: dwrite d3/d6/f22 [0,4194304] 0 2024-04-19T02:18:33.832 INFO:tasks.workunit.client.0.smithi073.stdout:1/614: mkdir db/d1c/d81/d86/ddd 0 2024-04-19T02:18:33.833 INFO:tasks.workunit.client.0.smithi073.stdout:7/689: chown d0/d3/dbb/f96 160585578 1 2024-04-19T02:18:33.833 INFO:tasks.workunit.client.0.smithi073.stdout:1/615: creat db/d1c/d78/dcf/fde x:0 0 0 2024-04-19T02:18:33.834 INFO:tasks.workunit.client.0.smithi073.stdout:3/734: write d3/d6/db/f66 [1277703,939] 0 2024-04-19T02:18:33.835 INFO:tasks.workunit.client.0.smithi073.stdout:1/616: write db/d1c/d81/d86/dae/fcd [3782239,25981] 0 2024-04-19T02:18:33.835 INFO:tasks.workunit.client.0.smithi073.stdout:4/666: dwrite da/d27/d1b/d1d/d8d/f78 [0,4194304] 0 2024-04-19T02:18:33.835 INFO:tasks.workunit.client.0.smithi073.stdout:3/735: chown d3/d6/db/d16/d75/f60 7 1 2024-04-19T02:18:33.837 INFO:tasks.workunit.client.0.smithi073.stdout:3/736: link d3/d6/db/d23/f27 d3/d6/db/d23/ff3 0 2024-04-19T02:18:33.841 INFO:tasks.workunit.client.0.smithi073.stdout:4/667: dwrite da/d27/d2c/da6/fcd [0,4194304] 0 2024-04-19T02:18:33.846 INFO:tasks.workunit.client.0.smithi073.stdout:4/668: rename da/d27/d3a/ce0 to da/d27/d2c/dc1/ced 0 2024-04-19T02:18:33.846 INFO:tasks.workunit.client.0.smithi073.stdout:3/737: dwrite d3/d6/db/d23/f27 [4194304,4194304] 0 2024-04-19T02:18:33.846 INFO:tasks.workunit.client.0.smithi073.stdout:4/669: readlink da/d27/d2c/dc1/lda 0 2024-04-19T02:18:33.846 INFO:tasks.workunit.client.0.smithi073.stdout:4/670: link da/d27/f6f da/d27/d2c/d80/fee 0 2024-04-19T02:18:33.846 INFO:tasks.workunit.client.0.smithi073.stdout:3/738: mkdir d3/d6/db/d3a/d38/d57/d88/df4 0 2024-04-19T02:18:33.846 INFO:tasks.workunit.client.0.smithi073.stdout:4/671: mkdir da/d27/d3a/d97/def 0 2024-04-19T02:18:33.846 INFO:tasks.workunit.client.0.smithi073.stdout:3/739: chown d3/d6/db/d3a/d5f/da7/dd7/fd8 533507846 1 2024-04-19T02:18:33.847 INFO:tasks.workunit.client.0.smithi073.stdout:3/740: symlink d3/d6/db/d3a/d38/d43/d4e/ddd/lf5 0 2024-04-19T02:18:33.847 INFO:tasks.workunit.client.0.smithi073.stdout:3/741: sync 2024-04-19T02:18:33.848 INFO:tasks.workunit.client.0.smithi073.stdout:3/742: rmdir d3/d6/db/d16/d7c 39 2024-04-19T02:18:33.848 INFO:tasks.workunit.client.0.smithi073.stdout:3/743: chown d3 16704069 1 2024-04-19T02:18:33.849 INFO:tasks.workunit.client.0.smithi073.stdout:2/694: dwrite f3 [4194304,4194304] 0 2024-04-19T02:18:33.850 INFO:tasks.workunit.client.0.smithi073.stdout:2/695: chown d5/d10/d29/d66/d67/fee 1030255572 1 2024-04-19T02:18:33.850 INFO:tasks.workunit.client.0.smithi073.stdout:3/744: mkdir d3/d6/db/d3a/d38/d57/df6 0 2024-04-19T02:18:33.851 INFO:tasks.workunit.client.0.smithi073.stdout:3/745: write d3/d6/db/d3a/d38/d89/d94/f35 [1065187,113887] 0 2024-04-19T02:18:33.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/672: dwrite da/d27/d1b/d1d/d8d/fec [0,4194304] 0 2024-04-19T02:18:33.852 INFO:tasks.workunit.client.0.smithi073.stdout:3/746: write d3/d6/db/d3a/d38/d89/d94/fc5 [427209,29603] 0 2024-04-19T02:18:33.852 INFO:tasks.workunit.client.0.smithi073.stdout:4/673: creat da/d27/d3a/d49/ff0 x:0 0 0 2024-04-19T02:18:33.853 INFO:tasks.workunit.client.0.smithi073.stdout:4/674: sync 2024-04-19T02:18:33.853 INFO:tasks.workunit.client.0.smithi073.stdout:3/747: readlink d3/d6/db/d23/lcc 0 2024-04-19T02:18:33.854 INFO:tasks.workunit.client.0.smithi073.stdout:6/582: truncate d8/d4b/d93/f5d 50894 0 2024-04-19T02:18:33.855 INFO:tasks.workunit.client.0.smithi073.stdout:6/583: mknod d8/de/d7f/cbb 0 2024-04-19T02:18:33.857 INFO:tasks.workunit.client.0.smithi073.stdout:2/696: dwrite d5/d10/d29/d42/f68 [0,4194304] 0 2024-04-19T02:18:33.857 INFO:tasks.workunit.client.0.smithi073.stdout:2/697: sync 2024-04-19T02:18:33.861 INFO:tasks.workunit.client.0.smithi073.stdout:2/698: fsync d5/d10/d29/d66/d67/f86 0 2024-04-19T02:18:33.862 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.555735406, 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:33.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.509473888999999, 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:33.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.496532222999999, 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.873 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.496470672000001, 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:33.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.495519603999998, 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:33.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:33.889 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.488379277, 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:33.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:33.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.480547174000002, 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.895 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:33.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:33.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.450481708000002, 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.900 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:33.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:33.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.905 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.447939860999998, 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:33.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.911 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5592238189999996, 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:33.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:33.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.3612390259999998, 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:33.917 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.920 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:33.916+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:33.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:33.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:33.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2627151440000004, 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.925 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:33.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:33.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2588742789999996, 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:33.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.1008516720000001, 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.937 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:33.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.942 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0716283369999999, 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:33.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:33.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0524554650000004, 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:33.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.953 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0486870250000004, 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:33.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:33.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10813 4.19 4:9ac2b2ed:::10000003115.00000001:head [write 1940318~127702] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.959 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.818280+0000", 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0428445020000003, 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.094513227000000005, 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10813 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.818280+0000", 2024-04-19T02:18:33.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.818280+0000", 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.818280+0000", 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.818348+0000", 2024-04-19T02:18:33.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8711e-05 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.818357+0000", 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3890000000000005e-06 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.818363+0000", 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.161e-06 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.859010+0000", 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040647441999999999 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.859127+0000", 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000117269 2024-04-19T02:18:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.859290+0000", 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016276299999999999 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912423+0000", 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.053132537000000001 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912752+0000", 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032945899999999999 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912776+0000", 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.391e-05 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912793+0000", 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7175000000000001e-05 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.965 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.7270023139999999, 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.966 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:33.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:33.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:33.971 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.6672632539999999, 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:33.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:33.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:33.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:33.976 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:33.977 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:33.995 INFO:tasks.workunit.client.0.smithi073.stdout:3/748: write d3/d6/db/d1a/f7d [1371881,43313] 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:3/749: fsync d3/d6/db/d3a/d38/d43/ff0 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/660: dread d14/f19 [0,4194304] 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/661: stat d14/d27/d29/d31/f3e 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:3/750: dwrite d3/d6/f6d [0,4194304] 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/662: mkdir d14/d15/d17/d48/d89/ddd 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:3/751: read d3/d6/db/d1a/f7d [135699,48163] 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/663: write d14/d27/d4c/f76 [677000,85495] 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:3/752: creat d3/d6/da6/ff7 x:0 0 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/664: rename d14/d27/d29/d31/fa3 to d14/d15/d17/d8d/fde 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/665: chown d14/d15/d17/d48/d89/lc2 254420 1 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/666: read - d14/d27/fb6 zero size 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/667: creat d14/d15/d17/d48/d89/d97/fdf x:0 0 0 2024-04-19T02:18:33.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/668: chown d14/d27/d29/d69/cb5 1364 1 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/669: write d14/d27/da4/fc3 [982164,37651] 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/670: fsync d14/d27/d4c/f6b 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:5/718: dread d0/f13 [0,4194304] 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/671: fsync d14/d27/d50/f6f 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/672: symlink d14/d15/le0 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/673: unlink d14/d27/d85/d9a/ld9 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/674: dread - d14/d15/d17/f4a zero size 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/675: mkdir d14/d27/d29/de1 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/676: chown d14/d27/d29/l70 131 1 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/677: creat d14/d15/d17/fe2 x:0 0 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/678: dwrite d14/d27/d4c/f4f [0,4194304] 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/679: write d14/d27/d4c/d75/fb8 [5016444,123572] 0 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/680: chown d14/d15/d17/d48/d89/dd6 1737509011 1 2024-04-19T02:18:33.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/681: rmdir d14/d27/d4c/d75 39 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:1/617: dread db/d41/f53 [0,4194304] 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:8/682: symlink d14/d15/d17/d48/le3 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/690: dread d0/d28/d63/f7f [0,4194304] 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:5/719: dread d0/d1d/d24/d61/fb1 [0,4194304] 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:8/683: rename d14/d15/c54 to d14/d27/dcc/ce4 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/691: mknod d0/dc/d67/cd1 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/692: fsync d0/dc/d39/d50/f86 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:5/720: fdatasync d0/d1d/d25/d37/d71/dd6/f92 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:8/684: write d14/d27/d4c/d75/dbb/fc7 [658535,57338] 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/693: mknod d0/dc/d33/cd2 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:6/584: truncate d8/d4b/d93/f5b 2558081 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:8/685: creat d14/d87/fe5 x:0 0 0 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:6/585: chown d8 7 1 2024-04-19T02:18:33.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/694: chown d0/dc/d67/d15/c42 258899 1 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:7/695: sync 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:2/699: write d5/d10/d29/d66/d67/d72/f12 [280024,105668] 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:8/686: mknod d14/d27/ce6 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:7/696: rename d0/dc/d33/d36/cb6 to d0/dc/d33/d36/d7b/cd3 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:8/687: fsync d14/d27/d4c/d75/f4b 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:2/700: truncate d5/d10/d53/f93 1746058 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:2/701: symlink d5/d10/d14/d18/d98/lf6 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:3/753: dwrite d3/d6/db/d3a/d38/d40/f95 [0,4194304] 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:3/754: chown d3/d6/db/d3a/d38/d6f/df2 1331948 1 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:7/697: dwrite d0/dc/d67/f31 [0,4194304] 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:3/755: fsync d3/d6/db/d23/f27 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:5/721: truncate d0/d1d/d25/d35/d39/f66 6053355 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:6/586: write d8/d4b/d93/f4a [1144919,9832] 0 2024-04-19T02:18:33.999 INFO:tasks.workunit.client.0.smithi073.stdout:8/688: dwrite d14/d15/f7e [0,4194304] 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:6/587: chown d8/d71/d7d/c9d 0 1 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:7/698: symlink d0/dc/d39/d50/ld4 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:3/756: rename d3/d6/cbd to d3/cf8 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:5/722: stat d0/d1d/d25/d35/d39/f86 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:8/689: mknod d14/d27/d29/d31/ce7 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:7/699: rmdir d0/dc/d33/d5d 39 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:5/723: truncate d0/f3b 405517 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:3/757: mknod d3/d6/db/d16/d52/cf9 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:6/588: getdents d8/d71/d75 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:5/724: stat d0/d1d/d25/d35/d88/fc3 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:0/642: dread d7/d14/d17/d1a/f39 [0,4194304] 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:7/700: symlink d0/dc/d39/d40/ld5 0 2024-04-19T02:18:34.000 INFO:tasks.workunit.client.0.smithi073.stdout:2/702: write d5/d10/d14/d18/d3e/f62 [676578,112024] 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/643: rename d7/d14/d17/d69/dbf to d7/d6d/dc7 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:3/758: mkdir d3/d6/db/d3a/d38/d57/d88/df4/dfa 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:5/725: creat d0/d1d/d25/d35/d39/fe5 x:0 0 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/701: mknod d0/dc/d33/d36/dce/cd6 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:2/703: symlink d5/d10/d14/d2e/da0/dc0/lf7 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:3/759: dread - d3/d6/db/d3a/d5f/da7/dd7/fd8 zero size 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/644: write d7/d14/d17/d1a/f22 [1681268,112871] 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:3/760: mkdir d3/d6/db/d3a/d38/d57/d88/dc2/dfb 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/702: link d0/dc/d39/d50/f6b d0/dc/d33/d36/d7b/d93/fd7 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:3/761: getdents d3/d6/db/d16 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/703: read d0/dc/d39/d50/f8c [767324,17495] 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/704: readlink d0/dc/d39/d50/dbc/lc1 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:3/762: creat d3/ffc x:0 0 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/705: read d0/d28/d63/f7f [706476,100320] 0 2024-04-19T02:18:34.001 INFO:tasks.workunit.client.0.smithi073.stdout:3/763: chown d3/d6/db/d3a/d38/d6f/fe1 8 1 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:7/706: symlink d0/dc/d67/d2a/ld8 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:3/764: mkdir d3/d6/db/d3a/d38/d6f/daf/dfd 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/645: dwrite d7/faa [0,4194304] 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:3/765: readlink d3/d6/db/d1a/l3c 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/646: mknod d7/d14/d17/d1a/d8d/cc8 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:9/625: dread d0/f1f [0,4194304] 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/647: getdents d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/648: write d7/d14/d17/d1a/f22 [1856058,39088] 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:7/707: dwrite d0/f6a [0,4194304] 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/649: fsync d7/d6d/f9b 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/650: write d7/faa [2299444,12051] 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:7/708: mkdir d0/dc/d67/d2a/d51/dd9 0 2024-04-19T02:18:34.002 INFO:tasks.workunit.client.0.smithi073.stdout:6/589: dwrite d8/de/d58/d63/d82/f83 [4194304,4194304] 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/590: rmdir d8/de/d7f/da5/dae 39 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/591: fdatasync d8/d4b/d8f/f95 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/592: creat d8/d4b/d8f/fbc x:0 0 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:7/709: dwrite d0/dc/d67/d15/d8f/f9b [0,4194304] 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:7/710: readlink d0/d28/d63/lac 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/593: truncate d8/de/d7f/fa0 147536 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/594: creat d8/d71/d7d/fbd x:0 0 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:3/766: getdents d3/d6/db/d3a/d38/d6f/daf 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:2/704: dwrite d5/d10/d29/dd4/ff5 [0,4194304] 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/726: dwrite d0/ff [0,4194304] 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:3/767: stat d3/d6/db/d3a/d38/d6f/fe1 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:2/705: mknod d5/d10/d14/cf8 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:3/768: fdatasync d3/d6/db/d23/f27 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/727: creat d0/d1d/d90/da0/dbb/fe6 x:0 0 0 2024-04-19T02:18:34.003 INFO:tasks.workunit.client.0.smithi073.stdout:8/690: dread d14/d27/f30 [0,4194304] 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/595: dwrite d8/de/f47 [4194304,4194304] 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:5/728: write d0/f1b [4711749,53836] 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/691: creat d14/d15/d17/da1/fe8 x:0 0 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:3/769: read - d3/d6/db/d3a/d38/d89/d94/d7b/fe5 zero size 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:2/706: write d5/d10/d14/d18/d3e/d2d/d63/f9f [1445068,114632] 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:5/729: symlink d0/d2d/dac/le7 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/692: creat d14/d15/d17/d48/fe9 x:0 0 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:3/770: fsync d3/d6/db/f4d 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/596: getdents d8/de/d7f 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:5/730: write d0/d1d/d1e/f40 [1248562,95279] 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:3/771: stat d3/d6/db/d16/d52 0 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:2/707: sync 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/597: sync 2024-04-19T02:18:34.004 INFO:tasks.workunit.client.0.smithi073.stdout:3/772: chown d3/d6/db/d3a/d38/d57/c9c 17 1 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:2/708: write d5/d10/d14/d18/d98/fc6 [1012518,38161] 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/773: mknod d3/d6/db/d3a/d5f/dca/dde/cfe 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:8/693: dread d14/d15/f7e [0,4194304] 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/774: fsync d3/d6/f6d 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:8/694: chown d14/d15/d17/d99 0 1 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/775: dread - d3/d6/da6/ff7 zero size 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/618: dread db/d1c/d81/d83/db8/fd7 [0,4194304] 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/619: stat db/f65 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:8/695: creat d14/d27/d29/d31/d34/fea x:0 0 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/620: stat db/d1c/l37 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/776: stat d3/d6/db/d3a/d38/d43/d4e/feb 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:8/696: chown d14/d15/d17/da1/ca6 1636217995 1 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/777: getdents d3/d6/db/d3a/d38/d57/d88 0 2024-04-19T02:18:34.005 INFO:tasks.workunit.client.0.smithi073.stdout:4/675: dread da/d27/d2c/d80/dcf/ddd/f40 [0,4194304] 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/709: dwrite d5/f64 [4194304,4194304] 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:3/778: chown d3/d6/db/d3a/d38/d89/d94/f2e 7 1 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:4/676: fdatasync da/d27/d1b/d26/d2a/d46/fb4 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:4/677: creat da/d27/d3a/ff1 x:0 0 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:3/779: rename d3/d6/db/d16/c86 to d3/d6/db/d3a/d38/d89/d94/cff 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:4/678: sync 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:4/679: symlink da/d27/d1b/d1d/d8d/d84/lf2 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/710: dread d5/d10/d14/d18/d3e/d2d/d63/fd7 [0,4194304] 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:4/680: unlink da/d27/d2c/l5c 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/711: creat d5/d10/d29/d66/d67/df1/ff9 x:0 0 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/712: write d5/d10/d29/d42/fb4 [2810677,94902] 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:7/711: fdatasync d0/f6a 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:3/780: dwrite d3/d6/db/d3a/d38/d43/d4e/f39 [0,4194304] 0 2024-04-19T02:18:34.006 INFO:tasks.workunit.client.0.smithi073.stdout:7/712: unlink d0/dc/d67/d15/l5f 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:7/713: unlink d0/d28/c41 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/781: write d3/d6/db/f45 [3701063,59428] 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:7/714: getdents d0/dc/d67/d99 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/782: creat d3/d6/db/d3a/f100 x:0 0 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/713: dwrite d5/d10/d14/db6/fbe [0,4194304] 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/714: mkdir d5/d10/d14/d2e/dfa 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/783: mkdir d3/d6/db/d3a/d38/d6f/daf/dfd/d101 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/715: write d5/d10/d14/d18/d3e/f3c [823692,83341] 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/784: creat d3/d6/db/d3a/d5f/da7/f102 x:0 0 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/716: fdatasync d5/d10/d14/d18/fbd 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/785: fsync d3/d6/db/f66 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/786: readlink d3/d6/db/d3a/ldb 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/717: fdatasync d5/d10/d14/d18/d3e/f85 0 2024-04-19T02:18:34.007 INFO:tasks.workunit.client.0.smithi073.stdout:6/598: dread d8/d71/d75/f8a [0,4194304] 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/787: mknod d3/d6/db/d3a/d38/d57/d88/df4/dfa/c103 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:7/715: dwrite d0/d28/fc7 [0,4194304] 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:0/651: dread d7/d14/d17/d1a/d20/f7a [0,4194304] 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/788: creat d3/d6/db/d3a/d38/d43/d4e/f104 x:0 0 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:7/716: readlink d0/d3/dbb/laa 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:0/652: mkdir d7/d14/d17/d1a/d21/dc9 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:2/718: dwrite d5/d10/d29/fd8 [0,4194304] 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:0/653: readlink d7/d14/d81/la6 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:7/717: rename d0/d28/d63/f82 to d0/dc/d67/fda 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:2/719: creat d5/ffb x:0 0 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:0/654: chown d7/d14/d17/d70/c77 4529872 1 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:2/720: unlink d5/d10/d14/d18/d3e/f85 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:2/721: write d5/d10/d29/d66/d83/fcd [4085877,32583] 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:6/599: dwrite d8/fa4 [0,4194304] 0 2024-04-19T02:18:34.008 INFO:tasks.workunit.client.0.smithi073.stdout:6/600: mknod d8/d4b/d93/d86/cbe 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:8/697: dread d14/d27/d50/faf [0,4194304] 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:8/698: fdatasync d14/d15/d17/f2c 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:6/601: creat d8/de/d22/fbf x:0 0 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:5/731: truncate d0/f4f 1827307 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:0/655: dwrite d7/d14/d17/d1a/fb1 [0,4194304] 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:7/718: read d0/dc/d67/d2a/f2b [1138331,28745] 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:8/699: mknod d14/d27/d4c/ceb 0 2024-04-19T02:18:34.009 INFO:tasks.workunit.client.0.smithi073.stdout:5/732: chown d0/d2d/f60 1848746 1 2024-04-19T02:18:34.012 INFO:tasks.workunit.client.0.smithi073.stdout:6/602: rename d8/de/f96 to d8/fc0 0 2024-04-19T02:18:34.012 INFO:tasks.workunit.client.0.smithi073.stdout:1/621: dread db/d1c/d78/d8c/dd5/d50/d62/f79 [0,4194304] 0 2024-04-19T02:18:34.012 INFO:tasks.workunit.client.0.smithi073.stdout:9/626: dread d0/df/d16/d19/d38/d5d/d45/f7a [0,4194304] 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:0/656: mknod d7/d6d/dbd/cca 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:7/719: truncate d0/d3/f46 4256705 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:1/622: stat db/d1c/d78/dcf 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/603: fdatasync d8/d4b/d93/f3d 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:2/722: dwrite d5/d10/fa7 [0,4194304] 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:7/720: symlink d0/dc/d39/d50/da3/ldb 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/604: creat d8/de/d22/fc1 x:0 0 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:9/627: write d0/df/d16/d19/d38/d5d/d5e/f8d [748339,27181] 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:1/623: rename db/d1c/f5d to db/d1c/d78/fdf 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:0/657: truncate d7/d14/d17/d1a/d20/f48 445374 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:2/723: symlink d5/d10/d29/dd4/lfc 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/605: mknod d8/d4b/cc2 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/606: stat d8/de/d7f/cbb 0 2024-04-19T02:18:34.013 INFO:tasks.workunit.client.0.smithi073.stdout:9/628: chown d0/df/d16/d19/d38/d5d/d76/d7d/d88/fac 1576 1 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:1/624: symlink db/d1c/d78/d8c/dd5/d50/d62/dc0/le0 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:6/607: mkdir d8/de/d7f/da5/dae/dc3 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/629: stat d0/df/d16/d19/db1/d2c/d2e 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:6/608: symlink d8/d71/d7d/dab/daf/lc4 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:1/625: truncate db/d1c/d78/d8c/dd5/f61 990478 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/630: write d0/d35/f4c [4027495,8037] 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:7/721: dwrite d0/dc/d33/d36/d7b/f85 [0,4194304] 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:4/681: dread da/d27/d1b/d1d/d8d/f98 [0,4194304] 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:1/626: unlink db/d1c/c5b 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:6/609: rename d8/d71/d7d/c99 to d8/d4b/cc5 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/631: stat d0/df/d16/d19/d38/d5d/d5e/fa7 0 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:1/627: read - db/d1c/d78/fb2 zero size 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:7/722: dread - d0/d28/d63/fa2 zero size 2024-04-19T02:18:34.014 INFO:tasks.workunit.client.0.smithi073.stdout:4/682: chown da/d27/d1b/l35 5 1 2024-04-19T02:18:34.015 INFO:tasks.workunit.client.0.smithi073.stdout:0/658: dwrite d7/d14/d17/d70/fb9 [0,4194304] 0 2024-04-19T02:18:34.015 INFO:tasks.workunit.client.0.smithi073.stdout:1/628: truncate db/d3e/f96 574698 0 2024-04-19T02:18:34.015 INFO:tasks.workunit.client.0.smithi073.stdout:7/723: write d0/dc/d67/d2a/f2b [116799,131059] 0 2024-04-19T02:18:34.015 INFO:tasks.workunit.client.0.smithi073.stdout:1/629: creat db/d41/dc5/fe1 x:0 0 0 2024-04-19T02:18:34.015 INFO:tasks.workunit.client.0.smithi073.stdout:0/659: truncate d7/d14/d17/d70/f72 958707 0 2024-04-19T02:18:34.016 INFO:tasks.workunit.client.0.smithi073.stdout:9/632: truncate d0/df/d16/d19/d38/d5d/d76/d7d/d88/fac 643993 0 2024-04-19T02:18:34.016 INFO:tasks.workunit.client.0.smithi073.stdout:9/633: chown d0/df/d60/cd1 2499 1 2024-04-19T02:18:34.016 INFO:tasks.workunit.client.0.smithi073.stdout:1/630: fsync db/d1c/d78/d8c/dd5/f69 0 2024-04-19T02:18:34.016 INFO:tasks.workunit.client.0.smithi073.stdout:2/724: dwrite d5/d10/d29/dd4/ff5 [0,4194304] 0 2024-04-19T02:18:34.016 INFO:tasks.workunit.client.0.smithi073.stdout:7/724: creat d0/dc/fdc x:0 0 0 2024-04-19T02:18:34.016 INFO:tasks.workunit.client.0.smithi073.stdout:9/634: mknod d0/df/d60/db0/cdb 0 2024-04-19T02:18:34.016 INFO:tasks.workunit.client.0.smithi073.stdout:2/725: creat d5/d10/d29/d66/d83/ffd x:0 0 0 2024-04-19T02:18:34.017 INFO:tasks.workunit.client.0.smithi073.stdout:0/660: mkdir d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba/dcb 0 2024-04-19T02:18:34.017 INFO:tasks.workunit.client.0.smithi073.stdout:2/726: symlink d5/d10/d14/d18/d98/lfe 0 2024-04-19T02:18:34.017 INFO:tasks.workunit.client.0.smithi073.stdout:4/683: dwrite da/d27/d36/d4d/d7b/f92 [0,4194304] 0 2024-04-19T02:18:34.017 INFO:tasks.workunit.client.0.smithi073.stdout:0/661: unlink d7/d14/d81/la6 0 2024-04-19T02:18:34.018 INFO:tasks.workunit.client.0.smithi073.stdout:2/727: mkdir d5/d10/d14/d2e/da0/dff 0 2024-04-19T02:18:34.018 INFO:tasks.workunit.client.0.smithi073.stdout:9/635: creat d0/df/d60/db0/dc2/dce/fdc x:0 0 0 2024-04-19T02:18:34.020 INFO:tasks.workunit.client.0.smithi073.stdout:2/728: truncate d5/d10/d29/d66/d67/f88 1918181 0 2024-04-19T02:18:34.020 INFO:tasks.workunit.client.0.smithi073.stdout:2/729: chown d5/d10/ddf 416045 1 2024-04-19T02:18:34.022 INFO:tasks.workunit.client.0.smithi073.stdout:1/631: dwrite db/d1c/d81/d83/db8/fd7 [0,4194304] 0 2024-04-19T02:18:34.023 INFO:tasks.workunit.client.0.smithi073.stdout:1/632: stat db/d1c/fc2 0 2024-04-19T02:18:34.023 INFO:tasks.workunit.client.0.smithi073.stdout:1/633: chown db/d41/l51 6 1 2024-04-19T02:18:34.024 INFO:tasks.workunit.client.0.smithi073.stdout:1/634: write db/d1c/f34 [807904,128909] 0 2024-04-19T02:18:34.030 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:34.028+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:34.031 INFO:tasks.workunit.client.0.smithi073.stdout:8/700: rmdir d14/d27/d29 39 2024-04-19T02:18:34.032 INFO:tasks.workunit.client.0.smithi073.stdout:8/701: symlink d14/d15/d17/d8d/lec 0 2024-04-19T02:18:34.033 INFO:tasks.workunit.client.0.smithi073.stdout:7/725: dread d0/f8 [0,4194304] 0 2024-04-19T02:18:34.034 INFO:tasks.workunit.client.0.smithi073.stdout:6/610: rename d8/d71/d7d/dab/daf to d8/de/d7f/dc6 0 2024-04-19T02:18:34.034 INFO:tasks.workunit.client.0.smithi073.stdout:7/726: chown d0/dc/d39/d50 8 1 2024-04-19T02:18:34.034 INFO:tasks.workunit.client.0.smithi073.stdout:8/702: mknod d14/d27/da4/ced 0 2024-04-19T02:18:34.035 INFO:tasks.workunit.client.0.smithi073.stdout:9/636: rename d0/df/d60/db0 to d0/d81/dda/ddd 0 2024-04-19T02:18:34.035 INFO:tasks.workunit.client.0.smithi073.stdout:6/611: rmdir d8/de/d58/d63 39 2024-04-19T02:18:34.036 INFO:tasks.workunit.client.0.smithi073.stdout:3/789: rename d3/d6/db/d1a/d54/f81 to d3/d6/db/d16/d52/f105 0 2024-04-19T02:18:34.037 INFO:tasks.workunit.client.0.smithi073.stdout:7/727: mknod d0/dc/d33/d5d/cdd 0 2024-04-19T02:18:34.038 INFO:tasks.workunit.client.0.smithi073.stdout:9/637: stat d0/df/d16/d19/d38/d5d/d76/dbc 0 2024-04-19T02:18:34.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/612: stat d8/de/d58/d63/c79 0 2024-04-19T02:18:34.038 INFO:tasks.workunit.client.0.smithi073.stdout:8/703: mknod d14/d15/d17/d48/d89/d97/cee 0 2024-04-19T02:18:34.039 INFO:tasks.workunit.client.0.smithi073.stdout:5/733: dwrite d0/d1d/d25/d37/d71/dd6/fa6 [0,4194304] 0 2024-04-19T02:18:34.039 INFO:tasks.workunit.client.0.smithi073.stdout:6/613: read d8/de/ff [7016234,20048] 0 2024-04-19T02:18:34.040 INFO:tasks.workunit.client.0.smithi073.stdout:7/728: write d0/dc/d33/d36/d7b/f85 [2404830,94554] 0 2024-04-19T02:18:34.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/704: write d14/d27/d4c/f6b [252962,15449] 0 2024-04-19T02:18:34.041 INFO:tasks.workunit.client.0.smithi073.stdout:5/734: sync 2024-04-19T02:18:34.041 INFO:tasks.workunit.client.0.smithi073.stdout:9/638: write d0/f54 [4760917,49054] 0 2024-04-19T02:18:34.041 INFO:tasks.workunit.client.0.smithi073.stdout:2/730: dwrite d5/d10/d14/d18/d3e/f32 [0,4194304] 0 2024-04-19T02:18:34.041 INFO:tasks.workunit.client.0.smithi073.stdout:3/790: creat d3/d6/db/d3a/d38/d43/f106 x:0 0 0 2024-04-19T02:18:34.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/614: symlink d8/lc7 0 2024-04-19T02:18:34.044 INFO:tasks.workunit.client.0.smithi073.stdout:3/791: fdatasync d3/d6/db/f14 0 2024-04-19T02:18:34.044 INFO:tasks.workunit.client.0.smithi073.stdout:2/731: symlink d5/d10/d14/d18/l100 0 2024-04-19T02:18:34.046 INFO:tasks.workunit.client.0.smithi073.stdout:4/684: dread da/d27/d1b/d1d/d72/d2b/f32 [0,4194304] 0 2024-04-19T02:18:34.047 INFO:tasks.workunit.client.0.smithi073.stdout:2/732: mkdir d5/d10/d14/db6/d101 0 2024-04-19T02:18:34.047 INFO:tasks.workunit.client.0.smithi073.stdout:1/635: dread db/ff [0,4194304] 0 2024-04-19T02:18:34.048 INFO:tasks.workunit.client.0.smithi073.stdout:9/639: dread d0/df/d16/d19/d38/d5d/d45/f7a [0,4194304] 0 2024-04-19T02:18:34.050 INFO:tasks.workunit.client.0.smithi073.stdout:2/733: write d5/d10/d29/d66/d67/d72/f12 [482949,40585] 0 2024-04-19T02:18:34.050 INFO:tasks.workunit.client.0.smithi073.stdout:9/640: mknod d0/df/cde 0 2024-04-19T02:18:34.050 INFO:tasks.workunit.client.0.smithi073.stdout:7/729: dwrite d0/dc/f4c [0,4194304] 0 2024-04-19T02:18:34.050 INFO:tasks.workunit.client.0.smithi073.stdout:2/734: chown f3 6369609 1 2024-04-19T02:18:34.051 INFO:tasks.workunit.client.0.smithi073.stdout:9/641: readlink d0/df/d16/l23 0 2024-04-19T02:18:34.051 INFO:tasks.workunit.client.0.smithi073.stdout:8/705: dwrite d14/d27/d50/faf [0,4194304] 0 2024-04-19T02:18:34.051 INFO:tasks.workunit.client.0.smithi073.stdout:7/730: creat d0/dc/d33/d36/dce/fde x:0 0 0 2024-04-19T02:18:34.051 INFO:tasks.workunit.client.0.smithi073.stdout:2/735: rename d5 to d5/d10/d14/d18/d3e/d51/d102 22 2024-04-19T02:18:34.052 INFO:tasks.workunit.client.0.smithi073.stdout:8/706: unlink d14/d87/fe5 0 2024-04-19T02:18:34.052 INFO:tasks.workunit.client.0.smithi073.stdout:9/642: creat d0/df/d16/d19/fdf x:0 0 0 2024-04-19T02:18:34.053 INFO:tasks.workunit.client.0.smithi073.stdout:8/707: readlink d14/l2f 0 2024-04-19T02:18:34.054 INFO:tasks.workunit.client.0.smithi073.stdout:1/636: dread db/d1c/d78/d8c/dd5/f61 [0,4194304] 0 2024-04-19T02:18:34.054 INFO:tasks.workunit.client.0.smithi073.stdout:7/731: mknod d0/dc/d33/d36/d7b/db4/cdf 0 2024-04-19T02:18:34.054 INFO:tasks.workunit.client.0.smithi073.stdout:2/736: mkdir d5/d10/d14/d7a/dd1/d103 0 2024-04-19T02:18:34.055 INFO:tasks.workunit.client.0.smithi073.stdout:6/615: truncate d8/de/f2a 154714 0 2024-04-19T02:18:34.055 INFO:tasks.workunit.client.0.smithi073.stdout:9/643: write d0/d35/fbb [471142,1169] 0 2024-04-19T02:18:34.055 INFO:tasks.workunit.client.0.smithi073.stdout:6/616: chown d8/de/d58/d63 1 1 2024-04-19T02:18:34.056 INFO:tasks.workunit.client.0.smithi073.stdout:7/732: creat d0/d3/dbb/fe0 x:0 0 0 2024-04-19T02:18:34.056 INFO:tasks.workunit.client.0.smithi073.stdout:5/735: truncate d0/d1d/d25/d37/f77 1163876 0 2024-04-19T02:18:34.056 INFO:tasks.workunit.client.0.smithi073.stdout:8/708: read - d14/d27/d85/d9a/fb2 zero size 2024-04-19T02:18:34.056 INFO:tasks.workunit.client.0.smithi073.stdout:7/733: dread - d0/dc/d67/d2a/d51/d7a/f95 zero size 2024-04-19T02:18:34.056 INFO:tasks.workunit.client.0.smithi073.stdout:7/734: write d0/dc/f8a [988489,42620] 0 2024-04-19T02:18:34.057 INFO:tasks.workunit.client.0.smithi073.stdout:9/644: creat d0/d81/dda/ddd/dc2/fe0 x:0 0 0 2024-04-19T02:18:34.059 INFO:tasks.workunit.client.0.smithi073.stdout:6/617: mknod d8/d4b/d93/d86/cc8 0 2024-04-19T02:18:34.060 INFO:tasks.workunit.client.0.smithi073.stdout:4/685: read da/d27/d3a/d50/f8b [57364,118529] 0 2024-04-19T02:18:34.060 INFO:tasks.workunit.client.0.smithi073.stdout:1/637: creat db/d1c/d78/d8c/dd5/d50/d62/dc0/db1/dc4/fe2 x:0 0 0 2024-04-19T02:18:34.060 INFO:tasks.workunit.client.0.smithi073.stdout:9/645: symlink d0/d81/dda/le1 0 2024-04-19T02:18:34.061 INFO:tasks.workunit.client.0.smithi073.stdout:5/736: rename d0/d1d/d24/d61/fa3 to d0/d1d/d24/fe8 0 2024-04-19T02:18:34.061 INFO:tasks.workunit.client.0.smithi073.stdout:8/709: dwrite d14/d15/d17/d8d/fc8 [0,4194304] 0 2024-04-19T02:18:34.062 INFO:tasks.workunit.client.0.smithi073.stdout:4/686: stat da/d27/d1b/d1d/d8d/d84/cc9 0 2024-04-19T02:18:34.063 INFO:tasks.workunit.client.0.smithi073.stdout:7/735: dwrite d0/f7c [0,4194304] 0 2024-04-19T02:18:34.065 INFO:tasks.workunit.client.0.smithi073.stdout:1/638: unlink db/d3e/c58 0 2024-04-19T02:18:34.065 INFO:tasks.workunit.client.0.smithi073.stdout:9/646: creat d0/d35/fe2 x:0 0 0 2024-04-19T02:18:34.065 INFO:tasks.workunit.client.0.smithi073.stdout:4/687: creat da/d27/d36/d4d/ff3 x:0 0 0 2024-04-19T02:18:34.066 INFO:tasks.workunit.client.0.smithi073.stdout:5/737: mkdir d0/d1d/d25/d35/dbf/de9 0 2024-04-19T02:18:34.066 INFO:tasks.workunit.client.0.smithi073.stdout:6/618: creat d8/d4b/d93/d60/fc9 x:0 0 0 2024-04-19T02:18:34.066 INFO:tasks.workunit.client.0.smithi073.stdout:5/738: sync 2024-04-19T02:18:34.066 INFO:tasks.workunit.client.0.smithi073.stdout:9/647: stat d0/f30 0 2024-04-19T02:18:34.066 INFO:tasks.workunit.client.0.smithi073.stdout:8/710: mknod d14/d27/d29/cef 0 2024-04-19T02:18:34.067 INFO:tasks.workunit.client.0.smithi073.stdout:6/619: stat d8/d71/d7d/dab 0 2024-04-19T02:18:34.067 INFO:tasks.workunit.client.0.smithi073.stdout:0/662: dread d7/d14/d17/d1a/d21/f40 [0,4194304] 0 2024-04-19T02:18:34.067 INFO:tasks.workunit.client.0.smithi073.stdout:5/739: readlink d0/d1d/d25/d35/l43 0 2024-04-19T02:18:34.068 INFO:tasks.workunit.client.0.smithi073.stdout:9/648: creat d0/df/d16/d19/d38/d5d/d5e/d83/fe3 x:0 0 0 2024-04-19T02:18:34.068 INFO:tasks.workunit.client.0.smithi073.stdout:0/663: creat d7/d14/d17/d1a/d20/d50/dc2/fcc x:0 0 0 2024-04-19T02:18:34.069 INFO:tasks.workunit.client.0.smithi073.stdout:5/740: rename d0/d1d/d25/d37/l5b to d0/d1d/d25/d35/d96/lea 0 2024-04-19T02:18:34.069 INFO:tasks.workunit.client.0.smithi073.stdout:9/649: creat d0/df/d16/fe4 x:0 0 0 2024-04-19T02:18:34.071 INFO:tasks.workunit.client.0.smithi073.stdout:0/664: mknod d7/d14/d17/d69/d7c/dbe/ccd 0 2024-04-19T02:18:34.072 INFO:tasks.workunit.client.0.smithi073.stdout:0/665: creat d7/d14/d17/d1a/d21/fce x:0 0 0 2024-04-19T02:18:34.072 INFO:tasks.workunit.client.0.smithi073.stdout:4/688: dwrite f1 [0,4194304] 0 2024-04-19T02:18:34.074 INFO:tasks.workunit.client.0.smithi073.stdout:0/666: symlink d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/lcf 0 2024-04-19T02:18:34.074 INFO:tasks.workunit.client.0.smithi073.stdout:6/620: dwrite d8/de/ff [0,4194304] 0 2024-04-19T02:18:34.075 INFO:tasks.workunit.client.0.smithi073.stdout:6/621: mkdir d8/de/d22/da8/dca 0 2024-04-19T02:18:34.076 INFO:tasks.workunit.client.0.smithi073.stdout:6/622: creat d8/d4b/d93/d86/fcb x:0 0 0 2024-04-19T02:18:34.078 INFO:tasks.workunit.client.0.smithi073.stdout:6/623: chown d8/l44 139379452 1 2024-04-19T02:18:34.078 INFO:tasks.workunit.client.0.smithi073.stdout:6/624: dread - d8/fa1 zero size 2024-04-19T02:18:34.079 INFO:tasks.workunit.client.0.smithi073.stdout:6/625: symlink d8/de/d22/da8/dca/lcc 0 2024-04-19T02:18:34.080 INFO:tasks.workunit.client.0.smithi073.stdout:4/689: dwrite da/d27/d2c/d80/dcf/ddd/d95/fb9 [0,4194304] 0 2024-04-19T02:18:34.081 INFO:tasks.workunit.client.0.smithi073.stdout:1/639: truncate f9 14300 0 2024-04-19T02:18:34.082 INFO:tasks.workunit.client.0.smithi073.stdout:1/640: readlink db/d1c/d78/d8c/dd5/d50/la9 0 2024-04-19T02:18:34.082 INFO:tasks.workunit.client.0.smithi073.stdout:0/667: dwrite d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:34.084 INFO:tasks.workunit.client.0.smithi073.stdout:0/668: readlink d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/lcf 0 2024-04-19T02:18:34.084 INFO:tasks.workunit.client.0.smithi073.stdout:0/669: sync 2024-04-19T02:18:34.084 INFO:tasks.workunit.client.0.smithi073.stdout:1/641: rename db/d1c/db3 to db/d1c/d78/d8c/dd5/de3 0 2024-04-19T02:18:34.086 INFO:tasks.workunit.client.0.smithi073.stdout:3/792: dread d3/d6/db/f14 [0,4194304] 0 2024-04-19T02:18:34.086 INFO:tasks.workunit.client.0.smithi073.stdout:0/670: write d7/d14/d17/d1a/d20/d50/d99/da7/d87/f8f [15740,40578] 0 2024-04-19T02:18:34.087 INFO:tasks.workunit.client.0.smithi073.stdout:3/793: fsync d3/d6/db/d3a/d38/d40/f77 0 2024-04-19T02:18:34.088 INFO:tasks.workunit.client.0.smithi073.stdout:5/741: link d0/d1d/d24/f38 d0/d69/feb 0 2024-04-19T02:18:34.088 INFO:tasks.workunit.client.0.smithi073.stdout:6/626: dread d8/de/d58/d63/f74 [0,4194304] 0 2024-04-19T02:18:34.090 INFO:tasks.workunit.client.0.smithi073.stdout:3/794: rmdir d3/d6/db/d16 39 2024-04-19T02:18:34.090 INFO:tasks.workunit.client.0.smithi073.stdout:0/671: write d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/fb2 [1085153,124554] 0 2024-04-19T02:18:34.090 INFO:tasks.workunit.client.0.smithi073.stdout:0/672: sync 2024-04-19T02:18:34.090 INFO:tasks.workunit.client.0.smithi073.stdout:4/690: dwrite da/d27/d2c/d80/dcf/ddd/fdc [0,4194304] 0 2024-04-19T02:18:34.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/627: rmdir d8/de/d7f/da5/dae 39 2024-04-19T02:18:34.090 INFO:tasks.workunit.client.0.smithi073.stdout:5/742: truncate d0/d1d/d24/fae 616969 0 2024-04-19T02:18:34.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/628: chown d8/de/d22 243099647 1 2024-04-19T02:18:34.091 INFO:tasks.workunit.client.0.smithi073.stdout:4/691: readlink da/d27/d1b/d26/d2a/l56 0 2024-04-19T02:18:34.091 INFO:tasks.workunit.client.0.smithi073.stdout:5/743: chown d0/d1d/ld5 341217 1 2024-04-19T02:18:34.091 INFO:tasks.workunit.client.0.smithi073.stdout:6/629: chown d8/d4b/d93/l61 1 1 2024-04-19T02:18:34.091 INFO:tasks.workunit.client.0.smithi073.stdout:5/744: chown d0/d1d/d25/d35/dbf/de9 702320 1 2024-04-19T02:18:34.091 INFO:tasks.workunit.client.0.smithi073.stdout:3/795: getdents d3/d6/db/d3a/d38/d89 0 2024-04-19T02:18:34.092 INFO:tasks.workunit.client.0.smithi073.stdout:4/692: creat da/d27/d1b/d26/d2a/ff4 x:0 0 0 2024-04-19T02:18:34.092 INFO:tasks.workunit.client.0.smithi073.stdout:0/673: truncate d7/d14/d17/d1a/d20/d50/d99/da7/f65 3922382 0 2024-04-19T02:18:34.093 INFO:tasks.workunit.client.0.smithi073.stdout:0/674: sync 2024-04-19T02:18:34.093 INFO:tasks.workunit.client.0.smithi073.stdout:6/630: symlink d8/d4b/d93/d60/lcd 0 2024-04-19T02:18:34.093 INFO:tasks.workunit.client.0.smithi073.stdout:6/631: chown d8/d4b/cc5 6 1 2024-04-19T02:18:34.094 INFO:tasks.workunit.client.0.smithi073.stdout:0/675: unlink d7/d6d/dbd/cc3 0 2024-04-19T02:18:34.094 INFO:tasks.workunit.client.0.smithi073.stdout:0/676: write d7/d14/d17/d69/f80 [583005,116598] 0 2024-04-19T02:18:34.096 INFO:tasks.workunit.client.0.smithi073.stdout:0/677: chown d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82 239 1 2024-04-19T02:18:34.096 INFO:tasks.workunit.client.0.smithi073.stdout:0/678: chown d7/d14/d17/d1a/d21/f8a 13154609 1 2024-04-19T02:18:34.097 INFO:tasks.workunit.client.0.smithi073.stdout:1/642: rmdir db/d1c/d81/d83/db8 39 2024-04-19T02:18:34.097 INFO:tasks.workunit.client.0.smithi073.stdout:3/796: dwrite d3/d6/db/d1a/d54/fe8 [0,4194304] 0 2024-04-19T02:18:34.098 INFO:tasks.workunit.client.0.smithi073.stdout:0/679: mknod d7/d14/d17/d1a/cd0 0 2024-04-19T02:18:34.099 INFO:tasks.workunit.client.0.smithi073.stdout:7/736: dread d0/dc/d67/f71 [0,4194304] 0 2024-04-19T02:18:34.099 INFO:tasks.workunit.client.0.smithi073.stdout:3/797: write d3/d6/db/d3a/d38/d43/ff0 [356,25510] 0 2024-04-19T02:18:34.100 INFO:tasks.workunit.client.0.smithi073.stdout:0/680: fsync d7/d14/d17/d1a/d20/f89 0 2024-04-19T02:18:34.100 INFO:tasks.workunit.client.0.smithi073.stdout:7/737: chown d0/dc/d67/f65 105 1 2024-04-19T02:18:34.100 INFO:tasks.workunit.client.0.smithi073.stdout:6/632: dread d8/de/f32 [0,4194304] 0 2024-04-19T02:18:34.101 INFO:tasks.workunit.client.0.smithi073.stdout:7/738: chown d0/dc/d33/da7 4093539 1 2024-04-19T02:18:34.101 INFO:tasks.workunit.client.0.smithi073.stdout:6/633: readlink d8/d4b/d93/l61 0 2024-04-19T02:18:34.101 INFO:tasks.workunit.client.0.smithi073.stdout:7/739: chown d0/dc/d39/d50/c6f 235173 1 2024-04-19T02:18:34.105 INFO:tasks.workunit.client.0.smithi073.stdout:6/634: dwrite d8/f16 [0,4194304] 0 2024-04-19T02:18:34.106 INFO:tasks.workunit.client.0.smithi073.stdout:6/635: fsync d8/de/d78/f9c 0 2024-04-19T02:18:34.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/636: truncate d8/d4b/d93/fba 894955 0 2024-04-19T02:18:34.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/637: mknod d8/d71/d7d/dab/cce 0 2024-04-19T02:18:34.109 INFO:tasks.workunit.client.0.smithi073.stdout:4/693: write da/d27/d2c/d80/fee [1327916,116393] 0 2024-04-19T02:18:34.109 INFO:tasks.workunit.client.0.smithi073.stdout:7/740: truncate d0/dc/d67/f65 4143110 0 2024-04-19T02:18:34.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/694: chown da/d27/d3a/ld4 8 1 2024-04-19T02:18:34.111 INFO:tasks.workunit.client.0.smithi073.stdout:8/711: dread d14/d27/d4c/f7d [0,4194304] 0 2024-04-19T02:18:34.111 INFO:tasks.workunit.client.0.smithi073.stdout:7/741: rmdir d0/dc/d39/d50/da3/dc9 0 2024-04-19T02:18:34.111 INFO:tasks.workunit.client.0.smithi073.stdout:4/695: mkdir da/d27/d2c/d80/dcf/ddd/df5 0 2024-04-19T02:18:34.111 INFO:tasks.workunit.client.0.smithi073.stdout:8/712: creat d14/d27/d85/d9b/ff0 x:0 0 0 2024-04-19T02:18:34.111 INFO:tasks.workunit.client.0.smithi073.stdout:4/696: fdatasync da/d27/d36/f5e 0 2024-04-19T02:18:34.112 INFO:tasks.workunit.client.0.smithi073.stdout:7/742: write d0/dc/d67/d2a/d51/d7a/fa5 [2854779,86065] 0 2024-04-19T02:18:34.112 INFO:tasks.workunit.client.0.smithi073.stdout:4/697: creat da/d27/d3a/d49/ff6 x:0 0 0 2024-04-19T02:18:34.113 INFO:tasks.workunit.client.0.smithi073.stdout:7/743: chown d0/dc/d33/d36/d7b/db4/cdf 26 1 2024-04-19T02:18:34.113 INFO:tasks.workunit.client.0.smithi073.stdout:7/744: sync 2024-04-19T02:18:34.113 INFO:tasks.workunit.client.0.smithi073.stdout:4/698: creat da/ff7 x:0 0 0 2024-04-19T02:18:34.114 INFO:tasks.workunit.client.0.smithi073.stdout:4/699: stat da/d27/d1b/d26/d2a/l56 0 2024-04-19T02:18:34.114 INFO:tasks.workunit.client.0.smithi073.stdout:7/745: unlink d0/dc/d39/f4f 0 2024-04-19T02:18:34.114 INFO:tasks.workunit.client.0.smithi073.stdout:7/746: sync 2024-04-19T02:18:34.115 INFO:tasks.workunit.client.0.smithi073.stdout:3/798: dread d3/d6/db/d16/d52/f8f [0,4194304] 0 2024-04-19T02:18:34.116 INFO:tasks.workunit.client.0.smithi073.stdout:7/747: link d0/dc/f5a d0/dc/d67/d2a/d51/fe1 0 2024-04-19T02:18:34.116 INFO:tasks.workunit.client.0.smithi073.stdout:3/799: unlink d3/d6/db/d3a/d38/d89/d94/d7b/f9b 0 2024-04-19T02:18:34.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/650: dread d0/df/d16/d19/db1/d2c/d2e/fc3 [4194304,4194304] 0 2024-04-19T02:18:34.118 INFO:tasks.workunit.client.0.smithi073.stdout:8/713: dread d14/d27/d4c/d75/dbb/fc7 [0,4194304] 0 2024-04-19T02:18:34.118 INFO:tasks.workunit.client.0.smithi073.stdout:3/800: creat d3/d6/db/d16/f107 x:0 0 0 2024-04-19T02:18:34.119 INFO:tasks.workunit.client.0.smithi073.stdout:3/801: chown d3/d6/db/d1a 15181 1 2024-04-19T02:18:34.121 INFO:tasks.workunit.client.0.smithi073.stdout:4/700: dwrite f1 [0,4194304] 0 2024-04-19T02:18:34.122 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:34.116+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:34.123 INFO:tasks.workunit.client.0.smithi073.stdout:4/701: write da/d27/d2c/f3c [6123073,48090] 0 2024-04-19T02:18:34.124 INFO:tasks.workunit.client.0.smithi073.stdout:7/748: dwrite d0/d3/f74 [0,4194304] 0 2024-04-19T02:18:34.125 INFO:tasks.workunit.client.0.smithi073.stdout:2/737: dread d5/d10/d29/d66/d67/d72/fb3 [0,4194304] 0 2024-04-19T02:18:34.125 INFO:tasks.workunit.client.0.smithi073.stdout:9/651: dwrite d0/f50 [0,4194304] 0 2024-04-19T02:18:34.126 INFO:tasks.workunit.client.0.smithi073.stdout:7/749: write d0/f7c [3722027,2546] 0 2024-04-19T02:18:34.126 INFO:tasks.workunit.client.0.smithi073.stdout:4/702: fdatasync da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f 0 2024-04-19T02:18:34.128 INFO:tasks.workunit.client.0.smithi073.stdout:8/714: dwrite d14/d27/d4c/d75/fb8 [0,4194304] 0 2024-04-19T02:18:34.128 INFO:tasks.workunit.client.0.smithi073.stdout:7/750: write d0/f3c [421764,32706] 0 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:2110 4.16 4:686191b0:::10000003454.00000000:head [trimtrunc 2@4143110] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.127665+0000", 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00036599000000000001, 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041922200000000002, 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127665+0000", 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127665+0000", 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127663+0000", 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127673+0000", 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8099999999999992e-06 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127685+0000", 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2694000000000001e-05 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127695+0000", 2024-04-19T02:18:34.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6039999999999999e-06 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127748+0000", 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2720999999999999e-05 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127843+0000", 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5288e-05 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:2109 3.8 e64/15 3:17051619:::200.0000000f:head v 64'196, mlcod=64'194)", 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.127683+0000", 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00034850099999999998, 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00055557899999999995, 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127683+0000", 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127683+0000", 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127682+0000", 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127692+0000", 2024-04-19T02:18:34.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9830000000000008e-06 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127699+0000", 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6399999999999997e-06 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127704+0000", 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8389999999999997e-06 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127802+0000", 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7891000000000002e-05 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127823+0000", 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0675000000000001e-05 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:2111 4.2f 4:f4fe786a:::10000003454.00000001:head [trimtrunc 2@0] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-19T02:18:34.136 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.127712+0000", 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.00031937600000000001, 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097395700000000001, 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127712+0000", 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127712+0000", 2024-04-19T02:18:34.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127711+0000", 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127714+0000", 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.931e-06 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127721+0000", 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3170000000000004e-06 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127728+0000", 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1550000000000004e-06 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127773+0000", 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5464999999999999e-05 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127899+0000", 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012555800000000001 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:2112 3.8 e64/15)", 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.128163+0000", 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9998684, 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058765900000000003, 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128163+0000", 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128163+0000", 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128162+0000", 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128169+0000", 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5769999999999999e-06 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128179+0000", 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0227999999999999e-05 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128185+0000", 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.229e-06 2024-04-19T02:18:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128374+0000", 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018926199999999999 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:13846 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@3589026] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.123657+0000", 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0043744719999999999, 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005221463, 2024-04-19T02:18:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 13846 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.123657+0000", 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.123657+0000", 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.123656+0000", 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128637+0000", 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049807260000000004 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128646+0000", 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6809999999999993e-06 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128651+0000", 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.78e-06 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128695+0000", 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4438999999999999e-05 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.128794+0000", 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8449000000000006e-05 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:13815 4.21 4:8563ce14:::100000036eb.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.100058+0000", 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.027973596999999999, 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028954135999999998, 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 13815 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.100058+0000", 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.100058+0000", 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.100056+0000", 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.104565+0000", 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045086359999999999 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.104577+0000", 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2357999999999999e-05 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.104584+0000", 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4899999999999997e-06 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.104633+0000", 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9017000000000002e-05 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.104791+0000", 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015858800000000001 2024-04-19T02:18:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.104891+0000", 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9452999999999998e-05 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.127790+0000", 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022898877000000002 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:13826 4.2d 4:b5f39dc8:::100000031ac.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.107863+0000", 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.020167905, 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021226532999999999, 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 13826 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.107863+0000", 2024-04-19T02:18:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.107863+0000", 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.107862+0000", 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112659+0000", 2024-04-19T02:18:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047963800000000003 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112671+0000", 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2386e-05 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112680+0000", 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1949999999999992e-06 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112742+0000", 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1978999999999997e-05 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112837+0000", 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4938999999999993e-05 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.113033+0000", 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019618000000000001 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:13827 4.2d 4.ea5ec9ad (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:34.112697+0000", 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.015334057999999999, 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016481310999999998, 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 13827 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112697+0000", 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112697+0000", 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112695+0000", 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112699+0000", 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1060000000000002e-06 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112708+0000", 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7819999999999999e-06 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:34.112714+0000", 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8080000000000001e-06 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 8 2024-04-19T02:18:34.159 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:34.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:34.165 INFO:tasks.workunit.client.0.smithi073.stdout:5/745: dread d0/d1d/d25/d37/f3e [4194304,4194304] 0 2024-04-19T02:18:34.165 INFO:tasks.workunit.client.0.smithi073.stdout:4/703: write da/d27/fd7 [954342,113757] 0 2024-04-19T02:18:34.165 INFO:tasks.workunit.client.0.smithi073.stdout:9/652: truncate d0/df/d16/d19/db1/d2c/d2e/f7f 1518360 0 2024-04-19T02:18:34.165 INFO:tasks.workunit.client.0.smithi073.stdout:3/802: fdatasync d3/d6/db/d16/d52/f99 0 2024-04-19T02:18:34.165 INFO:tasks.workunit.client.0.smithi073.stdout:5/746: write d0/d1d/d64/f8b [780002,121181] 0 2024-04-19T02:18:34.165 INFO:tasks.workunit.client.0.smithi073.stdout:9/653: readlink d0/l3 0 2024-04-19T02:18:34.165 INFO:tasks.workunit.client.0.smithi073.stdout:2/738: dread d5/d10/d29/fd8 [0,4194304] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:5/747: write d0/d1d/d25/d37/d71/f89 [88293,2727] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:7/751: dread d0/d28/fc7 [0,4194304] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:2/739: unlink d5/ca1 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:8/715: dwrite f0 [4194304,4194304] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:4/704: getdents da/d27/d2c/ddb 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:7/752: symlink d0/dc/le2 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:8/716: fsync d14/d27/d29/d31/fb7 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:4/705: write da/d27/d3a/d50/fbe [577186,72677] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:9/654: dwrite d0/df/d16/d19/f3d [0,4194304] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:3/803: dwrite d3/d6/f22 [0,4194304] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:6/638: dread d8/f11 [4194304,4194304] 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:4/706: unlink da/d27/d3a/d49/l81 0 2024-04-19T02:18:34.166 INFO:tasks.workunit.client.0.smithi073.stdout:7/753: mkdir d0/dc/d33/da7/de3 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:7/754: sync 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:8/717: symlink d14/d27/d4c/d75/dbb/lf1 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:2/740: link d5/d10/d29/d42/l6a d5/d10/d14/d18/d3e/d2d/l104 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:5/748: dwrite d0/d1d/d25/d35/d39/f4c [0,4194304] 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:8/718: fsync d14/d27/d29/d64/f78 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:2/741: write d5/f7 [4644459,93732] 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/639: mkdir d8/de/d22/da8/dcf 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:7/755: chown d0/dc/d67/f71 13 1 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:8/719: chown d14/d15/d17/f2c 140 1 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:2/742: readlink d5/d10/d14/d18/d98/lfe 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/640: write d8/de/f47 [6632620,7089] 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:4/707: rename da/d27/d1b/d1d/d72/fa4 to da/d27/d2c/d60/ff8 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:3/804: link d3/d6/db/d23/lcc d3/d6/db/d3a/d38/d89/d94/d7b/l108 0 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:7/756: chown d0/dc/d39/d50/ld4 23055966 1 2024-04-19T02:18:34.167 INFO:tasks.workunit.client.0.smithi073.stdout:9/655: dwrite d0/df/d16/d19/d38/d5d/d5e/f8d [0,4194304] 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:8/720: chown d14/d27/d4c/d75/f90 2659796 1 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:2/743: symlink d5/d10/d29/dcb/l105 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:4/708: creat da/d27/d2c/dc1/ff9 x:0 0 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:0/681: dread d7/d14/d17/d1a/f29 [0,4194304] 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:6/641: truncate d8/de/f2a 680506 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:4/709: chown da/d27/d3a/d50/l94 83796 1 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:7/757: dread - d0/dc/d33/d5d/db0/fca zero size 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:3/805: rename d3/d6/db/d23/c8d to d3/d6/db/d3a/d38/d89/c109 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:6/642: chown d8/d4b/cc2 169428 1 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:5/749: dwrite d0/d1d/d25/d35/d99/fc5 [0,4194304] 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:6/643: write d8/de/d7f/fa0 [1061006,106740] 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:0/682: truncate d7/d14/d17/d1a/d20/d50/d99/da7/f5a 630173 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:3/806: mknod d3/d6/db/d3a/d38/d57/d88/c10a 0 2024-04-19T02:18:34.168 INFO:tasks.workunit.client.0.smithi073.stdout:6/644: write d8/fa4 [5213248,19922] 0 2024-04-19T02:18:34.169 INFO:tasks.workunit.client.0.smithi073.stdout:9/656: getdents d0/df/d16/d19/d38/d5d 0 2024-04-19T02:18:34.169 INFO:tasks.workunit.client.0.smithi073.stdout:3/807: fdatasync d3/d6/db/d3a/d5f/da7/f102 0 2024-04-19T02:18:34.169 INFO:tasks.workunit.client.0.smithi073.stdout:2/744: dwrite d5/d10/d14/d18/d98/fc6 [0,4194304] 0 2024-04-19T02:18:34.169 INFO:tasks.workunit.client.0.smithi073.stdout:0/683: fdatasync d7/d14/d17/d1a/d20/d50/d99/da7/f65 0 2024-04-19T02:18:34.169 INFO:tasks.workunit.client.0.smithi073.stdout:9/657: dread - d0/d81/dda/ddd/fd6 zero size 2024-04-19T02:18:34.170 INFO:tasks.workunit.client.0.smithi073.stdout:4/710: dwrite da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/fce [0,4194304] 0 2024-04-19T02:18:34.170 INFO:tasks.workunit.client.0.smithi073.stdout:2/745: write d5/d10/d14/f8a [321477,7130] 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:9/658: mknod d0/d81/dda/ddd/ce5 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:3/808: symlink d3/d6/db/d3a/d38/d57/d88/df4/l10b 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/721: dwrite d14/d27/d29/d31/d34/fea [0,4194304] 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:7/758: dwrite d0/dc/d33/d36/d7b/d93/fc0 [0,4194304] 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/711: unlink da/d27/d1b/f45 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:9/659: stat d0/df/d16/d19/d38/d5d/d45/l9f 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:0/684: mknod d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba/dcb/cd1 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:2/746: symlink d5/d10/d29/d66/d7e/l106 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:9/660: truncate d0/d81/dda/ddd/dc2/fe0 472478 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/712: mknod da/d27/d3a/d49/cfa 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:0/685: creat d7/d14/d17/d1a/d20/d50/dc2/fd2 x:0 0 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/722: mkdir d14/d15/d17/d48/d89/ddd/df2 0 2024-04-19T02:18:34.171 INFO:tasks.workunit.client.0.smithi073.stdout:7/759: mknod d0/dc/db7/ce4 0 2024-04-19T02:18:34.172 INFO:tasks.workunit.client.0.smithi073.stdout:9/661: creat d0/d81/d5c/fe6 x:0 0 0 2024-04-19T02:18:34.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/809: write d3/d6/db/fa1 [862925,86395] 0 2024-04-19T02:18:34.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/713: write da/ff7 [413449,99906] 0 2024-04-19T02:18:34.172 INFO:tasks.workunit.client.0.smithi073.stdout:7/760: fdatasync d0/dc/fc2 0 2024-04-19T02:18:34.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/723: fdatasync d14/d27/da4/fb1 0 2024-04-19T02:18:34.173 INFO:tasks.workunit.client.0.smithi073.stdout:9/662: creat d0/df/d16/fe7 x:0 0 0 2024-04-19T02:18:34.173 INFO:tasks.workunit.client.0.smithi073.stdout:8/724: write d14/d27/d29/f51 [1454895,62199] 0 2024-04-19T02:18:34.173 INFO:tasks.workunit.client.0.smithi073.stdout:8/725: creat d14/d27/d50/ff3 x:0 0 0 2024-04-19T02:18:34.174 INFO:tasks.workunit.client.0.smithi073.stdout:9/663: creat d0/df/d16/d19/d38/d5d/d76/d7d/fe8 x:0 0 0 2024-04-19T02:18:34.174 INFO:tasks.workunit.client.0.smithi073.stdout:3/810: write d3/d6/db/d3a/d38/d89/d94/d7b/fe5 [348543,78032] 0 2024-04-19T02:18:34.175 INFO:tasks.workunit.client.0.smithi073.stdout:8/726: write d14/d27/d85/d9b/fd2 [572764,124607] 0 2024-04-19T02:18:34.175 INFO:tasks.workunit.client.0.smithi073.stdout:9/664: symlink d0/df/d16/d19/d38/d5d/d76/le9 0 2024-04-19T02:18:34.176 INFO:tasks.workunit.client.0.smithi073.stdout:7/761: creat d0/d28/d63/fe5 x:0 0 0 2024-04-19T02:18:34.176 INFO:tasks.workunit.client.0.smithi073.stdout:3/811: readlink d3/d6/l3b 0 2024-04-19T02:18:34.178 INFO:tasks.workunit.client.0.smithi073.stdout:8/727: rename d14/d15/d17/da1/ca6 to d14/d27/cf4 0 2024-04-19T02:18:34.178 INFO:tasks.workunit.client.0.smithi073.stdout:7/762: write d0/dc/d67/fda [1497961,54502] 0 2024-04-19T02:18:34.179 INFO:tasks.workunit.client.0.smithi073.stdout:4/714: dwrite da/d27/d1b/d26/f4c [0,4194304] 0 2024-04-19T02:18:34.179 INFO:tasks.workunit.client.0.smithi073.stdout:3/812: write d3/d6/db/d3a/d38/d89/d94/fc7 [112368,39204] 0 2024-04-19T02:18:34.181 INFO:tasks.workunit.client.0.smithi073.stdout:0/686: dwrite d7/d14/d17/d1a/f29 [4194304,4194304] 0 2024-04-19T02:18:34.184 INFO:tasks.workunit.client.0.smithi073.stdout:0/687: link d7/d14/d17/d1a/d21/f8a d7/d14/d17/d1a/d20/fd3 0 2024-04-19T02:18:34.185 INFO:tasks.workunit.client.0.smithi073.stdout:0/688: link d7/d14/d17/d69/d7c/c95 d7/cd4 0 2024-04-19T02:18:34.186 INFO:tasks.workunit.client.0.smithi073.stdout:3/813: dwrite d3/f3f [0,4194304] 0 2024-04-19T02:18:34.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/814: mknod d3/d6/db/d3a/d38/d6f/daf/dfd/d101/c10c 0 2024-04-19T02:18:34.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/815: creat d3/d6/db/d3a/d5f/dca/f10d x:0 0 0 2024-04-19T02:18:34.190 INFO:tasks.workunit.client.0.smithi073.stdout:1/643: dread db/f28 [0,4194304] 0 2024-04-19T02:18:34.190 INFO:tasks.workunit.client.0.smithi073.stdout:3/816: rename d3/d6/db/d1a/c1f to d3/d6/db/d3a/d38/d6f/dac/dc9/c10e 0 2024-04-19T02:18:34.191 INFO:tasks.workunit.client.0.smithi073.stdout:5/750: dread d0/f41 [0,4194304] 0 2024-04-19T02:18:34.191 INFO:tasks.workunit.client.0.smithi073.stdout:3/817: chown d3/d6/db/d16/d52/f8f 80353 1 2024-04-19T02:18:34.191 INFO:tasks.workunit.client.0.smithi073.stdout:1/644: readlink db/d1c/d78/d8c/dd5/l9a 0 2024-04-19T02:18:34.191 INFO:tasks.workunit.client.0.smithi073.stdout:1/645: readlink db/l19 0 2024-04-19T02:18:34.192 INFO:tasks.workunit.client.0.smithi073.stdout:1/646: unlink db/d1c/d81/d86/fbd 0 2024-04-19T02:18:34.192 INFO:tasks.workunit.client.0.smithi073.stdout:3/818: creat d3/d6/db/d3a/d38/d40/db5/f10f x:0 0 0 2024-04-19T02:18:34.193 INFO:tasks.workunit.client.0.smithi073.stdout:4/715: read da/d27/d1b/d26/f9d [2602261,101393] 0 2024-04-19T02:18:34.193 INFO:tasks.workunit.client.0.smithi073.stdout:1/647: creat db/d1c/d81/d86/ddd/fe4 x:0 0 0 2024-04-19T02:18:34.194 INFO:tasks.workunit.client.0.smithi073.stdout:3/819: creat d3/d6/db/d3a/d38/d57/d88/dc2/dfb/f110 x:0 0 0 2024-04-19T02:18:34.194 INFO:tasks.workunit.client.0.smithi073.stdout:4/716: symlink da/d27/d2c/d80/dcf/ddd/d95/lfb 0 2024-04-19T02:18:34.194 INFO:tasks.workunit.client.0.smithi073.stdout:1/648: readlink db/d1c/d78/ld3 0 2024-04-19T02:18:34.195 INFO:tasks.workunit.client.0.smithi073.stdout:3/820: rmdir d3/d6/db/d3a/d38/d43 39 2024-04-19T02:18:34.195 INFO:tasks.workunit.client.0.smithi073.stdout:1/649: creat db/d1c/d78/d8c/fe5 x:0 0 0 2024-04-19T02:18:34.195 INFO:tasks.workunit.client.0.smithi073.stdout:4/717: mkdir da/d27/d2c/d80/dcf/de1/dfc 0 2024-04-19T02:18:34.196 INFO:tasks.workunit.client.0.smithi073.stdout:1/650: mknod db/d1c/d81/d83/ce6 0 2024-04-19T02:18:34.196 INFO:tasks.workunit.client.0.smithi073.stdout:3/821: creat d3/d6/db/d3a/d38/d6f/daf/dfd/f111 x:0 0 0 2024-04-19T02:18:34.196 INFO:tasks.workunit.client.0.smithi073.stdout:4/718: getdents da/d27/d3a/d50/d9c 0 2024-04-19T02:18:34.197 INFO:tasks.workunit.client.0.smithi073.stdout:4/719: chown da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f 12426084 1 2024-04-19T02:18:34.198 INFO:tasks.workunit.client.0.smithi073.stdout:3/822: sync 2024-04-19T02:18:34.199 INFO:tasks.workunit.client.0.smithi073.stdout:4/720: read da/d27/d3a/d97/fe4 [665061,36546] 0 2024-04-19T02:18:34.200 INFO:tasks.workunit.client.0.smithi073.stdout:4/721: truncate da/d27/d3a/d49/ff6 895945 0 2024-04-19T02:18:34.203 INFO:tasks.workunit.client.0.smithi073.stdout:3/823: dwrite d3/d6/db/d3a/d38/d89/d94/f26 [0,4194304] 0 2024-04-19T02:18:34.210 INFO:tasks.workunit.client.0.smithi073.stdout:9/665: truncate d0/df/d16/d19/f26 3474803 0 2024-04-19T02:18:34.210 INFO:tasks.workunit.client.0.smithi073.stdout:8/728: truncate d14/d27/d4c/f6b 744031 0 2024-04-19T02:18:34.210 INFO:tasks.workunit.client.0.smithi073.stdout:8/729: write d14/d27/d50/f6f [897811,33715] 0 2024-04-19T02:18:34.211 INFO:tasks.workunit.client.0.smithi073.stdout:8/730: creat d14/d15/d17/d8d/ff5 x:0 0 0 2024-04-19T02:18:34.212 INFO:tasks.workunit.client.0.smithi073.stdout:8/731: mkdir d14/d27/d85/d9a/df6 0 2024-04-19T02:18:34.213 INFO:tasks.workunit.client.0.smithi073.stdout:8/732: symlink d14/d27/d85/d9b/lf7 0 2024-04-19T02:18:34.213 INFO:tasks.workunit.client.0.smithi073.stdout:2/747: dread d5/d10/d14/d18/d3e/d2d/d63/f9f [0,4194304] 0 2024-04-19T02:18:34.214 INFO:tasks.workunit.client.0.smithi073.stdout:8/733: getdents d14/d27/d4c/d75 0 2024-04-19T02:18:34.215 INFO:tasks.workunit.client.0.smithi073.stdout:8/734: chown d14/d27/d29/d31/d34/f40 123237 1 2024-04-19T02:18:34.215 INFO:tasks.workunit.client.0.smithi073.stdout:8/735: fsync d14/d27/d4c/f4f 0 2024-04-19T02:18:34.215 INFO:tasks.workunit.client.0.smithi073.stdout:8/736: mkdir d14/d15/df8 0 2024-04-19T02:18:34.216 INFO:tasks.workunit.client.0.smithi073.stdout:8/737: rename d14/d15/d17/da1/fe8 to d14/d27/da4/ff9 0 2024-04-19T02:18:34.217 INFO:tasks.workunit.client.0.smithi073.stdout:8/738: symlink d14/d15/d17/d99/lfa 0 2024-04-19T02:18:34.218 INFO:tasks.workunit.client.0.smithi073.stdout:8/739: link d14/d27/d4c/lc6 d14/d15/d17/da1/lfb 0 2024-04-19T02:18:34.219 INFO:tasks.workunit.client.0.smithi073.stdout:8/740: creat d14/d15/d17/d48/d89/d97/ffc x:0 0 0 2024-04-19T02:18:34.219 INFO:tasks.workunit.client.0.smithi073.stdout:8/741: truncate d14/d87/f96 488948 0 2024-04-19T02:18:34.221 INFO:tasks.workunit.client.0.smithi073.stdout:8/742: mknod d14/d15/d17/d48/d89/ddd/df2/cfd 0 2024-04-19T02:18:34.221 INFO:tasks.workunit.client.0.smithi073.stdout:8/743: chown d14/d15/f1e 0 1 2024-04-19T02:18:34.222 INFO:tasks.workunit.client.0.smithi073.stdout:8/744: mkdir d14/d15/d17/d48/d89/ddd/dfe 0 2024-04-19T02:18:34.222 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:34.219+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:34.223 INFO:tasks.workunit.client.0.smithi073.stdout:8/745: link d14/d15/c1c d14/d27/cff 0 2024-04-19T02:18:34.223 INFO:tasks.workunit.client.0.smithi073.stdout:4/722: dread da/d27/d2c/f3c [4194304,4194304] 0 2024-04-19T02:18:34.224 INFO:tasks.workunit.client.0.smithi073.stdout:8/746: chown d14/f62 549523070 1 2024-04-19T02:18:34.229 INFO:tasks.workunit.client.0.smithi073.stdout:4/723: dwrite da/d27/d1b/d26/d2a/ff4 [0,4194304] 0 2024-04-19T02:18:34.229 INFO:tasks.workunit.client.0.smithi073.stdout:4/724: mknod da/d27/d3a/d50/d9c/cfd 0 2024-04-19T02:18:34.232 INFO:tasks.workunit.client.0.smithi073.stdout:6/645: dread d8/f18 [0,4194304] 0 2024-04-19T02:18:34.232 INFO:tasks.workunit.client.0.smithi073.stdout:6/646: creat d8/d71/d75/fd0 x:0 0 0 2024-04-19T02:18:34.233 INFO:tasks.workunit.client.0.smithi073.stdout:6/647: unlink d8/de/d22/c80 0 2024-04-19T02:18:34.234 INFO:tasks.workunit.client.0.smithi073.stdout:6/648: mknod d8/de/d58/d63/cd1 0 2024-04-19T02:18:34.234 INFO:tasks.workunit.client.0.smithi073.stdout:4/725: dwrite da/d27/d3a/d49/ff6 [0,4194304] 0 2024-04-19T02:18:34.235 INFO:tasks.workunit.client.0.smithi073.stdout:4/726: creat da/ffe x:0 0 0 2024-04-19T02:18:34.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/649: mknod d8/de/d7f/da5/cd2 0 2024-04-19T02:18:34.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/650: dread - d8/fa1 zero size 2024-04-19T02:18:34.236 INFO:tasks.workunit.client.0.smithi073.stdout:4/727: chown f4 2 1 2024-04-19T02:18:34.236 INFO:tasks.workunit.client.0.smithi073.stdout:6/651: creat d8/de/d22/da8/fd3 x:0 0 0 2024-04-19T02:18:34.237 INFO:tasks.workunit.client.0.smithi073.stdout:6/652: creat d8/de/d58/d63/fd4 x:0 0 0 2024-04-19T02:18:34.237 INFO:tasks.workunit.client.0.smithi073.stdout:4/728: write da/d27/d1b/d1d/d72/d2b/f32 [517385,6525] 0 2024-04-19T02:18:34.237 INFO:tasks.workunit.client.0.smithi073.stdout:6/653: readlink l7 0 2024-04-19T02:18:34.238 INFO:tasks.workunit.client.0.smithi073.stdout:5/751: write d0/d2d/dac/fb2 [1472094,14338] 0 2024-04-19T02:18:34.238 INFO:tasks.workunit.client.0.smithi073.stdout:8/747: rmdir d14/d27/d85/d9b 39 2024-04-19T02:18:34.238 INFO:tasks.workunit.client.0.smithi073.stdout:1/651: write f9 [787609,66424] 0 2024-04-19T02:18:34.239 INFO:tasks.workunit.client.0.smithi073.stdout:4/729: stat da/d27/d1b/l22 0 2024-04-19T02:18:34.239 INFO:tasks.workunit.client.0.smithi073.stdout:6/654: stat d8/de/d22/l2d 0 2024-04-19T02:18:34.241 INFO:tasks.workunit.client.0.smithi073.stdout:8/748: creat d14/d27/d85/d9b/f100 x:0 0 0 2024-04-19T02:18:34.241 INFO:tasks.workunit.client.0.smithi073.stdout:1/652: mknod db/d7f/ce7 0 2024-04-19T02:18:34.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/752: creat d0/d1d/d25/d35/d99/fec x:0 0 0 2024-04-19T02:18:34.242 INFO:tasks.workunit.client.0.smithi073.stdout:6/655: symlink d8/de/d58/ld5 0 2024-04-19T02:18:34.242 INFO:tasks.workunit.client.0.smithi073.stdout:3/824: sync 2024-04-19T02:18:34.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/730: symlink da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/lff 0 2024-04-19T02:18:34.243 INFO:tasks.workunit.client.0.smithi073.stdout:7/763: dread d0/d3/f46 [0,4194304] 0 2024-04-19T02:18:34.243 INFO:tasks.workunit.client.0.smithi073.stdout:1/653: stat db/d1c/d54/d8b/dab 0 2024-04-19T02:18:34.244 INFO:tasks.workunit.client.0.smithi073.stdout:8/749: unlink d14/d27/d29/d69/l8e 0 2024-04-19T02:18:34.244 INFO:tasks.workunit.client.0.smithi073.stdout:0/689: dwrite d7/d14/d17/d1a/d20/f6c [0,4194304] 0 2024-04-19T02:18:34.245 INFO:tasks.workunit.client.0.smithi073.stdout:9/666: dwrite d0/df/d16/d19/db1/f37 [0,4194304] 0 2024-04-19T02:18:34.245 INFO:tasks.workunit.client.0.smithi073.stdout:2/748: dwrite d5/d10/d29/f8c [0,4194304] 0 2024-04-19T02:18:34.247 INFO:tasks.workunit.client.0.smithi073.stdout:4/731: creat da/d27/d2c/da6/f100 x:0 0 0 2024-04-19T02:18:34.247 INFO:tasks.workunit.client.0.smithi073.stdout:1/654: mknod db/d3e/ce8 0 2024-04-19T02:18:34.247 INFO:tasks.workunit.client.0.smithi073.stdout:5/753: getdents d0/d2d/daf 0 2024-04-19T02:18:34.248 INFO:tasks.workunit.client.0.smithi073.stdout:7/764: write d0/dc/d39/d40/f44 [3034282,69038] 0 2024-04-19T02:18:34.248 INFO:tasks.workunit.client.0.smithi073.stdout:1/655: chown db/d1c/d81 3264621 1 2024-04-19T02:18:34.248 INFO:tasks.workunit.client.0.smithi073.stdout:4/732: chown f4 141948125 1 2024-04-19T02:18:34.248 INFO:tasks.workunit.client.0.smithi073.stdout:5/754: mknod d0/d1d/d25/d37/ced 0 2024-04-19T02:18:34.249 INFO:tasks.workunit.client.0.smithi073.stdout:1/656: chown db/d3e/f97 8 1 2024-04-19T02:18:34.249 INFO:tasks.workunit.client.0.smithi073.stdout:9/667: symlink d0/d81/dda/ddd/dc2/lea 0 2024-04-19T02:18:34.250 INFO:tasks.workunit.client.0.smithi073.stdout:6/656: rename d8/d4b/d93/c5a to d8/de/d7f/da5/dae/dc3/cd6 0 2024-04-19T02:18:34.251 INFO:tasks.workunit.client.0.smithi073.stdout:5/755: write d0/d1d/d24/fae [81983,33267] 0 2024-04-19T02:18:34.251 INFO:tasks.workunit.client.0.smithi073.stdout:7/765: link d0/d28/d63/fa2 d0/dc/d33/da7/fe6 0 2024-04-19T02:18:34.251 INFO:tasks.workunit.client.0.smithi073.stdout:1/657: chown db/d3e/f92 18664927 1 2024-04-19T02:18:34.251 INFO:tasks.workunit.client.0.smithi073.stdout:6/657: stat d8/de/c17 0 2024-04-19T02:18:34.252 INFO:tasks.workunit.client.0.smithi073.stdout:4/733: chown da/d27/d36/d4d/dde/ce2 46990724 1 2024-04-19T02:18:34.252 INFO:tasks.workunit.client.0.smithi073.stdout:7/766: rmdir d0/dc/d84 39 2024-04-19T02:18:34.253 INFO:tasks.workunit.client.0.smithi073.stdout:5/756: truncate d0/f4f 2181967 0 2024-04-19T02:18:34.253 INFO:tasks.workunit.client.0.smithi073.stdout:6/658: write d8/d71/d75/f8d [615473,55258] 0 2024-04-19T02:18:34.253 INFO:tasks.workunit.client.0.smithi073.stdout:1/658: symlink db/d1c/d78/d8c/dd5/le9 0 2024-04-19T02:18:34.253 INFO:tasks.workunit.client.0.smithi073.stdout:7/767: fsync d0/dc/d67/f65 0 2024-04-19T02:18:34.253 INFO:tasks.workunit.client.0.smithi073.stdout:9/668: write d0/df/d16/d19/db1/d2c/d2e/f4b [1520924,70061] 0 2024-04-19T02:18:34.253 INFO:tasks.workunit.client.0.smithi073.stdout:3/825: dwrite d3/d6/db/d3a/d38/d43/d4e/f39 [0,4194304] 0 2024-04-19T02:18:34.254 INFO:tasks.workunit.client.0.smithi073.stdout:1/659: read - db/d1c/d81/d83/fc6 zero size 2024-04-19T02:18:34.254 INFO:tasks.workunit.client.0.smithi073.stdout:3/826: readlink d3/d6/db/d3a/lf1 0 2024-04-19T02:18:34.254 INFO:tasks.workunit.client.0.smithi073.stdout:1/660: chown db/d1c/d81/d86 5945842 1 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:1/661: chown db/d41/f4c 367096 1 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:6/659: symlink d8/de/d22/ld7 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:9/669: rename d0/f50 to d0/df/d16/d19/d38/d5d/d5e/d83/feb 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:6/660: read d8/f11 [6328065,98318] 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:9/670: fdatasync d0/df/d1d/f2f 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:3/827: truncate d3/d6/db/d16/d9e/fa8 1471435 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:6/661: dread d8/de/f32 [0,4194304] 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:9/671: mkdir d0/d81/dda/ddd/dc2/dec 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:8/750: dread d14/d27/da4/fc3 [0,4194304] 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:6/662: symlink d8/de/d22/da8/ld8 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:0/690: read d7/d14/d17/d69/f6a [2028657,22228] 0 2024-04-19T02:18:34.259 INFO:tasks.workunit.client.0.smithi073.stdout:1/662: dread db/d1c/d81/d86/f9e [0,4194304] 0 2024-04-19T02:18:34.260 INFO:tasks.workunit.client.0.smithi073.stdout:0/691: symlink d7/d14/d17/d1a/d21/ld5 0 2024-04-19T02:18:34.260 INFO:tasks.workunit.client.0.smithi073.stdout:8/751: mkdir d14/d27/d4c/d101 0 2024-04-19T02:18:34.260 INFO:tasks.workunit.client.0.smithi073.stdout:3/828: link d3/d6/db/d3a/d5f/lb8 d3/d6/db/d16/d52/l112 0 2024-04-19T02:18:34.260 INFO:tasks.workunit.client.0.smithi073.stdout:1/663: write db/d1c/d81/d86/fa6 [353113,50950] 0 2024-04-19T02:18:34.261 INFO:tasks.workunit.client.0.smithi073.stdout:1/664: fsync db/fac 0 2024-04-19T02:18:34.261 INFO:tasks.workunit.client.0.smithi073.stdout:0/692: symlink d7/d14/d17/d69/ld6 0 2024-04-19T02:18:34.261 INFO:tasks.workunit.client.0.smithi073.stdout:8/752: write d14/d27/d7b/fda [991924,21129] 0 2024-04-19T02:18:34.261 INFO:tasks.workunit.client.0.smithi073.stdout:3/829: mknod d3/d6/db/d3a/d38/d6f/daf/c113 0 2024-04-19T02:18:34.262 INFO:tasks.workunit.client.0.smithi073.stdout:1/665: chown db/d1c/d78/d8c/dd5/d50/cd9 1 1 2024-04-19T02:18:34.262 INFO:tasks.workunit.client.0.smithi073.stdout:8/753: chown d14/d27/d29/d31/d34/c7f 2 1 2024-04-19T02:18:34.262 INFO:tasks.workunit.client.0.smithi073.stdout:5/757: read d0/d1d/d25/d37/d71/dd6/f7e [126648,43319] 0 2024-04-19T02:18:34.263 INFO:tasks.workunit.client.0.smithi073.stdout:3/830: creat d3/d6/db/d16/d52/f114 x:0 0 0 2024-04-19T02:18:34.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/758: mkdir d0/d1d/d25/d35/dbf/de9/dee 0 2024-04-19T02:18:34.265 INFO:tasks.workunit.client.0.smithi073.stdout:8/754: getdents d14/d27/d29/d64 0 2024-04-19T02:18:34.265 INFO:tasks.workunit.client.0.smithi073.stdout:1/666: rename db/d1c/d81/d83/db8/fd7 to db/d1c/d54/fea 0 2024-04-19T02:18:34.265 INFO:tasks.workunit.client.0.smithi073.stdout:6/663: dread d8/de/d7f/fa0 [0,4194304] 0 2024-04-19T02:18:34.266 INFO:tasks.workunit.client.0.smithi073.stdout:3/831: getdents d3/d6/db/d3a/d38/d57/df6 0 2024-04-19T02:18:34.266 INFO:tasks.workunit.client.0.smithi073.stdout:4/734: dread da/d27/d2c/d80/dcf/ddd/f40 [0,4194304] 0 2024-04-19T02:18:34.267 INFO:tasks.workunit.client.0.smithi073.stdout:6/664: mkdir d8/d4b/d8f/dd9 0 2024-04-19T02:18:34.268 INFO:tasks.workunit.client.0.smithi073.stdout:8/755: write d14/d27/d4c/f7d [1180029,1099] 0 2024-04-19T02:18:34.268 INFO:tasks.workunit.client.0.smithi073.stdout:9/672: dwrite d0/df/d16/d19/d38/fc9 [0,4194304] 0 2024-04-19T02:18:34.269 INFO:tasks.workunit.client.0.smithi073.stdout:6/665: mkdir d8/dda 0 2024-04-19T02:18:34.269 INFO:tasks.workunit.client.0.smithi073.stdout:3/832: dread - d3/d6/db/d3a/d38/d6f/daf/fe4 zero size 2024-04-19T02:18:34.269 INFO:tasks.workunit.client.0.smithi073.stdout:0/693: dwrite d7/f11 [4194304,4194304] 0 2024-04-19T02:18:34.269 INFO:tasks.workunit.client.0.smithi073.stdout:1/667: rename db/d1c/d78/d8c/dd5/le9 to db/d3e/leb 0 2024-04-19T02:18:34.270 INFO:tasks.workunit.client.0.smithi073.stdout:4/735: creat da/d27/d1b/d1d/d72/dd5/f101 x:0 0 0 2024-04-19T02:18:34.272 INFO:tasks.workunit.client.0.smithi073.stdout:6/666: chown d8/de/d58/d63/f6b 14178181 1 2024-04-19T02:18:34.272 INFO:tasks.workunit.client.0.smithi073.stdout:0/694: symlink d7/d14/d17/d69/d7c/dbe/ld7 0 2024-04-19T02:18:34.273 INFO:tasks.workunit.client.0.smithi073.stdout:1/668: symlink db/d1c/d81/d83/db8/lec 0 2024-04-19T02:18:34.273 INFO:tasks.workunit.client.0.smithi073.stdout:4/736: creat da/d27/d2c/d80/dcf/ddd/f102 x:0 0 0 2024-04-19T02:18:34.273 INFO:tasks.workunit.client.0.smithi073.stdout:9/673: symlink d0/df/d16/d19/d38/d5d/d5e/da0/led 0 2024-04-19T02:18:34.273 INFO:tasks.workunit.client.0.smithi073.stdout:8/756: getdents d14/d15/d17/d48/d89/ddd/df2 0 2024-04-19T02:18:34.273 INFO:tasks.workunit.client.0.smithi073.stdout:5/759: dwrite d0/d1d/d25/d37/d71/f89 [0,4194304] 0 2024-04-19T02:18:34.274 INFO:tasks.workunit.client.0.smithi073.stdout:4/737: write da/d27/d1b/d26/d2a/d46/fc7 [558882,126026] 0 2024-04-19T02:18:34.274 INFO:tasks.workunit.client.0.smithi073.stdout:6/667: link d8/de/l48 d8/d71/d7d/dab/ldb 0 2024-04-19T02:18:34.275 INFO:tasks.workunit.client.0.smithi073.stdout:6/668: dread - d8/de/d22/fb2 zero size 2024-04-19T02:18:34.275 INFO:tasks.workunit.client.0.smithi073.stdout:4/738: symlink da/d27/d1b/d1d/d72/d2b/d2f/d68/de5/l103 0 2024-04-19T02:18:34.276 INFO:tasks.workunit.client.0.smithi073.stdout:4/739: readlink da/ld 0 2024-04-19T02:18:34.276 INFO:tasks.workunit.client.0.smithi073.stdout:6/669: chown d8/d71/d7d/dab 13 1 2024-04-19T02:18:34.277 INFO:tasks.workunit.client.0.smithi073.stdout:6/670: creat d8/d71/fdc x:0 0 0 2024-04-19T02:18:34.279 INFO:tasks.workunit.client.0.smithi073.stdout:9/674: dwrite d0/d35/fd9 [0,4194304] 0 2024-04-19T02:18:34.279 INFO:tasks.workunit.client.0.smithi073.stdout:0/695: dwrite f5 [0,4194304] 0 2024-04-19T02:18:34.281 INFO:tasks.workunit.client.0.smithi073.stdout:0/696: link d7/d14/d17/d1a/f29 d7/d6d/dbd/fd8 0 2024-04-19T02:18:34.282 INFO:tasks.workunit.client.0.smithi073.stdout:0/697: getdents d7/d6d 0 2024-04-19T02:18:34.283 INFO:tasks.workunit.client.0.smithi073.stdout:1/669: read db/d1c/d81/d86/fbc [662190,103552] 0 2024-04-19T02:18:34.283 INFO:tasks.workunit.client.0.smithi073.stdout:2/749: dread d5/d10/d14/db6/fe6 [0,4194304] 0 2024-04-19T02:18:34.284 INFO:tasks.workunit.client.0.smithi073.stdout:0/698: write d7/d14/d17/d1a/d21/f36 [814130,124665] 0 2024-04-19T02:18:34.284 INFO:tasks.workunit.client.0.smithi073.stdout:1/670: mkdir db/d7f/ded 0 2024-04-19T02:18:34.284 INFO:tasks.workunit.client.0.smithi073.stdout:0/699: fdatasync d7/d14/f47 0 2024-04-19T02:18:34.287 INFO:tasks.workunit.client.0.smithi073.stdout:1/671: dread db/d1c/d81/d86/dae/f75 [0,4194304] 0 2024-04-19T02:18:34.291 INFO:tasks.workunit.client.0.smithi073.stdout:2/750: dwrite d5/d10/d14/d18/d3e/d2d/f8e [0,4194304] 0 2024-04-19T02:18:34.291 INFO:tasks.workunit.client.0.smithi073.stdout:0/700: dwrite d7/d14/d17/d1a/d21/f36 [4194304,4194304] 0 2024-04-19T02:18:34.292 INFO:tasks.workunit.client.0.smithi073.stdout:2/751: fdatasync d5/d10/d14/d18/d3e/de1/ff2 0 2024-04-19T02:18:34.292 INFO:tasks.workunit.client.0.smithi073.stdout:1/672: dwrite db/f30 [0,4194304] 0 2024-04-19T02:18:34.293 INFO:tasks.workunit.client.0.smithi073.stdout:0/701: write d7/d14/d17/d1a/d21/f53 [2687234,50255] 0 2024-04-19T02:18:34.294 INFO:tasks.workunit.client.0.smithi073.stdout:0/702: chown d7/d14/d17/d1a/d20/d50/d99/cb6 120015 1 2024-04-19T02:18:34.294 INFO:tasks.workunit.client.0.smithi073.stdout:0/703: chown d7/d14/d17/l31 5 1 2024-04-19T02:18:34.294 INFO:tasks.workunit.client.0.smithi073.stdout:4/740: rename da/d27/d2c/d80/dcf to da/d27/d1b/d1d/d72/d104 0 2024-04-19T02:18:34.295 INFO:tasks.workunit.client.0.smithi073.stdout:5/760: write d0/d1d/d25/d35/f3a [273468,64507] 0 2024-04-19T02:18:34.295 INFO:tasks.workunit.client.0.smithi073.stdout:6/671: truncate d8/f11 337884 0 2024-04-19T02:18:34.295 INFO:tasks.workunit.client.0.smithi073.stdout:2/752: rename d5/d10/d29/dd4 to d5/d10/d14/d18/d98/d107 0 2024-04-19T02:18:34.296 INFO:tasks.workunit.client.0.smithi073.stdout:5/761: dread - d0/d1d/d64/f6b zero size 2024-04-19T02:18:34.296 INFO:tasks.workunit.client.0.smithi073.stdout:4/741: mkdir da/d27/d1b/d1d/d72/d2b/d2f/d105 0 2024-04-19T02:18:34.296 INFO:tasks.workunit.client.0.smithi073.stdout:0/704: rmdir d7/d14/d17/d1a/d20/d50/d99/da7/d87 39 2024-04-19T02:18:34.297 INFO:tasks.workunit.client.0.smithi073.stdout:5/762: write d0/d1d/d25/f6e [125601,75141] 0 2024-04-19T02:18:34.297 INFO:tasks.workunit.client.0.smithi073.stdout:6/672: rename d8/de/d7f/da5/dae to d8/de/d7f/da5/dae/ddd 22 2024-04-19T02:18:34.297 INFO:tasks.workunit.client.0.smithi073.stdout:2/753: chown d5/d10/d14/d18/d3e/d2d/d63/da2/fb2 3 1 2024-04-19T02:18:34.298 INFO:tasks.workunit.client.0.smithi073.stdout:4/742: creat da/d27/d1b/d1d/d72/d104/f106 x:0 0 0 2024-04-19T02:18:34.298 INFO:tasks.workunit.client.0.smithi073.stdout:5/763: write d0/d1d/d1e/f80 [1764979,78092] 0 2024-04-19T02:18:34.298 INFO:tasks.workunit.client.0.smithi073.stdout:2/754: read - d5/d10/d29/d66/d83/ffd zero size 2024-04-19T02:18:34.299 INFO:tasks.workunit.client.0.smithi073.stdout:2/755: stat d5/d10/d14/d18/d3e/d2d/f8e 0 2024-04-19T02:18:34.300 INFO:tasks.workunit.client.0.smithi073.stdout:4/743: rename da/d27/d1b/d1d/d72/d104/de1 to da/d27/d2c/ddb/d107 0 2024-04-19T02:18:34.301 INFO:tasks.workunit.client.0.smithi073.stdout:2/756: unlink d5/d10/d29/d42/cf4 0 2024-04-19T02:18:34.301 INFO:tasks.workunit.client.0.smithi073.stdout:4/744: chown da/d27/d2c/d80 0 1 2024-04-19T02:18:34.305 INFO:tasks.workunit.client.0.smithi073.stdout:4/745: mkdir da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/d108 0 2024-04-19T02:18:34.305 INFO:tasks.workunit.client.0.smithi073.stdout:0/705: dwrite d7/d14/d17/d1a/d8d/fb3 [0,4194304] 0 2024-04-19T02:18:34.305 INFO:tasks.workunit.client.0.smithi073.stdout:4/746: stat da/d27/d1b/d1d/d72/d104 0 2024-04-19T02:18:34.306 INFO:tasks.workunit.client.0.smithi073.stdout:5/764: dwrite d0/d69/fab [0,4194304] 0 2024-04-19T02:18:34.306 INFO:tasks.workunit.client.0.smithi073.stdout:4/747: mkdir da/d27/d1b/d109 0 2024-04-19T02:18:34.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/748: readlink da/d27/d1b/l22 0 2024-04-19T02:18:34.307 INFO:tasks.workunit.client.0.smithi073.stdout:1/673: dwrite db/ff [4194304,4194304] 0 2024-04-19T02:18:34.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/749: dread - da/d27/d3a/d49/ff0 zero size 2024-04-19T02:18:34.308 INFO:tasks.workunit.client.0.smithi073.stdout:4/750: dread - da/d27/fd3 zero size 2024-04-19T02:18:34.309 INFO:tasks.workunit.client.0.smithi073.stdout:5/765: getdents d0/d1d/d25/d37 0 2024-04-19T02:18:34.311 INFO:tasks.workunit.client.0.smithi073.stdout:3/833: sync 2024-04-19T02:18:34.311 INFO:tasks.workunit.client.0.smithi073.stdout:8/757: sync 2024-04-19T02:18:34.312 INFO:tasks.workunit.client.0.smithi073.stdout:6/673: truncate d8/de/d58/d63/f6b 1627081 0 2024-04-19T02:18:34.315 INFO:tasks.workunit.client.0.smithi073.stdout:5/766: mknod d0/d1d/d25/d35/d39/dd8/cef 0 2024-04-19T02:18:34.315 INFO:tasks.workunit.client.0.smithi073.stdout:8/758: write d14/d27/d29/d31/fb7 [37967,62473] 0 2024-04-19T02:18:34.315 INFO:tasks.workunit.client.0.smithi073.stdout:1/674: dwrite db/d41/f74 [0,4194304] 0 2024-04-19T02:18:34.315 INFO:tasks.workunit.client.0.smithi073.stdout:5/767: chown d0/d1d/d24/d61/f74 994537 1 2024-04-19T02:18:34.315 INFO:tasks.workunit.client.0.smithi073.stdout:5/768: mkdir d0/d1d/d25/d35/d96/df0 0 2024-04-19T02:18:34.316 INFO:tasks.workunit.client.0.smithi073.stdout:4/751: dwrite da/d27/d1b/d26/d2a/fa9 [0,4194304] 0 2024-04-19T02:18:34.316 INFO:tasks.workunit.client.0.smithi073.stdout:2/757: dread d5/d10/d14/d7a/fba [0,4194304] 0 2024-04-19T02:18:34.317 INFO:tasks.workunit.client.0.smithi073.stdout:6/674: dread d8/de/f1e [0,4194304] 0 2024-04-19T02:18:34.318 INFO:tasks.workunit.client.0.smithi073.stdout:7/768: dread d0/dc/d39/d50/f86 [0,4194304] 0 2024-04-19T02:18:34.319 INFO:tasks.workunit.client.0.smithi073.stdout:5/769: read d0/d1d/d25/d37/d71/dd6/fa6 [1068175,13235] 0 2024-04-19T02:18:34.319 INFO:tasks.workunit.client.0.smithi073.stdout:6/675: rename d8/d71/d75/fac to d8/d4b/d93/fde 0 2024-04-19T02:18:34.320 INFO:tasks.workunit.client.0.smithi073.stdout:5/770: getdents d0/d1d/d25/d35/d96/dd3 0 2024-04-19T02:18:34.323 INFO:tasks.workunit.client.0.smithi073.stdout:1/675: dwrite db/d3e/fd8 [0,4194304] 0 2024-04-19T02:18:34.323 INFO:tasks.workunit.client.0.smithi073.stdout:3/834: truncate d3/f47 4003523 0 2024-04-19T02:18:34.323 INFO:tasks.workunit.client.0.smithi073.stdout:8/759: write d14/d27/d29/d31/d34/fa8 [1112458,125395] 0 2024-04-19T02:18:34.324 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:34.319+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:34.326 INFO:tasks.workunit.client.0.smithi073.stdout:8/760: mkdir d14/d15/d17/d48/d89/ddd/dfe/d102 0 2024-04-19T02:18:34.327 INFO:tasks.workunit.client.0.smithi073.stdout:4/752: dwrite da/d27/d36/f6e [0,4194304] 0 2024-04-19T02:18:34.327 INFO:tasks.workunit.client.0.smithi073.stdout:3/835: creat d3/d6/db/d3a/d38/d57/d88/dc2/f115 x:0 0 0 2024-04-19T02:18:34.327 INFO:tasks.workunit.client.0.smithi073.stdout:1/676: getdents db/d1c/d54/d8b 0 2024-04-19T02:18:34.327 INFO:tasks.workunit.client.0.smithi073.stdout:6/676: dwrite d8/de/f32 [0,4194304] 0 2024-04-19T02:18:34.328 INFO:tasks.workunit.client.0.smithi073.stdout:7/769: dwrite d0/dc/d67/d2a/d51/d7a/f95 [0,4194304] 0 2024-04-19T02:18:34.329 INFO:tasks.workunit.client.0.smithi073.stdout:4/753: write da/d27/d3a/d49/ff0 [981326,22829] 0 2024-04-19T02:18:34.329 INFO:tasks.workunit.client.0.smithi073.stdout:3/836: truncate d3/d6/db/d1a/d2f/fc6 162984 0 2024-04-19T02:18:34.330 INFO:tasks.workunit.client.0.smithi073.stdout:8/761: symlink d14/d15/d17/d8d/l103 0 2024-04-19T02:18:34.330 INFO:tasks.workunit.client.0.smithi073.stdout:7/770: fdatasync d0/dc/d39/d50/f8c 0 2024-04-19T02:18:34.330 INFO:tasks.workunit.client.0.smithi073.stdout:6/677: creat d8/fdf x:0 0 0 2024-04-19T02:18:34.330 INFO:tasks.workunit.client.0.smithi073.stdout:4/754: mknod da/d27/d1b/d1d/d72/d104/ddd/df5/c10a 0 2024-04-19T02:18:34.331 INFO:tasks.workunit.client.0.smithi073.stdout:1/677: creat db/d1c/d78/d8c/dd5/fee x:0 0 0 2024-04-19T02:18:34.331 INFO:tasks.workunit.client.0.smithi073.stdout:7/771: mknod d0/dc/d39/d40/ce7 0 2024-04-19T02:18:34.331 INFO:tasks.workunit.client.0.smithi073.stdout:3/837: symlink d3/d6/db/d16/d75/l116 0 2024-04-19T02:18:34.332 INFO:tasks.workunit.client.0.smithi073.stdout:8/762: link d14/fd5 d14/d27/d85/d9a/df6/f104 0 2024-04-19T02:18:34.332 INFO:tasks.workunit.client.0.smithi073.stdout:6/678: write d8/de/ff [5240235,25727] 0 2024-04-19T02:18:34.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/678: write db/d1c/d78/fb9 [236997,5755] 0 2024-04-19T02:18:34.333 INFO:tasks.workunit.client.0.smithi073.stdout:7/772: creat d0/dc/d67/d15/fe8 x:0 0 0 2024-04-19T02:18:34.333 INFO:tasks.workunit.client.0.smithi073.stdout:6/679: creat d8/de/d7f/fe0 x:0 0 0 2024-04-19T02:18:34.333 INFO:tasks.workunit.client.0.smithi073.stdout:4/755: mknod da/d27/d1b/d1d/d72/dd5/c10b 0 2024-04-19T02:18:34.333 INFO:tasks.workunit.client.0.smithi073.stdout:5/771: read d0/d1d/d25/d35/f42 [2201130,34101] 0 2024-04-19T02:18:34.334 INFO:tasks.workunit.client.0.smithi073.stdout:1/679: write db/d1c/d81/d86/fbc [343629,102828] 0 2024-04-19T02:18:34.334 INFO:tasks.workunit.client.0.smithi073.stdout:3/838: truncate d3/d6/db/d3a/d38/d6f/daf/dfd/f111 155530 0 2024-04-19T02:18:34.334 INFO:tasks.workunit.client.0.smithi073.stdout:4/756: creat da/d27/d2c/dc1/f10c x:0 0 0 2024-04-19T02:18:34.335 INFO:tasks.workunit.client.0.smithi073.stdout:1/680: mknod db/d3e/cef 0 2024-04-19T02:18:34.335 INFO:tasks.workunit.client.0.smithi073.stdout:3/839: creat d3/d6/db/d3a/d5f/dca/dde/f117 x:0 0 0 2024-04-19T02:18:34.336 INFO:tasks.workunit.client.0.smithi073.stdout:0/706: dread d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:34.336 INFO:tasks.workunit.client.0.smithi073.stdout:1/681: fsync db/d1c/d54/fea 0 2024-04-19T02:18:34.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/772: truncate d0/d1d/d25/d37/d71/dd6/f92 3590162 0 2024-04-19T02:18:34.337 INFO:tasks.workunit.client.0.smithi073.stdout:4/757: rename da/d27/d1b/d1d/d8d/d84/lf2 to da/d27/d1b/d1d/d72/l10d 0 2024-04-19T02:18:34.337 INFO:tasks.workunit.client.0.smithi073.stdout:3/840: write d3/d6/db/d16/d9e/fd9 [768821,25458] 0 2024-04-19T02:18:34.338 INFO:tasks.workunit.client.0.smithi073.stdout:1/682: dread - db/d1c/d54/d8b/dab/fb0 zero size 2024-04-19T02:18:34.338 INFO:tasks.workunit.client.0.smithi073.stdout:5/773: symlink d0/d1d/d25/d35/d39/dd8/lf1 0 2024-04-19T02:18:34.339 INFO:tasks.workunit.client.0.smithi073.stdout:1/683: chown db/d41/l51 6 1 2024-04-19T02:18:34.339 INFO:tasks.workunit.client.0.smithi073.stdout:2/758: dread d5/d10/d29/d66/f69 [0,4194304] 0 2024-04-19T02:18:34.339 INFO:tasks.workunit.client.0.smithi073.stdout:3/841: chown d3/d6/db/d3a/d38/d89/d94/d7b/f8b 2 1 2024-04-19T02:18:34.340 INFO:tasks.workunit.client.0.smithi073.stdout:1/684: write db/d1c/d81/d86/ddd/fe4 [968186,35321] 0 2024-04-19T02:18:34.340 INFO:tasks.workunit.client.0.smithi073.stdout:2/759: write d5/d10/d14/d18/d3e/f9a [1969024,24005] 0 2024-04-19T02:18:34.341 INFO:tasks.workunit.client.0.smithi073.stdout:1/685: stat db/d1c/d78/d8c/dd5/d50/cd9 0 2024-04-19T02:18:34.341 INFO:tasks.workunit.client.0.smithi073.stdout:6/680: dwrite d8/d71/d75/f8d [0,4194304] 0 2024-04-19T02:18:34.342 INFO:tasks.workunit.client.0.smithi073.stdout:1/686: write db/d41/dc5/fe1 [702535,46634] 0 2024-04-19T02:18:34.342 INFO:tasks.workunit.client.0.smithi073.stdout:3/842: getdents d3/d6/db/d3a/d38/d43/d4e 0 2024-04-19T02:18:34.342 INFO:tasks.workunit.client.0.smithi073.stdout:2/760: truncate d5/d10/d14/d2e/fcc 375572 0 2024-04-19T02:18:34.342 INFO:tasks.workunit.client.0.smithi073.stdout:2/761: chown d5/d10/l1c 131341478 1 2024-04-19T02:18:34.343 INFO:tasks.workunit.client.0.smithi073.stdout:3/843: creat d3/d6/db/d3a/d38/d6f/daf/f118 x:0 0 0 2024-04-19T02:18:34.343 INFO:tasks.workunit.client.0.smithi073.stdout:1/687: link db/d1c/d78/d8c/dd5/f63 db/d1c/d54/d8b/dab/ff0 0 2024-04-19T02:18:34.343 INFO:tasks.workunit.client.0.smithi073.stdout:2/762: write d5/d10/d14/d18/fbd [584181,24252] 0 2024-04-19T02:18:34.344 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:34.344 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:34.344 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:34.344 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:34.344 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:34.345 INFO:tasks.workunit.client.0.smithi073.stdout:1/688: fsync db/d1c/d78/d8c/dd5/d50/d62/dc0/db1/dc4/fe2 0 2024-04-19T02:18:34.345 INFO:tasks.workunit.client.0.smithi073.stdout:2/763: mkdir d5/d10/d29/d66/d7e/d108 0 2024-04-19T02:18:34.345 INFO:tasks.workunit.client.0.smithi073.stdout:3/844: chown d3/d6/db/d3a/d38/c82 205684 1 2024-04-19T02:18:34.346 INFO:tasks.workunit.client.0.smithi073.stdout:4/758: dread da/d27/d3a/d50/f8b [0,4194304] 0 2024-04-19T02:18:34.346 INFO:tasks.workunit.client.0.smithi073.stdout:3/845: write d3/d6/db/d3a/d5f/da7/f102 [785578,34944] 0 2024-04-19T02:18:34.347 INFO:tasks.workunit.client.0.smithi073.stdout:9/675: dread d0/df/d1d/f44 [4194304,4194304] 0 2024-04-19T02:18:34.347 INFO:tasks.workunit.client.0.smithi073.stdout:3/846: symlink d3/d6/db/d16/l119 0 2024-04-19T02:18:34.348 INFO:tasks.workunit.client.0.smithi073.stdout:9/676: chown d0/df/f11 2374473 1 2024-04-19T02:18:34.348 INFO:tasks.workunit.client.0.smithi073.stdout:3/847: readlink d3/d6/db/d3a/d38/d6f/dac/dc9/led 0 2024-04-19T02:18:34.349 INFO:tasks.workunit.client.0.smithi073.stdout:9/677: write d0/fc [7058070,20225] 0 2024-04-19T02:18:34.349 INFO:tasks.workunit.client.0.smithi073.stdout:4/759: dread da/d27/d1b/d26/f4c [0,4194304] 0 2024-04-19T02:18:34.350 INFO:tasks.workunit.client.0.smithi073.stdout:9/678: write d0/df/d16/d19/f3d [2439444,129401] 0 2024-04-19T02:18:34.353 INFO:tasks.workunit.client.0.smithi073.stdout:9/679: unlink d0/c1c 0 2024-04-19T02:18:34.353 INFO:tasks.workunit.client.0.smithi073.stdout:2/764: dwrite d5/d10/d14/d18/d3e/d2d/fc1 [4194304,4194304] 0 2024-04-19T02:18:34.354 INFO:tasks.workunit.client.0.smithi073.stdout:9/680: creat d0/fee x:0 0 0 2024-04-19T02:18:34.354 INFO:tasks.workunit.client.0.smithi073.stdout:2/765: creat d5/d10/d14/d18/d3e/d51/f109 x:0 0 0 2024-04-19T02:18:34.355 INFO:tasks.workunit.client.0.smithi073.stdout:2/766: write d5/d10/fec [909864,50707] 0 2024-04-19T02:18:34.356 INFO:tasks.workunit.client.0.smithi073.stdout:3/848: dwrite d3/d6/db/d3a/d38/d43/d4e/f39 [0,4194304] 0 2024-04-19T02:18:34.357 INFO:tasks.workunit.client.0.smithi073.stdout:9/681: link d0/df/d16/d19/d38/d5d/d45/f48 d0/df/d16/d19/db1/d2c/fef 0 2024-04-19T02:18:34.357 INFO:tasks.workunit.client.0.smithi073.stdout:4/760: dwrite da/d27/d1b/d1d/d72/d2b/d2f/f63 [0,4194304] 0 2024-04-19T02:18:34.358 INFO:tasks.workunit.client.0.smithi073.stdout:9/682: truncate d0/d35/fe2 3981 0 2024-04-19T02:18:34.358 INFO:tasks.workunit.client.0.smithi073.stdout:4/761: write da/d27/d3a/d50/d9c/fc6 [5123556,118477] 0 2024-04-19T02:18:34.359 INFO:tasks.workunit.client.0.smithi073.stdout:2/767: rename d5/d10/d14/d18/d3e/f9a to d5/d10/d14/d18/d3e/de1/f10a 0 2024-04-19T02:18:34.359 INFO:tasks.workunit.client.0.smithi073.stdout:4/762: read da/d27/d1b/d26/f4c [2837325,30666] 0 2024-04-19T02:18:34.359 INFO:tasks.workunit.client.0.smithi073.stdout:9/683: mkdir d0/df/df0 0 2024-04-19T02:18:34.359 INFO:tasks.workunit.client.0.smithi073.stdout:2/768: chown d5/d10/d29/d66/d67/df1 17 1 2024-04-19T02:18:34.360 INFO:tasks.workunit.client.0.smithi073.stdout:4/763: stat da/d27/d1b/d26/d2a/l57 0 2024-04-19T02:18:34.360 INFO:tasks.workunit.client.0.smithi073.stdout:4/764: dread - da/d27/fd3 zero size 2024-04-19T02:18:34.360 INFO:tasks.workunit.client.0.smithi073.stdout:9/684: symlink d0/df/d16/d19/d38/d5d/d45/lf1 0 2024-04-19T02:18:34.360 INFO:tasks.workunit.client.0.smithi073.stdout:2/769: mknod d5/d10/d29/d66/d67/c10b 0 2024-04-19T02:18:34.361 INFO:tasks.workunit.client.0.smithi073.stdout:9/685: readlink d0/df/d16/d19/d38/d5d/d5e/da0/led 0 2024-04-19T02:18:34.361 INFO:tasks.workunit.client.0.smithi073.stdout:4/765: symlink da/d27/d1b/d1d/d72/d104/l10e 0 2024-04-19T02:18:34.361 INFO:tasks.workunit.client.0.smithi073.stdout:2/770: write d5/d10/d14/d18/d3e/d2d/d63/f46 [5008804,45519] 0 2024-04-19T02:18:34.362 INFO:tasks.workunit.client.0.smithi073.stdout:4/766: mknod da/d27/d1b/d1d/d72/d2b/c10f 0 2024-04-19T02:18:34.362 INFO:tasks.workunit.client.0.smithi073.stdout:2/771: fdatasync d5/d10/d29/d42/fed 0 2024-04-19T02:18:34.363 INFO:tasks.workunit.client.0.smithi073.stdout:2/772: stat d5/d10/d14/d18/d3e/d2d/c6d 0 2024-04-19T02:18:34.363 INFO:tasks.workunit.client.0.smithi073.stdout:4/767: mkdir da/d27/d2c/ddb/d107/dfc/d110 0 2024-04-19T02:18:34.364 INFO:tasks.workunit.client.0.smithi073.stdout:2/773: creat d5/d10/d14/d7a/f10c x:0 0 0 2024-04-19T02:18:34.364 INFO:tasks.workunit.client.0.smithi073.stdout:4/768: dread - da/d27/d1b/d1d/d72/f96 zero size 2024-04-19T02:18:34.365 INFO:tasks.workunit.client.0.smithi073.stdout:4/769: chown da/d27/d1b/d1d/d72/d2b/d2f/lbf 525 1 2024-04-19T02:18:34.365 INFO:tasks.workunit.client.0.smithi073.stdout:7/773: getdents d0/dc/d39/d40 0 2024-04-19T02:18:34.365 INFO:tasks.workunit.client.0.smithi073.stdout:8/763: truncate d14/f62 594837 0 2024-04-19T02:18:34.366 INFO:tasks.workunit.client.0.smithi073.stdout:5/774: write d0/d2d/f60 [3749948,5520] 0 2024-04-19T02:18:34.367 INFO:tasks.workunit.client.0.smithi073.stdout:5/775: symlink d0/d1d/d25/d35/dbf/de9/lf2 0 2024-04-19T02:18:34.368 INFO:tasks.workunit.client.0.smithi073.stdout:5/776: creat d0/d1d/d90/da0/dbb/ff3 x:0 0 0 2024-04-19T02:18:34.369 INFO:tasks.workunit.client.0.smithi073.stdout:3/849: dwrite d3/d6/db/d16/d9e/fd9 [0,4194304] 0 2024-04-19T02:18:34.370 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:34.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/764: write d14/d15/f26 [2904630,115339] 0 2024-04-19T02:18:34.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/774: truncate d0/dc/d67/f65 818732 0 2024-04-19T02:18:34.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/765: chown d14/d15 2404184 1 2024-04-19T02:18:34.371 INFO:tasks.workunit.client.0.smithi073.stdout:3/850: creat d3/d6/db/d3a/d5f/f11a x:0 0 0 2024-04-19T02:18:34.372 INFO:tasks.workunit.client.0.smithi073.stdout:2/774: dwrite d5/d10/d14/d2e/fcc [0,4194304] 0 2024-04-19T02:18:34.372 INFO:tasks.workunit.client.0.smithi073.stdout:7/775: rename d0/dc/d67/d2a/l69 to d0/d28/dba/le9 0 2024-04-19T02:18:34.372 INFO:tasks.workunit.client.0.smithi073.stdout:5/777: truncate d0/d1d/d25/d37/d71/dd6/f92 4410884 0 2024-04-19T02:18:34.373 INFO:tasks.workunit.client.0.smithi073.stdout:2/775: fdatasync d5/d10/d14/db6/fe6 0 2024-04-19T02:18:34.373 INFO:tasks.workunit.client.0.smithi073.stdout:3/851: truncate d3/d6/db/d3a/d38/d43/d4e/f104 219305 0 2024-04-19T02:18:34.373 INFO:tasks.workunit.client.0.smithi073.stdout:5/778: creat d0/d1d/d64/ff4 x:0 0 0 2024-04-19T02:18:34.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/776: mkdir d5/d10/d14/d18/d98/d107/d10d 0 2024-04-19T02:18:34.374 INFO:tasks.workunit.client.0.smithi073.stdout:5/779: write d0/f41 [81316,10476] 0 2024-04-19T02:18:34.375 INFO:tasks.workunit.client.0.smithi073.stdout:3/852: truncate d3/d6/db/d3a/fd6 597747 0 2024-04-19T02:18:34.376 INFO:tasks.workunit.client.0.smithi073.stdout:2/777: fdatasync d5/d10/d14/d18/d3e/de1/ff2 0 2024-04-19T02:18:34.376 INFO:tasks.workunit.client.0.smithi073.stdout:5/780: mkdir d0/d1d/d24/df5 0 2024-04-19T02:18:34.377 INFO:tasks.workunit.client.0.smithi073.stdout:2/778: rename d5 to d5/d10/d29/d66/d67/d10e 22 2024-04-19T02:18:34.377 INFO:tasks.workunit.client.0.smithi073.stdout:5/781: stat d0/d1d/d25/d35/d88/c91 0 2024-04-19T02:18:34.378 INFO:tasks.workunit.client.0.smithi073.stdout:8/766: dwrite d14/d27/d4c/d75/fb8 [0,4194304] 0 2024-04-19T02:18:34.379 INFO:tasks.workunit.client.0.smithi073.stdout:5/782: creat d0/ff6 x:0 0 0 2024-04-19T02:18:34.379 INFO:tasks.workunit.client.0.smithi073.stdout:2/779: rename f3 to d5/d10/d29/d66/d83/f10f 0 2024-04-19T02:18:34.380 INFO:tasks.workunit.client.0.smithi073.stdout:3/853: rename d3/d6/db/d3a/d5f/dca/cce to d3/d6/db/d3a/d38/d6f/daf/dfd/c11b 0 2024-04-19T02:18:34.380 INFO:tasks.workunit.client.0.smithi073.stdout:7/776: dwrite d0/dc/d67/d15/fe8 [0,4194304] 0 2024-04-19T02:18:34.382 INFO:tasks.workunit.client.0.smithi073.stdout:5/783: mknod d0/cf7 0 2024-04-19T02:18:34.382 INFO:tasks.workunit.client.0.smithi073.stdout:8/767: getdents d14/d15 0 2024-04-19T02:18:34.383 INFO:tasks.workunit.client.0.smithi073.stdout:2/780: mknod d5/d10/d29/d66/c110 0 2024-04-19T02:18:34.383 INFO:tasks.workunit.client.0.smithi073.stdout:1/689: fsync db/f30 0 2024-04-19T02:18:34.383 INFO:tasks.workunit.client.0.smithi073.stdout:5/784: mknod d0/d1d/d25/d35/d99/cf8 0 2024-04-19T02:18:34.384 INFO:tasks.workunit.client.0.smithi073.stdout:3/854: rename d3/d6/db/d3a/d38/d43/d4e/cea to d3/d6/db/d3a/d5f/dca/c11c 0 2024-04-19T02:18:34.384 INFO:tasks.workunit.client.0.smithi073.stdout:5/785: mkdir d0/d1d/d64/dbd/df9 0 2024-04-19T02:18:34.384 INFO:tasks.workunit.client.0.smithi073.stdout:2/781: fdatasync d5/d10/d14/d18/d98/fc6 0 2024-04-19T02:18:34.384 INFO:tasks.workunit.client.0.smithi073.stdout:1/690: write db/d3e/f96 [1092086,109002] 0 2024-04-19T02:18:34.385 INFO:tasks.workunit.client.0.smithi073.stdout:5/786: creat d0/d69/ffa x:0 0 0 2024-04-19T02:18:34.385 INFO:tasks.workunit.client.0.smithi073.stdout:2/782: chown d5/d10/d14/cb1 318376 1 2024-04-19T02:18:34.385 INFO:tasks.workunit.client.0.smithi073.stdout:8/768: rename d14/d15/d17/d48/d89/ddd/df2/cfd to d14/d15/d17/d48/d89/c105 0 2024-04-19T02:18:34.386 INFO:tasks.workunit.client.0.smithi073.stdout:1/691: creat db/d1c/d54/d8b/ff1 x:0 0 0 2024-04-19T02:18:34.386 INFO:tasks.workunit.client.0.smithi073.stdout:2/783: symlink d5/d10/d14/d18/d3e/de1/l111 0 2024-04-19T02:18:34.387 INFO:tasks.workunit.client.0.smithi073.stdout:8/769: unlink d14/d15/d17/da1/lfb 0 2024-04-19T02:18:34.387 INFO:tasks.workunit.client.0.smithi073.stdout:3/855: getdents d3/d6/db/d16/d52 0 2024-04-19T02:18:34.387 INFO:tasks.workunit.client.0.smithi073.stdout:5/787: truncate d0/d1d/d1e/fa8 692327 0 2024-04-19T02:18:34.387 INFO:tasks.workunit.client.0.smithi073.stdout:2/784: creat d5/d10/d14/d18/f112 x:0 0 0 2024-04-19T02:18:34.388 INFO:tasks.workunit.client.0.smithi073.stdout:5/788: write d0/d1d/d24/f38 [915393,122151] 0 2024-04-19T02:18:34.389 INFO:tasks.workunit.client.0.smithi073.stdout:3/856: chown d3/d6/db/d3a/d38/d57/d88/dc2/f115 507 1 2024-04-19T02:18:34.389 INFO:tasks.workunit.client.0.smithi073.stdout:7/777: dwrite d0/dc/d33/d36/d7b/f85 [4194304,4194304] 0 2024-04-19T02:18:34.390 INFO:tasks.workunit.client.0.smithi073.stdout:5/789: creat d0/d1d/d25/db5/ffb x:0 0 0 2024-04-19T02:18:34.390 INFO:tasks.workunit.client.0.smithi073.stdout:3/857: mknod d3/d6/db/d3a/d5f/dca/dde/c11d 0 2024-04-19T02:18:34.391 INFO:tasks.workunit.client.0.smithi073.stdout:3/858: mknod d3/d6/db/d3a/d5f/dca/c11e 0 2024-04-19T02:18:34.392 INFO:tasks.workunit.client.0.smithi073.stdout:5/790: rename d0/d1d/d25/d35/d39/f7f to d0/d1d/d25/d35/d39/ffc 0 2024-04-19T02:18:34.392 INFO:tasks.workunit.client.0.smithi073.stdout:3/859: creat d3/d6/db/d3a/d38/d6f/daf/f11f x:0 0 0 2024-04-19T02:18:34.396 INFO:tasks.workunit.client.0.smithi073.stdout:7/778: read d0/dc/d67/d2a/d51/fe1 [821002,16517] 0 2024-04-19T02:18:34.401 INFO:tasks.workunit.client.0.smithi073.stdout:4/770: sync 2024-04-19T02:18:34.402 INFO:tasks.workunit.client.0.smithi073.stdout:4/771: write da/d27/d1b/d26/d2a/ff4 [3905009,20816] 0 2024-04-19T02:18:34.406 INFO:tasks.workunit.client.0.smithi073.stdout:1/692: creat db/d1c/d54/d8b/ff2 x:0 0 0 2024-04-19T02:18:34.407 INFO:tasks.workunit.client.0.smithi073.stdout:1/693: read db/d1c/d78/d8c/dd5/d50/f60 [150073,26154] 0 2024-04-19T02:18:34.407 INFO:tasks.workunit.client.0.smithi073.stdout:9/686: dread d0/df/d16/d19/d38/d5d/f4e [0,4194304] 0 2024-04-19T02:18:34.407 INFO:tasks.workunit.client.0.smithi073.stdout:1/694: creat db/d1c/d78/d8c/dd5/d50/d62/dc0/ff3 x:0 0 0 2024-04-19T02:18:34.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:18:34.409 INFO:tasks.workunit.client.0.smithi073.stdout:1/695: chown db/d1c/d78/d8c/dd5/d50/c91 2 1 2024-04-19T02:18:34.409 INFO:tasks.workunit.client.0.smithi073.stdout:1/696: mkdir db/d7f/ded/df4 0 2024-04-19T02:18:34.410 INFO:tasks.workunit.client.0.smithi073.stdout:1/697: chown db/d1c/d78/d8c/dd5/d50 801571396 1 2024-04-19T02:18:34.410 INFO:tasks.workunit.client.0.smithi073.stdout:1/698: symlink db/d7f/ded/lf5 0 2024-04-19T02:18:34.412 INFO:tasks.workunit.client.0.smithi073.stdout:1/699: write db/d1c/d78/d8c/dd5/d50/d62/dc0/db1/dc4/fc8 [724299,95471] 0 2024-04-19T02:18:34.413 INFO:tasks.workunit.client.0.smithi073.stdout:9/687: dwrite d0/df/f78 [0,4194304] 0 2024-04-19T02:18:34.414 INFO:tasks.workunit.client.0.smithi073.stdout:1/700: symlink db/lf6 0 2024-04-19T02:18:34.414 INFO:tasks.workunit.client.0.smithi073.stdout:8/770: truncate d14/d27/f30 31993 0 2024-04-19T02:18:34.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/681: dread d8/fc0 [0,4194304] 0 2024-04-19T02:18:34.415 INFO:tasks.workunit.client.0.smithi073.stdout:1/701: creat db/d1c/d78/d8c/ff7 x:0 0 0 2024-04-19T02:18:34.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/688: fdatasync d0/df/d16/d19/d38/d5d/d76/d7d/d88/f92 0 2024-04-19T02:18:34.418 INFO:tasks.workunit.client.0.smithi073.stdout:8/771: write d14/d27/d29/d64/f78 [917201,58148] 0 2024-04-19T02:18:34.418 INFO:tasks.workunit.client.0.smithi073.stdout:6/682: write d8/de/f47 [7224609,13574] 0 2024-04-19T02:18:34.419 INFO:tasks.workunit.client.0.smithi073.stdout:9/689: mkdir d0/df/d16/d19/d38/d5d/df2 0 2024-04-19T02:18:34.419 INFO:tasks.workunit.client.0.smithi073.stdout:0/707: dread d7/d14/d17/d1a/d20/f4c [0,4194304] 0 2024-04-19T02:18:34.420 INFO:tasks.workunit.client.0.smithi073.stdout:1/702: readlink db/d1c/d78/d8c/dd5/l93 0 2024-04-19T02:18:34.420 INFO:tasks.workunit.client.0.smithi073.stdout:8/772: mkdir d14/d15/d17/d99/d106 0 2024-04-19T02:18:34.421 INFO:tasks.workunit.client.0.smithi073.stdout:2/785: dread d5/d10/d14/d18/d3e/d2d/f3a [0,4194304] 0 2024-04-19T02:18:34.421 INFO:tasks.workunit.client.0.smithi073.stdout:3/860: dwrite d3/d6/db/d16/d52/f56 [4194304,4194304] 0 2024-04-19T02:18:34.421 INFO:tasks.workunit.client.0.smithi073.stdout:6/683: creat d8/de/d22/da8/fe1 x:0 0 0 2024-04-19T02:18:34.422 INFO:tasks.workunit.client.0.smithi073.stdout:8/773: stat d14/d15/f7e 0 2024-04-19T02:18:34.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/791: dwrite d0/d1d/d25/d37/d71/dd6/f7e [0,4194304] 0 2024-04-19T02:18:34.422 INFO:tasks.workunit.client.0.smithi073.stdout:0/708: write d7/d14/d17/d70/f72 [1010600,77970] 0 2024-04-19T02:18:34.423 INFO:tasks.workunit.client.0.smithi073.stdout:3/861: write d3/d6/db/d3a/d38/d43/d4e/f104 [414740,26657] 0 2024-04-19T02:18:34.424 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:34.423+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:34.424 INFO:tasks.workunit.client.0.smithi073.stdout:6/684: fsync d8/d71/d7d/f87 0 2024-04-19T02:18:34.424 INFO:tasks.workunit.client.0.smithi073.stdout:5/792: mknod d0/d1d/d90/da0/cfd 0 2024-04-19T02:18:34.425 INFO:tasks.workunit.client.0.smithi073.stdout:8/774: creat d14/d15/df8/f107 x:0 0 0 2024-04-19T02:18:34.425 INFO:tasks.workunit.client.0.smithi073.stdout:1/703: mknod db/d1c/d78/d8c/dd5/d50/cf8 0 2024-04-19T02:18:34.426 INFO:tasks.workunit.client.0.smithi073.stdout:5/793: chown d0/d1d/d25/d37/d71/dd6/f7e 305783 1 2024-04-19T02:18:34.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/685: mkdir d8/de/d58/d63/d82/de2 0 2024-04-19T02:18:34.426 INFO:tasks.workunit.client.0.smithi073.stdout:1/704: rename db/d3e to db/d1c/d81/df9 0 2024-04-19T02:18:34.427 INFO:tasks.workunit.client.0.smithi073.stdout:6/686: rename d8/de/d22/c26 to d8/de/d22/da8/ce3 0 2024-04-19T02:18:34.428 INFO:tasks.workunit.client.0.smithi073.stdout:1/705: write db/d1c/d81/d83/db8/fbe [629765,39622] 0 2024-04-19T02:18:34.429 INFO:tasks.workunit.client.0.smithi073.stdout:1/706: symlink db/d1c/d81/d83/db8/lfa 0 2024-04-19T02:18:34.431 INFO:tasks.workunit.client.0.smithi073.stdout:1/707: chown db/d1c/d78/d8c/dd5/fa3 21033325 1 2024-04-19T02:18:34.431 INFO:tasks.workunit.client.0.smithi073.stdout:3/862: dwrite d3/d6/db/d3a/d38/d43/f106 [0,4194304] 0 2024-04-19T02:18:34.431 INFO:tasks.workunit.client.0.smithi073.stdout:2/786: truncate d5/d10/fec 2890040 0 2024-04-19T02:18:34.432 INFO:tasks.workunit.client.0.smithi073.stdout:2/787: dread - d5/fd5 zero size 2024-04-19T02:18:34.433 INFO:tasks.workunit.client.0.smithi073.stdout:3/863: write d3/d6/db/d16/d9e/fd9 [1205544,6301] 0 2024-04-19T02:18:34.433 INFO:tasks.workunit.client.0.smithi073.stdout:1/708: write db/d1c/d78/d8c/dd5/d50/d62/f79 [519381,42059] 0 2024-04-19T02:18:34.435 INFO:tasks.workunit.client.0.smithi073.stdout:1/709: mknod db/d7f/ded/df4/cfb 0 2024-04-19T02:18:34.436 INFO:tasks.workunit.client.0.smithi073.stdout:0/709: read d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/fb2 [466668,63156] 0 2024-04-19T02:18:34.436 INFO:tasks.workunit.client.0.smithi073.stdout:6/687: dwrite d8/de/f47 [0,4194304] 0 2024-04-19T02:18:34.438 INFO:tasks.workunit.client.0.smithi073.stdout:0/710: rename d7/d14/d17/d1a/d8d/fb3 to d7/d6d/dbd/fd9 0 2024-04-19T02:18:34.438 INFO:tasks.workunit.client.0.smithi073.stdout:6/688: truncate d8/de/d58/d63/f6b 293484 0 2024-04-19T02:18:34.439 INFO:tasks.workunit.client.0.smithi073.stdout:0/711: creat d7/d14/d17/d69/d7c/dbe/fda x:0 0 0 2024-04-19T02:18:34.440 INFO:tasks.workunit.client.0.smithi073.stdout:5/794: read d0/f5d [1755183,28379] 0 2024-04-19T02:18:34.441 INFO:tasks.workunit.client.0.smithi073.stdout:2/788: dwrite d5/d10/d14/d18/d98/fc6 [0,4194304] 0 2024-04-19T02:18:34.442 INFO:tasks.workunit.client.0.smithi073.stdout:2/789: write d5/d10/d53/f93 [1842614,101114] 0 2024-04-19T02:18:34.443 INFO:tasks.workunit.client.0.smithi073.stdout:0/712: read d7/d14/f1b [528518,27335] 0 2024-04-19T02:18:34.443 INFO:tasks.workunit.client.0.smithi073.stdout:0/713: stat d7/d14/d17 0 2024-04-19T02:18:34.445 INFO:tasks.workunit.client.0.smithi073.stdout:9/690: dread d0/df/d16/f1e [0,4194304] 0 2024-04-19T02:18:34.448 INFO:tasks.workunit.client.0.smithi073.stdout:6/689: read d8/d4b/d93/d86/fa6 [1478938,52937] 0 2024-04-19T02:18:34.449 INFO:tasks.workunit.client.0.smithi073.stdout:6/690: chown d8/de/f2a 4 1 2024-04-19T02:18:34.449 INFO:tasks.workunit.client.0.smithi073.stdout:6/691: write d8/d71/d75/fd0 [966298,24344] 0 2024-04-19T02:18:34.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/691: dwrite d0/f8b [4194304,4194304] 0 2024-04-19T02:18:34.450 INFO:tasks.workunit.client.0.smithi073.stdout:1/710: truncate db/d1c/d78/d8c/dd5/d50/d62/fb6 2847084 0 2024-04-19T02:18:34.451 INFO:tasks.workunit.client.0.smithi073.stdout:9/692: readlink d0/df/d16/d19/l95 0 2024-04-19T02:18:34.452 INFO:tasks.workunit.client.0.smithi073.stdout:2/790: fdatasync d5/d10/d14/d18/d3e/de1/f10a 0 2024-04-19T02:18:34.452 INFO:tasks.workunit.client.0.smithi073.stdout:6/692: dread d8/de/d7f/fa0 [0,4194304] 0 2024-04-19T02:18:34.453 INFO:tasks.workunit.client.0.smithi073.stdout:1/711: rename db/d1c/d54/l73 to db/d1c/d78/d8c/dd5/d50/d62/dc0/lfc 0 2024-04-19T02:18:34.454 INFO:tasks.workunit.client.0.smithi073.stdout:2/791: rename d5/d10/d29/d42/fed to d5/d10/d14/d7a/dd1/f113 0 2024-04-19T02:18:34.457 INFO:tasks.workunit.client.0.smithi073.stdout:1/712: write db/d1c/d54/d8b/dab/fb0 [62499,34396] 0 2024-04-19T02:18:34.457 INFO:tasks.workunit.client.0.smithi073.stdout:6/693: creat d8/de/d58/d63/d82/de2/fe4 x:0 0 0 2024-04-19T02:18:34.458 INFO:tasks.workunit.client.0.smithi073.stdout:6/694: readlink d8/d71/d7d/dab/ldb 0 2024-04-19T02:18:34.458 INFO:tasks.workunit.client.0.smithi073.stdout:1/713: creat db/d7f/ded/ffd x:0 0 0 2024-04-19T02:18:34.458 INFO:tasks.workunit.client.0.smithi073.stdout:2/792: creat d5/d10/d14/d18/d3e/d2d/d63/da2/f114 x:0 0 0 2024-04-19T02:18:34.459 INFO:tasks.workunit.client.0.smithi073.stdout:0/714: dwrite d7/d14/d17/d1a/d8d/fab [0,4194304] 0 2024-04-19T02:18:34.459 INFO:tasks.workunit.client.0.smithi073.stdout:6/695: truncate d8/d4b/d8f/fbc 1006631 0 2024-04-19T02:18:34.459 INFO:tasks.workunit.client.0.smithi073.stdout:1/714: creat db/d1c/d81/d86/ddd/ffe x:0 0 0 2024-04-19T02:18:34.459 INFO:tasks.workunit.client.0.smithi073.stdout:6/696: creat d8/de/d22/fe5 x:0 0 0 2024-04-19T02:18:34.459 INFO:tasks.workunit.client.0.smithi073.stdout:0/715: write d7/d14/d17/d1a/f22 [2760767,78766] 0 2024-04-19T02:18:34.459 INFO:tasks.workunit.client.0.smithi073.stdout:3/864: dread d3/d6/db/d3a/d38/d89/d94/fa9 [0,4194304] 0 2024-04-19T02:18:34.460 INFO:tasks.workunit.client.0.smithi073.stdout:1/715: write db/d1c/d78/d8c/ff7 [97466,57505] 0 2024-04-19T02:18:34.463 INFO:tasks.workunit.client.0.smithi073.stdout:3/865: creat d3/d6/db/d3a/d38/d89/f120 x:0 0 0 2024-04-19T02:18:34.463 INFO:tasks.workunit.client.0.smithi073.stdout:2/793: read d5/d10/d53/f73 [98939,72435] 0 2024-04-19T02:18:34.463 INFO:tasks.workunit.client.0.smithi073.stdout:0/716: rename d7/d14/d17/d1a/d21/f40 to d7/d14/d17/d1a/d20/d50/dc2/fdb 0 2024-04-19T02:18:34.464 INFO:tasks.workunit.client.0.smithi073.stdout:6/697: link d8/de/d58/d63/cd1 d8/de/d7f/da5/ce6 0 2024-04-19T02:18:34.464 INFO:tasks.workunit.client.0.smithi073.stdout:7/779: dread d0/dc/d39/f3f [0,4194304] 0 2024-04-19T02:18:34.465 INFO:tasks.workunit.client.0.smithi073.stdout:6/698: fsync d8/de/d22/f34 0 2024-04-19T02:18:34.466 INFO:tasks.workunit.client.0.smithi073.stdout:3/866: dread d3/d6/db/d3a/d38/d89/d94/fa9 [0,4194304] 0 2024-04-19T02:18:34.468 INFO:tasks.workunit.client.0.smithi073.stdout:2/794: dread d5/d10/d14/d18/d3e/d2d/f3a [0,4194304] 0 2024-04-19T02:18:34.468 INFO:tasks.workunit.client.0.smithi073.stdout:1/716: dwrite db/d1c/d78/d8c/dd5/d50/f60 [0,4194304] 0 2024-04-19T02:18:34.471 INFO:tasks.workunit.client.0.smithi073.stdout:4/772: dread da/d27/d1b/d1d/d72/f62 [0,4194304] 0 2024-04-19T02:18:34.472 INFO:tasks.workunit.client.0.smithi073.stdout:7/780: dwrite d0/d3/fb3 [0,4194304] 0 2024-04-19T02:18:34.473 INFO:tasks.workunit.client.0.smithi073.stdout:1/717: write db/d1c/d81/d86/fbc [1155162,124517] 0 2024-04-19T02:18:34.473 INFO:tasks.workunit.client.0.smithi073.stdout:2/795: creat d5/d10/d14/d7a/dde/f115 x:0 0 0 2024-04-19T02:18:34.474 INFO:tasks.workunit.client.0.smithi073.stdout:7/781: rmdir d0/d28/d63 39 2024-04-19T02:18:34.475 INFO:tasks.workunit.client.0.smithi073.stdout:3/867: getdents d3/d6/db/d3a/d38/d89 0 2024-04-19T02:18:34.475 INFO:tasks.workunit.client.0.smithi073.stdout:0/717: dwrite d7/d14/d17/d69/d7c/f8b [0,4194304] 0 2024-04-19T02:18:34.478 INFO:tasks.workunit.client.0.smithi073.stdout:1/718: rename db/d7f/ded/ffd to db/d1c/d81/d86/ddd/fff 0 2024-04-19T02:18:34.478 INFO:tasks.workunit.client.0.smithi073.stdout:0/718: rmdir d7/d14/d17/d69 39 2024-04-19T02:18:34.478 INFO:tasks.workunit.client.0.smithi073.stdout:3/868: symlink d3/d6/db/d3a/d38/d6f/l121 0 2024-04-19T02:18:34.478 INFO:tasks.workunit.client.0.smithi073.stdout:7/782: mknod d0/dc/d33/cea 0 2024-04-19T02:18:34.478 INFO:tasks.workunit.client.0.smithi073.stdout:7/783: dread - d0/d28/d63/fe5 zero size 2024-04-19T02:18:34.478 INFO:tasks.workunit.client.0.smithi073.stdout:3/869: mknod d3/d6/db/d1a/c122 0 2024-04-19T02:18:34.480 INFO:tasks.workunit.client.0.smithi073.stdout:6/699: dread f3 [0,4194304] 0 2024-04-19T02:18:34.480 INFO:tasks.workunit.client.0.smithi073.stdout:3/870: write d3/d6/db/d16/d52/f56 [7560843,110861] 0 2024-04-19T02:18:34.480 INFO:tasks.workunit.client.0.smithi073.stdout:7/784: fdatasync d0/dc/d67/d15/f56 0 2024-04-19T02:18:34.480 INFO:tasks.workunit.client.0.smithi073.stdout:6/700: chown d8/de/d7f/fe0 264254863 1 2024-04-19T02:18:34.481 INFO:tasks.workunit.client.0.smithi073.stdout:3/871: write d3/d6/db/d1a/d2f/f9f [718884,128887] 0 2024-04-19T02:18:34.481 INFO:tasks.workunit.client.0.smithi073.stdout:7/785: rmdir d0/dc/d33/da7 39 2024-04-19T02:18:34.482 INFO:tasks.workunit.client.0.smithi073.stdout:7/786: stat d0/dc/d67/d2a/d51/d7a/f95 0 2024-04-19T02:18:34.482 INFO:tasks.workunit.client.0.smithi073.stdout:3/872: creat d3/d6/db/f123 x:0 0 0 2024-04-19T02:18:34.489 INFO:tasks.workunit.client.0.smithi073.stdout:2/796: dread d5/d10/d29/d66/d67/d72/f12 [0,4194304] 0 2024-04-19T02:18:34.492 INFO:tasks.workunit.client.0.smithi073.stdout:0/719: truncate d7/d14/d17/d1a/d21/f36 4905102 0 2024-04-19T02:18:34.492 INFO:tasks.workunit.client.0.smithi073.stdout:9/693: dread d0/f54 [0,4194304] 0 2024-04-19T02:18:34.492 INFO:tasks.workunit.client.0.smithi073.stdout:2/797: chown d5/d10/d29/d66/c94 124 1 2024-04-19T02:18:34.492 INFO:tasks.workunit.client.0.smithi073.stdout:3/873: rmdir d3/d6 39 2024-04-19T02:18:34.496 INFO:tasks.workunit.client.0.smithi073.stdout:1/719: dwrite db/d41/f59 [0,4194304] 0 2024-04-19T02:18:34.496 INFO:tasks.workunit.client.0.smithi073.stdout:3/874: getdents d3/d6 0 2024-04-19T02:18:34.497 INFO:tasks.workunit.client.0.smithi073.stdout:1/720: symlink db/d1c/d54/l100 0 2024-04-19T02:18:34.497 INFO:tasks.workunit.client.0.smithi073.stdout:3/875: fsync d3/d6/db/d3a/d5f/dca/dde/f117 0 2024-04-19T02:18:34.498 INFO:tasks.workunit.client.0.smithi073.stdout:1/721: write db/d1c/d78/dcf/fd0 [161783,1340] 0 2024-04-19T02:18:34.498 INFO:tasks.workunit.client.0.smithi073.stdout:0/720: dread d7/d14/d17/d1a/d20/d50/f85 [0,4194304] 0 2024-04-19T02:18:34.499 INFO:tasks.workunit.client.0.smithi073.stdout:9/694: dwrite d0/df/d16/d19/d38/d5d/f4e [0,4194304] 0 2024-04-19T02:18:34.500 INFO:tasks.workunit.client.0.smithi073.stdout:1/722: rename db/d1c/d78/d8c/dd5/d50/d62/dc0 to db/d41/d101 0 2024-04-19T02:18:34.504 INFO:tasks.workunit.client.0.smithi073.stdout:3/876: truncate d3/d6/db/d3a/d38/d89/d94/f35 3274709 0 2024-04-19T02:18:34.505 INFO:tasks.workunit.client.0.smithi073.stdout:2/798: dwrite d5/d10/d14/d18/d98/d107/ff5 [0,4194304] 0 2024-04-19T02:18:34.505 INFO:tasks.workunit.client.0.smithi073.stdout:0/721: dwrite d7/d14/d17/d1a/d21/fc1 [0,4194304] 0 2024-04-19T02:18:34.506 INFO:tasks.workunit.client.0.smithi073.stdout:3/877: rename d3/d6/db/d1a/d2f to d3/d6/db/d3a/d5f/dca/d124 0 2024-04-19T02:18:34.507 INFO:tasks.workunit.client.0.smithi073.stdout:2/799: write d5/d10/d29/d42/fe9 [3205347,52905] 0 2024-04-19T02:18:34.508 INFO:tasks.workunit.client.0.smithi073.stdout:0/722: creat d7/d14/d17/d1a/d20/d50/d99/da7/fdc x:0 0 0 2024-04-19T02:18:34.508 INFO:tasks.workunit.client.0.smithi073.stdout:2/800: chown d5/d10/d14/db6/fe3 247247410 1 2024-04-19T02:18:34.509 INFO:tasks.workunit.client.0.smithi073.stdout:2/801: creat d5/d10/d14/d7a/dd1/f116 x:0 0 0 2024-04-19T02:18:34.511 INFO:tasks.workunit.client.0.smithi073.stdout:1/723: read db/d1c/d78/fb9 [129111,62046] 0 2024-04-19T02:18:34.512 INFO:tasks.workunit.client.0.smithi073.stdout:1/724: creat db/d1c/d78/d8c/dd5/d50/d62/f102 x:0 0 0 2024-04-19T02:18:34.513 INFO:tasks.workunit.client.0.smithi073.stdout:3/878: dwrite d3/d6/db/d3a/d38/d43/f84 [0,4194304] 0 2024-04-19T02:18:34.514 INFO:tasks.workunit.client.0.smithi073.stdout:0/723: dwrite d7/d14/d17/d1a/fa0 [0,4194304] 0 2024-04-19T02:18:34.515 INFO:tasks.workunit.client.0.smithi073.stdout:3/879: mknod d3/d6/db/d3a/d38/d57/df6/c125 0 2024-04-19T02:18:34.516 INFO:tasks.workunit.client.0.smithi073.stdout:2/802: dwrite d5/d10/d29/d66/d83/f10f [0,4194304] 0 2024-04-19T02:18:34.516 INFO:tasks.workunit.client.0.smithi073.stdout:0/724: getdents d7/d6d 0 2024-04-19T02:18:34.520 INFO:tasks.workunit.client.0.smithi073.stdout:1/725: dwrite f9 [0,4194304] 0 2024-04-19T02:18:34.520 INFO:tasks.workunit.client.0.smithi073.stdout:6/701: dread d8/d4b/d93/d60/f4f [0,4194304] 0 2024-04-19T02:18:34.522 INFO:tasks.workunit.client.0.smithi073.stdout:1/726: rename db/d1c/d78/d8c/dd5/f72 to db/d1c/d81/f103 0 2024-04-19T02:18:34.523 INFO:tasks.workunit.client.0.smithi073.stdout:1/727: write db/d1c/d78/dcf/fd0 [291228,91532] 0 2024-04-19T02:18:34.524 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:34.523+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:34.529 INFO:tasks.workunit.client.0.smithi073.stdout:3/880: dwrite d3/f5 [0,4194304] 0 2024-04-19T02:18:34.531 INFO:tasks.workunit.client.0.smithi073.stdout:3/881: link d3/d6/db/f4d d3/d6/db/d16/d75/f126 0 2024-04-19T02:18:34.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/882: write d3/d6/f6d [554776,24377] 0 2024-04-19T02:18:34.533 INFO:tasks.workunit.client.0.smithi073.stdout:3/883: symlink d3/d6/db/d3a/d38/d43/d4e/ddd/l127 0 2024-04-19T02:18:34.534 INFO:tasks.workunit.client.0.smithi073.stdout:3/884: creat d3/d6/db/d3a/d38/d57/df6/f128 x:0 0 0 2024-04-19T02:18:34.535 INFO:tasks.workunit.client.0.smithi073.stdout:3/885: write d3/d6/db/d23/f27 [3067842,1052] 0 2024-04-19T02:18:34.536 INFO:tasks.workunit.client.0.smithi073.stdout:3/886: write d3/d6/db/d3a/d38/d40/db5/f10f [70643,72656] 0 2024-04-19T02:18:34.536 INFO:tasks.workunit.client.0.smithi073.stdout:3/887: rename d3/d6 to d3/d6/db/d1a/d129 22 2024-04-19T02:18:34.539 INFO:tasks.workunit.client.0.smithi073.stdout:1/728: dread db/d1c/d78/d8c/dd5/d50/d62/fb6 [0,4194304] 0 2024-04-19T02:18:34.540 INFO:tasks.workunit.client.0.smithi073.stdout:1/729: creat db/d1c/d81/d83/db8/dd1/f104 x:0 0 0 2024-04-19T02:18:34.541 INFO:tasks.workunit.client.0.smithi073.stdout:1/730: dread - db/d1c/d81/fd2 zero size 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:34.542 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.186740714999999, 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:34.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:34.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:34.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.173512651999999, 2024-04-19T02:18:34.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:34.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.173417937, 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:34.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.172036161000001, 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.557 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:34.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:34.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.167386022999999, 2024-04-19T02:18:34.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:34.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.567 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.150981415, 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:34.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.141763231999999, 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:34.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.577 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.138952532000001, 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.578 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:34.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:34.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.129966450000001, 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:34.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.127393645000001, 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.588 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:34.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.120166348000001, 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:34.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.599 INFO:tasks.workunit.client.0.smithi073.stdout:1/731: creat db/d1c/d81/d83/db8/dd1/f105 x:0 0 0 2024-04-19T02:18:34.599 INFO:tasks.workunit.client.0.smithi073.stdout:1/732: chown db/d1c/d78/d8c/dd5/d50/la9 52623 1 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.114939082999999, 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.601 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:34.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.103186949000001, 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.606 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:34.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.096011779000001, 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:34.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:34.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:34.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3796322979999998, 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:34.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:34.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3673479349999997, 2024-04-19T02:18:34.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:34.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:34.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:34.627 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2647013239999998, 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:34.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:34.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2634996149999997, 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:34.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:34.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:34.637 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2600132649999995, 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:34.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2596613530000003, 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:34.642 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:34.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:34.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:34.647 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:34.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:34.657 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:34.647+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:34.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/775: sync 2024-04-19T02:18:34.668 INFO:tasks.workunit.client.0.smithi073.stdout:5/795: sync 2024-04-19T02:18:34.668 INFO:tasks.workunit.client.0.smithi073.stdout:5/796: creat d0/d1d/d90/da0/ffe x:0 0 0 2024-04-19T02:18:34.668 INFO:tasks.workunit.client.0.smithi073.stdout:1/733: read db/d1c/f39 [319681,71660] 0 2024-04-19T02:18:34.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/776: link d14/f93 d14/d27/d85/d9a/df6/f108 0 2024-04-19T02:18:34.668 INFO:tasks.workunit.client.0.smithi073.stdout:5/797: write d0/d1d/d1e/f55 [2112301,34837] 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:3/888: write d3/d6/fda [686983,123594] 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:1/734: creat db/d1c/d81/d86/dae/f106 x:0 0 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:8/777: rmdir d14/d27/d7b 39 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:5/798: chown d0/d1d/d25/d35/d96/c9e 205123 1 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:1/735: creat db/d1c/d81/f107 x:0 0 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:8/778: chown d14/d27/d4c/l86 49139241 1 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:3/889: mkdir d3/d6/db/d16/d75/d12a 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:5/799: mkdir d0/d1d/d90/dff 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:1/736: symlink db/d1c/d78/d8c/dd5/de3/l108 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:3/890: creat d3/d6/db/d16/d75/f12b x:0 0 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:0/725: dwrite d7/d14/f2d [0,4194304] 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:8/779: link d14/d27/d29/d31/d34/ld1 d14/d15/d17/da1/l109 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:1/737: write db/d1c/d54/d8b/ff2 [630159,22242] 0 2024-04-19T02:18:34.669 INFO:tasks.workunit.client.0.smithi073.stdout:5/800: write d0/d1d/d25/d35/d39/f4c [5205965,113299] 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/891: fsync d3/d6/db/d16/d52/f99 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:0/726: mknod d7/d14/d17/d1a/d21/cdd 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:1/738: creat db/d7f/ded/df4/f109 x:0 0 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:8/780: creat d14/d15/d17/d99/d106/f10a x:0 0 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:5/801: creat d0/d1d/f100 x:0 0 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/892: mkdir d3/d6/db/d3a/d5f/dca/d12c 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:8/781: chown d14/d15/d17/d48/d89/ddd/dfe 1638 1 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:5/802: write d0/f1b [8714409,6764] 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:1/739: creat db/d1c/d78/d8c/dd5/de3/f10a x:0 0 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/893: dread - d3/d6/db/d16/d7c/f92 zero size 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:8/782: symlink d14/d27/l10b 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:1/740: fsync db/d1c/d81/d86/dae/f75 0 2024-04-19T02:18:34.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/894: dread - d3/d6/db/d3a/d38/d6f/daf/f11f zero size 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/803: link d0/c3d d0/d1d/d25/d35/c101 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/783: rename d14/d27/l57 to d14/d27/d85/d9b/l10c 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:1/741: mknod db/d1c/d78/d8c/dd5/c10b 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/784: dread - d14/d87/fd3 zero size 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/804: chown d0/d1d/d64/dbd/df9 12 1 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:0/727: read d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/fb2 [296511,72928] 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:3/895: unlink d3/d6/db/d16/d9e/fa8 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/805: unlink d0/d1d/d24/d61/f74 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/785: readlink d14/d15/d17/da1/l109 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:3/896: rmdir d3/d6/db/d3a/d38/d57 39 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/806: chown d0/d1d/d25/c70 1 1 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/786: symlink d14/d27/d4c/d75/l10d 0 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/787: dread - d14/d27/fb6 zero size 2024-04-19T02:18:34.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/807: link d0/d2d/fb3 d0/d1d/d24/d61/f102 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:3/897: link d3/d6/db/d3a/d38/d57/c9c d3/d6/db/d3a/d5f/dca/d124/c12d 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:5/808: truncate d0/d2d/dac/fb2 2820318 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:8/788: rename d14/d15/d17/f21 to d14/d27/d4c/f10e 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:1/742: truncate db/d1c/d78/d8c/dd5/d50/f60 586015 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:3/898: write d3/d6/db/d16/d7c/f92 [240607,4799] 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:8/789: fdatasync d14/d27/d29/d31/d34/f40 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:1/743: fsync db/d1c/d81/d86/ddd/ffe 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:3/899: chown d3/d6/db/d3a/d38/d6f 6 1 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:5/809: rename d0/d1d/d25/d35/d99/cc0 to d0/d2d/dac/c103 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:3/900: rmdir d3/d6/db/d1a/d54 39 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:5/810: truncate d0/d1d/d24/f5e 761539 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:5/811: chown d0/f41 57922 1 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:0/728: dwrite d7/d14/d17/d1a/f29 [4194304,4194304] 0 2024-04-19T02:18:34.672 INFO:tasks.workunit.client.0.smithi073.stdout:5/812: write d0/d1d/d1e/f80 [3681,64882] 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/813: creat d0/d1d/d90/dff/f104 x:0 0 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/744: dwrite db/d1c/d78/d8c/dd5/d50/d62/f102 [0,4194304] 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:0/729: write d7/d14/d17/d1a/d20/faf [498904,19200] 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:0/730: chown d7/d6d/cbc 162977638 1 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:3/901: dwrite d3/d6/f6d [0,4194304] 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/745: getdents db/d1c/d54 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/746: mkdir db/d1c/d78/d8c/d10c 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:0/731: symlink d7/d14/d17/d1a/d20/d50/d99/da7/d9e/lde 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/814: fsync d0/d1d/d1e/f80 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/747: mknod db/d41/c10d 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/815: write d0/d1d/d24/f30 [5769107,84959] 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/816: mkdir d0/d1d/d25/d105 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/817: unlink d0/f41 0 2024-04-19T02:18:34.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/818: unlink d0/d1d/d1e/f8d 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:5/819: write d0/d1d/d90/da0/dbb/fd4 [187149,90009] 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/902: dwrite d3/d6/db/d3a/d38/d89/d94/fa9 [0,4194304] 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:1/748: dwrite db/d41/d101/db1/fce [0,4194304] 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/903: mknod d3/d6/db/d3a/d5f/c12e 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/904: unlink d3/d6/db/d3a/d38/d6f/daf/dfd/d101/c10c 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/905: rmdir d3/d6/db/d3a/d38/d89/d94 39 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/906: unlink d3/cf8 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/907: mknod d3/d6/db/d3a/d38/d6f/df2/c12f 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/908: symlink d3/d6/db/d3a/d38/l130 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/909: mkdir d3/d6/db/d3a/d38/d43/d4e/ddd/d131 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/910: unlink d3/d6/db/d3a/d5f/da7/dc0/cc4 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:0/732: dread d7/d14/d17/d1a/d20/d50/dc2/fdb [0,4194304] 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:0/733: write d7/d14/d17/d69/d7c/dbe/fda [775306,37708] 0 2024-04-19T02:18:34.674 INFO:tasks.workunit.client.0.smithi073.stdout:0/734: getdents d7/d14/d17/d69/d7c/dbe 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:0/735: creat d7/d14/fdf x:0 0 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:0/736: unlink d7/d14/d17/d1a/d20/d50/d99/da7/d9e/lc0 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:0/737: write d7/d14/f15 [3054651,106398] 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:0/738: mknod d7/d14/d17/d1a/d20/d50/d99/da7/d87/ce0 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:0/739: write d7/d14/fdf [180739,99530] 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:0/740: unlink d7/d14/d17/f1f 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:3/911: truncate d3/d6/fd 1070550 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:3/912: link d3/d6/db/d3a/fd6 d3/d6/db/d3a/d5f/dca/dde/f132 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:1/749: dwrite db/d1c/d78/d8c/dd5/f61 [0,4194304] 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:5/820: dwrite d0/d1d/d24/d61/fb1 [0,4194304] 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:1/750: creat db/d7f/ded/df4/f10e x:0 0 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:3/913: rename d3/d6/db/d3a/d5f/da7/f102 to d3/d6/db/d3a/d38/d6f/dac/f133 0 2024-04-19T02:18:34.675 INFO:tasks.workunit.client.0.smithi073.stdout:3/914: write d3/d6/db/d3a/d38/d6f/daf/fe4 [551595,52400] 0 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/751: getdents db/d1c/d81/d83/db8 0 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:3/915: chown d3/d6/db/d3a/d5f/dca/d124/fc6 794088616 1 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/752: mkdir db/d1c/d78/d8c/dd5/de3/d10f 0 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:3/916: chown d3/d6/db/d3a/d38/d57/df6 4 1 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/753: write db/d41/d101/ff3 [751249,130691] 0 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:0/741: dwrite d7/d14/d17/d1a/d21/f8a [0,4194304] 0 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:5/821: dwrite d0/d1d/d25/d37/f4d [0,4194304] 0 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/754: dread - db/d1c/d78/d8c/fe5 zero size 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:7/787: sync 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:2/803: sync 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:9/695: sync 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:6/702: sync 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:8/790: sync 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/755: readlink db/d1c/d81/d86/dae/l76 0 2024-04-19T02:18:34.676 INFO:tasks.workunit.client.0.smithi073.stdout:3/917: chown d3/d6/db/d3a/d38/d89/d94/d7b/f8b 436 1 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:4/773: sync 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:7/788: chown d0/dc/d39/d50/f8c 53606262 1 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:1/756: mknod db/d1c/d81/d86/dae/c110 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:9/696: mknod d0/df/d16/d19/db1/d2c/d6b/cf3 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:7/789: chown d0/dc/d67/d2a/f9c 1406 1 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:8/791: rename d14/d15/le0 to d14/l10f 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:9/697: creat d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8/ff4 x:0 0 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:1/757: creat db/d1c/d78/d8c/dd5/f111 x:0 0 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:2/804: rename d5/d10/d14/d18/d3e/d2d/f3a to d5/d10/d14/d2e/da0/dff/f117 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:8/792: symlink d14/d15/d17/l110 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:9/698: chown d0/d81/dda/ddd/dc2/dce 524352 1 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:4/774: getdents da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/d108 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:6/703: write d8/de/f2a [1269751,18317] 0 2024-04-19T02:18:34.677 INFO:tasks.workunit.client.0.smithi073.stdout:1/758: dread - db/d7f/ded/df4/f109 zero size 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:7/790: getdents d0/dc/d39/d50/da3 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:8/793: mknod d14/d15/d17/d99/c111 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:9/699: fsync d0/df/d16/d19/f3d 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:6/704: rename d8/de/l48 to d8/de/d7f/le7 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:7/791: fsync d0/d3/f46 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:3/918: dwrite d3/f5 [0,4194304] 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:9/700: readlink d0/d81/l8c 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:1/759: link db/d1c/d81/df9/f92 db/f112 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:0/742: dwrite d7/d14/d17/d1a/d21/fc1 [0,4194304] 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:2/805: rename d5/d10/d14/d7a/fd2 to d5/d10/d14/d2e/da0/dc0/f118 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:8/794: creat d14/d27/da4/f112 x:0 0 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:7/792: symlink d0/dc/d39/d50/dbc/leb 0 2024-04-19T02:18:34.678 INFO:tasks.workunit.client.0.smithi073.stdout:6/705: mknod d8/de/d58/d63/d82/de2/ce8 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:9/701: fsync d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8/ff4 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:3/919: write d3/d6/db/d3a/d38/d89/d94/fc7 [44373,81994] 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:5/822: dwrite d0/d1d/d25/d35/f42 [0,4194304] 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:8/795: unlink d14/c6c 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:1/760: write db/d1c/d78/d8c/dd5/d50/f6d [2515983,90531] 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:2/806: mknod d5/d10/d29/d66/d67/c119 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:6/706: write d8/de/d58/d63/fd4 [971848,102735] 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:9/702: fsync d0/df/d16/d19/d38/d5d/f84 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:8/796: chown d14/d27/d50/f5d 10752594 1 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:6/707: write d8/de/d78/f7e [604858,14593] 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:1/761: dread - db/d41/d101/db1/dc4/fe2 zero size 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:0/743: unlink d7/d14/d17/d1a/d20/d50/dc2/fd2 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:3/920: write d3/d6/db/d3a/d38/d57/d88/fbe [485478,11083] 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:8/797: readlink d14/d27/d4c/d75/l10d 0 2024-04-19T02:18:34.679 INFO:tasks.workunit.client.0.smithi073.stdout:0/744: rmdir d7 39 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:5/823: creat d0/d1d/d25/d35/dc7/f106 x:0 0 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:6/708: mknod d8/de/d22/da8/dca/ce9 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:2/807: write d5/d10/d14/d7a/dde/f115 [363040,57640] 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:1/762: rename db/d41/f67 to db/d1c/d54/f113 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:6/709: rmdir d8/d71 39 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:0/745: write d7/d14/f47 [209043,104269] 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:3/921: creat d3/d6/db/d3a/d38/d6f/daf/f134 x:0 0 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:5/824: fdatasync d0/d1d/d25/d35/d99/fc5 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:1/763: rename db/d1c to db/d1c/d78/dcf/d114 22 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:3/922: chown d3/d6/da6/fe9 2 1 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:6/710: mkdir d8/de/d58/d63/d82/de2/dea 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:7/793: dwrite d0/dc/d67/f31 [0,4194304] 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:8/798: dwrite d14/d27/d29/d31/d34/f88 [0,4194304] 0 2024-04-19T02:18:34.680 INFO:tasks.workunit.client.0.smithi073.stdout:3/923: truncate d3/d6/db/d3a/f5c 228909 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:2/808: creat d5/d10/d29/d66/d67/f11a x:0 0 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/711: truncate d8/d4b/d93/d60/fc9 74950 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:0/746: creat d7/d14/d17/fe1 x:0 0 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:3/924: readlink d3/d6/db/d3a/d38/d57/d88/df4/l10b 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:5/825: dwrite d0/d1d/d25/d35/f49 [0,4194304] 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:7/794: fsync d0/dc/d33/da7/fe6 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/764: dwrite db/d41/d101/db1/dc4/fe2 [0,4194304] 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:2/809: mknod d5/d10/d14/db6/c11b 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/712: mknod d8/d71/d75/ceb 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:3/925: fsync d3/d6/db/f4d 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:2/810: fsync d5/d10/d14/d18/d3e/d2d/d63/da2/f114 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:5/826: mknod d0/d1d/d25/d35/d39/dd8/c107 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/765: creat db/d1c/d81/d83/f115 x:0 0 0 2024-04-19T02:18:34.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/713: write d8/de/d58/d63/d82/f9b [2053642,20223] 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:0/747: dwrite d7/d14/d17/d1a/d20/d50/d99/da7/d6f/fc5 [0,4194304] 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:0/748: readlink d7/d14/lb4 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:0/749: dread - d7/d14/d17/d70/f9a zero size 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:6/714: mknod d8/de/d78/cec 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:5/827: write d0/d1d/d1e/f2b [4059786,11377] 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:1/766: truncate db/d1c/d81/d83/db8/dd1/f104 688216 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:7/795: dwrite d0/dc/d67/f31 [0,4194304] 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:6/715: symlink d8/de/d7f/dc6/led 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:0/750: rename d7/d14/d17/d1a/d20/faf to d7/d14/d81/fe2 0 2024-04-19T02:18:34.682 INFO:tasks.workunit.client.0.smithi073.stdout:5/828: creat d0/d1d/d25/d35/d96/f108 x:0 0 0 2024-04-19T02:18:34.684 INFO:tasks.workunit.client.0.smithi073.stdout:2/811: dwrite d5/d10/d14/d18/f4d [0,4194304] 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:3/926: dwrite d3/d6/db/d16/d9e/fd9 [0,4194304] 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:1/767: rename db/d1c/d78/d8c/dd5/c42 to db/d1c/d78/dcf/c116 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:0/751: chown d7/d14/d17/d1a/d20/d50/f85 119801498 1 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:2/812: read d5/d10/d29/d66/d67/f86 [1828256,104771] 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:5/829: rename d0/d1d/d24/c87 to d0/d1d/d90/c109 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:1/768: fdatasync db/d1c/d81/d83/db8/dd1/f105 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:0/752: write d7/d14/d17/d1a/d21/f32 [5555663,106562] 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:3/927: symlink d3/d6/db/d16/d9e/l135 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:1/769: stat db/d41/f84 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:1/770: dread - db/d1c/d81/d83/fc6 zero size 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:6/716: dwrite d8/de/d78/f7e [0,4194304] 0 2024-04-19T02:18:34.685 INFO:tasks.workunit.client.0.smithi073.stdout:9/703: sync 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:8/799: sync 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:1/771: getdents db/d7f 0 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/704: symlink d0/d35/lf5 0 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:1/772: mknod db/d1c/c117 0 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:7/796: dwrite d0/dc/d33/fcd [0,4194304] 0 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:8/800: chown d14/d27/d29/d31/d34/c9d 179672 1 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/705: unlink d0/df/d16/d19/d38/c39 0 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:8/801: readlink d14/d27/d4c/d75/dbb/lc0 0 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:4/775: dread da/d27/d36/d4d/d7b/f92 [0,4194304] 0 2024-04-19T02:18:34.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/706: unlink d0/df/d1d/f2f 0 2024-04-19T02:18:34.687 INFO:tasks.workunit.client.0.smithi073.stdout:0/753: dwrite d7/d14/fdf [0,4194304] 0 2024-04-19T02:18:34.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/802: readlink d14/d27/d50/l68 0 2024-04-19T02:18:34.687 INFO:tasks.workunit.client.0.smithi073.stdout:4/776: mknod da/c111 0 2024-04-19T02:18:34.687 INFO:tasks.workunit.client.0.smithi073.stdout:1/773: truncate db/d1c/d78/d8c/dd5/f111 394474 0 2024-04-19T02:18:34.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/803: fsync d14/d27/d29/d31/f5b 0 2024-04-19T02:18:34.687 INFO:tasks.workunit.client.0.smithi073.stdout:3/928: dwrite d3/d6/db/d3a/d38/d6f/dac/fc1 [0,4194304] 0 2024-04-19T02:18:34.688 INFO:tasks.workunit.client.0.smithi073.stdout:9/707: getdents d0/d81/dda/ddd/dc2 0 2024-04-19T02:18:34.688 INFO:tasks.workunit.client.0.smithi073.stdout:1/774: rename db/d1c/d78/d8c/dd5/d50/d62/cc1 to db/d1c/d78/d8c/c118 0 2024-04-19T02:18:34.688 INFO:tasks.workunit.client.0.smithi073.stdout:8/804: truncate d14/d15/d17/f4a 955871 0 2024-04-19T02:18:34.690 INFO:tasks.workunit.client.0.smithi073.stdout:9/708: creat d0/df/d16/d19/d38/d5d/d76/d7d/ff6 x:0 0 0 2024-04-19T02:18:34.690 INFO:tasks.workunit.client.0.smithi073.stdout:8/805: write d14/d15/df8/f107 [808276,10362] 0 2024-04-19T02:18:34.690 INFO:tasks.workunit.client.0.smithi073.stdout:3/929: mknod d3/d6/db/d3a/d38/d57/d88/df4/dfa/c136 0 2024-04-19T02:18:34.690 INFO:tasks.workunit.client.0.smithi073.stdout:1/775: write db/d1c/d81/df9/fd8 [1862680,68220] 0 2024-04-19T02:18:34.691 INFO:tasks.workunit.client.0.smithi073.stdout:1/776: fdatasync db/f2a 0 2024-04-19T02:18:34.691 INFO:tasks.workunit.client.0.smithi073.stdout:0/754: dread d7/d14/f1b [0,4194304] 0 2024-04-19T02:18:34.692 INFO:tasks.workunit.client.0.smithi073.stdout:9/709: truncate d0/df/d16/d19/db1/f3a 2437595 0 2024-04-19T02:18:34.692 INFO:tasks.workunit.client.0.smithi073.stdout:9/710: readlink d0/l3 0 2024-04-19T02:18:34.692 INFO:tasks.workunit.client.0.smithi073.stdout:1/777: unlink db/d1c/d78/d8c/dd5/d50/cf8 0 2024-04-19T02:18:34.692 INFO:tasks.workunit.client.0.smithi073.stdout:9/711: fsync d0/df/d16/fe7 0 2024-04-19T02:18:34.693 INFO:tasks.workunit.client.0.smithi073.stdout:0/755: creat d7/d14/d17/d1a/d20/d50/d99/da7/fe3 x:0 0 0 2024-04-19T02:18:34.693 INFO:tasks.workunit.client.0.smithi073.stdout:9/712: unlink d0/df/d16/d19/db1/d2c/f56 0 2024-04-19T02:18:34.694 INFO:tasks.workunit.client.0.smithi073.stdout:0/756: dread - d7/d14/d17/d1a/fac zero size 2024-04-19T02:18:34.694 INFO:tasks.workunit.client.0.smithi073.stdout:9/713: creat d0/df/d60/d72/d8e/ff7 x:0 0 0 2024-04-19T02:18:34.694 INFO:tasks.workunit.client.0.smithi073.stdout:0/757: creat d7/d14/d17/d1a/d20/d50/fe4 x:0 0 0 2024-04-19T02:18:34.695 INFO:tasks.workunit.client.0.smithi073.stdout:0/758: readlink d7/lb 0 2024-04-19T02:18:34.696 INFO:tasks.workunit.client.0.smithi073.stdout:9/714: rmdir d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8 39 2024-04-19T02:18:34.696 INFO:tasks.workunit.client.0.smithi073.stdout:0/759: chown d7/d14/d17/d1a 47231 1 2024-04-19T02:18:34.696 INFO:tasks.workunit.client.0.smithi073.stdout:0/760: chown d7/lb 2182666 1 2024-04-19T02:18:34.697 INFO:tasks.workunit.client.0.smithi073.stdout:9/715: creat d0/df/d16/d19/d38/d5d/ff8 x:0 0 0 2024-04-19T02:18:34.697 INFO:tasks.workunit.client.0.smithi073.stdout:9/716: mkdir d0/df9 0 2024-04-19T02:18:34.698 INFO:tasks.workunit.client.0.smithi073.stdout:1/778: dwrite db/d1c/d78/d8c/dd5/f45 [0,4194304] 0 2024-04-19T02:18:34.698 INFO:tasks.workunit.client.0.smithi073.stdout:0/761: mknod d7/d14/d17/d1a/d21/dc9/ce5 0 2024-04-19T02:18:34.699 INFO:tasks.workunit.client.0.smithi073.stdout:0/762: write d7/d14/d17/d1a/d21/f8a [2070380,63572] 0 2024-04-19T02:18:34.699 INFO:tasks.workunit.client.0.smithi073.stdout:1/779: write db/d41/d101/db1/dc4/fc8 [545157,122929] 0 2024-04-19T02:18:34.699 INFO:tasks.workunit.client.0.smithi073.stdout:1/780: creat db/d1c/d78/dcf/f119 x:0 0 0 2024-04-19T02:18:34.700 INFO:tasks.workunit.client.0.smithi073.stdout:0/763: mknod d7/d14/d17/d1a/d20/d50/d99/da7/d87/ce6 0 2024-04-19T02:18:34.700 INFO:tasks.workunit.client.0.smithi073.stdout:1/781: chown db/d1c/l31 32197852 1 2024-04-19T02:18:34.701 INFO:tasks.workunit.client.0.smithi073.stdout:1/782: write db/d1c/d78/dcf/f119 [452768,53291] 0 2024-04-19T02:18:34.701 INFO:tasks.workunit.client.0.smithi073.stdout:0/764: getdents d7/d14/d17/d1a 0 2024-04-19T02:18:34.702 INFO:tasks.workunit.client.0.smithi073.stdout:1/783: chown db/d1c/d81/ca2 1037172272 1 2024-04-19T02:18:34.702 INFO:tasks.workunit.client.0.smithi073.stdout:1/784: getdents db/d1c/d78/d8c/dd5/de3 0 2024-04-19T02:18:34.703 INFO:tasks.workunit.client.0.smithi073.stdout:1/785: stat db/d1c/d78/d8c/fe5 0 2024-04-19T02:18:34.704 INFO:tasks.workunit.client.0.smithi073.stdout:1/786: symlink db/d1c/d81/d86/ddd/l11a 0 2024-04-19T02:18:34.704 INFO:tasks.workunit.client.0.smithi073.stdout:3/930: read d3/d6/db/d3a/d38/d43/d4e/f91 [477041,60096] 0 2024-04-19T02:18:34.705 INFO:tasks.workunit.client.0.smithi073.stdout:1/787: readlink db/l19 0 2024-04-19T02:18:34.705 INFO:tasks.workunit.client.0.smithi073.stdout:3/931: creat d3/d6/db/d3a/d38/d57/d88/dc2/f137 x:0 0 0 2024-04-19T02:18:34.707 INFO:tasks.workunit.client.0.smithi073.stdout:3/932: rmdir d3/d6/db/d3a/d5f/da7/dc0 0 2024-04-19T02:18:34.707 INFO:tasks.workunit.client.0.smithi073.stdout:0/765: dwrite d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:34.708 INFO:tasks.workunit.client.0.smithi073.stdout:3/933: mknod d3/d6/db/d3a/d38/d89/d94/d7b/c138 0 2024-04-19T02:18:34.708 INFO:tasks.workunit.client.0.smithi073.stdout:0/766: chown d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82 28111 1 2024-04-19T02:18:34.713 INFO:tasks.workunit.client.0.smithi073.stdout:3/934: dwrite d3/d6/db/fa0 [4194304,4194304] 0 2024-04-19T02:18:34.713 INFO:tasks.workunit.client.0.smithi073.stdout:3/935: fdatasync d3/d6/db/d16/d52/f114 0 2024-04-19T02:18:34.714 INFO:tasks.workunit.client.0.smithi073.stdout:3/936: fsync d3/d6/db/fa1 0 2024-04-19T02:18:34.715 INFO:tasks.workunit.client.0.smithi073.stdout:3/937: creat d3/d6/db/d3a/d38/d43/d4e/f139 x:0 0 0 2024-04-19T02:18:34.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/717: dread d8/de/f67 [0,4194304] 0 2024-04-19T02:18:34.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/718: rmdir d8/de/d7f/da5/dae/dc3 39 2024-04-19T02:18:34.723 INFO:tasks.workunit.client.0.smithi073.stdout:6/719: chown d8/de/f67 194 1 2024-04-19T02:18:34.724 INFO:tasks.workunit.client.0.smithi073.stdout:6/720: symlink d8/de/d22/da8/dca/lee 0 2024-04-19T02:18:34.729 INFO:tasks.workunit.client.0.smithi073.stdout:6/721: dwrite d8/de/d22/fb2 [0,4194304] 0 2024-04-19T02:18:34.729 INFO:tasks.workunit.client.0.smithi073.stdout:6/722: rmdir d8/de/d58/d63/d82 39 2024-04-19T02:18:34.730 INFO:tasks.workunit.client.0.smithi073.stdout:6/723: mknod d8/cef 0 2024-04-19T02:18:34.730 INFO:tasks.workunit.client.0.smithi073.stdout:6/724: write d8/de/f1e [3514411,25764] 0 2024-04-19T02:18:34.734 INFO:tasks.workunit.client.0.smithi073.stdout:9/717: sync 2024-04-19T02:18:34.735 INFO:tasks.workunit.client.0.smithi073.stdout:6/725: dwrite d8/d71/d7d/fbd [0,4194304] 0 2024-04-19T02:18:34.736 INFO:tasks.workunit.client.0.smithi073.stdout:9/718: truncate d0/df/d60/d72/d8e/f94 910222 0 2024-04-19T02:18:34.737 INFO:tasks.workunit.client.0.smithi073.stdout:9/719: rmdir d0/d81/d5c 39 2024-04-19T02:18:34.737 INFO:tasks.workunit.client.0.smithi073.stdout:6/726: link d8/d4b/d8f/fbc d8/de/d58/d63/d82/ff0 0 2024-04-19T02:18:34.738 INFO:tasks.workunit.client.0.smithi073.stdout:8/806: dread d14/d27/d4c/f10e [0,4194304] 0 2024-04-19T02:18:34.738 INFO:tasks.workunit.client.0.smithi073.stdout:8/807: stat d14/d27/d29/d64/f78 0 2024-04-19T02:18:34.738 INFO:tasks.workunit.client.0.smithi073.stdout:6/727: write d8/d4b/d8f/fbc [551620,51109] 0 2024-04-19T02:18:34.739 INFO:tasks.workunit.client.0.smithi073.stdout:8/808: mkdir d14/d27/d7b/d113 0 2024-04-19T02:18:34.740 INFO:tasks.workunit.client.0.smithi073.stdout:6/728: creat d8/dda/ff1 x:0 0 0 2024-04-19T02:18:34.740 INFO:tasks.workunit.client.0.smithi073.stdout:6/729: truncate d8/de/f32 4376614 0 2024-04-19T02:18:34.741 INFO:tasks.workunit.client.0.smithi073.stdout:2/813: truncate d5/d10/d14/d18/d98/d107/ff5 907518 0 2024-04-19T02:18:34.741 INFO:tasks.workunit.client.0.smithi073.stdout:5/830: write d0/d1d/d25/d35/d39/ffc [974746,115493] 0 2024-04-19T02:18:34.741 INFO:tasks.workunit.client.0.smithi073.stdout:4/777: truncate da/d27/d1b/d1d/d72/d104/ddd/f40 3434687 0 2024-04-19T02:18:34.742 INFO:tasks.workunit.client.0.smithi073.stdout:2/814: chown d5/d10/d14/d18/d98/ld6 1 1 2024-04-19T02:18:34.743 INFO:tasks.workunit.client.0.smithi073.stdout:5/831: dread - d0/d1d/d25/d35/d39/dd8/fe1 zero size 2024-04-19T02:18:34.743 INFO:tasks.workunit.client.0.smithi073.stdout:2/815: write d5/fb9 [1247659,129945] 0 2024-04-19T02:18:34.744 INFO:tasks.workunit.client.0.smithi073.stdout:9/720: dwrite d0/df/d16/fe7 [0,4194304] 0 2024-04-19T02:18:34.744 INFO:tasks.workunit.client.0.smithi073.stdout:5/832: write d0/d1d/d25/db5/ffb [665204,84110] 0 2024-04-19T02:18:34.746 INFO:tasks.workunit.client.0.smithi073.stdout:5/833: creat d0/d2d/dac/f10a x:0 0 0 2024-04-19T02:18:34.746 INFO:tasks.workunit.client.0.smithi073.stdout:8/809: dwrite d14/d27/d4c/d75/dbb/fc7 [0,4194304] 0 2024-04-19T02:18:34.747 INFO:tasks.workunit.client.0.smithi073.stdout:8/810: mknod d14/d15/d17/c114 0 2024-04-19T02:18:34.748 INFO:tasks.workunit.client.0.smithi073.stdout:8/811: stat d14/d27/d29/d31/ce7 0 2024-04-19T02:18:34.749 INFO:tasks.workunit.client.0.smithi073.stdout:8/812: rename d14/d87/fbd to d14/d27/d29/d69/f115 0 2024-04-19T02:18:34.749 INFO:tasks.workunit.client.0.smithi073.stdout:8/813: symlink d14/d27/d4c/d101/l116 0 2024-04-19T02:18:34.750 INFO:tasks.workunit.client.0.smithi073.stdout:8/814: creat d14/d15/d17/d99/d106/f117 x:0 0 0 2024-04-19T02:18:34.750 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:34.747+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:34.751 INFO:tasks.workunit.client.0.smithi073.stdout:8/815: rename d14/c49 to d14/d27/d29/d31/d34/c118 0 2024-04-19T02:18:34.752 INFO:tasks.workunit.client.0.smithi073.stdout:8/816: mkdir d14/d15/d17/d48/d119 0 2024-04-19T02:18:34.753 INFO:tasks.workunit.client.0.smithi073.stdout:8/817: creat d14/d15/d17/d48/d89/dd6/f11a x:0 0 0 2024-04-19T02:18:34.756 INFO:tasks.workunit.client.0.smithi073.stdout:8/818: read d14/d27/f30 [6046,115220] 0 2024-04-19T02:18:34.758 INFO:tasks.workunit.client.0.smithi073.stdout:8/819: mknod d14/d27/d4c/c11b 0 2024-04-19T02:18:34.759 INFO:tasks.workunit.client.0.smithi073.stdout:8/820: symlink d14/d27/d50/l11c 0 2024-04-19T02:18:34.759 INFO:tasks.workunit.client.0.smithi073.stdout:8/821: mknod d14/d27/d85/c11d 0 2024-04-19T02:18:34.760 INFO:tasks.workunit.client.0.smithi073.stdout:8/822: symlink d14/d27/d29/d69/l11e 0 2024-04-19T02:18:34.762 INFO:tasks.workunit.client.0.smithi073.stdout:8/823: mkdir d14/d27/d4c/d75/d11f 0 2024-04-19T02:18:34.763 INFO:tasks.workunit.client.0.smithi073.stdout:0/767: truncate d7/faa 319294 0 2024-04-19T02:18:34.763 INFO:tasks.workunit.client.0.smithi073.stdout:1/788: write db/d1c/d81/df9/f92 [512247,3933] 0 2024-04-19T02:18:34.764 INFO:tasks.workunit.client.0.smithi073.stdout:2/816: truncate d5/d10/d14/f2c 7692028 0 2024-04-19T02:18:34.764 INFO:tasks.workunit.client.0.smithi073.stdout:6/730: write d8/de/d58/d63/f6b [45002,100660] 0 2024-04-19T02:18:34.765 INFO:tasks.workunit.client.0.smithi073.stdout:1/789: creat db/d1c/d81/d83/db8/f11b x:0 0 0 2024-04-19T02:18:34.765 INFO:tasks.workunit.client.0.smithi073.stdout:6/731: mknod d8/de/d22/cf2 0 2024-04-19T02:18:34.766 INFO:tasks.workunit.client.0.smithi073.stdout:2/817: write d5/d10/d14/d18/d3e/d2d/d63/da2/fb2 [1016205,84095] 0 2024-04-19T02:18:34.766 INFO:tasks.workunit.client.0.smithi073.stdout:9/721: dread d0/df/d16/d19/d38/fc9 [0,4194304] 0 2024-04-19T02:18:34.767 INFO:tasks.workunit.client.0.smithi073.stdout:8/824: dread d14/d27/f5c [0,4194304] 0 2024-04-19T02:18:34.767 INFO:tasks.workunit.client.0.smithi073.stdout:6/732: creat d8/de/d22/da8/ff3 x:0 0 0 2024-04-19T02:18:34.767 INFO:tasks.workunit.client.0.smithi073.stdout:9/722: chown d0/df/fbf 1059825 1 2024-04-19T02:18:34.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/818: write d5/d10/d29/d66/d83/fc9 [1119619,42112] 0 2024-04-19T02:18:34.768 INFO:tasks.workunit.client.0.smithi073.stdout:9/723: truncate d0/fa1 5124824 0 2024-04-19T02:18:34.768 INFO:tasks.workunit.client.0.smithi073.stdout:0/768: dread d7/d14/d17/d69/d7c/f8b [0,4194304] 0 2024-04-19T02:18:34.769 INFO:tasks.workunit.client.0.smithi073.stdout:9/724: dread - d0/df/d16/d19/d38/d5d/f84 zero size 2024-04-19T02:18:34.770 INFO:tasks.workunit.client.0.smithi073.stdout:0/769: write d7/d14/d17/d1a/d20/f6c [4477809,5497] 0 2024-04-19T02:18:34.770 INFO:tasks.workunit.client.0.smithi073.stdout:2/819: mknod d5/d10/d14/d7a/dd1/d103/c11c 0 2024-04-19T02:18:34.771 INFO:tasks.workunit.client.0.smithi073.stdout:2/820: stat d5/d10/d14/d18/d3e/d2d/l6c 0 2024-04-19T02:18:34.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/770: write d7/d14/d17/d1a/f29 [6705141,71457] 0 2024-04-19T02:18:34.772 INFO:tasks.workunit.client.0.smithi073.stdout:2/821: unlink d5/d10/d14/d7a/ca5 0 2024-04-19T02:18:34.772 INFO:tasks.workunit.client.0.smithi073.stdout:0/771: dread - d7/d14/d17/d1a/d21/fce zero size 2024-04-19T02:18:34.773 INFO:tasks.workunit.client.0.smithi073.stdout:2/822: dread - d5/d10/d29/d66/d83/ffd zero size 2024-04-19T02:18:34.774 INFO:tasks.workunit.client.0.smithi073.stdout:6/733: dwrite d8/de/f1f [0,4194304] 0 2024-04-19T02:18:34.777 INFO:tasks.workunit.client.0.smithi073.stdout:6/734: truncate d8/d4b/d93/f3d 1246296 0 2024-04-19T02:18:34.777 INFO:tasks.workunit.client.0.smithi073.stdout:6/735: sync 2024-04-19T02:18:34.778 INFO:tasks.workunit.client.0.smithi073.stdout:0/772: dread d7/d14/d17/d69/d7c/f8b [0,4194304] 0 2024-04-19T02:18:34.779 INFO:tasks.workunit.client.0.smithi073.stdout:0/773: sync 2024-04-19T02:18:34.780 INFO:tasks.workunit.client.0.smithi073.stdout:8/825: dwrite d14/d27/f30 [0,4194304] 0 2024-04-19T02:18:34.781 INFO:tasks.workunit.client.0.smithi073.stdout:8/826: write d14/d15/f7e [4457097,104950] 0 2024-04-19T02:18:34.782 INFO:tasks.workunit.client.0.smithi073.stdout:0/774: rename d7/d6d/c9d to d7/d14/d17/d1a/d20/d50/d99/da7/d6f/ce7 0 2024-04-19T02:18:34.782 INFO:tasks.workunit.client.0.smithi073.stdout:2/823: dwrite d5/d10/d53/f75 [4194304,4194304] 0 2024-04-19T02:18:34.783 INFO:tasks.workunit.client.0.smithi073.stdout:0/775: mkdir d7/d6d/dc7/de8 0 2024-04-19T02:18:34.787 INFO:tasks.workunit.client.0.smithi073.stdout:0/776: dread d7/d14/d17/d1a/d21/f8a [0,4194304] 0 2024-04-19T02:18:34.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/777: creat d7/d6d/dc7/fe9 x:0 0 0 2024-04-19T02:18:34.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/824: truncate d5/d10/d53/f75 1389516 0 2024-04-19T02:18:34.793 INFO:tasks.workunit.client.0.smithi073.stdout:0/778: getdents d7/d14/d17/d70 0 2024-04-19T02:18:34.794 INFO:tasks.workunit.client.0.smithi073.stdout:0/779: rename d7/d14/d81 to d7/d14/d17/d1a/d8d/dea 0 2024-04-19T02:18:34.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/827: dread d14/d27/d29/f51 [0,4194304] 0 2024-04-19T02:18:34.796 INFO:tasks.workunit.client.0.smithi073.stdout:2/825: dwrite d5/d10/d14/d18/d3e/d51/f59 [0,4194304] 0 2024-04-19T02:18:34.796 INFO:tasks.workunit.client.0.smithi073.stdout:8/828: rmdir d14/d27/d50 39 2024-04-19T02:18:34.797 INFO:tasks.workunit.client.0.smithi073.stdout:8/829: chown d14/d27/da4 222459 1 2024-04-19T02:18:34.797 INFO:tasks.workunit.client.0.smithi073.stdout:1/790: dread db/d1c/d78/d8c/dd5/f77 [0,4194304] 0 2024-04-19T02:18:34.797 INFO:tasks.workunit.client.0.smithi073.stdout:8/830: stat d14/d27/d4c/d75/c66 0 2024-04-19T02:18:34.798 INFO:tasks.workunit.client.0.smithi073.stdout:1/791: readlink db/d1c/d78/d8c/dd5/l46 0 2024-04-19T02:18:34.801 INFO:tasks.workunit.client.0.smithi073.stdout:0/780: dwrite d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/fb2 [0,4194304] 0 2024-04-19T02:18:34.803 INFO:tasks.workunit.client.0.smithi073.stdout:2/826: dwrite d5/d10/d29/d66/d67/d72/fb3 [4194304,4194304] 0 2024-04-19T02:18:34.805 INFO:tasks.workunit.client.0.smithi073.stdout:2/827: chown d5/d10/d14/d18/d3e/d2d 13309211 1 2024-04-19T02:18:34.805 INFO:tasks.workunit.client.0.smithi073.stdout:1/792: dwrite db/d1c/d78/fb2 [0,4194304] 0 2024-04-19T02:18:34.806 INFO:tasks.workunit.client.0.smithi073.stdout:0/781: getdents d7/d14/d17/d1a/d20/d50/d99/da7/d9e 0 2024-04-19T02:18:34.806 INFO:tasks.workunit.client.0.smithi073.stdout:2/828: chown d5/d10/d14/d7a/dde 61683704 1 2024-04-19T02:18:34.810 INFO:tasks.workunit.client.0.smithi073.stdout:5/834: dread d0/d69/fab [0,4194304] 0 2024-04-19T02:18:34.811 INFO:tasks.workunit.client.0.smithi073.stdout:2/829: chown d5/d10/d14/d18/d3e/de1 24264 1 2024-04-19T02:18:34.811 INFO:tasks.workunit.client.0.smithi073.stdout:3/938: dread d3/f49 [0,4194304] 0 2024-04-19T02:18:34.811 INFO:tasks.workunit.client.0.smithi073.stdout:8/831: dwrite d14/d27/d85/d9b/fa9 [4194304,4194304] 0 2024-04-19T02:18:34.811 INFO:tasks.workunit.client.0.smithi073.stdout:2/830: write d5/d10/d14/d18/d3e/d2d/fc1 [8902395,41920] 0 2024-04-19T02:18:34.811 INFO:tasks.workunit.client.0.smithi073.stdout:1/793: read db/d1c/d54/d8b/ff2 [430959,126864] 0 2024-04-19T02:18:34.811 INFO:tasks.workunit.client.0.smithi073.stdout:8/832: chown d14/d15/d17/d48/le3 6736 1 2024-04-19T02:18:34.812 INFO:tasks.workunit.client.0.smithi073.stdout:2/831: rename d5/d10/d14/d18/d3e/de1/f10a to d5/d10/ddf/f11d 0 2024-04-19T02:18:34.812 INFO:tasks.workunit.client.0.smithi073.stdout:3/939: mkdir d3/d6/db/d3a/d38/d57/d88/dc2/dfb/d13a 0 2024-04-19T02:18:34.813 INFO:tasks.workunit.client.0.smithi073.stdout:0/782: dread d7/d14/d17/d1a/d20/fd3 [0,4194304] 0 2024-04-19T02:18:34.813 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:34.813 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:34.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.813 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:2376 4.27 4.38dee8e7 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-19T02:18:34.813 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.806720+0000", 2024-04-19T02:18:34.813 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0076929349999999997, 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0077154820000000001, 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806720+0000", 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806720+0000", 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806719+0000", 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806722+0000", 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3980000000000002e-06 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806728+0000", 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8510000000000004e-06 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806732+0000", 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5619999999999997e-06 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:2377 3.d 3:b02ffd62:::200.00000010:head [write 646163~7964 [fadvise_dontneed] in=7964b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.811744+0000", 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0026690059999999998, 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027309600000000002, 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.811744+0000", 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.811744+0000", 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.811741+0000", 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.811818+0000", 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6131999999999995e-05 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.811833+0000", 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5132e-05 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.811843+0000", 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0601000000000001e-05 2024-04-19T02:18:34.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.811907+0000", 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3785e-05 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.812023+0000", 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115876 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:14285 4.3a 4:5d082a23:::100000036c3.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.761920+0000", 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.052492522999999999, 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052592491999999998, 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14285 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.761920+0000", 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.761920+0000", 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.761920+0000", 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.764529+0000", 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026098779999999999 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.764542+0000", 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2918999999999999e-05 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.764551+0000", 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0159999999999997e-06 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.783253+0000", 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018701183999999999 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.783352+0000", 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9252000000000004e-05 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.783499+0000", 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014711699999999999 2024-04-19T02:18:34.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.807753+0000", 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024254487000000002 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:14318 4.13 4:cae5e35d:::100000031d8.00000000:head [write 0~4194304 [3@320365] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.777783+0000", 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.036629687000000001, 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036778500999999998, 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14318 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.777783+0000", 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.777783+0000", 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.777782+0000", 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781783+0000", 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040012249999999997 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781790+0000", 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9809999999999997e-06 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781795+0000", 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4089999999999996e-06 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781833+0000", 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8124000000000003e-05 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781910+0000", 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7106000000000003e-05 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:14322 4.13 4:cafaca30:::100000036df.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.781965+0000", 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032447463000000003, 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032635816999999998, 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14322 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781965+0000", 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781965+0000", 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781964+0000", 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781969+0000", 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1389999999999997e-06 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781977+0000", 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9699999999999999e-06 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.781982+0000", 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8119999999999996e-06 2024-04-19T02:18:34.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.808485+0000", 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026502266999999999 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.808562+0000", 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7854000000000004e-05 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:14325 4.27 4:e7177b1c:::10000003431.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.785056+0000", 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.029357037999999998, 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029582681, 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.834 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14325 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.785056+0000", 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.785056+0000", 2024-04-19T02:18:34.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.785053+0000", 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.792441+0000", 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073878709999999998 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.792462+0000", 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0996e-05 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.792473+0000", 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1253999999999999e-05 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.792534+0000", 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0529000000000003e-05 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:34.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.792631+0000", 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7436999999999996e-05 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:14323 4.f e64/16 4:f3d03306:::10000003301.00000000:head v 64'190, mlcod=64'188)", 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.789754+0000", 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024658770999999999, 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024921210999999999, 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.789754+0000", 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.789754+0000", 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.789753+0000", 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:34.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.796054+0000", 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063009659999999999 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.796066+0000", 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2138e-05 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.796074+0000", 2024-04-19T02:18:34.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1480000000000006e-06 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.796156+0000", 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2286999999999993e-05 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.796183+0000", 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6689000000000001e-05 2024-04-19T02:18:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:14337 4.3d 4:bcb2973a:::1000000337d.00000000:head [write 0~4194304 [2@444182] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:34.801548+0000", 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012864248999999999, 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013161357, 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:34.842 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14337 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.801548+0000", 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.801548+0000", 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.801548+0000", 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806519+0000", 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049711909999999998 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806531+0000", 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2306999999999999e-05 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806538+0000", 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6889999999999998e-06 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806589+0000", 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0633000000000001e-05 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:34.806692+0000", 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103884 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:34.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:34.846 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:34.846 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 8 2024-04-19T02:18:34.846 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:34.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:3/940: unlink d3/d6/db/d3a/d38/l83 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:2/832: creat d5/d10/d14/d2e/da0/f11e x:0 0 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:8/833: read d14/d27/d4c/d75/f44 [1280847,22167] 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:0/783: symlink d7/d14/d17/d1a/d8d/leb 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:3/941: creat d3/d6/db/d16/d7c/f13b x:0 0 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:2/833: creat d5/d10/d14/d18/d98/d107/f11f x:0 0 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:0/784: creat d7/d14/d17/d69/fec x:0 0 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:8/834: write d14/d27/d29/d64/f78 [226576,85750] 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:3/942: symlink d3/l13c 0 2024-04-19T02:18:34.854 INFO:tasks.workunit.client.0.smithi073.stdout:8/835: fdatasync d14/d27/d85/d9b/fd2 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/834: creat d5/d10/d14/db6/d101/f120 x:0 0 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/785: write d7/d14/d17/d1a/d20/f4c [5369588,65102] 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:3/943: read d3/d6/db/d3a/d38/d40/db5/f10f [25438,30490] 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/835: creat d5/d10/d14/d2e/da0/dff/f121 x:0 0 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/786: rename d7/d14/d17/d69/d7c/c95 to d7/d14/d17/d1a/d21/dc9/ced 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/787: chown d7/d14/d17/d1a/fb0 1853 1 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:4/778: dread da/d27/d1b/d1d/d72/d104/ddd/fdc [0,4194304] 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/836: dwrite d5/ffb [0,4194304] 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/837: stat d5/d10/d14/d7a/dd1/d103 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:4/779: write da/d27/d1b/d1d/d8d/d84/fa0 [323216,15665] 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:4/780: mkdir da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/d112 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/838: rename d5/d10/d29/d66/d7e/c97 to d5/d10/d14/d18/d3e/d2d/d63/c122 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:4/781: symlink da/d27/d1b/d1d/d72/d2b/l113 0 2024-04-19T02:18:34.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/839: chown d5/d10/d29/d66/d67/d72/f12 3441349 1 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:2/840: unlink d5/d10/d14/d18/d3e/d2d/c4e 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:2/841: mkdir d5/d10/d14/d2e/da0/dc0/d123 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/782: link da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/lff da/d27/d1b/d1d/d72/d104/ddd/df5/l114 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/783: readlink da/d27/d3a/d49/l93 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:2/842: link d5/d10/d29/d66/d67/f4f d5/d10/d29/d66/d67/f124 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/784: write da/d27/d2c/f3c [5356964,62726] 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/785: chown da/d27/d3a/d49/l7f 22933240 1 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/835: dread d0/d1d/d25/f72 [0,4194304] 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/786: write da/d27/d3a/d97/fbb [88172,78469] 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/787: rmdir da/d27/d1b/d1d 39 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:0/788: dread d7/f67 [0,4194304] 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:8/836: sync 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/836: dread d0/d1d/d25/d35/f49 [0,4194304] 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:8/837: fdatasync d14/d27/d85/d9b/fd2 0 2024-04-19T02:18:34.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/837: fsync d0/d1d/d1e/fda 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:8/838: truncate d14/d27/d29/d31/d34/fcb 807819 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:5/838: chown d0/d1d/d64/c8e 884 1 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:5/839: chown d0/d1d/f20 1362373037 1 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:4/788: dwrite da/d27/d1b/d1d/d72/dd5/f101 [0,4194304] 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:0/789: dwrite d7/d14/d17/d1a/d21/f3b [0,4194304] 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:8/839: chown d14/d15/d17/f73 0 1 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:5/840: write d0/ff [3918749,103579] 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:4/789: fsync da/d27/fa7 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:0/790: readlink d7/d14/d17/d69/l90 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:0/791: unlink d7/d14/d17/d1a/d21/f63 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:5/841: dwrite d0/d1d/d25/f6e [0,4194304] 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:5/842: creat d0/f10b x:0 0 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:8/840: dwrite d14/d15/d17/d48/f59 [0,4194304] 0 2024-04-19T02:18:34.857 INFO:tasks.workunit.client.0.smithi073.stdout:4/790: dwrite da/d27/d36/f5e [0,4194304] 0 2024-04-19T02:18:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:5/843: fdatasync d0/d1d/d25/db5/ffb 0 2024-04-19T02:18:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:8/841: fsync d14/d27/d85/d9b/f100 0 2024-04-19T02:18:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:3/944: truncate d3/d6/db/d1a/faa 1407390 0 2024-04-19T02:18:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:4/791: truncate da/d27/d1b/d1d/d8d/f89 8752895 0 2024-04-19T02:18:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:4/792: write da/d27/feb [680635,79732] 0 2024-04-19T02:18:34.858 INFO:tasks.workunit.client.0.smithi073.stdout:3/945: write d3/d6/db/d16/d7c/f92 [372747,88989] 0 2024-04-19T02:18:34.859 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:34.848+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/844: rmdir d0/d2d/dd2 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:4/793: truncate da/d27/fa7 2961087 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/845: creat d0/d1d/d90/da0/dbb/f10c x:0 0 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:0/792: read d7/d14/d17/d1a/d20/d50/d99/da7/f5a [327970,91233] 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:3/946: link d3/d6/db/d16/d75/f126 d3/d6/db/d3a/d38/d40/db5/f13d 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:2/843: fdatasync d5/ffb 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:7/797: dread d0/dc/f26 [0,4194304] 0 2024-04-19T02:18:34.860 INFO:tasks.workunit.client.0.smithi073.stdout:3/947: fsync d3/d6/db/d3a/d38/d89/d94/fcb 0 2024-04-19T02:18:34.861 INFO:tasks.workunit.client.0.smithi073.stdout:8/842: dwrite d14/d15/d17/f2c [0,4194304] 0 2024-04-19T02:18:34.861 INFO:tasks.workunit.client.0.smithi073.stdout:7/798: link d0/l53 d0/dc/d67/d2a/d51/dd9/lec 0 2024-04-19T02:18:34.862 INFO:tasks.workunit.client.0.smithi073.stdout:8/843: dread - d14/d15/d17/d48/fe9 zero size 2024-04-19T02:18:34.862 INFO:tasks.workunit.client.0.smithi073.stdout:1/794: dread db/f112 [0,4194304] 0 2024-04-19T02:18:34.862 INFO:tasks.workunit.client.0.smithi073.stdout:7/799: unlink d0/f7c 0 2024-04-19T02:18:34.862 INFO:tasks.workunit.client.0.smithi073.stdout:1/795: unlink db/d41/d101/db1/dc4/fc8 0 2024-04-19T02:18:34.862 INFO:tasks.workunit.client.0.smithi073.stdout:8/844: mkdir d14/d15/d17/da1/db9/d120 0 2024-04-19T02:18:34.863 INFO:tasks.workunit.client.0.smithi073.stdout:7/800: mknod d0/dc/ced 0 2024-04-19T02:18:34.864 INFO:tasks.workunit.client.0.smithi073.stdout:7/801: creat d0/dc/d67/d2a/d51/d7a/fee x:0 0 0 2024-04-19T02:18:34.869 INFO:tasks.workunit.client.0.smithi073.stdout:6/736: dread d8/de/f1e [0,4194304] 0 2024-04-19T02:18:34.870 INFO:tasks.workunit.client.0.smithi073.stdout:2/844: write d5/d10/f7d [4386929,22222] 0 2024-04-19T02:18:34.870 INFO:tasks.workunit.client.0.smithi073.stdout:0/793: write d7/d14/d17/d1a/d20/d50/d99/da7/f65 [3680169,5719] 0 2024-04-19T02:18:34.870 INFO:tasks.workunit.client.0.smithi073.stdout:7/802: dwrite d0/dc/f8a [0,4194304] 0 2024-04-19T02:18:34.871 INFO:tasks.workunit.client.0.smithi073.stdout:6/737: write d8/de/d22/da8/fe1 [288977,125209] 0 2024-04-19T02:18:34.871 INFO:tasks.workunit.client.0.smithi073.stdout:8/845: dread d14/d27/d50/f5d [0,4194304] 0 2024-04-19T02:18:34.871 INFO:tasks.workunit.client.0.smithi073.stdout:2/845: creat d5/d10/d29/d66/d83/dbc/f125 x:0 0 0 2024-04-19T02:18:34.872 INFO:tasks.workunit.client.0.smithi073.stdout:8/846: chown d14/d27/d4c/d75 639803 1 2024-04-19T02:18:34.872 INFO:tasks.workunit.client.0.smithi073.stdout:7/803: readlink d0/dc/d67/d15/l48 0 2024-04-19T02:18:34.872 INFO:tasks.workunit.client.0.smithi073.stdout:6/738: rmdir d8/d71 39 2024-04-19T02:18:34.872 INFO:tasks.workunit.client.0.smithi073.stdout:2/846: mkdir d5/d10/d14/d2e/d126 0 2024-04-19T02:18:34.873 INFO:tasks.workunit.client.0.smithi073.stdout:2/847: chown d5/d10/l1c 428819324 1 2024-04-19T02:18:34.873 INFO:tasks.workunit.client.0.smithi073.stdout:6/739: read - d8/de/d7f/da5/fad zero size 2024-04-19T02:18:34.873 INFO:tasks.workunit.client.0.smithi073.stdout:8/847: fdatasync d14/d27/d29/d69/f115 0 2024-04-19T02:18:34.876 INFO:tasks.workunit.client.0.smithi073.stdout:6/740: write d8/fdf [100333,123278] 0 2024-04-19T02:18:34.877 INFO:tasks.workunit.client.0.smithi073.stdout:8/848: creat d14/d87/f121 x:0 0 0 2024-04-19T02:18:34.879 INFO:tasks.workunit.client.0.smithi073.stdout:0/794: dread d7/d14/d17/d1a/d20/fd3 [0,4194304] 0 2024-04-19T02:18:34.879 INFO:tasks.workunit.client.0.smithi073.stdout:8/849: chown d14/d27/d50 602 1 2024-04-19T02:18:34.880 INFO:tasks.workunit.client.0.smithi073.stdout:9/725: dread d0/df/d16/d19/d38/fab [0,4194304] 0 2024-04-19T02:18:34.880 INFO:tasks.workunit.client.0.smithi073.stdout:8/850: creat d14/d27/d85/d9b/f122 x:0 0 0 2024-04-19T02:18:34.882 INFO:tasks.workunit.client.0.smithi073.stdout:3/948: dwrite d3/d6/db/d3a/d5f/dca/dde/f132 [0,4194304] 0 2024-04-19T02:18:34.882 INFO:tasks.workunit.client.0.smithi073.stdout:8/851: chown d14/d15/c81 11717 1 2024-04-19T02:18:34.883 INFO:tasks.workunit.client.0.smithi073.stdout:2/848: dwrite d5/d10/d29/d42/f6e [0,4194304] 0 2024-04-19T02:18:34.883 INFO:tasks.workunit.client.0.smithi073.stdout:8/852: readlink d14/d27/d29/d31/d34/ld1 0 2024-04-19T02:18:34.884 INFO:tasks.workunit.client.0.smithi073.stdout:3/949: write d3/d6/db/d3a/d38/d43/d4e/f139 [579055,57932] 0 2024-04-19T02:18:34.884 INFO:tasks.workunit.client.0.smithi073.stdout:2/849: chown d5/d10/d14/d18/d3e/de1 4007671 1 2024-04-19T02:18:34.884 INFO:tasks.workunit.client.0.smithi073.stdout:3/950: write d3/d6/f1e [828157,4752] 0 2024-04-19T02:18:34.886 INFO:tasks.workunit.client.0.smithi073.stdout:4/794: sync 2024-04-19T02:18:34.886 INFO:tasks.workunit.client.0.smithi073.stdout:1/796: sync 2024-04-19T02:18:34.886 INFO:tasks.workunit.client.0.smithi073.stdout:2/850: rename d5/d10/d14/d7a/fba to d5/d10/f127 0 2024-04-19T02:18:34.888 INFO:tasks.workunit.client.0.smithi073.stdout:2/851: creat d5/d10/d53/f128 x:0 0 0 2024-04-19T02:18:34.889 INFO:tasks.workunit.client.0.smithi073.stdout:4/795: getdents da/d27/d3a/d50/d9c/dba 0 2024-04-19T02:18:34.889 INFO:tasks.workunit.client.0.smithi073.stdout:9/726: dwrite d0/df/d16/d19/d38/d5d/d5e/d83/fe3 [0,4194304] 0 2024-04-19T02:18:34.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/796: chown da/d27/d1b/d1d 359148627 1 2024-04-19T02:18:34.890 INFO:tasks.workunit.client.0.smithi073.stdout:2/852: write d5/d10/d29/d66/d67/f45 [4673391,11909] 0 2024-04-19T02:18:34.892 INFO:tasks.workunit.client.0.smithi073.stdout:8/853: dwrite d14/d15/d17/d99/d106/f10a [0,4194304] 0 2024-04-19T02:18:34.894 INFO:tasks.workunit.client.0.smithi073.stdout:8/854: rename d14/d27/d29/f51 to d14/d15/d17/da1/db9/f123 0 2024-04-19T02:18:34.895 INFO:tasks.workunit.client.0.smithi073.stdout:1/797: dwrite db/d1c/d81/d86/ddd/ffe [0,4194304] 0 2024-04-19T02:18:34.897 INFO:tasks.workunit.client.0.smithi073.stdout:1/798: rename db/l19 to db/d1c/l11c 0 2024-04-19T02:18:34.899 INFO:tasks.workunit.client.0.smithi073.stdout:3/951: dread d3/d6/db/d3a/f5c [0,4194304] 0 2024-04-19T02:18:34.902 INFO:tasks.workunit.client.0.smithi073.stdout:6/741: dread d8/de/d22/f3a [4194304,4194304] 0 2024-04-19T02:18:34.903 INFO:tasks.workunit.client.0.smithi073.stdout:8/855: dwrite d14/d27/d29/d31/f5e [0,4194304] 0 2024-04-19T02:18:34.903 INFO:tasks.workunit.client.0.smithi073.stdout:1/799: dwrite db/d1c/d54/d8b/ff2 [0,4194304] 0 2024-04-19T02:18:34.903 INFO:tasks.workunit.client.0.smithi073.stdout:6/742: mknod d8/de/d58/d63/cf4 0 2024-04-19T02:18:34.907 INFO:tasks.workunit.client.0.smithi073.stdout:8/856: truncate d14/d27/d4c/d75/dbb/fc7 126460 0 2024-04-19T02:18:34.907 INFO:tasks.workunit.client.0.smithi073.stdout:8/857: rename d14/d15/d17/d8d to d14/d15/d17/d48/d89/d97/d124 0 2024-04-19T02:18:34.909 INFO:tasks.workunit.client.0.smithi073.stdout:1/800: dwrite db/d1c/d78/d8c/ff7 [0,4194304] 0 2024-04-19T02:18:34.910 INFO:tasks.workunit.client.0.smithi073.stdout:7/804: dread d0/dc/d67/d2a/d51/d7a/f95 [0,4194304] 0 2024-04-19T02:18:34.910 INFO:tasks.workunit.client.0.smithi073.stdout:1/801: readlink db/d41/l51 0 2024-04-19T02:18:34.910 INFO:tasks.workunit.client.0.smithi073.stdout:1/802: mknod db/d1c/c11d 0 2024-04-19T02:18:34.911 INFO:tasks.workunit.client.0.smithi073.stdout:1/803: fdatasync db/d41/d101/ff3 0 2024-04-19T02:18:34.915 INFO:tasks.workunit.client.0.smithi073.stdout:7/805: dwrite d0/dc/d67/d2a/f2b [4194304,4194304] 0 2024-04-19T02:18:34.916 INFO:tasks.workunit.client.0.smithi073.stdout:0/795: sync 2024-04-19T02:18:34.916 INFO:tasks.workunit.client.0.smithi073.stdout:8/858: sync 2024-04-19T02:18:34.917 INFO:tasks.workunit.client.0.smithi073.stdout:0/796: sync 2024-04-19T02:18:34.918 INFO:tasks.workunit.client.0.smithi073.stdout:1/804: dwrite db/d41/f59 [0,4194304] 0 2024-04-19T02:18:34.918 INFO:tasks.workunit.client.0.smithi073.stdout:1/805: sync 2024-04-19T02:18:34.919 INFO:tasks.workunit.client.0.smithi073.stdout:8/859: write d14/d27/d50/faf [4781292,58416] 0 2024-04-19T02:18:34.920 INFO:tasks.workunit.client.0.smithi073.stdout:0/797: unlink d7/d14/d17/d70/f72 0 2024-04-19T02:18:34.920 INFO:tasks.workunit.client.0.smithi073.stdout:8/860: mknod d14/d27/d29/d64/c125 0 2024-04-19T02:18:34.920 INFO:tasks.workunit.client.0.smithi073.stdout:1/806: mknod db/d1c/d78/d8c/dd5/d50/c11e 0 2024-04-19T02:18:34.921 INFO:tasks.workunit.client.0.smithi073.stdout:0/798: readlink d7/d14/d17/d1a/d8d/dea/l83 0 2024-04-19T02:18:34.921 INFO:tasks.workunit.client.0.smithi073.stdout:1/807: chown db/d1c/d54/d8b/dab/ff0 167791 1 2024-04-19T02:18:34.922 INFO:tasks.workunit.client.0.smithi073.stdout:1/808: creat db/d41/dc5/f11f x:0 0 0 2024-04-19T02:18:34.922 INFO:tasks.workunit.client.0.smithi073.stdout:7/806: dwrite d0/dc/d67/fda [0,4194304] 0 2024-04-19T02:18:34.926 INFO:tasks.workunit.client.0.smithi073.stdout:7/807: rename d0/dc/d67/d2a/d51/d7a/d9f to d0/d3/dbb/da1/def 0 2024-04-19T02:18:34.928 INFO:tasks.workunit.client.0.smithi073.stdout:0/799: dwrite d7/d14/d17/d1a/d20/d50/d99/da7/fe3 [0,4194304] 0 2024-04-19T02:18:34.928 INFO:tasks.workunit.client.0.smithi073.stdout:1/809: symlink db/d1c/d78/d8c/dd5/de3/l120 0 2024-04-19T02:18:34.929 INFO:tasks.workunit.client.0.smithi073.stdout:0/800: mknod d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/cee 0 2024-04-19T02:18:34.930 INFO:tasks.workunit.client.0.smithi073.stdout:1/810: creat db/d1c/f121 x:0 0 0 2024-04-19T02:18:34.931 INFO:tasks.workunit.client.0.smithi073.stdout:1/811: mkdir db/d1c/d122 0 2024-04-19T02:18:34.931 INFO:tasks.workunit.client.0.smithi073.stdout:7/808: dread d0/dc/d67/fda [0,4194304] 0 2024-04-19T02:18:34.931 INFO:tasks.workunit.client.0.smithi073.stdout:0/801: unlink d7/d14/d17/d1a/d20/f89 0 2024-04-19T02:18:34.932 INFO:tasks.workunit.client.0.smithi073.stdout:0/802: unlink d7/d14/d17/d1a/d21/l57 0 2024-04-19T02:18:34.932 INFO:tasks.workunit.client.0.smithi073.stdout:1/812: write db/d1c/d78/d8c/fe5 [53228,7606] 0 2024-04-19T02:18:34.934 INFO:tasks.workunit.client.0.smithi073.stdout:7/809: read d0/dc/d39/d50/f6b [148703,113598] 0 2024-04-19T02:18:34.936 INFO:tasks.workunit.client.0.smithi073.stdout:5/846: dread d0/d1d/d24/fa5 [0,4194304] 0 2024-04-19T02:18:34.936 INFO:tasks.workunit.client.0.smithi073.stdout:7/810: dread - d0/dc/fc2 zero size 2024-04-19T02:18:34.936 INFO:tasks.workunit.client.0.smithi073.stdout:5/847: symlink d0/d2d/l10d 0 2024-04-19T02:18:34.937 INFO:tasks.workunit.client.0.smithi073.stdout:7/811: fsync d0/d28/d63/fa2 0 2024-04-19T02:18:34.937 INFO:tasks.workunit.client.0.smithi073.stdout:7/812: mknod d0/dc/d39/cf0 0 2024-04-19T02:18:34.937 INFO:tasks.workunit.client.0.smithi073.stdout:5/848: getdents d0/d1d/d25/d35/d96/dd3 0 2024-04-19T02:18:34.938 INFO:tasks.workunit.client.0.smithi073.stdout:7/813: unlink d0/dc/le2 0 2024-04-19T02:18:34.938 INFO:tasks.workunit.client.0.smithi073.stdout:5/849: chown d0/d1d/d25/d37/l58 336193694 1 2024-04-19T02:18:34.939 INFO:tasks.workunit.client.0.smithi073.stdout:7/814: fdatasync d0/dc/d39/d50/f6b 0 2024-04-19T02:18:34.939 INFO:tasks.workunit.client.0.smithi073.stdout:5/850: mknod d0/c10e 0 2024-04-19T02:18:34.940 INFO:tasks.workunit.client.0.smithi073.stdout:0/803: dwrite d7/d14/d17/d1a/d20/f6c [4194304,4194304] 0 2024-04-19T02:18:34.940 INFO:tasks.workunit.client.0.smithi073.stdout:7/815: symlink d0/dc/d33/d5d/lf1 0 2024-04-19T02:18:34.941 INFO:tasks.workunit.client.0.smithi073.stdout:7/816: chown d0/dc/fc2 2389 1 2024-04-19T02:18:34.941 INFO:tasks.workunit.client.0.smithi073.stdout:5/851: mkdir d0/d1d/d25/d35/d39/d10f 0 2024-04-19T02:18:34.941 INFO:tasks.workunit.client.0.smithi073.stdout:0/804: unlink d7/d14/d17/d1a/d20/d50/d99/cb6 0 2024-04-19T02:18:34.941 INFO:tasks.workunit.client.0.smithi073.stdout:7/817: fsync d0/dc/d67/d2a/d51/f6c 0 2024-04-19T02:18:34.941 INFO:tasks.workunit.client.0.smithi073.stdout:5/852: write d0/d1d/d25/d35/d99/fc5 [3133116,115548] 0 2024-04-19T02:18:34.942 INFO:tasks.workunit.client.0.smithi073.stdout:0/805: symlink d7/d14/d17/d1a/d20/d50/d99/da7/d9e/lef 0 2024-04-19T02:18:34.942 INFO:tasks.workunit.client.0.smithi073.stdout:7/818: truncate d0/dc/d67/d15/f87 534032 0 2024-04-19T02:18:34.943 INFO:tasks.workunit.client.0.smithi073.stdout:5/853: write d0/d1d/d24/d61/f7c [1116570,8458] 0 2024-04-19T02:18:34.943 INFO:tasks.workunit.client.0.smithi073.stdout:7/819: write d0/dc/d33/fcd [1196316,43383] 0 2024-04-19T02:18:34.943 INFO:tasks.workunit.client.0.smithi073.stdout:0/806: mkdir d7/d14/d17/d1a/d20/d50/dc2/df0 0 2024-04-19T02:18:34.944 INFO:tasks.workunit.client.0.smithi073.stdout:1/813: dread db/d1c/d78/d8c/dd5/d50/d62/fb6 [0,4194304] 0 2024-04-19T02:18:34.944 INFO:tasks.workunit.client.0.smithi073.stdout:5/854: write d0/d1d/d25/d37/d71/f89 [955094,24059] 0 2024-04-19T02:18:34.944 INFO:tasks.workunit.client.0.smithi073.stdout:0/807: fdatasync d7/d14/d17/d69/fec 0 2024-04-19T02:18:34.944 INFO:tasks.workunit.client.0.smithi073.stdout:7/820: write d0/d3/fc8 [272604,44206] 0 2024-04-19T02:18:34.945 INFO:tasks.workunit.client.0.smithi073.stdout:0/808: creat d7/d14/d17/d1a/d21/dc9/ff1 x:0 0 0 2024-04-19T02:18:34.945 INFO:tasks.workunit.client.0.smithi073.stdout:7/821: rename d0/dc/d33/d36/dce/fcf to d0/d3/ff2 0 2024-04-19T02:18:34.946 INFO:tasks.workunit.client.0.smithi073.stdout:0/809: sync 2024-04-19T02:18:34.946 INFO:tasks.workunit.client.0.smithi073.stdout:1/814: truncate db/d1c/d78/d8c/dd5/de3/f10a 609668 0 2024-04-19T02:18:34.946 INFO:tasks.workunit.client.0.smithi073.stdout:7/822: symlink d0/d28/d63/lf3 0 2024-04-19T02:18:34.947 INFO:tasks.workunit.client.0.smithi073.stdout:9/727: dread d0/df/d16/d19/d38/d5d/d5e/f8d [0,4194304] 0 2024-04-19T02:18:34.947 INFO:tasks.workunit.client.0.smithi073.stdout:7/823: creat d0/d3/dbb/da1/def/ff4 x:0 0 0 2024-04-19T02:18:34.948 INFO:tasks.workunit.client.0.smithi073.stdout:7/824: write d0/dc/d67/d15/d8f/f9b [5222068,107451] 0 2024-04-19T02:18:34.948 INFO:tasks.workunit.client.0.smithi073.stdout:9/728: truncate d0/d81/dda/ddd/fd6 978425 0 2024-04-19T02:18:34.949 INFO:tasks.workunit.client.0.smithi073.stdout:7/825: creat d0/dc/d33/da7/de3/ff5 x:0 0 0 2024-04-19T02:18:34.950 INFO:tasks.workunit.client.0.smithi073.stdout:9/729: write d0/df/d16/d19/db1/d2c/d2e/f4b [312431,68486] 0 2024-04-19T02:18:34.950 INFO:tasks.workunit.client.0.smithi073.stdout:7/826: write d0/dc/d67/d2a/d51/d7a/fee [535875,21661] 0 2024-04-19T02:18:34.950 INFO:tasks.workunit.client.0.smithi073.stdout:9/730: stat d0/df/d16/d19/f26 0 2024-04-19T02:18:34.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/810: dwrite d7/d14/d17/d1a/f7d [0,4194304] 0 2024-04-19T02:18:34.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/827: unlink d0/dc/d39/d50/dbc/lc1 0 2024-04-19T02:18:34.952 INFO:tasks.workunit.client.0.smithi073.stdout:1/815: truncate db/d1c/d81/df9/f97 2704080 0 2024-04-19T02:18:34.952 INFO:tasks.workunit.client.0.smithi073.stdout:1/816: sync 2024-04-19T02:18:34.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/828: fsync d0/dc/d67/d2a/d51/f6c 0 2024-04-19T02:18:34.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/829: write d0/dc/fc2 [872065,122962] 0 2024-04-19T02:18:34.953 INFO:tasks.workunit.client.0.smithi073.stdout:9/731: rename d0/df/d16/d19/d38/d5d/d5e/d83/lb6 to d0/df/d16/d19/d38/d5d/d76/d7d/d88/lfa 0 2024-04-19T02:18:34.954 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:34.948+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:34.954 INFO:tasks.workunit.client.0.smithi073.stdout:9/732: mknod d0/df9/cfb 0 2024-04-19T02:18:34.955 INFO:tasks.workunit.client.0.smithi073.stdout:7/830: mkdir d0/dc/d33/d36/df6 0 2024-04-19T02:18:34.955 INFO:tasks.workunit.client.0.smithi073.stdout:2/853: dread d5/d10/d14/d7a/dde/f115 [0,4194304] 0 2024-04-19T02:18:34.955 INFO:tasks.workunit.client.0.smithi073.stdout:7/831: chown d0/d3/f74 41192499 1 2024-04-19T02:18:34.956 INFO:tasks.workunit.client.0.smithi073.stdout:7/832: chown d0/f1d 2864 1 2024-04-19T02:18:34.956 INFO:tasks.workunit.client.0.smithi073.stdout:1/817: rmdir db/d1c 39 2024-04-19T02:18:34.956 INFO:tasks.workunit.client.0.smithi073.stdout:0/811: truncate d7/d14/d17/d1a/d20/f48 392726 0 2024-04-19T02:18:34.956 INFO:tasks.workunit.client.0.smithi073.stdout:7/833: mkdir d0/dc/d39/d50/dbc/df7 0 2024-04-19T02:18:34.957 INFO:tasks.workunit.client.0.smithi073.stdout:0/812: mknod d7/d14/d17/d1a/d21/cf2 0 2024-04-19T02:18:34.957 INFO:tasks.workunit.client.0.smithi073.stdout:1/818: fdatasync db/d1c/d81/d86/ddd/fff 0 2024-04-19T02:18:34.958 INFO:tasks.workunit.client.0.smithi073.stdout:0/813: readlink d7/d14/d17/d1a/l34 0 2024-04-19T02:18:34.958 INFO:tasks.workunit.client.0.smithi073.stdout:7/834: rename d0/dc/db7/ce4 to d0/dc/d33/d36/d7b/cf8 0 2024-04-19T02:18:34.958 INFO:tasks.workunit.client.0.smithi073.stdout:1/819: rmdir db/d7f/ded 39 2024-04-19T02:18:34.959 INFO:tasks.workunit.client.0.smithi073.stdout:7/835: mknod d0/dc/d33/da7/de3/cf9 0 2024-04-19T02:18:34.959 INFO:tasks.workunit.client.0.smithi073.stdout:0/814: stat d7/d14/d17/d1a/d20/d50/d99/da7/d6f 0 2024-04-19T02:18:34.959 INFO:tasks.workunit.client.0.smithi073.stdout:1/820: creat db/d1c/d78/dcf/f123 x:0 0 0 2024-04-19T02:18:34.960 INFO:tasks.workunit.client.0.smithi073.stdout:7/836: write d0/dc/d67/d15/fe8 [247453,15515] 0 2024-04-19T02:18:34.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/815: mknod d7/d6d/dc7/cf3 0 2024-04-19T02:18:34.960 INFO:tasks.workunit.client.0.smithi073.stdout:1/821: symlink db/d1c/d122/l124 0 2024-04-19T02:18:34.961 INFO:tasks.workunit.client.0.smithi073.stdout:0/816: chown d7/d14/d17/d70 23 1 2024-04-19T02:18:34.961 INFO:tasks.workunit.client.0.smithi073.stdout:2/854: dwrite d5/d10/d14/d18/d3e/d2d/d63/da2/fb2 [0,4194304] 0 2024-04-19T02:18:34.962 INFO:tasks.workunit.client.0.smithi073.stdout:1/822: rmdir db/d1c/d81/d83/db8/dd1 39 2024-04-19T02:18:34.963 INFO:tasks.workunit.client.0.smithi073.stdout:2/855: stat d5/d10/d14/d2e/d126 0 2024-04-19T02:18:34.963 INFO:tasks.workunit.client.0.smithi073.stdout:1/823: mkdir db/d7f/d125 0 2024-04-19T02:18:34.963 INFO:tasks.workunit.client.0.smithi073.stdout:0/817: link l1 d7/d14/d17/d1a/d20/d50/dc2/lf4 0 2024-04-19T02:18:34.964 INFO:tasks.workunit.client.0.smithi073.stdout:1/824: fdatasync db/d1c/d78/d8c/dd5/f45 0 2024-04-19T02:18:34.965 INFO:tasks.workunit.client.0.smithi073.stdout:2/856: creat d5/d10/d14/d18/d3e/d51/f129 x:0 0 0 2024-04-19T02:18:34.965 INFO:tasks.workunit.client.0.smithi073.stdout:0/818: truncate d7/d14/f2d 4222400 0 2024-04-19T02:18:34.965 INFO:tasks.workunit.client.0.smithi073.stdout:1/825: creat db/d1c/d122/f126 x:0 0 0 2024-04-19T02:18:34.966 INFO:tasks.workunit.client.0.smithi073.stdout:1/826: stat db/d41/f84 0 2024-04-19T02:18:34.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/857: symlink d5/d10/d14/d18/d3e/de1/l12a 0 2024-04-19T02:18:34.967 INFO:tasks.workunit.client.0.smithi073.stdout:6/743: dread d8/de/f47 [4194304,4194304] 0 2024-04-19T02:18:34.968 INFO:tasks.workunit.client.0.smithi073.stdout:1/827: unlink db/d1c/d78/d8c/dd5/f69 0 2024-04-19T02:18:34.968 INFO:tasks.workunit.client.0.smithi073.stdout:0/819: write d7/d14/f3e [1106749,35215] 0 2024-04-19T02:18:34.968 INFO:tasks.workunit.client.0.smithi073.stdout:7/837: dwrite d0/d3/f66 [4194304,4194304] 0 2024-04-19T02:18:34.968 INFO:tasks.workunit.client.0.smithi073.stdout:0/820: write f5 [5670155,20689] 0 2024-04-19T02:18:34.968 INFO:tasks.workunit.client.0.smithi073.stdout:2/858: truncate d5/d10/d29/d66/d83/ffd 948749 0 2024-04-19T02:18:34.969 INFO:tasks.workunit.client.0.smithi073.stdout:2/859: stat d5/d10/la9 0 2024-04-19T02:18:34.969 INFO:tasks.workunit.client.0.smithi073.stdout:0/821: stat d7/d14/d17/d1a/f39 0 2024-04-19T02:18:34.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/828: getdents db/d1c/d81/d83/db8 0 2024-04-19T02:18:34.971 INFO:tasks.workunit.client.0.smithi073.stdout:2/860: truncate d5/d10/d29/d66/d67/fdd 172996 0 2024-04-19T02:18:34.972 INFO:tasks.workunit.client.0.smithi073.stdout:0/822: link d7/faa d7/d14/d17/d1a/ff5 0 2024-04-19T02:18:34.973 INFO:tasks.workunit.client.0.smithi073.stdout:6/744: write d8/f10 [795471,33533] 0 2024-04-19T02:18:34.973 INFO:tasks.workunit.client.0.smithi073.stdout:2/861: truncate d5/d10/d29/d66/d83/faa 2640927 0 2024-04-19T02:18:34.974 INFO:tasks.workunit.client.0.smithi073.stdout:0/823: mknod d7/d14/d17/d1a/d20/d50/d99/da7/cf6 0 2024-04-19T02:18:34.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/862: unlink d5/d10/d14/d18/d3e/l9e 0 2024-04-19T02:18:34.975 INFO:tasks.workunit.client.0.smithi073.stdout:6/745: rename d8/d71/fdc to d8/de/d58/d63/d82/ff5 0 2024-04-19T02:18:34.976 INFO:tasks.workunit.client.0.smithi073.stdout:0/824: creat d7/d14/d17/d1a/ff7 x:0 0 0 2024-04-19T02:18:34.976 INFO:tasks.workunit.client.0.smithi073.stdout:0/825: truncate f5 5725473 0 2024-04-19T02:18:34.977 INFO:tasks.workunit.client.0.smithi073.stdout:7/838: dwrite d0/dc/fc2 [0,4194304] 0 2024-04-19T02:18:34.977 INFO:tasks.workunit.client.0.smithi073.stdout:0/826: chown d7/d14/d17/d69/l90 334 1 2024-04-19T02:18:34.978 INFO:tasks.workunit.client.0.smithi073.stdout:1/829: dwrite db/d1c/f34 [0,4194304] 0 2024-04-19T02:18:34.979 INFO:tasks.workunit.client.0.smithi073.stdout:4/797: dread da/f44 [0,4194304] 0 2024-04-19T02:18:34.981 INFO:tasks.workunit.client.0.smithi073.stdout:1/830: symlink db/d41/d101/db1/dc4/l127 0 2024-04-19T02:18:34.981 INFO:tasks.workunit.client.0.smithi073.stdout:7/839: chown d0/dc/d39/d50/dbc/lcc 2041 1 2024-04-19T02:18:34.982 INFO:tasks.workunit.client.0.smithi073.stdout:2/863: dread d5/d10/d29/d66/d67/f124 [0,4194304] 0 2024-04-19T02:18:34.983 INFO:tasks.workunit.client.0.smithi073.stdout:4/798: mkdir da/d27/d1b/d109/d115 0 2024-04-19T02:18:34.983 INFO:tasks.workunit.client.0.smithi073.stdout:1/831: unlink db/d1c/d81/f103 0 2024-04-19T02:18:34.983 INFO:tasks.workunit.client.0.smithi073.stdout:7/840: creat d0/dc/d33/da7/ffa x:0 0 0 2024-04-19T02:18:34.984 INFO:tasks.workunit.client.0.smithi073.stdout:6/746: dwrite d8/de/d22/da8/fe1 [0,4194304] 0 2024-04-19T02:18:34.985 INFO:tasks.workunit.client.0.smithi073.stdout:3/952: dread d3/d6/db/f4d [0,4194304] 0 2024-04-19T02:18:34.985 INFO:tasks.workunit.client.0.smithi073.stdout:7/841: rmdir d0/dc/d39/d50 39 2024-04-19T02:18:34.986 INFO:tasks.workunit.client.0.smithi073.stdout:2/864: mknod d5/d10/d29/d66/d83/dbc/c12b 0 2024-04-19T02:18:34.987 INFO:tasks.workunit.client.0.smithi073.stdout:4/799: write da/d27/d1b/d26/f9d [869733,101391] 0 2024-04-19T02:18:34.987 INFO:tasks.workunit.client.0.smithi073.stdout:6/747: mknod d8/de/d58/d63/cf6 0 2024-04-19T02:18:34.987 INFO:tasks.workunit.client.0.smithi073.stdout:0/827: dwrite d7/d14/d17/d1a/f7d [0,4194304] 0 2024-04-19T02:18:34.988 INFO:tasks.workunit.client.0.smithi073.stdout:3/953: fsync d3/d6/db/d3a/d38/d89/d94/f5a 0 2024-04-19T02:18:34.988 INFO:tasks.workunit.client.0.smithi073.stdout:7/842: rename d0/d28/dba to d0/d3/dbb/da1/dfb 0 2024-04-19T02:18:34.989 INFO:tasks.workunit.client.0.smithi073.stdout:7/843: chown d0/dc/d33/l88 82675983 1 2024-04-19T02:18:34.991 INFO:tasks.workunit.client.0.smithi073.stdout:9/733: dread d0/df/d16/d19/db1/f63 [0,4194304] 0 2024-04-19T02:18:34.991 INFO:tasks.workunit.client.0.smithi073.stdout:3/954: mkdir d3/d13e 0 2024-04-19T02:18:34.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/844: creat d0/dc/db7/ffc x:0 0 0 2024-04-19T02:18:34.991 INFO:tasks.workunit.client.0.smithi073.stdout:6/748: creat d8/de/d7f/da5/ff7 x:0 0 0 2024-04-19T02:18:34.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/832: dwrite db/d1c/d54/f90 [0,4194304] 0 2024-04-19T02:18:34.993 INFO:tasks.workunit.client.0.smithi073.stdout:4/800: getdents da/d27/d1b/d1d/d72/d2b/d2f/d68 0 2024-04-19T02:18:34.993 INFO:tasks.workunit.client.0.smithi073.stdout:3/955: creat d3/d6/db/d3a/d38/d40/db5/f13f x:0 0 0 2024-04-19T02:18:34.993 INFO:tasks.workunit.client.0.smithi073.stdout:7/845: dread - d0/dc/d33/da7/de3/ff5 zero size 2024-04-19T02:18:34.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/749: getdents d8 0 2024-04-19T02:18:34.994 INFO:tasks.workunit.client.0.smithi073.stdout:4/801: sync 2024-04-19T02:18:34.994 INFO:tasks.workunit.client.0.smithi073.stdout:3/956: stat d3/f5 0 2024-04-19T02:18:34.994 INFO:tasks.workunit.client.0.smithi073.stdout:9/734: mknod d0/df/d16/d19/d38/d5d/d76/d7d/cfc 0 2024-04-19T02:18:34.995 INFO:tasks.workunit.client.0.smithi073.stdout:5/855: dread d0/d1d/d24/f2e [4194304,4194304] 0 2024-04-19T02:18:34.995 INFO:tasks.workunit.client.0.smithi073.stdout:5/856: chown d0/d1d/d1e 196418823 1 2024-04-19T02:18:34.996 INFO:tasks.workunit.client.0.smithi073.stdout:6/750: mkdir d8/d4b/df8 0 2024-04-19T02:18:34.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/846: mkdir d0/dc/d33/d36/d7b/d93/dfd 0 2024-04-19T02:18:34.996 INFO:tasks.workunit.client.0.smithi073.stdout:3/957: creat d3/d6/db/d16/d75/d12a/f140 x:0 0 0 2024-04-19T02:18:34.997 INFO:tasks.workunit.client.0.smithi073.stdout:6/751: write f3 [1217085,70295] 0 2024-04-19T02:18:34.997 INFO:tasks.workunit.client.0.smithi073.stdout:9/735: link d0/dad/fb7 d0/df/d16/d19/d38/d5d/d76/ffd 0 2024-04-19T02:18:34.999 INFO:tasks.workunit.client.0.smithi073.stdout:4/802: write da/d27/d36/f6e [7012076,110133] 0 2024-04-19T02:18:35.001 INFO:tasks.workunit.client.0.smithi073.stdout:2/865: read d5/d10/d14/d18/d98/fc6 [2611455,38635] 0 2024-04-19T02:18:35.001 INFO:tasks.workunit.client.0.smithi073.stdout:6/752: rename d8/de/d22/da8/dca/ce9 to d8/d71/cf9 0 2024-04-19T02:18:35.001 INFO:tasks.workunit.client.0.smithi073.stdout:8/861: dread d14/d27/d50/f6f [0,4194304] 0 2024-04-19T02:18:35.002 INFO:tasks.workunit.client.0.smithi073.stdout:9/736: rename d0/df/d16/d19/d38/d5d/d5e/fa7 to d0/d81/dda/ddd/dc2/dce/ffe 0 2024-04-19T02:18:35.002 INFO:tasks.workunit.client.0.smithi073.stdout:6/753: stat d8/de/d78/f7e 0 2024-04-19T02:18:35.002 INFO:tasks.workunit.client.0.smithi073.stdout:2/866: mkdir d5/d10/ddf/d12c 0 2024-04-19T02:18:35.003 INFO:tasks.workunit.client.0.smithi073.stdout:8/862: rmdir d14/d27/d85/d9b 39 2024-04-19T02:18:35.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/737: chown d0/df/d16/d19/d38 1314344853 1 2024-04-19T02:18:35.004 INFO:tasks.workunit.client.0.smithi073.stdout:3/958: dwrite d3/d6/db/d3a/d38/d43/d4e/f39 [4194304,4194304] 0 2024-04-19T02:18:35.004 INFO:tasks.workunit.client.0.smithi073.stdout:5/857: dwrite d0/d1d/d25/f72 [0,4194304] 0 2024-04-19T02:18:35.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/867: rename d5/d10/d14/d7a/dd1/fe2 to d5/d10/d29/d66/d67/d72/f12d 0 2024-04-19T02:18:35.006 INFO:tasks.workunit.client.0.smithi073.stdout:3/959: truncate d3/d6/db/d3a/d38/d6f/daf/dfd/f111 928165 0 2024-04-19T02:18:35.009 INFO:tasks.workunit.client.0.smithi073.stdout:9/738: rename d0/df/d16/d19/d38/l3e to d0/df/d16/d19/db1/d2c/d6b/lff 0 2024-04-19T02:18:35.009 INFO:tasks.workunit.client.0.smithi073.stdout:5/858: dread d0/d1d/d24/fa5 [0,4194304] 0 2024-04-19T02:18:35.010 INFO:tasks.workunit.client.0.smithi073.stdout:3/960: link d3/d6/db/d3a/d38/d57/d88/df4/l10b d3/d6/db/d3a/d38/d43/d4e/ddd/l141 0 2024-04-19T02:18:35.011 INFO:tasks.workunit.client.0.smithi073.stdout:8/863: dwrite d14/d27/da4/fc3 [0,4194304] 0 2024-04-19T02:18:35.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/739: creat d0/d81/dda/ddd/dc2/dec/f100 x:0 0 0 2024-04-19T02:18:35.014 INFO:tasks.workunit.client.0.smithi073.stdout:2/868: dwrite d5/d10/d29/d42/f6e [0,4194304] 0 2024-04-19T02:18:35.014 INFO:tasks.workunit.client.0.smithi073.stdout:7/847: write d0/f79 [1928330,73482] 0 2024-04-19T02:18:35.014 INFO:tasks.workunit.client.0.smithi073.stdout:8/864: stat d14/d15/c1c 0 2024-04-19T02:18:35.015 INFO:tasks.workunit.client.0.smithi073.stdout:5/859: getdents d0/d1d/d64/dbd 0 2024-04-19T02:18:35.016 INFO:tasks.workunit.client.0.smithi073.stdout:8/865: write d14/d27/fb6 [561684,39943] 0 2024-04-19T02:18:35.016 INFO:tasks.workunit.client.0.smithi073.stdout:1/833: dread - db/d1c/d81/d86/dae/f106 zero size 2024-04-19T02:18:35.016 INFO:tasks.workunit.client.0.smithi073.stdout:9/740: fdatasync d0/df/d1d/f65 0 2024-04-19T02:18:35.017 INFO:tasks.workunit.client.0.smithi073.stdout:2/869: mkdir d5/d10/d14/d18/d98/d12e 0 2024-04-19T02:18:35.017 INFO:tasks.workunit.client.0.smithi073.stdout:7/848: rename d0/dc/d33/l88 to d0/d3/dbb/lfe 0 2024-04-19T02:18:35.017 INFO:tasks.workunit.client.0.smithi073.stdout:8/866: readlink d14/d15/d17/da1/lc1 0 2024-04-19T02:18:35.018 INFO:tasks.workunit.client.0.smithi073.stdout:5/860: fdatasync d0/d1d/d24/d61/f102 0 2024-04-19T02:18:35.018 INFO:tasks.workunit.client.0.smithi073.stdout:7/849: chown d0/dc/d39/f3f 1 1 2024-04-19T02:18:35.018 INFO:tasks.workunit.client.0.smithi073.stdout:9/741: write d0/df/f21 [8835,102168] 0 2024-04-19T02:18:35.019 INFO:tasks.workunit.client.0.smithi073.stdout:3/961: dwrite d3/d6/db/f123 [0,4194304] 0 2024-04-19T02:18:35.020 INFO:tasks.workunit.client.0.smithi073.stdout:9/742: rename d0/df/fbf to d0/d81/dda/ddd/dc2/f101 0 2024-04-19T02:18:35.020 INFO:tasks.workunit.client.0.smithi073.stdout:3/962: creat d3/d6/db/d3a/d38/d43/d4e/ddd/f142 x:0 0 0 2024-04-19T02:18:35.022 INFO:tasks.workunit.client.0.smithi073.stdout:9/743: rename d0/df/d16/d19/d38/d5d/d45/l67 to d0/d81/dda/l102 0 2024-04-19T02:18:35.023 INFO:tasks.workunit.client.0.smithi073.stdout:3/963: creat d3/d6/db/d3a/d38/d6f/daf/dfd/f143 x:0 0 0 2024-04-19T02:18:35.026 INFO:tasks.workunit.client.0.smithi073.stdout:2/870: dwrite d5/d10/d29/dcb/fdb [0,4194304] 0 2024-04-19T02:18:35.026 INFO:tasks.workunit.client.0.smithi073.stdout:0/828: dread f5 [0,4194304] 0 2024-04-19T02:18:35.028 INFO:tasks.workunit.client.0.smithi073.stdout:2/871: write d5/d10/d29/d66/d83/fc9 [2138496,113543] 0 2024-04-19T02:18:35.031 INFO:tasks.workunit.client.0.smithi073.stdout:0/829: rmdir d7/d6d/dc7/de8 0 2024-04-19T02:18:35.031 INFO:tasks.workunit.client.0.smithi073.stdout:1/834: write db/d41/d101/fb5 [2937306,58265] 0 2024-04-19T02:18:35.031 INFO:tasks.workunit.client.0.smithi073.stdout:5/861: dwrite d0/d69/feb [0,4194304] 0 2024-04-19T02:18:35.032 INFO:tasks.workunit.client.0.smithi073.stdout:8/867: truncate d14/d15/d17/f1f 1305594 0 2024-04-19T02:18:35.032 INFO:tasks.workunit.client.0.smithi073.stdout:8/868: sync 2024-04-19T02:18:35.032 INFO:tasks.workunit.client.0.smithi073.stdout:9/744: write d0/df/d16/d19/db1/d2c/fef [61258,101940] 0 2024-04-19T02:18:35.032 INFO:tasks.workunit.client.0.smithi073.stdout:0/830: rmdir d7/d14/d17/d1a/d8d/dea 39 2024-04-19T02:18:35.033 INFO:tasks.workunit.client.0.smithi073.stdout:7/850: dwrite d0/dc/d33/fcd [4194304,4194304] 0 2024-04-19T02:18:35.034 INFO:tasks.workunit.client.0.smithi073.stdout:5/862: getdents d0/d1d/d64/dbd 0 2024-04-19T02:18:35.035 INFO:tasks.workunit.client.0.smithi073.stdout:7/851: write d0/d28/fbd [84828,5738] 0 2024-04-19T02:18:35.036 INFO:tasks.workunit.client.0.smithi073.stdout:3/964: dwrite d3/d6/db/d3a/d38/d6f/daf/f118 [0,4194304] 0 2024-04-19T02:18:35.036 INFO:tasks.workunit.client.0.smithi073.stdout:0/831: mknod d7/d6d/dc7/cf8 0 2024-04-19T02:18:35.036 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:35.039 INFO:tasks.workunit.client.0.smithi073.stdout:2/872: dwrite d5/d10/d14/db6/fe3 [0,4194304] 0 2024-04-19T02:18:35.040 INFO:tasks.workunit.client.0.smithi073.stdout:0/832: creat d7/d14/d17/d1a/d20/d50/dc2/ff9 x:0 0 0 2024-04-19T02:18:35.040 INFO:tasks.workunit.client.0.smithi073.stdout:7/852: truncate d0/d28/d63/f9e 1878452 0 2024-04-19T02:18:35.042 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:35.042 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:35.042 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:35.042 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:35.043 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:35.043 INFO:tasks.workunit.client.0.smithi073.stdout:1/835: dwrite db/d41/f53 [0,4194304] 0 2024-04-19T02:18:35.043 INFO:tasks.workunit.client.0.smithi073.stdout:2/873: mkdir d5/d10/d14/d2e/da0/d12f 0 2024-04-19T02:18:35.043 INFO:tasks.workunit.client.0.smithi073.stdout:7/853: mkdir d0/d28/d63/dff 0 2024-04-19T02:18:35.043 INFO:tasks.workunit.client.0.smithi073.stdout:9/745: dwrite d0/d81/dda/ddd/dc2/fe0 [0,4194304] 0 2024-04-19T02:18:35.044 INFO:tasks.workunit.client.0.smithi073.stdout:1/836: mknod db/d1c/d81/d83/db8/dd1/c128 0 2024-04-19T02:18:35.048 INFO:tasks.workunit.client.0.smithi073.stdout:1/837: unlink db/d1c/d78/d8c/dd5/fee 0 2024-04-19T02:18:35.049 INFO:tasks.workunit.client.0.smithi073.stdout:3/965: dwrite d3/d6/db/d3a/d38/d6f/daf/dfd/f111 [0,4194304] 0 2024-04-19T02:18:35.050 INFO:tasks.workunit.client.0.smithi073.stdout:0/833: dwrite d7/d6d/dc7/fe9 [0,4194304] 0 2024-04-19T02:18:35.051 INFO:tasks.workunit.client.0.smithi073.stdout:1/838: readlink db/d1c/d54/l100 0 2024-04-19T02:18:35.052 INFO:tasks.workunit.client.0.smithi073.stdout:6/754: dread d8/de/d58/d63/d82/fb0 [0,4194304] 0 2024-04-19T02:18:35.052 INFO:tasks.workunit.client.0.smithi073.stdout:3/966: write d3/d6/db/d16/d75/f60 [4420796,106987] 0 2024-04-19T02:18:35.052 INFO:tasks.workunit.client.0.smithi073.stdout:1/839: rmdir db/d1c/d81/d86/ddd 39 2024-04-19T02:18:35.053 INFO:tasks.workunit.client.0.smithi073.stdout:0/834: rename d7/d14/d17/d1a/d21/f8a to d7/d14/d17/d69/ffa 0 2024-04-19T02:18:35.054 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:35.051+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:35.054 INFO:tasks.workunit.client.0.smithi073.stdout:1/840: mkdir db/d1c/d81/d83/db8/d129 0 2024-04-19T02:18:35.054 INFO:tasks.workunit.client.0.smithi073.stdout:0/835: creat d7/d6d/dbd/ffb x:0 0 0 2024-04-19T02:18:35.055 INFO:tasks.workunit.client.0.smithi073.stdout:1/841: fdatasync db/d1c/d81/df9/f47 0 2024-04-19T02:18:35.055 INFO:tasks.workunit.client.0.smithi073.stdout:2/874: dwrite d5/d10/d29/f8d [0,4194304] 0 2024-04-19T02:18:35.055 INFO:tasks.workunit.client.0.smithi073.stdout:1/842: chown db/d1c/d78/d8c/dd5/d50/c52 2 1 2024-04-19T02:18:35.057 INFO:tasks.workunit.client.0.smithi073.stdout:9/746: truncate d0/df/f40 2285193 0 2024-04-19T02:18:35.058 INFO:tasks.workunit.client.0.smithi073.stdout:1/843: write db/d1c/f34 [2882939,68878] 0 2024-04-19T02:18:35.060 INFO:tasks.workunit.client.0.smithi073.stdout:2/875: rename d5/d10/d29 to d5/d10/d14/d18/d3e/de1/d130 0 2024-04-19T02:18:35.060 INFO:tasks.workunit.client.0.smithi073.stdout:9/747: mknod d0/df/d16/d19/d38/d5d/df2/c103 0 2024-04-19T02:18:35.060 INFO:tasks.workunit.client.0.smithi073.stdout:1/844: symlink db/d1c/d78/d8c/dd5/d50/l12a 0 2024-04-19T02:18:35.060 INFO:tasks.workunit.client.0.smithi073.stdout:9/748: creat d0/d81/dda/ddd/f104 x:0 0 0 2024-04-19T02:18:35.060 INFO:tasks.workunit.client.0.smithi073.stdout:2/876: readlink d5/d10/d14/d18/d3e/de1/d130/d42/l6a 0 2024-04-19T02:18:35.061 INFO:tasks.workunit.client.0.smithi073.stdout:1/845: creat db/d41/d101/db1/dc4/f12b x:0 0 0 2024-04-19T02:18:35.061 INFO:tasks.workunit.client.0.smithi073.stdout:1/846: chown db/d1c/d78/l98 0 1 2024-04-19T02:18:35.062 INFO:tasks.workunit.client.0.smithi073.stdout:9/749: unlink d0/df/d16/d19/f87 0 2024-04-19T02:18:35.062 INFO:tasks.workunit.client.0.smithi073.stdout:2/877: creat d5/d10/d14/d18/d3e/d51/f131 x:0 0 0 2024-04-19T02:18:35.062 INFO:tasks.workunit.client.0.smithi073.stdout:1/847: chown db/d7f/ded/df4/cfb 686312195 1 2024-04-19T02:18:35.064 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:35.065 INFO:tasks.workunit.client.0.smithi073.stdout:1/848: rename db/d1c/d78/d8c/dd5/d50/d62/l8e to db/d1c/d78/d8c/dd5/d50/d62/l12c 0 2024-04-19T02:18:35.065 INFO:tasks.workunit.client.0.smithi073.stdout:5/863: dread d0/d1d/d25/d37/d71/f9f [0,4194304] 0 2024-04-19T02:18:35.066 INFO:tasks.workunit.client.0.smithi073.stdout:5/864: dread - d0/d2d/dac/f10a zero size 2024-04-19T02:18:35.068 INFO:tasks.workunit.client.0.smithi073.stdout:5/865: mkdir d0/d1d/d64/dbd/df9/d110 0 2024-04-19T02:18:35.069 INFO:tasks.workunit.client.0.smithi073.stdout:9/750: dwrite d0/df/d16/d19/db1/f52 [0,4194304] 0 2024-04-19T02:18:35.069 INFO:tasks.workunit.client.0.smithi073.stdout:5/866: read - d0/d1d/d25/d37/d71/fb8 zero size 2024-04-19T02:18:35.074 INFO:tasks.workunit.client.0.smithi073.stdout:5/867: unlink d0/d1d/d25/d35/ld0 0 2024-04-19T02:18:35.074 INFO:tasks.workunit.client.0.smithi073.stdout:5/868: fdatasync d0/d1d/d25/d35/d99/fec 0 2024-04-19T02:18:35.074 INFO:tasks.workunit.client.0.smithi073.stdout:1/849: dwrite db/d1c/d78/fdf [4194304,4194304] 0 2024-04-19T02:18:35.074 INFO:tasks.workunit.client.0.smithi073.stdout:1/850: stat db/d1c/d78/dcf/fde 0 2024-04-19T02:18:35.074 INFO:tasks.workunit.client.0.smithi073.stdout:1/851: stat db/d1c/d81/d83 0 2024-04-19T02:18:35.075 INFO:tasks.workunit.client.0.smithi073.stdout:1/852: mknod db/d41/dc5/c12d 0 2024-04-19T02:18:35.078 INFO:tasks.workunit.client.0.smithi073.stdout:8/869: dread d14/d27/d85/d9a/df6/f108 [0,4194304] 0 2024-04-19T02:18:35.079 INFO:tasks.workunit.client.0.smithi073.stdout:8/870: creat d14/dbc/f126 x:0 0 0 2024-04-19T02:18:35.081 INFO:tasks.workunit.client.0.smithi073.stdout:8/871: link d14/d15/d17/d99/c111 d14/d27/c127 0 2024-04-19T02:18:35.083 INFO:tasks.workunit.client.0.smithi073.stdout:8/872: rename d14/d27/d85/d9a/df6/f108 to d14/d15/d17/f128 0 2024-04-19T02:18:35.084 INFO:tasks.workunit.client.0.smithi073.stdout:8/873: mknod d14/d27/d29/d31/d34/c129 0 2024-04-19T02:18:35.086 INFO:tasks.workunit.client.0.smithi073.stdout:9/751: dwrite d0/dad/fb7 [0,4194304] 0 2024-04-19T02:18:35.088 INFO:tasks.workunit.client.0.smithi073.stdout:9/752: creat d0/df/d16/d19/d38/d5d/d45/f105 x:0 0 0 2024-04-19T02:18:35.090 INFO:tasks.workunit.client.0.smithi073.stdout:8/874: dread d14/fd5 [4194304,4194304] 0 2024-04-19T02:18:35.092 INFO:tasks.workunit.client.0.smithi073.stdout:3/967: dread d3/d6/db/d3a/d38/d89/d94/d7b/fe5 [0,4194304] 0 2024-04-19T02:18:35.093 INFO:tasks.workunit.client.0.smithi073.stdout:3/968: dread - d3/d6/db/d3a/d5f/dca/dde/f117 zero size 2024-04-19T02:18:35.096 INFO:tasks.workunit.client.0.smithi073.stdout:0/836: read d7/d14/d17/f5f [1263999,83971] 0 2024-04-19T02:18:35.096 INFO:tasks.workunit.client.0.smithi073.stdout:8/875: dwrite d14/d27/d4c/f10e [4194304,4194304] 0 2024-04-19T02:18:35.097 INFO:tasks.workunit.client.0.smithi073.stdout:8/876: creat d14/d15/d17/da1/f12a x:0 0 0 2024-04-19T02:18:35.098 INFO:tasks.workunit.client.0.smithi073.stdout:0/837: rename d7/faa to d7/d14/d17/d1a/d21/ffc 0 2024-04-19T02:18:35.098 INFO:tasks.workunit.client.0.smithi073.stdout:0/838: readlink d7/d14/d17/d1a/l4e 0 2024-04-19T02:18:35.100 INFO:tasks.workunit.client.0.smithi073.stdout:1/853: dread db/d41/f74 [0,4194304] 0 2024-04-19T02:18:35.102 INFO:tasks.workunit.client.0.smithi073.stdout:1/854: creat db/d1c/d81/d86/ddd/f12e x:0 0 0 2024-04-19T02:18:35.102 INFO:tasks.workunit.client.0.smithi073.stdout:5/869: dread d0/f5d [0,4194304] 0 2024-04-19T02:18:35.103 INFO:tasks.workunit.client.0.smithi073.stdout:1/855: write db/d1c/d78/d8c/dd5/f5c [3713674,49997] 0 2024-04-19T02:18:35.103 INFO:tasks.workunit.client.0.smithi073.stdout:5/870: mknod d0/d1d/d25/d35/d96/c111 0 2024-04-19T02:18:35.104 INFO:tasks.workunit.client.0.smithi073.stdout:5/871: fdatasync d0/f15 0 2024-04-19T02:18:35.104 INFO:tasks.workunit.client.0.smithi073.stdout:1/856: write db/d7f/ded/df4/f109 [1013672,49460] 0 2024-04-19T02:18:35.105 INFO:tasks.workunit.client.0.smithi073.stdout:1/857: mknod db/d7f/ded/df4/c12f 0 2024-04-19T02:18:35.105 INFO:tasks.workunit.client.0.smithi073.stdout:5/872: rmdir d0/d2d/daf 0 2024-04-19T02:18:35.105 INFO:tasks.workunit.client.0.smithi073.stdout:7/854: dread d0/dc/d39/d50/f6b [0,4194304] 0 2024-04-19T02:18:35.106 INFO:tasks.workunit.client.0.smithi073.stdout:1/858: unlink db/d1c/l11c 0 2024-04-19T02:18:35.106 INFO:tasks.workunit.client.0.smithi073.stdout:5/873: chown d0/c3d 11649 1 2024-04-19T02:18:35.106 INFO:tasks.workunit.client.0.smithi073.stdout:5/874: stat d0/c1a 0 2024-04-19T02:18:35.107 INFO:tasks.workunit.client.0.smithi073.stdout:1/859: mknod db/d41/d101/db1/c130 0 2024-04-19T02:18:35.107 INFO:tasks.workunit.client.0.smithi073.stdout:5/875: creat d0/d69/f112 x:0 0 0 2024-04-19T02:18:35.108 INFO:tasks.workunit.client.0.smithi073.stdout:1/860: write db/d1c/d81/d83/db8/fbe [68808,63521] 0 2024-04-19T02:18:35.108 INFO:tasks.workunit.client.0.smithi073.stdout:5/876: link d0/d1d/d24/c84 d0/d1d/d25/d105/c113 0 2024-04-19T02:18:35.109 INFO:tasks.workunit.client.0.smithi073.stdout:1/861: mknod db/d1c/d78/d8c/d10c/c131 0 2024-04-19T02:18:35.109 INFO:tasks.workunit.client.0.smithi073.stdout:1/862: mkdir db/d1c/d81/d83/db8/d129/d132 0 2024-04-19T02:18:35.110 INFO:tasks.workunit.client.0.smithi073.stdout:1/863: mknod db/d1c/d54/d8b/c133 0 2024-04-19T02:18:35.112 INFO:tasks.workunit.client.0.smithi073.stdout:2/878: fsync d5/d10/d14/d18/d3e/de1/d130/f8d 0 2024-04-19T02:18:35.113 INFO:tasks.workunit.client.0.smithi073.stdout:9/753: dread d0/df/d16/d19/d38/fc9 [0,4194304] 0 2024-04-19T02:18:35.113 INFO:tasks.workunit.client.0.smithi073.stdout:2/879: mkdir d5/d10/d14/d18/d3e/de1/d130/d66/d7e/d108/d132 0 2024-04-19T02:18:35.114 INFO:tasks.workunit.client.0.smithi073.stdout:9/754: rmdir d0/d81/dda 39 2024-04-19T02:18:35.114 INFO:tasks.workunit.client.0.smithi073.stdout:5/877: dwrite d0/d1d/d25/d37/d71/f9f [0,4194304] 0 2024-04-19T02:18:35.115 INFO:tasks.workunit.client.0.smithi073.stdout:2/880: creat d5/d10/d14/d2e/f133 x:0 0 0 2024-04-19T02:18:35.116 INFO:tasks.workunit.client.0.smithi073.stdout:3/969: truncate d3/f3d 604446 0 2024-04-19T02:18:35.116 INFO:tasks.workunit.client.0.smithi073.stdout:0/839: write d7/d14/d17/f5f [475447,37709] 0 2024-04-19T02:18:35.116 INFO:tasks.workunit.client.0.smithi073.stdout:5/878: creat d0/d69/f114 x:0 0 0 2024-04-19T02:18:35.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/755: chown d0/d81/d5c/l69 737269 1 2024-04-19T02:18:35.117 INFO:tasks.workunit.client.0.smithi073.stdout:2/881: readlink d5/d10/d14/d18/d3e/de1/leb 0 2024-04-19T02:18:35.117 INFO:tasks.workunit.client.0.smithi073.stdout:5/879: readlink d0/d2d/l10d 0 2024-04-19T02:18:35.117 INFO:tasks.workunit.client.0.smithi073.stdout:0/840: stat d7/d14/lb4 0 2024-04-19T02:18:35.118 INFO:tasks.workunit.client.0.smithi073.stdout:9/756: symlink d0/d81/dda/l106 0 2024-04-19T02:18:35.118 INFO:tasks.workunit.client.0.smithi073.stdout:1/864: dwrite db/d1c/d54/d8b/dab/fb0 [0,4194304] 0 2024-04-19T02:18:35.118 INFO:tasks.workunit.client.0.smithi073.stdout:5/880: creat d0/d1d/d25/d35/dbf/f115 x:0 0 0 2024-04-19T02:18:35.119 INFO:tasks.workunit.client.0.smithi073.stdout:5/881: readlink d0/d1d/ld5 0 2024-04-19T02:18:35.119 INFO:tasks.workunit.client.0.smithi073.stdout:2/882: write d5/d10/d14/d18/d3e/de1/d130/d66/d67/d72/fb3 [7657116,15636] 0 2024-04-19T02:18:35.119 INFO:tasks.workunit.client.0.smithi073.stdout:0/841: mkdir d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba/dcb/dfd 0 2024-04-19T02:18:35.120 INFO:tasks.workunit.client.0.smithi073.stdout:5/882: rmdir d0/d1d/d90/da0 39 2024-04-19T02:18:35.120 INFO:tasks.workunit.client.0.smithi073.stdout:0/842: fdatasync d7/d14/d17/d1a/fb0 0 2024-04-19T02:18:35.120 INFO:tasks.workunit.client.0.smithi073.stdout:2/883: creat d5/d10/d14/d7a/f134 x:0 0 0 2024-04-19T02:18:35.123 INFO:tasks.workunit.client.0.smithi073.stdout:0/843: symlink d7/lfe 0 2024-04-19T02:18:35.124 INFO:tasks.workunit.client.0.smithi073.stdout:2/884: write d5/d10/d14/d18/d3e/de1/d130/d42/fa3 [134980,83199] 0 2024-04-19T02:18:35.124 INFO:tasks.workunit.client.0.smithi073.stdout:0/844: write d7/d14/d17/d1a/fb0 [64194,28946] 0 2024-04-19T02:18:35.126 INFO:tasks.workunit.client.0.smithi073.stdout:3/970: dwrite d3/d6/db/d3a/d38/d6f/daf/dfd/f111 [0,4194304] 0 2024-04-19T02:18:35.126 INFO:tasks.workunit.client.0.smithi073.stdout:2/885: truncate d5/d10/d14/db6/d101/f120 938016 0 2024-04-19T02:18:35.127 INFO:tasks.workunit.client.0.smithi073.stdout:1/865: dwrite db/d7f/ded/df4/f10e [0,4194304] 0 2024-04-19T02:18:35.127 INFO:tasks.workunit.client.0.smithi073.stdout:3/971: mkdir d3/d6/db/d16/d144 0 2024-04-19T02:18:35.128 INFO:tasks.workunit.client.0.smithi073.stdout:1/866: symlink db/d41/d101/l134 0 2024-04-19T02:18:35.128 INFO:tasks.workunit.client.0.smithi073.stdout:2/886: mknod d5/d10/d14/d2e/dfa/c135 0 2024-04-19T02:18:35.130 INFO:tasks.workunit.client.0.smithi073.stdout:2/887: write d5/d10/d53/f92 [1012593,12744] 0 2024-04-19T02:18:35.130 INFO:tasks.workunit.client.0.smithi073.stdout:2/888: truncate d5/d10/d14/d18/d3e/d2d/d63/fd7 362427 0 2024-04-19T02:18:35.132 INFO:tasks.workunit.client.0.smithi073.stdout:2/889: mkdir d5/d10/d14/d18/d98/d107/d10d/d136 0 2024-04-19T02:18:35.133 INFO:tasks.workunit.client.0.smithi073.stdout:2/890: rmdir d5/d10/d14/d18/d3e 39 2024-04-19T02:18:35.134 INFO:tasks.workunit.client.0.smithi073.stdout:3/972: dwrite d3/d6/f22 [0,4194304] 0 2024-04-19T02:18:35.135 INFO:tasks.workunit.client.0.smithi073.stdout:2/891: creat d5/d10/d14/f137 x:0 0 0 2024-04-19T02:18:35.136 INFO:tasks.workunit.client.0.smithi073.stdout:1/867: dwrite db/d1c/d81/d86/ddd/f12e [0,4194304] 0 2024-04-19T02:18:35.136 INFO:tasks.workunit.client.0.smithi073.stdout:2/892: chown d5/d10/d53/f128 256644 1 2024-04-19T02:18:35.136 INFO:tasks.workunit.client.0.smithi073.stdout:3/973: mknod d3/d6/db/d1a/d54/c145 0 2024-04-19T02:18:35.137 INFO:tasks.workunit.client.0.smithi073.stdout:7/855: sync 2024-04-19T02:18:35.137 INFO:tasks.workunit.client.0.smithi073.stdout:6/755: sync 2024-04-19T02:18:35.139 INFO:tasks.workunit.client.0.smithi073.stdout:2/893: mkdir d5/d10/d14/d18/d3e/d2d/d63/d138 0 2024-04-19T02:18:35.140 INFO:tasks.workunit.client.0.smithi073.stdout:2/894: truncate d5/d10/d14/d7a/fa4 4943532 0 2024-04-19T02:18:35.142 INFO:tasks.workunit.client.0.smithi073.stdout:2/895: rename d5/d10/d14/d18/d3e/f62 to d5/d10/d53/f139 0 2024-04-19T02:18:35.142 INFO:tasks.workunit.client.0.smithi073.stdout:7/856: getdents d0/dc/d67/d2a 0 2024-04-19T02:18:35.144 INFO:tasks.workunit.client.0.smithi073.stdout:2/896: creat d5/d10/d14/d18/d3e/d2d/d63/f13a x:0 0 0 2024-04-19T02:18:35.144 INFO:tasks.workunit.client.0.smithi073.stdout:7/857: creat d0/dc/d67/d2a/d51/f100 x:0 0 0 2024-04-19T02:18:35.144 INFO:tasks.workunit.client.0.smithi073.stdout:1/868: dwrite db/d1c/d81/d83/db8/dd1/f105 [0,4194304] 0 2024-04-19T02:18:35.144 INFO:tasks.workunit.client.0.smithi073.stdout:7/858: dread - d0/dc/d33/da7/fe6 zero size 2024-04-19T02:18:35.145 INFO:tasks.workunit.client.0.smithi073.stdout:2/897: unlink d5/d10/d14/d18/d3e/de1/d130/d66/d7e/c90 0 2024-04-19T02:18:35.145 INFO:tasks.workunit.client.0.smithi073.stdout:1/869: rename db/d7f/ce7 to db/d1c/d78/d8c/c135 0 2024-04-19T02:18:35.145 INFO:tasks.workunit.client.0.smithi073.stdout:2/898: fdatasync d5/d10/d14/d18/f6b 0 2024-04-19T02:18:35.146 INFO:tasks.workunit.client.0.smithi073.stdout:7/859: write d0/dc/d67/d2a/d51/f100 [850599,44829] 0 2024-04-19T02:18:35.146 INFO:tasks.workunit.client.0.smithi073.stdout:1/870: creat db/d7f/f136 x:0 0 0 2024-04-19T02:18:35.147 INFO:tasks.workunit.client.0.smithi073.stdout:2/899: mknod d5/d10/d14/d18/d3e/de1/d130/d66/d67/c13b 0 2024-04-19T02:18:35.152 INFO:tasks.workunit.client.0.smithi073.stdout:7/860: dwrite d0/dc/f26 [0,4194304] 0 2024-04-19T02:18:35.154 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:35.151+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:35.156 INFO:tasks.workunit.client.0.smithi073.stdout:8/877: sync 2024-04-19T02:18:35.156 INFO:tasks.workunit.client.0.smithi073.stdout:7/861: sync 2024-04-19T02:18:35.156 INFO:tasks.workunit.client.0.smithi073.stdout:3/974: sync 2024-04-19T02:18:35.157 INFO:tasks.workunit.client.0.smithi073.stdout:3/975: stat d3/d6/db/d3a/d5f/dca/dde/f132 0 2024-04-19T02:18:35.158 INFO:tasks.workunit.client.0.smithi073.stdout:4/803: dread da/d27/d2c/d80/f8e [4194304,4194304] 0 2024-04-19T02:18:35.158 INFO:tasks.workunit.client.0.smithi073.stdout:2/900: read d5/d10/d14/d18/d3e/de1/d130/d42/f68 [3816844,41406] 0 2024-04-19T02:18:35.159 INFO:tasks.workunit.client.0.smithi073.stdout:3/976: mknod d3/d6/db/d3a/d38/d6f/daf/dfd/c146 0 2024-04-19T02:18:35.160 INFO:tasks.workunit.client.0.smithi073.stdout:3/977: chown d3/d6/db/f7e 139853 1 2024-04-19T02:18:35.160 INFO:tasks.workunit.client.0.smithi073.stdout:2/901: symlink d5/d10/d14/d18/d98/d12e/l13c 0 2024-04-19T02:18:35.161 INFO:tasks.workunit.client.0.smithi073.stdout:3/978: creat d3/d6/db/d3a/d5f/da7/f147 x:0 0 0 2024-04-19T02:18:35.163 INFO:tasks.workunit.client.0.smithi073.stdout:7/862: read d0/dc/d67/d15/fe8 [3603267,51127] 0 2024-04-19T02:18:35.164 INFO:tasks.workunit.client.0.smithi073.stdout:8/878: dwrite d14/d27/d29/fb0 [0,4194304] 0 2024-04-19T02:18:35.165 INFO:tasks.workunit.client.0.smithi073.stdout:3/979: link d3/d6/db/d3a/d38/d6f/daf/c113 d3/d6/db/d23/c148 0 2024-04-19T02:18:35.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/756: dread d8/d71/d7d/fbd [0,4194304] 0 2024-04-19T02:18:35.167 INFO:tasks.workunit.client.0.smithi073.stdout:7/863: mknod d0/dc/d39/d50/dbc/df7/c101 0 2024-04-19T02:18:35.167 INFO:tasks.workunit.client.0.smithi073.stdout:3/980: mkdir d3/d6/db/d3a/d38/d149 0 2024-04-19T02:18:35.168 INFO:tasks.workunit.client.0.smithi073.stdout:4/804: dwrite da/d27/d2c/d60/fa1 [4194304,4194304] 0 2024-04-19T02:18:35.170 INFO:tasks.workunit.client.0.smithi073.stdout:1/871: dread db/d1c/d78/d8c/dd5/d50/f94 [0,4194304] 0 2024-04-19T02:18:35.171 INFO:tasks.workunit.client.0.smithi073.stdout:2/902: truncate d5/d10/d53/f139 765590 0 2024-04-19T02:18:35.171 INFO:tasks.workunit.client.0.smithi073.stdout:6/757: creat d8/de/d22/da8/dca/ffa x:0 0 0 2024-04-19T02:18:35.171 INFO:tasks.workunit.client.0.smithi073.stdout:3/981: symlink d3/d6/db/d3a/d38/d57/d88/df4/dfa/l14a 0 2024-04-19T02:18:35.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/879: link d14/d27/d85/d9b/ff0 d14/d15/d17/d48/d89/ddd/df2/f12b 0 2024-04-19T02:18:35.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/805: mknod da/d27/d1b/d1d/d72/d2b/d2f/d68/de5/c116 0 2024-04-19T02:18:35.172 INFO:tasks.workunit.client.0.smithi073.stdout:2/903: fdatasync d5/d10/d14/d18/d3e/f49 0 2024-04-19T02:18:35.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/758: symlink d8/de/d22/da8/dca/lfb 0 2024-04-19T02:18:35.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/880: write d14/d27/d85/d9a/fb2 [15311,37899] 0 2024-04-19T02:18:35.173 INFO:tasks.workunit.client.0.smithi073.stdout:1/872: link db/d1c/d81/d83/f115 db/d1c/f137 0 2024-04-19T02:18:35.173 INFO:tasks.workunit.client.0.smithi073.stdout:4/806: mknod da/d27/c117 0 2024-04-19T02:18:35.173 INFO:tasks.workunit.client.0.smithi073.stdout:1/873: sync 2024-04-19T02:18:35.173 INFO:tasks.workunit.client.0.smithi073.stdout:2/904: chown d5/d10/d14/d18/d3e/lea 1 1 2024-04-19T02:18:35.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/905: sync 2024-04-19T02:18:35.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/759: write d8/d4b/d93/f62 [4327861,113901] 0 2024-04-19T02:18:35.174 INFO:tasks.workunit.client.0.smithi073.stdout:4/807: mknod da/d27/d3a/d50/d9c/c118 0 2024-04-19T02:18:35.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/760: rmdir d8/de/d7f/dc6 39 2024-04-19T02:18:35.176 INFO:tasks.workunit.client.0.smithi073.stdout:6/761: truncate d8/de/d58/d63/d82/f9b 2855937 0 2024-04-19T02:18:35.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/864: dwrite d0/dc/d67/fda [0,4194304] 0 2024-04-19T02:18:35.179 INFO:tasks.workunit.client.0.smithi073.stdout:6/762: read d8/de/d22/f34 [2443002,16364] 0 2024-04-19T02:18:35.180 INFO:tasks.workunit.client.0.smithi073.stdout:7/865: chown d0/dc/d39/d50/da3/lab 106864756 1 2024-04-19T02:18:35.181 INFO:tasks.workunit.client.0.smithi073.stdout:4/808: rename da/d27/d1b/d1d/d72/d104/ddd/d95/ce6 to da/d27/d1b/d1d/c119 0 2024-04-19T02:18:35.181 INFO:tasks.workunit.client.0.smithi073.stdout:8/881: dread d14/d27/d4c/f6b [0,4194304] 0 2024-04-19T02:18:35.181 INFO:tasks.workunit.client.0.smithi073.stdout:6/763: read - d8/de/d22/fbf zero size 2024-04-19T02:18:35.183 INFO:tasks.workunit.client.0.smithi073.stdout:1/874: dwrite db/f112 [0,4194304] 0 2024-04-19T02:18:35.183 INFO:tasks.workunit.client.0.smithi073.stdout:7/866: creat d0/dc/d67/f102 x:0 0 0 2024-04-19T02:18:35.183 INFO:tasks.workunit.client.0.smithi073.stdout:7/867: sync 2024-04-19T02:18:35.183 INFO:tasks.workunit.client.0.smithi073.stdout:2/906: dwrite d5/d10/d14/d18/d3e/d2d/d63/f46 [4194304,4194304] 0 2024-04-19T02:18:35.184 INFO:tasks.workunit.client.0.smithi073.stdout:8/882: rmdir d14/d27/d85/d9a/df6 39 2024-04-19T02:18:35.184 INFO:tasks.workunit.client.0.smithi073.stdout:1/875: mknod db/d1c/d78/d8c/dd5/de3/c138 0 2024-04-19T02:18:35.184 INFO:tasks.workunit.client.0.smithi073.stdout:2/907: mkdir d5/d10/d14/d18/d98/d107/d10d/d13d 0 2024-04-19T02:18:35.185 INFO:tasks.workunit.client.0.smithi073.stdout:1/876: dread - db/d1c/d81/d86/dae/f106 zero size 2024-04-19T02:18:35.186 INFO:tasks.workunit.client.0.smithi073.stdout:2/908: chown d5/d10/d14/d18/d3e/f49 13179430 1 2024-04-19T02:18:35.187 INFO:tasks.workunit.client.0.smithi073.stdout:7/868: rename d0/dc/d33/d36/d7b/d93/lb8 to d0/dc/d67/l103 0 2024-04-19T02:18:35.187 INFO:tasks.workunit.client.0.smithi073.stdout:7/869: write d0/d3/fc8 [1327623,89585] 0 2024-04-19T02:18:35.188 INFO:tasks.workunit.client.0.smithi073.stdout:0/845: dread d7/d14/f68 [0,4194304] 0 2024-04-19T02:18:35.188 INFO:tasks.workunit.client.0.smithi073.stdout:8/883: rename d14/d27/d29/l2d to d14/d27/d29/d31/l12c 0 2024-04-19T02:18:35.188 INFO:tasks.workunit.client.0.smithi073.stdout:2/909: truncate d5/d10/d14/d18/d3e/de1/d130/d66/d83/fc9 2533372 0 2024-04-19T02:18:35.189 INFO:tasks.workunit.client.0.smithi073.stdout:2/910: sync 2024-04-19T02:18:35.189 INFO:tasks.workunit.client.0.smithi073.stdout:1/877: rename db/d1c/d81/d86/ddd/ffe to db/d1c/d78/d8c/dd5/d50/d62/f139 0 2024-04-19T02:18:35.189 INFO:tasks.workunit.client.0.smithi073.stdout:7/870: creat d0/dc/d39/d50/da3/f104 x:0 0 0 2024-04-19T02:18:35.190 INFO:tasks.workunit.client.0.smithi073.stdout:0/846: write d7/d14/d17/d69/f6a [651261,6554] 0 2024-04-19T02:18:35.190 INFO:tasks.workunit.client.0.smithi073.stdout:8/884: mkdir d14/d27/d4c/d12d 0 2024-04-19T02:18:35.190 INFO:tasks.workunit.client.0.smithi073.stdout:2/911: readlink d5/d10/d14/d18/d3e/lea 0 2024-04-19T02:18:35.190 INFO:tasks.workunit.client.0.smithi073.stdout:8/885: rmdir d14/d27/d29/d31 39 2024-04-19T02:18:35.191 INFO:tasks.workunit.client.0.smithi073.stdout:1/878: chown db/d7f/ded/lf5 34871766 1 2024-04-19T02:18:35.191 INFO:tasks.workunit.client.0.smithi073.stdout:0/847: creat d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba/fff x:0 0 0 2024-04-19T02:18:35.192 INFO:tasks.workunit.client.0.smithi073.stdout:1/879: chown db/d1c/d81/df9/f92 1460057 1 2024-04-19T02:18:35.192 INFO:tasks.workunit.client.0.smithi073.stdout:8/886: creat d14/d27/d4c/d75/f12e x:0 0 0 2024-04-19T02:18:35.192 INFO:tasks.workunit.client.0.smithi073.stdout:1/880: symlink db/d7f/l13a 0 2024-04-19T02:18:35.199 INFO:tasks.workunit.client.0.smithi073.stdout:2/912: creat d5/d10/d14/d2e/da0/dc0/f13e x:0 0 0 2024-04-19T02:18:35.199 INFO:tasks.workunit.client.0.smithi073.stdout:8/887: link d14/d27/d29/d31/f5b d14/d27/da4/f12f 0 2024-04-19T02:18:35.199 INFO:tasks.workunit.client.0.smithi073.stdout:8/888: chown d14/d27/d29/d31/f5b 672 1 2024-04-19T02:18:35.199 INFO:tasks.workunit.client.0.smithi073.stdout:2/913: creat d5/d10/d14/d7a/dde/f13f x:0 0 0 2024-04-19T02:18:35.199 INFO:tasks.workunit.client.0.smithi073.stdout:8/889: fsync d14/d87/f121 0 2024-04-19T02:18:35.200 INFO:tasks.workunit.client.0.smithi073.stdout:2/914: write d5/d10/d14/f137 [872015,112500] 0 2024-04-19T02:18:35.200 INFO:tasks.workunit.client.0.smithi073.stdout:8/890: write d14/dbc/fdb [938794,84911] 0 2024-04-19T02:18:35.200 INFO:tasks.workunit.client.0.smithi073.stdout:1/881: dread db/d1c/d81/d86/fbc [0,4194304] 0 2024-04-19T02:18:35.200 INFO:tasks.workunit.client.0.smithi073.stdout:8/891: write d14/d87/f96 [215772,76018] 0 2024-04-19T02:18:35.201 INFO:tasks.workunit.client.0.smithi073.stdout:2/915: creat d5/d10/d14/d2e/da0/d12f/f140 x:0 0 0 2024-04-19T02:18:35.201 INFO:tasks.workunit.client.0.smithi073.stdout:1/882: write db/d7f/ded/df4/f10e [1100551,6006] 0 2024-04-19T02:18:35.201 INFO:tasks.workunit.client.0.smithi073.stdout:2/916: fsync d5/d10/d14/d18/f22 0 2024-04-19T02:18:35.202 INFO:tasks.workunit.client.0.smithi073.stdout:1/883: unlink db/d1c/d81/d86/dae/f75 0 2024-04-19T02:18:35.202 INFO:tasks.workunit.client.0.smithi073.stdout:2/917: stat d5/d10/d53/c65 0 2024-04-19T02:18:35.202 INFO:tasks.workunit.client.0.smithi073.stdout:2/918: mknod d5/d10/ddf/d12c/c141 0 2024-04-19T02:18:35.205 INFO:tasks.workunit.client.0.smithi073.stdout:3/982: write d3/d6/db/f4d [5144310,67061] 0 2024-04-19T02:18:35.207 INFO:tasks.workunit.client.0.smithi073.stdout:2/919: dread d5/d10/d14/d18/d3e/de1/d130/d66/f69 [0,4194304] 0 2024-04-19T02:18:35.207 INFO:tasks.workunit.client.0.smithi073.stdout:5/883: dread d0/d1d/d25/d35/d99/fc5 [0,4194304] 0 2024-04-19T02:18:35.208 INFO:tasks.workunit.client.0.smithi073.stdout:6/764: dread d8/f16 [0,4194304] 0 2024-04-19T02:18:35.208 INFO:tasks.workunit.client.0.smithi073.stdout:3/983: creat d3/d6/db/d3a/d38/d89/d94/d7b/f14b x:0 0 0 2024-04-19T02:18:35.209 INFO:tasks.workunit.client.0.smithi073.stdout:6/765: fsync d8/de/d22/fb2 0 2024-04-19T02:18:35.210 INFO:tasks.workunit.client.0.smithi073.stdout:2/920: read d5/d10/d14/d18/d3e/de1/d130/d66/d83/ffd [558867,105157] 0 2024-04-19T02:18:35.211 INFO:tasks.workunit.client.0.smithi073.stdout:6/766: creat d8/de/d22/da8/dca/ffc x:0 0 0 2024-04-19T02:18:35.212 INFO:tasks.workunit.client.0.smithi073.stdout:7/871: dwrite d0/dc/d33/da7/fe6 [0,4194304] 0 2024-04-19T02:18:35.213 INFO:tasks.workunit.client.0.smithi073.stdout:2/921: mkdir d5/d10/d14/d2e/da0/dc0/d142 0 2024-04-19T02:18:35.213 INFO:tasks.workunit.client.0.smithi073.stdout:6/767: chown d8/d4b/d93/d60/c46 61112897 1 2024-04-19T02:18:35.213 INFO:tasks.workunit.client.0.smithi073.stdout:7/872: stat d0/dc/d33/d36/d7b/d93/d97 0 2024-04-19T02:18:35.214 INFO:tasks.workunit.client.0.smithi073.stdout:6/768: stat d8/d4b/l6a 0 2024-04-19T02:18:35.215 INFO:tasks.workunit.client.0.smithi073.stdout:5/884: dwrite d0/d1d/d1e/f40 [0,4194304] 0 2024-04-19T02:18:35.215 INFO:tasks.workunit.client.0.smithi073.stdout:6/769: mknod d8/d4b/d8f/cfd 0 2024-04-19T02:18:35.217 INFO:tasks.workunit.client.0.smithi073.stdout:5/885: symlink d0/d1d/d90/l116 0 2024-04-19T02:18:35.217 INFO:tasks.workunit.client.0.smithi073.stdout:5/886: dread - d0/d1d/d64/ff4 zero size 2024-04-19T02:18:35.217 INFO:tasks.workunit.client.0.smithi073.stdout:5/887: mkdir d0/d69/d117 0 2024-04-19T02:18:35.220 INFO:tasks.workunit.client.0.smithi073.stdout:0/848: dread d7/f11 [4194304,4194304] 0 2024-04-19T02:18:35.221 INFO:tasks.workunit.client.0.smithi073.stdout:6/770: dwrite d8/dda/ff1 [0,4194304] 0 2024-04-19T02:18:35.221 INFO:tasks.workunit.client.0.smithi073.stdout:0/849: creat d7/d14/d17/d69/d7c/f100 x:0 0 0 2024-04-19T02:18:35.223 INFO:tasks.workunit.client.0.smithi073.stdout:0/850: write d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/fb2 [1474095,27419] 0 2024-04-19T02:18:35.223 INFO:tasks.workunit.client.0.smithi073.stdout:0/851: mkdir d7/d6d/d101 0 2024-04-19T02:18:35.224 INFO:tasks.workunit.client.0.smithi073.stdout:6/771: truncate d8/de/d7f/fe0 894179 0 2024-04-19T02:18:35.224 INFO:tasks.workunit.client.0.smithi073.stdout:8/892: creat d14/d15/f130 x:0 0 0 2024-04-19T02:18:35.225 INFO:tasks.workunit.client.0.smithi073.stdout:6/772: truncate d8/de/d58/d63/f74 237181 0 2024-04-19T02:18:35.226 INFO:tasks.workunit.client.0.smithi073.stdout:8/893: write d14/d27/d29/d64/fc5 [598566,53144] 0 2024-04-19T02:18:35.226 INFO:tasks.workunit.client.0.smithi073.stdout:8/894: write d14/d27/d50/faf [1873794,5244] 0 2024-04-19T02:18:35.227 INFO:tasks.workunit.client.0.smithi073.stdout:9/757: dread d0/df/f11 [0,4194304] 0 2024-04-19T02:18:35.227 INFO:tasks.workunit.client.0.smithi073.stdout:8/895: creat d14/d15/d17/d48/d89/ddd/df2/f131 x:0 0 0 2024-04-19T02:18:35.228 INFO:tasks.workunit.client.0.smithi073.stdout:6/773: creat d8/de/d22/ffe x:0 0 0 2024-04-19T02:18:35.228 INFO:tasks.workunit.client.0.smithi073.stdout:9/758: mkdir d0/d81/dda/ddd/dc2/d107 0 2024-04-19T02:18:35.228 INFO:tasks.workunit.client.0.smithi073.stdout:9/759: stat d0/df/c9e 0 2024-04-19T02:18:35.228 INFO:tasks.workunit.client.0.smithi073.stdout:9/760: chown d0/df/d16/d19/d38/d5d 11 1 2024-04-19T02:18:35.233 INFO:tasks.workunit.client.0.smithi073.stdout:6/774: dwrite d8/d71/d7d/fb1 [0,4194304] 0 2024-04-19T02:18:35.234 INFO:tasks.workunit.client.0.smithi073.stdout:6/775: chown d8/d4b/d8f/fbc 52 1 2024-04-19T02:18:35.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/776: write d8/de/d22/da8/fe1 [938260,4393] 0 2024-04-19T02:18:35.240 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:35.240 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:35.240 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:35.250 INFO:tasks.workunit.client.0.smithi073.stdout:4/809: dread da/d27/d2c/d60/fa1 [0,4194304] 0 2024-04-19T02:18:35.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/810: fdatasync da/d27/d2c/d60/fa1 0 2024-04-19T02:18:35.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/811: stat da/d27/d1b/c6b 0 2024-04-19T02:18:35.252 INFO:tasks.workunit.client.0.smithi073.stdout:4/812: fdatasync da/f44 0 2024-04-19T02:18:35.253 INFO:tasks.workunit.client.0.smithi073.stdout:4/813: link da/d27/d1b/d26/cb8 da/d27/d1b/d26/d2a/d46/c11a 0 2024-04-19T02:18:35.257 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:35.252+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:35.258 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:35.258 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:35.260 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:35.263 INFO:tasks.workunit.client.0.smithi073.stdout:6/777: dread d8/de/d78/f7e [0,4194304] 0 2024-04-19T02:18:35.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:35.264 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:35.264 INFO:tasks.workunit.client.0.smithi073.stdout:6/778: creat d8/de/d22/da8/dca/fff x:0 0 0 2024-04-19T02:18:35.265 INFO:tasks.workunit.client.0.smithi073.stdout:6/779: getdents d8/de/d58/d63/d82/de2/dea 0 2024-04-19T02:18:35.277 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:35.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/852: write d7/d14/d17/d1a/d8d/dea/fe2 [433591,57459] 0 2024-04-19T02:18:35.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/853: rmdir d7/d6d 39 2024-04-19T02:18:35.290 INFO:tasks.workunit.client.0.smithi073.stdout:0/854: dread d7/d14/d17/d1a/d8d/f96 [0,4194304] 0 2024-04-19T02:18:35.290 INFO:tasks.workunit.client.0.smithi073.stdout:0/855: creat d7/d6d/dc7/f102 x:0 0 0 2024-04-19T02:18:35.295 INFO:tasks.workunit.client.0.smithi073.stdout:0/856: dwrite d7/d14/d17/d69/d7c/dbe/fda [0,4194304] 0 2024-04-19T02:18:35.296 INFO:tasks.workunit.client.0.smithi073.stdout:0/857: symlink d7/d14/d17/d69/l103 0 2024-04-19T02:18:35.296 INFO:tasks.workunit.client.0.smithi073.stdout:9/761: link d0/c7 d0/df/c108 0 2024-04-19T02:18:35.297 INFO:tasks.workunit.client.0.smithi073.stdout:0/858: readlink d7/d14/d17/d1a/d20/d50/d99/da7/d9e/lde 0 2024-04-19T02:18:35.297 INFO:tasks.workunit.client.0.smithi073.stdout:0/859: truncate d7/f67 1404891 0 2024-04-19T02:18:35.304 INFO:tasks.workunit.client.0.smithi073.stdout:7/873: creat d0/dc/f105 x:0 0 0 2024-04-19T02:18:35.304 INFO:tasks.workunit.client.0.smithi073.stdout:6/780: dwrite d8/d4b/d93/f5d [0,4194304] 0 2024-04-19T02:18:35.305 INFO:tasks.workunit.client.0.smithi073.stdout:7/874: mknod d0/dc/d33/d5d/db0/c106 0 2024-04-19T02:18:35.305 INFO:tasks.workunit.client.0.smithi073.stdout:1/884: rename db/ff to db/d1c/d78/d8c/dd5/d50/f13b 0 2024-04-19T02:18:35.306 INFO:tasks.workunit.client.0.smithi073.stdout:7/875: fdatasync d0/dc/d33/da7/fe6 0 2024-04-19T02:18:35.306 INFO:tasks.workunit.client.0.smithi073.stdout:3/984: rename d3/f47 to d3/d6/db/d3a/d38/d6f/daf/dfd/d101/f14c 0 2024-04-19T02:18:35.308 INFO:tasks.workunit.client.0.smithi073.stdout:8/896: dread d14/d27/d85/d9b/fd2 [0,4194304] 0 2024-04-19T02:18:35.308 INFO:tasks.workunit.client.0.smithi073.stdout:8/897: truncate d14/f9f 635504 0 2024-04-19T02:18:35.309 INFO:tasks.workunit.client.0.smithi073.stdout:7/876: mkdir d0/dc/d67/d2a/d107 0 2024-04-19T02:18:35.309 INFO:tasks.workunit.client.0.smithi073.stdout:2/922: rename d5/d10/d14/d18/d98/lfe to d5/d10/d14/db6/l143 0 2024-04-19T02:18:35.309 INFO:tasks.workunit.client.0.smithi073.stdout:9/762: truncate d0/df/d1d/f44 4766533 0 2024-04-19T02:18:35.309 INFO:tasks.workunit.client.0.smithi073.stdout:6/781: truncate d8/de/ff 4361938 0 2024-04-19T02:18:35.310 INFO:tasks.workunit.client.0.smithi073.stdout:5/888: rename d0/d1d/d24/d61/fb4 to d0/d1d/d25/d37/f118 0 2024-04-19T02:18:35.310 INFO:tasks.workunit.client.0.smithi073.stdout:8/898: write d14/d15/f130 [313764,43714] 0 2024-04-19T02:18:35.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/985: creat d3/d6/db/d3a/d38/d43/f14d x:0 0 0 2024-04-19T02:18:35.310 INFO:tasks.workunit.client.0.smithi073.stdout:4/814: rename da/d27/d2c/dc1/f10c to da/d27/d2c/ddb/d107/dfc/d110/f11b 0 2024-04-19T02:18:35.310 INFO:tasks.workunit.client.0.smithi073.stdout:5/889: write d0/d1d/d64/f6b [771536,35655] 0 2024-04-19T02:18:35.310 INFO:tasks.workunit.client.0.smithi073.stdout:1/885: readlink db/d41/d101/lfc 0 2024-04-19T02:18:35.312 INFO:tasks.workunit.client.0.smithi073.stdout:4/815: write da/d27/d3a/d50/fbe [934028,93231] 0 2024-04-19T02:18:35.312 INFO:tasks.workunit.client.0.smithi073.stdout:0/860: rename d7/d14/d17/c5d to d7/d14/d17/d1a/d8d/c104 0 2024-04-19T02:18:35.312 INFO:tasks.workunit.client.0.smithi073.stdout:5/890: write d0/d1d/d25/d37/f77 [2628527,5297] 0 2024-04-19T02:18:35.312 INFO:tasks.workunit.client.0.smithi073.stdout:9/763: link d0/df/d60/d72/caf d0/df/d16/d19/c109 0 2024-04-19T02:18:35.313 INFO:tasks.workunit.client.0.smithi073.stdout:7/877: write d0/dc/d67/d2a/d51/d7a/f95 [1279133,5230] 0 2024-04-19T02:18:35.315 INFO:tasks.workunit.client.0.smithi073.stdout:7/878: chown d0/dc/d33/da7/de3/cf9 2939174 1 2024-04-19T02:18:35.315 INFO:tasks.workunit.client.0.smithi073.stdout:9/764: creat d0/df/d16/d19/d38/d5d/d76/f10a x:0 0 0 2024-04-19T02:18:35.316 INFO:tasks.workunit.client.0.smithi073.stdout:0/861: rename d7/d14/d17/d1a/l34 to d7/d14/d17/d1a/d20/d50/d99/da7/l105 0 2024-04-19T02:18:35.320 INFO:tasks.workunit.client.0.smithi073.stdout:8/899: dwrite d14/d15/f1e [0,4194304] 0 2024-04-19T02:18:35.320 INFO:tasks.workunit.client.0.smithi073.stdout:4/816: truncate da/ff7 309454 0 2024-04-19T02:18:35.320 INFO:tasks.workunit.client.0.smithi073.stdout:9/765: fdatasync d0/df/d16/f1e 0 2024-04-19T02:18:35.320 INFO:tasks.workunit.client.0.smithi073.stdout:6/782: dwrite d8/de/f4d [4194304,4194304] 0 2024-04-19T02:18:35.321 INFO:tasks.workunit.client.0.smithi073.stdout:2/923: dread d5/d10/d14/d18/d3e/de1/d130/d66/d83/fc9 [0,4194304] 0 2024-04-19T02:18:35.322 INFO:tasks.workunit.client.0.smithi073.stdout:6/783: chown d8/dda 73 1 2024-04-19T02:18:35.322 INFO:tasks.workunit.client.0.smithi073.stdout:4/817: dread - da/d27/d2c/da6/f100 zero size 2024-04-19T02:18:35.322 INFO:tasks.workunit.client.0.smithi073.stdout:8/900: write d14/d27/d50/faf [4064928,23695] 0 2024-04-19T02:18:35.322 INFO:tasks.workunit.client.0.smithi073.stdout:1/886: dwrite db/d1c/d81/d86/fbc [0,4194304] 0 2024-04-19T02:18:35.324 INFO:tasks.workunit.client.0.smithi073.stdout:5/891: dwrite d0/d1d/f2a [0,4194304] 0 2024-04-19T02:18:35.325 INFO:tasks.workunit.client.0.smithi073.stdout:1/887: symlink db/d1c/d54/l13c 0 2024-04-19T02:18:35.325 INFO:tasks.workunit.client.0.smithi073.stdout:6/784: creat d8/de/d7f/dc6/f100 x:0 0 0 2024-04-19T02:18:35.326 INFO:tasks.workunit.client.0.smithi073.stdout:4/818: creat da/d27/d1b/d26/d2a/f11c x:0 0 0 2024-04-19T02:18:35.326 INFO:tasks.workunit.client.0.smithi073.stdout:8/901: mknod d14/d27/d29/c132 0 2024-04-19T02:18:35.326 INFO:tasks.workunit.client.0.smithi073.stdout:1/888: chown db/d1c/l26 48302 1 2024-04-19T02:18:35.328 INFO:tasks.workunit.client.0.smithi073.stdout:9/766: rename d0/fee to d0/df/d16/d19/f10b 0 2024-04-19T02:18:35.329 INFO:tasks.workunit.client.0.smithi073.stdout:8/902: chown d14/d27/da4/fc3 427 1 2024-04-19T02:18:35.329 INFO:tasks.workunit.client.0.smithi073.stdout:6/785: creat d8/d4b/d93/d60/f101 x:0 0 0 2024-04-19T02:18:35.330 INFO:tasks.workunit.client.0.smithi073.stdout:0/862: dwrite d7/d14/d17/d1a/d8d/dea/fe2 [0,4194304] 0 2024-04-19T02:18:35.330 INFO:tasks.workunit.client.0.smithi073.stdout:9/767: creat d0/d81/dda/ddd/f10c x:0 0 0 2024-04-19T02:18:35.331 INFO:tasks.workunit.client.0.smithi073.stdout:0/863: fsync d7/d14/f1b 0 2024-04-19T02:18:35.331 INFO:tasks.workunit.client.0.smithi073.stdout:6/786: write d8/de/d58/d63/d82/ff0 [581206,63578] 0 2024-04-19T02:18:35.332 INFO:tasks.workunit.client.0.smithi073.stdout:8/903: mknod d14/d27/c133 0 2024-04-19T02:18:35.332 INFO:tasks.workunit.client.0.smithi073.stdout:5/892: dwrite d0/d1d/f7d [4194304,4194304] 0 2024-04-19T02:18:35.332 INFO:tasks.workunit.client.0.smithi073.stdout:0/864: readlink d7/d14/d17/d1a/d20/d50/d99/da7/d6f/l79 0 2024-04-19T02:18:35.333 INFO:tasks.workunit.client.0.smithi073.stdout:0/865: chown d7/d14/d17/d1a/d20/l59 1769 1 2024-04-19T02:18:35.334 INFO:tasks.workunit.client.0.smithi073.stdout:8/904: creat d14/d27/d85/d9a/df6/f134 x:0 0 0 2024-04-19T02:18:35.334 INFO:tasks.workunit.client.0.smithi073.stdout:8/905: chown d14/d27/d4c/f8b 1253625772 1 2024-04-19T02:18:35.335 INFO:tasks.workunit.client.0.smithi073.stdout:0/866: creat d7/d6d/d101/f106 x:0 0 0 2024-04-19T02:18:35.338 INFO:tasks.workunit.client.0.smithi073.stdout:4/819: truncate da/d27/d1b/d26/d2a/fa9 2701759 0 2024-04-19T02:18:35.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/768: dwrite d0/df/d16/d19/d38/d5d/d45/f7a [0,4194304] 0 2024-04-19T02:18:35.340 INFO:tasks.workunit.client.0.smithi073.stdout:6/787: write d8/f11 [875807,119939] 0 2024-04-19T02:18:35.340 INFO:tasks.workunit.client.0.smithi073.stdout:6/788: fdatasync d8/fa1 0 2024-04-19T02:18:35.342 INFO:tasks.workunit.client.0.smithi073.stdout:6/789: truncate d8/d71/d75/fd0 1920716 0 2024-04-19T02:18:35.342 INFO:tasks.workunit.client.0.smithi073.stdout:0/867: dwrite d7/d6d/dc7/fe9 [4194304,4194304] 0 2024-04-19T02:18:35.342 INFO:tasks.workunit.client.0.smithi073.stdout:1/889: read db/f65 [640492,79900] 0 2024-04-19T02:18:35.343 INFO:tasks.workunit.client.0.smithi073.stdout:9/769: link d0/df/d16/d19/d38/d5d/d76/d7d/lc5 d0/df/d16/d19/db1/d2c/d6b/l10d 0 2024-04-19T02:18:35.343 INFO:tasks.workunit.client.0.smithi073.stdout:1/890: stat db/f28 0 2024-04-19T02:18:35.343 INFO:tasks.workunit.client.0.smithi073.stdout:6/790: unlink d8/de/f1e 0 2024-04-19T02:18:35.343 INFO:tasks.workunit.client.0.smithi073.stdout:8/906: dwrite d14/d15/d17/f128 [0,4194304] 0 2024-04-19T02:18:35.343 INFO:tasks.workunit.client.0.smithi073.stdout:0/868: symlink d7/d14/d17/d70/l107 0 2024-04-19T02:18:35.344 INFO:tasks.workunit.client.0.smithi073.stdout:1/891: write db/d41/d101/db1/dc4/f12b [1026663,50160] 0 2024-04-19T02:18:35.344 INFO:tasks.workunit.client.0.smithi073.stdout:8/907: mknod d14/d15/d17/c135 0 2024-04-19T02:18:35.345 INFO:tasks.workunit.client.0.smithi073.stdout:0/869: dread - d7/d14/d17/d1a/d20/d50/dc2/ff9 zero size 2024-04-19T02:18:35.346 INFO:tasks.workunit.client.0.smithi073.stdout:6/791: getdents d8/de/d7f/da5 0 2024-04-19T02:18:35.346 INFO:tasks.workunit.client.0.smithi073.stdout:1/892: symlink db/d1c/d54/d8b/dab/l13d 0 2024-04-19T02:18:35.346 INFO:tasks.workunit.client.0.smithi073.stdout:0/870: mkdir d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/d108 0 2024-04-19T02:18:35.346 INFO:tasks.workunit.client.0.smithi073.stdout:6/792: fsync d8/de/d7f/fb7 0 2024-04-19T02:18:35.347 INFO:tasks.workunit.client.0.smithi073.stdout:6/793: mknod d8/de/d58/d63/d82/c102 0 2024-04-19T02:18:35.347 INFO:tasks.workunit.client.0.smithi073.stdout:5/893: truncate d0/d1d/d25/f27 874985 0 2024-04-19T02:18:35.348 INFO:tasks.workunit.client.0.smithi073.stdout:6/794: read d8/d4b/d93/f57 [5456086,37516] 0 2024-04-19T02:18:35.349 INFO:tasks.workunit.client.0.smithi073.stdout:4/820: dread da/d27/d3a/d50/f8b [0,4194304] 0 2024-04-19T02:18:35.350 INFO:tasks.workunit.client.0.smithi073.stdout:5/894: truncate d0/d1d/d90/da0/ffe 631686 0 2024-04-19T02:18:35.350 INFO:tasks.workunit.client.0.smithi073.stdout:6/795: write d8/de/d58/d63/d82/f83 [7755656,119834] 0 2024-04-19T02:18:35.350 INFO:tasks.workunit.client.0.smithi073.stdout:8/908: write d14/d15/d17/d48/d89/d97/d124/fc8 [4369076,63880] 0 2024-04-19T02:18:35.351 INFO:tasks.workunit.client.0.smithi073.stdout:1/893: dread db/d1c/d54/d8b/dab/fb0 [0,4194304] 0 2024-04-19T02:18:35.351 INFO:tasks.workunit.client.0.smithi073.stdout:7/879: dread d0/dc/d33/d36/d7b/d93/fc0 [0,4194304] 0 2024-04-19T02:18:35.352 INFO:tasks.workunit.client.0.smithi073.stdout:4/821: read da/d27/d1b/d1d/d72/d2b/d2f/f63 [1344241,12778] 0 2024-04-19T02:18:35.352 INFO:tasks.workunit.client.0.smithi073.stdout:5/895: mkdir d0/d1d/d25/d35/d88/d119 0 2024-04-19T02:18:35.353 INFO:tasks.workunit.client.0.smithi073.stdout:4/822: write da/d27/d3a/d49/ff6 [12526,91946] 0 2024-04-19T02:18:35.354 INFO:tasks.workunit.client.0.smithi073.stdout:6/796: mkdir d8/d71/d103 0 2024-04-19T02:18:35.354 INFO:tasks.workunit.client.0.smithi073.stdout:1/894: mkdir db/d1c/d78/d8c/dd5/de3/d13e 0 2024-04-19T02:18:35.355 INFO:tasks.workunit.client.0.smithi073.stdout:4/823: mknod da/d27/d1b/d26/d2a/c11d 0 2024-04-19T02:18:35.356 INFO:tasks.workunit.client.0.smithi073.stdout:0/871: dwrite d7/d14/d17/d1a/d20/d50/d99/fb8 [0,4194304] 0 2024-04-19T02:18:35.356 INFO:tasks.workunit.client.0.smithi073.stdout:8/909: getdents d14 0 2024-04-19T02:18:35.356 INFO:tasks.workunit.client.0.smithi073.stdout:6/797: truncate d8/fa1 502840 0 2024-04-19T02:18:35.357 INFO:tasks.workunit.client.0.smithi073.stdout:8/910: write d14/d27/d29/d31/d34/fea [1936863,57028] 0 2024-04-19T02:18:35.357 INFO:tasks.workunit.client.0.smithi073.stdout:0/872: write d7/d14/d17/d1a/d21/f32 [4633187,98197] 0 2024-04-19T02:18:35.358 INFO:tasks.workunit.client.0.smithi073.stdout:6/798: mkdir d8/de/d7f/da5/d104 0 2024-04-19T02:18:35.358 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:35.355+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:35.359 INFO:tasks.workunit.client.0.smithi073.stdout:6/799: fdatasync d8/d4b/d93/fba 0 2024-04-19T02:18:35.359 INFO:tasks.workunit.client.0.smithi073.stdout:0/873: symlink d7/d14/d17/d70/l109 0 2024-04-19T02:18:35.359 INFO:tasks.workunit.client.0.smithi073.stdout:8/911: write d14/d15/d17/da1/db9/f123 [305722,25652] 0 2024-04-19T02:18:35.360 INFO:tasks.workunit.client.0.smithi073.stdout:6/800: write d8/d4b/d93/f62 [1163243,37862] 0 2024-04-19T02:18:35.361 INFO:tasks.workunit.client.0.smithi073.stdout:0/874: symlink d7/d6d/dc7/l10a 0 2024-04-19T02:18:35.361 INFO:tasks.workunit.client.0.smithi073.stdout:0/875: stat d7/d14/f1b 0 2024-04-19T02:18:35.361 INFO:tasks.workunit.client.0.smithi073.stdout:6/801: write d8/f2e [2601892,17593] 0 2024-04-19T02:18:35.362 INFO:tasks.workunit.client.0.smithi073.stdout:5/896: dwrite d0/d1d/d24/fa5 [0,4194304] 0 2024-04-19T02:18:35.363 INFO:tasks.workunit.client.0.smithi073.stdout:0/876: creat d7/d6d/dbd/f10b x:0 0 0 2024-04-19T02:18:35.363 INFO:tasks.workunit.client.0.smithi073.stdout:6/802: read - d8/de/d22/da8/fd3 zero size 2024-04-19T02:18:35.363 INFO:tasks.workunit.client.0.smithi073.stdout:0/877: read - d7/d14/d17/d69/d7c/f100 zero size 2024-04-19T02:18:35.363 INFO:tasks.workunit.client.0.smithi073.stdout:6/803: chown d8/de/d58/d63/l6f 3 1 2024-04-19T02:18:35.363 INFO:tasks.workunit.client.0.smithi073.stdout:5/897: link d0/d1d/d25/d35/d39/dd8/lf1 d0/d1d/d24/df5/l11a 0 2024-04-19T02:18:35.363 INFO:tasks.workunit.client.0.smithi073.stdout:5/898: readlink d0/l12 0 2024-04-19T02:18:35.364 INFO:tasks.workunit.client.0.smithi073.stdout:8/912: dread d14/d15/d17/f128 [0,4194304] 0 2024-04-19T02:18:35.365 INFO:tasks.workunit.client.0.smithi073.stdout:8/913: link d14/d87/f121 d14/d15/d17/d48/d89/f136 0 2024-04-19T02:18:35.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/914: readlink d14/d27/d29/d31/lce 0 2024-04-19T02:18:35.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/915: mknod d14/d27/d85/c137 0 2024-04-19T02:18:35.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/916: dread d14/d27/d29/fb0 [0,4194304] 0 2024-04-19T02:18:35.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/917: dread - d14/d27/d29/d31/f5b zero size 2024-04-19T02:18:35.372 INFO:tasks.workunit.client.0.smithi073.stdout:8/918: creat d14/d27/d7b/d113/f138 x:0 0 0 2024-04-19T02:18:35.377 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:18:35.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/824: dread da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f [0,4194304] 0 2024-04-19T02:18:35.379 INFO:tasks.workunit.client.0.smithi073.stdout:4/825: mknod da/d27/d1b/d1d/d72/d104/ddd/dd0/c11e 0 2024-04-19T02:18:35.380 INFO:tasks.workunit.client.0.smithi073.stdout:4/826: write da/d27/d2c/d80/fee [577011,130976] 0 2024-04-19T02:18:35.381 INFO:tasks.workunit.client.0.smithi073.stdout:9/770: dread d0/df/d16/d19/db1/d2c/fef [0,4194304] 0 2024-04-19T02:18:35.382 INFO:tasks.workunit.client.0.smithi073.stdout:9/771: chown d0/d81/dda/ddd/dc2/dce/fdc 55200490 1 2024-04-19T02:18:35.383 INFO:tasks.workunit.client.0.smithi073.stdout:9/772: mkdir d0/df/d60/d72/d10e 0 2024-04-19T02:18:35.384 INFO:tasks.workunit.client.0.smithi073.stdout:9/773: creat d0/df/d16/d19/d38/d5d/d5e/f10f x:0 0 0 2024-04-19T02:18:35.384 INFO:tasks.workunit.client.0.smithi073.stdout:9/774: mknod d0/df/d16/d19/d38/d5d/d76/c110 0 2024-04-19T02:18:35.386 INFO:tasks.workunit.client.0.smithi073.stdout:9/775: link d0/df/d16/d19/db1/cc4 d0/df/d16/d19/d38/d5d/d5e/d83/c111 0 2024-04-19T02:18:35.387 INFO:tasks.workunit.client.0.smithi073.stdout:9/776: truncate d0/d81/dda/ddd/dc2/fe0 4905985 0 2024-04-19T02:18:35.388 INFO:tasks.workunit.client.0.smithi073.stdout:9/777: creat d0/df/d16/d19/db1/dd4/f112 x:0 0 0 2024-04-19T02:18:35.390 INFO:tasks.workunit.client.0.smithi073.stdout:9/778: mknod d0/d81/dda/ddd/dc2/dce/c113 0 2024-04-19T02:18:35.390 INFO:tasks.workunit.client.0.smithi073.stdout:7/880: dread d0/f6a [0,4194304] 0 2024-04-19T02:18:35.391 INFO:tasks.workunit.client.0.smithi073.stdout:9/779: rmdir d0/df/d16/d19/d38/d5d/d6d 0 2024-04-19T02:18:35.392 INFO:tasks.workunit.client.0.smithi073.stdout:9/780: write d0/fa3 [1600009,58973] 0 2024-04-19T02:18:35.393 INFO:tasks.workunit.client.0.smithi073.stdout:7/881: rename d0/dc/d33/d36/d7b/d93/d97/c9d to d0/d28/d63/c108 0 2024-04-19T02:18:35.394 INFO:tasks.workunit.client.0.smithi073.stdout:9/781: chown d0/df/d16/d19/db1/f37 1101 1 2024-04-19T02:18:35.394 INFO:tasks.workunit.client.0.smithi073.stdout:5/899: dread d0/d1d/d24/d61/fb1 [0,4194304] 0 2024-04-19T02:18:35.395 INFO:tasks.workunit.client.0.smithi073.stdout:5/900: creat d0/d1d/d25/d35/d96/df0/f11b x:0 0 0 2024-04-19T02:18:35.395 INFO:tasks.workunit.client.0.smithi073.stdout:1/895: dread db/f30 [4194304,4194304] 0 2024-04-19T02:18:35.396 INFO:tasks.workunit.client.0.smithi073.stdout:1/896: mkdir db/d41/d101/d13f 0 2024-04-19T02:18:35.398 INFO:tasks.workunit.client.0.smithi073.stdout:7/882: truncate d0/dc/d67/f31 1526645 0 2024-04-19T02:18:35.399 INFO:tasks.workunit.client.0.smithi073.stdout:7/883: unlink d0/d3/f74 0 2024-04-19T02:18:35.400 INFO:tasks.workunit.client.0.smithi073.stdout:6/804: dread d8/f2e [0,4194304] 0 2024-04-19T02:18:35.401 INFO:tasks.workunit.client.0.smithi073.stdout:6/805: readlink d8/de/d78/l9e 0 2024-04-19T02:18:35.402 INFO:tasks.workunit.client.0.smithi073.stdout:1/897: dwrite db/d1c/d81/d83/db8/dd1/f104 [0,4194304] 0 2024-04-19T02:18:35.408 INFO:tasks.workunit.client.0.smithi073.stdout:1/898: dread db/d1c/d78/d8c/dd5/f111 [0,4194304] 0 2024-04-19T02:18:35.409 INFO:tasks.workunit.client.0.smithi073.stdout:2/924: dread d5/d10/d14/d18/d3e/de1/d130/d66/d67/f124 [0,4194304] 0 2024-04-19T02:18:35.410 INFO:tasks.workunit.client.0.smithi073.stdout:1/899: creat db/d41/d101/d13f/f140 x:0 0 0 2024-04-19T02:18:35.410 INFO:tasks.workunit.client.0.smithi073.stdout:7/884: write d0/dc/d39/d40/f44 [321689,61639] 0 2024-04-19T02:18:35.412 INFO:tasks.workunit.client.0.smithi073.stdout:2/925: read d5/f64 [8050939,126331] 0 2024-04-19T02:18:35.413 INFO:tasks.workunit.client.0.smithi073.stdout:2/926: mknod d5/d10/d14/d2e/da0/dc0/d142/c144 0 2024-04-19T02:18:35.414 INFO:tasks.workunit.client.0.smithi073.stdout:8/919: dread d14/d15/d17/f3d [0,4194304] 0 2024-04-19T02:18:35.415 INFO:tasks.workunit.client.0.smithi073.stdout:8/920: write d14/d27/d4c/f8b [222145,126702] 0 2024-04-19T02:18:35.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/782: dread d0/df/f78 [0,4194304] 0 2024-04-19T02:18:35.417 INFO:tasks.workunit.client.0.smithi073.stdout:1/900: dwrite db/d1c/d81/d83/db8/dd1/f105 [0,4194304] 0 2024-04-19T02:18:35.417 INFO:tasks.workunit.client.0.smithi073.stdout:8/921: truncate d14/d15/f55 1066097 0 2024-04-19T02:18:35.417 INFO:tasks.workunit.client.0.smithi073.stdout:9/783: dread - d0/df/d16/d19/d38/d5d/d76/f10a zero size 2024-04-19T02:18:35.418 INFO:tasks.workunit.client.0.smithi073.stdout:8/922: truncate d14/d27/d29/d69/f8c 563637 0 2024-04-19T02:18:35.419 INFO:tasks.workunit.client.0.smithi073.stdout:9/784: truncate d0/d35/fe2 676629 0 2024-04-19T02:18:35.419 INFO:tasks.workunit.client.0.smithi073.stdout:8/923: fsync d14/d15/f130 0 2024-04-19T02:18:35.419 INFO:tasks.workunit.client.0.smithi073.stdout:9/785: mknod d0/df/d60/c114 0 2024-04-19T02:18:35.420 INFO:tasks.workunit.client.0.smithi073.stdout:8/924: readlink d14/d27/d4c/d75/l41 0 2024-04-19T02:18:35.421 INFO:tasks.workunit.client.0.smithi073.stdout:8/925: write d14/d27/d85/d9a/df6/f134 [540697,68439] 0 2024-04-19T02:18:35.421 INFO:tasks.workunit.client.0.smithi073.stdout:9/786: link d0/df/d16/d19/d38/d5d/d76/d7d/d88/cb9 d0/df/c115 0 2024-04-19T02:18:35.422 INFO:tasks.workunit.client.0.smithi073.stdout:8/926: link d14/d27/dcc/cdc d14/c139 0 2024-04-19T02:18:35.422 INFO:tasks.workunit.client.0.smithi073.stdout:9/787: mknod d0/df9/c116 0 2024-04-19T02:18:35.427 INFO:tasks.workunit.client.0.smithi073.stdout:9/788: dwrite d0/df/d16/d19/d38/f66 [0,4194304] 0 2024-04-19T02:18:35.428 INFO:tasks.workunit.client.0.smithi073.stdout:9/789: chown d0/df/d16/d19/d38/d5d/d5e/f10f 13 1 2024-04-19T02:18:35.429 INFO:tasks.workunit.client.0.smithi073.stdout:9/790: symlink d0/d81/dda/ddd/dc2/l117 0 2024-04-19T02:18:35.431 INFO:tasks.workunit.client.0.smithi073.stdout:9/791: mknod d0/df/d16/d19/d38/d5d/d5e/d83/c118 0 2024-04-19T02:18:35.431 INFO:tasks.workunit.client.0.smithi073.stdout:9/792: chown d0/l3 5844 1 2024-04-19T02:18:35.432 INFO:tasks.workunit.client.0.smithi073.stdout:8/927: dwrite d14/d15/d17/fe2 [0,4194304] 0 2024-04-19T02:18:35.432 INFO:tasks.workunit.client.0.smithi073.stdout:9/793: chown d0/df9/c116 289 1 2024-04-19T02:18:35.433 INFO:tasks.workunit.client.0.smithi073.stdout:8/928: creat d14/d15/d17/f13a x:0 0 0 2024-04-19T02:18:35.434 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:35.434 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:35.436 INFO:tasks.workunit.client.0.smithi073.stdout:7/885: dread d0/dc/d39/f3f [0,4194304] 0 2024-04-19T02:18:35.437 INFO:tasks.workunit.client.0.smithi073.stdout:7/886: creat d0/dc/d67/d2a/d51/f109 x:0 0 0 2024-04-19T02:18:35.438 INFO:tasks.workunit.client.0.smithi073.stdout:9/794: dwrite d0/d81/dda/ddd/fd6 [0,4194304] 0 2024-04-19T02:18:35.439 INFO:tasks.workunit.client.0.smithi073.stdout:9/795: write d0/df/d16/d19/d38/f9b [4111672,68518] 0 2024-04-19T02:18:35.440 INFO:tasks.workunit.client.0.smithi073.stdout:9/796: write d0/df/d16/fe4 [825069,82725] 0 2024-04-19T02:18:35.441 INFO:tasks.workunit.client.0.smithi073.stdout:1/901: dread db/d1c/d78/d8c/dd5/fa3 [0,4194304] 0 2024-04-19T02:18:35.443 INFO:tasks.workunit.client.0.smithi073.stdout:1/902: symlink db/d41/d101/db1/l141 0 2024-04-19T02:18:35.445 INFO:tasks.workunit.client.0.smithi073.stdout:7/887: truncate d0/f79 1343918 0 2024-04-19T02:18:35.446 INFO:tasks.workunit.client.0.smithi073.stdout:7/888: readlink d0/dc/d84/lb2 0 2024-04-19T02:18:35.446 INFO:tasks.workunit.client.0.smithi073.stdout:9/797: dwrite d0/df/d16/d19/db1/dd4/f112 [0,4194304] 0 2024-04-19T02:18:35.446 INFO:tasks.workunit.client.0.smithi073.stdout:2/927: dread d5/d10/d14/d18/d3e/de1/d130/d66/d67/f48 [0,4194304] 0 2024-04-19T02:18:35.447 INFO:tasks.workunit.client.0.smithi073.stdout:7/889: chown d0/dc/d39/d50/dbc 403800952 1 2024-04-19T02:18:35.449 INFO:tasks.workunit.client.0.smithi073.stdout:7/890: creat d0/dc/d33/d5d/db0/f10a x:0 0 0 2024-04-19T02:18:35.449 INFO:tasks.workunit.client.0.smithi073.stdout:8/929: dwrite d14/d27/d50/f5d [0,4194304] 0 2024-04-19T02:18:35.449 INFO:tasks.workunit.client.0.smithi073.stdout:3/986: sync 2024-04-19T02:18:35.449 INFO:tasks.workunit.client.0.smithi073.stdout:0/878: sync 2024-04-19T02:18:35.450 INFO:tasks.workunit.client.0.smithi073.stdout:7/891: fdatasync d0/dc/fdc 0 2024-04-19T02:18:35.450 INFO:tasks.workunit.client.0.smithi073.stdout:1/903: dwrite db/d1c/d81/df9/f47 [0,4194304] 0 2024-04-19T02:18:35.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:35.453 INFO:tasks.workunit.client.0.smithi073.stdout:8/930: rename d14/d27/d29/d69 to d14/d27/da4/d13b 0 2024-04-19T02:18:35.453 INFO:tasks.workunit.client.0.smithi073.stdout:1/904: dread - db/d1c/f121 zero size 2024-04-19T02:18:35.453 INFO:tasks.workunit.client.0.smithi073.stdout:2/928: read d5/d10/d14/db6/d101/f120 [532853,25471] 0 2024-04-19T02:18:35.454 INFO:tasks.workunit.client.0.smithi073.stdout:3/987: mkdir d3/d6/db/d3a/d38/d43/d14e 0 2024-04-19T02:18:35.454 INFO:tasks.workunit.client.0.smithi073.stdout:0/879: getdents d7 0 2024-04-19T02:18:35.454 INFO:tasks.workunit.client.0.smithi073.stdout:1/905: dread - db/d1c/d81/fb4 zero size 2024-04-19T02:18:35.454 INFO:tasks.workunit.client.0.smithi073.stdout:3/988: chown d3/l20 4 1 2024-04-19T02:18:35.455 INFO:tasks.workunit.client.0.smithi073.stdout:0/880: fsync d7/d14/d17/d1a/d20/fd3 0 2024-04-19T02:18:35.455 INFO:tasks.workunit.client.0.smithi073.stdout:1/906: chown db/d41/dc5/c12d 1630 1 2024-04-19T02:18:35.455 INFO:tasks.workunit.client.0.smithi073.stdout:9/798: dwrite d0/df/d16/d19/d38/d5d/f84 [0,4194304] 0 2024-04-19T02:18:35.455 INFO:tasks.workunit.client.0.smithi073.stdout:3/989: chown d3/d6/db/d3a/d38/d43/d4e/f91 1 1 2024-04-19T02:18:35.455 INFO:tasks.workunit.client.0.smithi073.stdout:0/881: creat d7/d14/d17/d1a/d21/dc9/f10c x:0 0 0 2024-04-19T02:18:35.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/929: link d5/d10/d14/d18/d3e/de1/d130/d66/d83/ffd d5/d10/d14/d18/d3e/de1/d130/d66/d7e/d108/f145 0 2024-04-19T02:18:35.457 INFO:tasks.workunit.client.0.smithi073.stdout:3/990: write d3/d6/f9 [440769,51281] 0 2024-04-19T02:18:35.457 INFO:tasks.workunit.client.0.smithi073.stdout:3/991: getdents d3/d13e 0 2024-04-19T02:18:35.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/930: symlink d5/d10/d14/d18/d3e/d2d/d63/da2/l146 0 2024-04-19T02:18:35.458 INFO:tasks.workunit.client.0.smithi073.stdout:3/992: getdents d3/d6/db/d3a/d38/d89/d94/d7b 0 2024-04-19T02:18:35.459 INFO:tasks.workunit.client.0.smithi073.stdout:2/931: link d5/d10/d14/d18/d98/ld6 d5/d10/d53/l147 0 2024-04-19T02:18:35.460 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:35.455+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:35.461 INFO:tasks.workunit.client.0.smithi073.stdout:0/882: dwrite f5 [0,4194304] 0 2024-04-19T02:18:35.461 INFO:tasks.workunit.client.0.smithi073.stdout:0/883: chown d7/d6d/dc7/f102 23064199 1 2024-04-19T02:18:35.462 INFO:tasks.workunit.client.0.smithi073.stdout:1/907: truncate db/d1c/d54/d8b/dab/fb0 1994273 0 2024-04-19T02:18:35.462 INFO:tasks.workunit.client.0.smithi073.stdout:0/884: dread - d7/d6d/dbd/ffb zero size 2024-04-19T02:18:35.462 INFO:tasks.workunit.client.0.smithi073.stdout:2/932: rename d5/d10/d14/d18/d3e/de1/l12a to d5/d10/d14/d18/d3e/de1/d130/l148 0 2024-04-19T02:18:35.463 INFO:tasks.workunit.client.0.smithi073.stdout:2/933: stat d5/d10/d14/f2c 0 2024-04-19T02:18:35.464 INFO:tasks.workunit.client.0.smithi073.stdout:1/908: creat db/d1c/d78/d8c/d10c/f142 x:0 0 0 2024-04-19T02:18:35.465 INFO:tasks.workunit.client.0.smithi073.stdout:1/909: creat db/d1c/d78/dcf/f143 x:0 0 0 2024-04-19T02:18:35.465 INFO:tasks.workunit.client.0.smithi073.stdout:3/993: dwrite d3/d6/db/d3a/d38/d89/d94/d7b/fbc [0,4194304] 0 2024-04-19T02:18:35.466 INFO:tasks.workunit.client.0.smithi073.stdout:2/934: truncate d5/d10/d14/d18/d3e/de1/d130/d66/d67/f4f 974178 0 2024-04-19T02:18:35.467 INFO:tasks.workunit.client.0.smithi073.stdout:3/994: unlink d3/d6/db/d3a/d38/d89/d94/d7b/fe5 0 2024-04-19T02:18:35.467 INFO:tasks.workunit.client.0.smithi073.stdout:1/910: write db/d1c/d78/d8c/dd5/d50/d62/f139 [2949440,63446] 0 2024-04-19T02:18:35.471 INFO:tasks.workunit.client.0.smithi073.stdout:3/995: chown d3/d6/db/d3a/d38/d43/d4e/c6b 6447947 1 2024-04-19T02:18:35.471 INFO:tasks.workunit.client.0.smithi073.stdout:3/996: readlink d3/d6/db/d23/l5d 0 2024-04-19T02:18:35.472 INFO:tasks.workunit.client.0.smithi073.stdout:0/885: dwrite d7/d14/d17/d1a/f39 [4194304,4194304] 0 2024-04-19T02:18:35.475 INFO:tasks.workunit.client.0.smithi073.stdout:2/935: dwrite d5/d10/d14/d18/d3e/de1/d130/d66/d67/d72/f12d [0,4194304] 0 2024-04-19T02:18:35.476 INFO:tasks.workunit.client.0.smithi073.stdout:2/936: chown d5/d10/d14/d18/d3e/de1/d130/d66/d7e/d108/d132 2 1 2024-04-19T02:18:35.477 INFO:tasks.workunit.client.0.smithi073.stdout:0/886: dwrite d7/d14/d17/d1a/d21/fc1 [0,4194304] 0 2024-04-19T02:18:35.480 INFO:tasks.workunit.client.0.smithi073.stdout:7/892: dread d0/dc/d67/d2a/d51/d7a/fee [0,4194304] 0 2024-04-19T02:18:35.486 INFO:tasks.workunit.client.0.smithi073.stdout:7/893: rename d0/d3/dbb/da1 to d0/dc/d33/d36/d7b/db4/d10b 0 2024-04-19T02:18:35.486 INFO:tasks.workunit.client.0.smithi073.stdout:2/937: dwrite d5/d10/d14/d2e/fcc [0,4194304] 0 2024-04-19T02:18:35.486 INFO:tasks.workunit.client.0.smithi073.stdout:2/938: mknod d5/d10/d14/d2e/da0/dff/c149 0 2024-04-19T02:18:35.486 INFO:tasks.workunit.client.0.smithi073.stdout:0/887: dwrite d7/d14/f2d [4194304,4194304] 0 2024-04-19T02:18:35.490 INFO:tasks.workunit.client.0.smithi073.stdout:3/997: read d3/d6/db/d3a/d38/d6f/daf/dfd/f111 [2253858,14787] 0 2024-04-19T02:18:35.492 INFO:tasks.workunit.client.0.smithi073.stdout:2/939: dwrite d5/d10/d14/d18/d3e/d2d/f5d [0,4194304] 0 2024-04-19T02:18:35.494 INFO:tasks.workunit.client.0.smithi073.stdout:3/998: write d3/d6/db/d16/d52/f99 [121066,22113] 0 2024-04-19T02:18:35.494 INFO:tasks.workunit.client.0.smithi073.stdout:7/894: write d0/dc/d67/f71 [1826358,9879] 0 2024-04-19T02:18:35.498 INFO:tasks.workunit.client.0.smithi073.stdout:4/827: sync 2024-04-19T02:18:35.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/999: dwrite d3/d6/db/d3a/d38/d6f/daf/fe4 [0,4194304] 0 2024-04-19T02:18:35.499 INFO:tasks.workunit.client.0.smithi073.stdout:4/828: mkdir da/d27/d36/d4d/dde/d11f 0 2024-04-19T02:18:35.500 INFO:tasks.workunit.client.0.smithi073.stdout:4/829: creat da/d27/d36/d4d/f120 x:0 0 0 2024-04-19T02:18:35.500 INFO:tasks.workunit.client.0.smithi073.stdout:4/830: stat da/d27/d3a/d49/c67 0 2024-04-19T02:18:35.501 INFO:tasks.workunit.client.0.smithi073.stdout:4/831: readlink da/l17 0 2024-04-19T02:18:35.501 INFO:tasks.workunit.client.0.smithi073.stdout:4/832: mkdir da/d27/d3a/d121 0 2024-04-19T02:18:35.509 INFO:tasks.workunit.client.0.smithi073.stdout:4/833: rename da/d27/d36 to da/d27/d3a/d97/d122 0 2024-04-19T02:18:35.510 INFO:tasks.workunit.client.0.smithi073.stdout:4/834: mknod da/d27/d1b/c123 0 2024-04-19T02:18:35.511 INFO:tasks.workunit.client.0.smithi073.stdout:4/835: mknod da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/d112/c124 0 2024-04-19T02:18:35.512 INFO:tasks.workunit.client.0.smithi073.stdout:4/836: read - da/d27/d1b/d1d/d72/f96 zero size 2024-04-19T02:18:35.513 INFO:tasks.workunit.client.0.smithi073.stdout:4/837: symlink da/d27/d1b/d1d/d72/d104/ddd/l125 0 2024-04-19T02:18:35.514 INFO:tasks.workunit.client.0.smithi073.stdout:4/838: chown da/d27/d1b/d1d/d72/d2b/d2f/c53 8 1 2024-04-19T02:18:35.514 INFO:tasks.workunit.client.0.smithi073.stdout:9/799: dread d0/fa1 [0,4194304] 0 2024-04-19T02:18:35.515 INFO:tasks.workunit.client.0.smithi073.stdout:9/800: stat d0/fa3 0 2024-04-19T02:18:35.515 INFO:tasks.workunit.client.0.smithi073.stdout:9/801: creat d0/df9/f119 x:0 0 0 2024-04-19T02:18:35.515 INFO:tasks.workunit.client.0.smithi073.stdout:4/839: truncate da/d27/d2c/ddb/d107/dfc/d110/f11b 662543 0 2024-04-19T02:18:35.516 INFO:tasks.workunit.client.0.smithi073.stdout:9/802: truncate d0/df/f41 4594473 0 2024-04-19T02:18:35.516 INFO:tasks.workunit.client.0.smithi073.stdout:4/840: mkdir da/d27/d1b/d26/d126 0 2024-04-19T02:18:35.516 INFO:tasks.workunit.client.0.smithi073.stdout:4/841: creat da/d27/d3a/d97/f127 x:0 0 0 2024-04-19T02:18:35.517 INFO:tasks.workunit.client.0.smithi073.stdout:4/842: chown da/d27/d1b/d1d/l5b 1 1 2024-04-19T02:18:35.518 INFO:tasks.workunit.client.0.smithi073.stdout:4/843: write da/d27/d1b/d1d/d72/d104/ddd/d95/fb9 [2074405,73112] 0 2024-04-19T02:18:35.518 INFO:tasks.workunit.client.0.smithi073.stdout:4/844: readlink da/d27/d1b/l35 0 2024-04-19T02:18:35.519 INFO:tasks.workunit.client.0.smithi073.stdout:4/845: write da/d27/d1b/d1d/d72/fd9 [798821,102296] 0 2024-04-19T02:18:35.519 INFO:tasks.workunit.client.0.smithi073.stdout:4/846: creat da/d27/d2c/dc1/f128 x:0 0 0 2024-04-19T02:18:35.520 INFO:tasks.workunit.client.0.smithi073.stdout:4/847: truncate da/d27/d1b/d26/d2a/f11c 628824 0 2024-04-19T02:18:35.521 INFO:tasks.workunit.client.0.smithi073.stdout:9/803: dread d0/df/d16/d19/db1/d2c/d2e/f7f [0,4194304] 0 2024-04-19T02:18:35.521 INFO:tasks.workunit.client.0.smithi073.stdout:4/848: chown da/d27/d1b/d1d/c119 1 1 2024-04-19T02:18:35.522 INFO:tasks.workunit.client.0.smithi073.stdout:4/849: mknod da/d27/d1b/d1d/d72/dd5/c129 0 2024-04-19T02:18:35.524 INFO:tasks.workunit.client.0.smithi073.stdout:9/804: truncate d0/df/d60/d72/d8e/f94 689224 0 2024-04-19T02:18:35.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/931: dread f11 [0,4194304] 0 2024-04-19T02:18:35.529 INFO:tasks.workunit.client.0.smithi073.stdout:0/888: dread d7/d14/d17/d1a/d21/f32 [4194304,4194304] 0 2024-04-19T02:18:35.531 INFO:tasks.workunit.client.0.smithi073.stdout:0/889: creat d7/d14/d17/d1a/d8d/f10d x:0 0 0 2024-04-19T02:18:35.532 INFO:tasks.workunit.client.0.smithi073.stdout:0/890: symlink d7/d14/d17/d1a/d20/d50/d99/da7/d87/l10e 0 2024-04-19T02:18:35.532 INFO:tasks.workunit.client.0.smithi073.stdout:8/932: dwrite f0 [4194304,4194304] 0 2024-04-19T02:18:35.533 INFO:tasks.workunit.client.0.smithi073.stdout:0/891: mkdir d7/d14/d17/d1a/d21/d10f 0 2024-04-19T02:18:35.533 INFO:tasks.workunit.client.0.smithi073.stdout:8/933: chown d14/d27/da4/ff9 32508 1 2024-04-19T02:18:35.534 INFO:tasks.workunit.client.0.smithi073.stdout:0/892: fdatasync d7/d14/d17/d1a/d20/d50/d99/da7/d87/f8f 0 2024-04-19T02:18:35.534 INFO:tasks.workunit.client.0.smithi073.stdout:8/934: creat d14/d27/d7b/d113/f13c x:0 0 0 2024-04-19T02:18:35.535 INFO:tasks.workunit.client.0.smithi073.stdout:8/935: mkdir d14/d27/d29/d64/d13d 0 2024-04-19T02:18:35.535 INFO:tasks.workunit.client.0.smithi073.stdout:0/893: chown d7/d14/d17/d1a/d20/d50/d99/da7/d6f/ce7 18 1 2024-04-19T02:18:35.536 INFO:tasks.workunit.client.0.smithi073.stdout:0/894: dread - d7/d14/d17/d69/d7c/f100 zero size 2024-04-19T02:18:35.538 INFO:tasks.workunit.client.0.smithi073.stdout:7/895: dread d0/dc/d67/d15/d8f/f9b [0,4194304] 0 2024-04-19T02:18:35.541 INFO:tasks.workunit.client.0.smithi073.stdout:8/936: dwrite d14/d27/d85/d9a/df6/f134 [0,4194304] 0 2024-04-19T02:18:35.543 INFO:tasks.workunit.client.0.smithi073.stdout:8/937: rename d14/d15 to d14/d15/d13e 22 2024-04-19T02:18:35.545 INFO:tasks.workunit.client.0.smithi073.stdout:8/938: rename d14/d27/da4/f12f to d14/d27/d29/de1/f13f 0 2024-04-19T02:18:35.545 INFO:tasks.workunit.client.0.smithi073.stdout:7/896: dwrite d0/dc/d39/d50/da3/f104 [0,4194304] 0 2024-04-19T02:18:35.546 INFO:tasks.workunit.client.0.smithi073.stdout:8/939: chown d14/d15/d17/d48/d89/dd6/f11a 0 1 2024-04-19T02:18:35.547 INFO:tasks.workunit.client.0.smithi073.stdout:7/897: mkdir d0/dc/d33/d36/d10c 0 2024-04-19T02:18:35.547 INFO:tasks.workunit.client.0.smithi073.stdout:4/850: dread da/d27/f39 [0,4194304] 0 2024-04-19T02:18:35.549 INFO:tasks.workunit.client.0.smithi073.stdout:7/898: getdents d0/dc/d39/d40 0 2024-04-19T02:18:35.549 INFO:tasks.workunit.client.0.smithi073.stdout:1/911: dread db/fd [0,4194304] 0 2024-04-19T02:18:35.550 INFO:tasks.workunit.client.0.smithi073.stdout:7/899: mkdir d0/d3/d10d 0 2024-04-19T02:18:35.550 INFO:tasks.workunit.client.0.smithi073.stdout:9/805: dread d0/d35/fd9 [0,4194304] 0 2024-04-19T02:18:35.550 INFO:tasks.workunit.client.0.smithi073.stdout:7/900: creat d0/d3/d10d/f10e x:0 0 0 2024-04-19T02:18:35.551 INFO:tasks.workunit.client.0.smithi073.stdout:1/912: getdents db/d41/dc5 0 2024-04-19T02:18:35.551 INFO:tasks.workunit.client.0.smithi073.stdout:7/901: creat d0/d3/f10f x:0 0 0 2024-04-19T02:18:35.552 INFO:tasks.workunit.client.0.smithi073.stdout:1/913: chown db/d7f/ded/df4/c12f 522297738 1 2024-04-19T02:18:35.552 INFO:tasks.workunit.client.0.smithi073.stdout:9/806: rename d0/df/c108 to d0/df/d60/d72/d8e/c11a 0 2024-04-19T02:18:35.552 INFO:tasks.workunit.client.0.smithi073.stdout:4/851: dread da/d27/feb [0,4194304] 0 2024-04-19T02:18:35.552 INFO:tasks.workunit.client.0.smithi073.stdout:7/902: unlink d0/dc/d33/d36/d7b/d93/d97/lcb 0 2024-04-19T02:18:35.553 INFO:tasks.workunit.client.0.smithi073.stdout:9/807: fsync d0/df/d16/d19/d38/d5d/f84 0 2024-04-19T02:18:35.553 INFO:tasks.workunit.client.0.smithi073.stdout:1/914: creat db/d1c/d81/d86/ddd/f144 x:0 0 0 2024-04-19T02:18:35.553 INFO:tasks.workunit.client.0.smithi073.stdout:7/903: chown d0/dc/d33/d5d/db0/c106 18 1 2024-04-19T02:18:35.554 INFO:tasks.workunit.client.0.smithi073.stdout:1/915: mkdir db/d1c/d81/d86/d145 0 2024-04-19T02:18:35.554 INFO:tasks.workunit.client.0.smithi073.stdout:9/808: symlink d0/df/d16/d19/db1/d2c/d2e/l11b 0 2024-04-19T02:18:35.556 INFO:tasks.workunit.client.0.smithi073.stdout:7/904: truncate d0/dc/f8a 1085318 0 2024-04-19T02:18:35.557 INFO:tasks.workunit.client.0.smithi073.stdout:7/905: write d0/d3/dbb/fe0 [442746,15128] 0 2024-04-19T02:18:35.558 INFO:tasks.workunit.client.0.smithi073.stdout:7/906: dread - d0/dc/db7/ffc zero size 2024-04-19T02:18:35.559 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:35.556+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:35.561 INFO:tasks.workunit.client.0.smithi073.stdout:4/852: dread da/d27/fd7 [0,4194304] 0 2024-04-19T02:18:35.561 INFO:tasks.workunit.client.0.smithi073.stdout:7/907: truncate d0/dc/d39/d50/f6b 933847 0 2024-04-19T02:18:35.561 INFO:tasks.workunit.client.0.smithi073.stdout:7/908: write d0/d3/d10d/f10e [296014,19084] 0 2024-04-19T02:18:35.561 INFO:tasks.workunit.client.0.smithi073.stdout:0/895: dread d7/d14/d17/d1a/d20/f6c [4194304,4194304] 0 2024-04-19T02:18:35.562 INFO:tasks.workunit.client.0.smithi073.stdout:7/909: write d0/dc/d67/d2a/d51/f54 [9496785,25151] 0 2024-04-19T02:18:35.563 INFO:tasks.workunit.client.0.smithi073.stdout:0/896: getdents d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82 0 2024-04-19T02:18:35.564 INFO:tasks.workunit.client.0.smithi073.stdout:4/853: dread da/d27/d3a/d50/fbe [0,4194304] 0 2024-04-19T02:18:35.565 INFO:tasks.workunit.client.0.smithi073.stdout:0/897: rename d7/d14/c49 to d7/d14/d17/d70/c110 0 2024-04-19T02:18:35.566 INFO:tasks.workunit.client.0.smithi073.stdout:4/854: link da/d27/d3a/d50/f8b da/d27/d3a/d121/f12a 0 2024-04-19T02:18:35.568 INFO:tasks.workunit.client.0.smithi073.stdout:7/910: dwrite d0/dc/d39/fa6 [0,4194304] 0 2024-04-19T02:18:35.569 INFO:tasks.workunit.client.0.smithi073.stdout:7/911: stat d0/dc/d39/cf0 0 2024-04-19T02:18:35.570 INFO:tasks.workunit.client.0.smithi073.stdout:7/912: mknod d0/dc/d39/d40/c110 0 2024-04-19T02:18:35.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/898: dwrite d7/d14/f68 [0,4194304] 0 2024-04-19T02:18:35.571 INFO:tasks.workunit.client.0.smithi073.stdout:0/899: stat d7/d14 0 2024-04-19T02:18:35.571 INFO:tasks.workunit.client.0.smithi073.stdout:7/913: creat d0/dc/d33/d36/d10c/f111 x:0 0 0 2024-04-19T02:18:35.572 INFO:tasks.workunit.client.0.smithi073.stdout:7/914: truncate d0/d28/d63/f7f 1036682 0 2024-04-19T02:18:35.574 INFO:tasks.workunit.client.0.smithi073.stdout:7/915: symlink d0/dc/d33/d36/d7b/d93/l112 0 2024-04-19T02:18:35.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/900: write d7/d14/d17/d1a/ff5 [1316416,28907] 0 2024-04-19T02:18:35.576 INFO:tasks.workunit.client.0.smithi073.stdout:0/901: write d7/d14/d17/d1a/d21/dc9/ff1 [872083,7518] 0 2024-04-19T02:18:35.577 INFO:tasks.workunit.client.0.smithi073.stdout:0/902: symlink d7/d14/l111 0 2024-04-19T02:18:35.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/916: dread db/d1c/d81/d86/dae/fcd [0,4194304] 0 2024-04-19T02:18:35.578 INFO:tasks.workunit.client.0.smithi073.stdout:1/917: stat db/d41/l51 0 2024-04-19T02:18:35.578 INFO:tasks.workunit.client.0.smithi073.stdout:1/918: creat db/d41/f146 x:0 0 0 2024-04-19T02:18:35.578 INFO:tasks.workunit.client.0.smithi073.stdout:0/903: unlink d7/d14/d17/d1a/d20/d50/d99/da7/l105 0 2024-04-19T02:18:35.579 INFO:tasks.workunit.client.0.smithi073.stdout:1/919: mknod db/d41/d101/c147 0 2024-04-19T02:18:35.580 INFO:tasks.workunit.client.0.smithi073.stdout:1/920: mkdir db/d1c/d81/d86/d145/d148 0 2024-04-19T02:18:35.580 INFO:tasks.workunit.client.0.smithi073.stdout:0/904: link d7/d14/d17/d1a/d20/d50/dc2/fcc d7/d14/d17/d1a/d20/d50/dc2/df0/f112 0 2024-04-19T02:18:35.581 INFO:tasks.workunit.client.0.smithi073.stdout:0/905: write d7/d14/f3e [297125,63368] 0 2024-04-19T02:18:35.583 INFO:tasks.workunit.client.0.smithi073.stdout:0/906: creat d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/d108/f113 x:0 0 0 2024-04-19T02:18:35.583 INFO:tasks.workunit.client.0.smithi073.stdout:1/921: dread db/d1c/d78/d8c/dd5/fa3 [0,4194304] 0 2024-04-19T02:18:35.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/922: mkdir db/d1c/d78/dcf/d149 0 2024-04-19T02:18:35.586 INFO:tasks.workunit.client.0.smithi073.stdout:1/923: truncate db/d1c/d78/d8c/dd5/f45 1962063 0 2024-04-19T02:18:35.587 INFO:tasks.workunit.client.0.smithi073.stdout:1/924: creat db/d1c/d81/d86/d145/d148/f14a x:0 0 0 2024-04-19T02:18:35.588 INFO:tasks.workunit.client.0.smithi073.stdout:1/925: readlink db/d1c/d78/d8c/dd5/l6c 0 2024-04-19T02:18:35.588 INFO:tasks.workunit.client.0.smithi073.stdout:0/907: dwrite d7/d6d/f88 [0,4194304] 0 2024-04-19T02:18:35.588 INFO:tasks.workunit.client.0.smithi073.stdout:0/908: fsync d7/d6d/dbd/ffb 0 2024-04-19T02:18:35.589 INFO:tasks.workunit.client.0.smithi073.stdout:1/926: truncate db/d1c/d81/d86/f9e 264224 0 2024-04-19T02:18:35.590 INFO:tasks.workunit.client.0.smithi073.stdout:1/927: link db/d1c/d78/d8c/dd5/d50/d62/l12c db/d41/dc5/l14b 0 2024-04-19T02:18:35.591 INFO:tasks.workunit.client.0.smithi073.stdout:1/928: fsync db/d1c/d78/fbb 0 2024-04-19T02:18:35.591 INFO:tasks.workunit.client.0.smithi073.stdout:1/929: symlink db/d1c/d78/l14c 0 2024-04-19T02:18:35.596 INFO:tasks.workunit.client.0.smithi073.stdout:7/916: dread d0/dc/d33/d36/d7b/f85 [0,4194304] 0 2024-04-19T02:18:35.597 INFO:tasks.workunit.client.0.smithi073.stdout:1/930: dwrite db/d41/d101/db1/fc7 [0,4194304] 0 2024-04-19T02:18:35.598 INFO:tasks.workunit.client.0.smithi073.stdout:1/931: rename db/d1c/d81/df9/f92 to db/d1c/d78/d8c/dd5/f14d 0 2024-04-19T02:18:35.599 INFO:tasks.workunit.client.0.smithi073.stdout:7/917: read d0/dc/f26 [4108251,42611] 0 2024-04-19T02:18:35.599 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:35.600 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:35.600 INFO:tasks.workunit.client.0.smithi073.stdout:1/932: truncate db/d41/f84 188575 0 2024-04-19T02:18:35.600 INFO:tasks.workunit.client.0.smithi073.stdout:7/918: mknod d0/dc/d67/d2a/d51/dd9/c113 0 2024-04-19T02:18:35.600 INFO:tasks.workunit.client.0.smithi073.stdout:1/933: chown db/d1c/d81/d86/f9e 0 1 2024-04-19T02:18:35.601 INFO:tasks.workunit.client.0.smithi073.stdout:7/919: write d0/dc/d33/d36/d7b/fa9 [1736825,73835] 0 2024-04-19T02:18:35.601 INFO:tasks.workunit.client.0.smithi073.stdout:1/934: write db/fac [643541,68464] 0 2024-04-19T02:18:35.601 INFO:tasks.workunit.client.0.smithi073.stdout:7/920: rmdir d0 39 2024-04-19T02:18:35.601 INFO:tasks.workunit.client.0.smithi073.stdout:7/921: stat d0/dc/d67/f31 0 2024-04-19T02:18:35.602 INFO:tasks.workunit.client.0.smithi073.stdout:1/935: rename db/d1c/d78/d8c/dd5/f63 to db/d1c/d81/d83/db8/dd1/f14e 0 2024-04-19T02:18:35.602 INFO:tasks.workunit.client.0.smithi073.stdout:7/922: mkdir d0/d114 0 2024-04-19T02:18:35.603 INFO:tasks.workunit.client.0.smithi073.stdout:7/923: mknod d0/dc/d67/d15/d8f/c115 0 2024-04-19T02:18:35.603 INFO:tasks.workunit.client.0.smithi073.stdout:1/936: link db/d1c/d78/d8c/dd5/d50/d62/fb6 db/d1c/d78/d8c/dd5/d50/d62/f14f 0 2024-04-19T02:18:35.603 INFO:tasks.workunit.client.0.smithi073.stdout:7/924: creat d0/dc/d67/d2a/d51/f116 x:0 0 0 2024-04-19T02:18:35.604 INFO:tasks.workunit.client.0.smithi073.stdout:7/925: fsync d0/dc/d67/d2a/d51/f100 0 2024-04-19T02:18:35.604 INFO:tasks.workunit.client.0.smithi073.stdout:1/937: symlink db/d1c/d81/d86/l150 0 2024-04-19T02:18:35.605 INFO:tasks.workunit.client.0.smithi073.stdout:1/938: truncate db/d41/f4c 2825113 0 2024-04-19T02:18:35.606 INFO:tasks.workunit.client.0.smithi073.stdout:6/806: sync 2024-04-19T02:18:35.606 INFO:tasks.workunit.client.0.smithi073.stdout:5/901: sync 2024-04-19T02:18:35.606 INFO:tasks.workunit.client.0.smithi073.stdout:6/807: chown d8/de/d58/c36 712290436 1 2024-04-19T02:18:35.606 INFO:tasks.workunit.client.0.smithi073.stdout:1/939: truncate db/d1c/d78/dcf/f119 862568 0 2024-04-19T02:18:35.607 INFO:tasks.workunit.client.0.smithi073.stdout:5/902: read d0/f13 [3497059,23786] 0 2024-04-19T02:18:35.607 INFO:tasks.workunit.client.0.smithi073.stdout:1/940: write db/d1c/d78/d8c/dd5/d50/d62/f79 [2091600,16231] 0 2024-04-19T02:18:35.608 INFO:tasks.workunit.client.0.smithi073.stdout:6/808: link d8/de/d22/da8/ff3 d8/d4b/d93/d60/f105 0 2024-04-19T02:18:35.608 INFO:tasks.workunit.client.0.smithi073.stdout:1/941: chown db/d41/l4a 3622 1 2024-04-19T02:18:35.608 INFO:tasks.workunit.client.0.smithi073.stdout:5/903: rename d0/d69/feb to d0/d1d/d25/d35/dc7/f11c 0 2024-04-19T02:18:35.608 INFO:tasks.workunit.client.0.smithi073.stdout:6/809: write d8/fa1 [919303,45433] 0 2024-04-19T02:18:35.609 INFO:tasks.workunit.client.0.smithi073.stdout:5/904: mkdir d0/d1d/d11d 0 2024-04-19T02:18:35.609 INFO:tasks.workunit.client.0.smithi073.stdout:6/810: read - d8/de/d22/fc1 zero size 2024-04-19T02:18:35.609 INFO:tasks.workunit.client.0.smithi073.stdout:5/905: chown d0/d1d/f20 298029203 1 2024-04-19T02:18:35.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/906: dread - d0/d69/f112 zero size 2024-04-19T02:18:35.610 INFO:tasks.workunit.client.0.smithi073.stdout:6/811: creat d8/de/d58/d63/d82/f106 x:0 0 0 2024-04-19T02:18:35.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/907: readlink d0/d1d/d25/d35/d88/l93 0 2024-04-19T02:18:35.610 INFO:tasks.workunit.client.0.smithi073.stdout:6/812: rename d8/de/d7f/da5 to d8/d71/d107 0 2024-04-19T02:18:35.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/908: write d0/d1d/d25/d35/f9c [1810356,112534] 0 2024-04-19T02:18:35.611 INFO:tasks.workunit.client.0.smithi073.stdout:6/813: creat d8/f108 x:0 0 0 2024-04-19T02:18:35.612 INFO:tasks.workunit.client.0.smithi073.stdout:5/909: symlink d0/d1d/d25/d35/dc7/l11e 0 2024-04-19T02:18:35.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:35.613 INFO:tasks.workunit.client.0.smithi073.stdout:5/910: creat d0/d1d/d25/d35/d96/f11f x:0 0 0 2024-04-19T02:18:35.614 INFO:tasks.workunit.client.0.smithi073.stdout:5/911: dread - d0/d1d/d64/dbd/fdb zero size 2024-04-19T02:18:35.631 INFO:tasks.workunit.client.0.smithi073.stdout:0/909: truncate d7/d14/d17/d1a/d20/d50/d99/da7/f78 394631 0 2024-04-19T02:18:35.634 INFO:tasks.workunit.client.0.smithi073.stdout:6/814: creat d8/d71/d107/f109 x:0 0 0 2024-04-19T02:18:35.634 INFO:tasks.workunit.client.0.smithi073.stdout:1/942: dread db/d1c/d81/d86/fbc [0,4194304] 0 2024-04-19T02:18:35.636 INFO:tasks.workunit.client.0.smithi073.stdout:6/815: dread - d8/de/d22/da8/fd3 zero size 2024-04-19T02:18:35.637 INFO:tasks.workunit.client.0.smithi073.stdout:7/926: dwrite d0/f79 [0,4194304] 0 2024-04-19T02:18:35.637 INFO:tasks.workunit.client.0.smithi073.stdout:6/816: chown d8/d71/d103 24897 1 2024-04-19T02:18:35.637 INFO:tasks.workunit.client.0.smithi073.stdout:7/927: chown d0/d28 145019 1 2024-04-19T02:18:35.638 INFO:tasks.workunit.client.0.smithi073.stdout:5/912: dread d0/d1d/d24/f2e [0,4194304] 0 2024-04-19T02:18:35.639 INFO:tasks.workunit.client.0.smithi073.stdout:0/910: dwrite d7/d14/d17/d1a/d21/fc1 [0,4194304] 0 2024-04-19T02:18:35.639 INFO:tasks.workunit.client.0.smithi073.stdout:6/817: symlink d8/de/d22/da8/l10a 0 2024-04-19T02:18:35.641 INFO:tasks.workunit.client.0.smithi073.stdout:5/913: creat d0/d1d/d24/d61/f120 x:0 0 0 2024-04-19T02:18:35.641 INFO:tasks.workunit.client.0.smithi073.stdout:6/818: truncate d8/de/d78/f9c 4301089 0 2024-04-19T02:18:35.641 INFO:tasks.workunit.client.0.smithi073.stdout:0/911: rename d7/d14/d17/d1a/d8d/f96 to d7/d6d/dc7/f114 0 2024-04-19T02:18:35.642 INFO:tasks.workunit.client.0.smithi073.stdout:6/819: mkdir d8/d71/d7d/dab/d10b 0 2024-04-19T02:18:35.643 INFO:tasks.workunit.client.0.smithi073.stdout:6/820: write d8/d4b/d93/fde [465706,114266] 0 2024-04-19T02:18:35.643 INFO:tasks.workunit.client.0.smithi073.stdout:5/914: dread d0/d1d/d25/d35/d96/fc1 [0,4194304] 0 2024-04-19T02:18:35.645 INFO:tasks.workunit.client.0.smithi073.stdout:0/912: mknod d7/d14/d17/d1a/d8d/c115 0 2024-04-19T02:18:35.645 INFO:tasks.workunit.client.0.smithi073.stdout:6/821: rename d8/de/d7f/le7 to d8/de/d7f/dc6/l10c 0 2024-04-19T02:18:35.645 INFO:tasks.workunit.client.0.smithi073.stdout:5/915: chown d0/d1d/d25/d35/d39/d10f 192831 1 2024-04-19T02:18:35.645 INFO:tasks.workunit.client.0.smithi073.stdout:5/916: mknod d0/d1d/d1e/c121 0 2024-04-19T02:18:35.645 INFO:tasks.workunit.client.0.smithi073.stdout:7/928: dwrite d0/dc/d67/d2a/d51/d7a/fee [0,4194304] 0 2024-04-19T02:18:35.646 INFO:tasks.workunit.client.0.smithi073.stdout:0/913: rename d7/d14/d17/d69/d7c/dbe to d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/d108/d116 0 2024-04-19T02:18:35.651 INFO:tasks.workunit.client.0.smithi073.stdout:7/929: dwrite d0/f79 [4194304,4194304] 0 2024-04-19T02:18:35.652 INFO:tasks.workunit.client.0.smithi073.stdout:6/822: dwrite d8/de/ff [0,4194304] 0 2024-04-19T02:18:35.653 INFO:tasks.workunit.client.0.smithi073.stdout:0/914: dwrite d7/d14/d17/d1a/d21/dc9/ff1 [0,4194304] 0 2024-04-19T02:18:35.653 INFO:tasks.workunit.client.0.smithi073.stdout:6/823: symlink d8/d71/d7d/dab/l10d 0 2024-04-19T02:18:35.653 INFO:tasks.workunit.client.0.smithi073.stdout:7/930: rename d0/dc/d39/d50 to d0/dc/d67/d2a/d117 0 2024-04-19T02:18:35.654 INFO:tasks.workunit.client.0.smithi073.stdout:6/824: stat d8/de/c41 0 2024-04-19T02:18:35.655 INFO:tasks.workunit.client.0.smithi073.stdout:7/931: rename d0/d3/dbb/cc3 to d0/dc/d33/da7/c118 0 2024-04-19T02:18:35.655 INFO:tasks.workunit.client.0.smithi073.stdout:6/825: mkdir d8/d71/d7d/dab/d10e 0 2024-04-19T02:18:35.655 INFO:tasks.workunit.client.0.smithi073.stdout:7/932: write d0/dc/db7/ffc [245231,6146] 0 2024-04-19T02:18:35.656 INFO:tasks.workunit.client.0.smithi073.stdout:6/826: rename d8/de/d22/c8c to d8/d4b/d93/d60/c10f 0 2024-04-19T02:18:35.657 INFO:tasks.workunit.client.0.smithi073.stdout:6/827: fdatasync d8/de/f67 0 2024-04-19T02:18:35.657 INFO:tasks.workunit.client.0.smithi073.stdout:7/933: getdents d0/dc/d33/d36/d7b/d93/d97 0 2024-04-19T02:18:35.658 INFO:tasks.workunit.client.0.smithi073.stdout:6/828: dread - d8/d71/d75/fb8 zero size 2024-04-19T02:18:35.658 INFO:tasks.workunit.client.0.smithi073.stdout:6/829: readlink d8/d71/d7d/la7 0 2024-04-19T02:18:35.662 INFO:tasks.workunit.client.0.smithi073.stdout:0/915: write d7/d14/d17/d1a/d21/f3b [4186189,9829] 0 2024-04-19T02:18:35.663 INFO:tasks.workunit.client.0.smithi073.stdout:0/916: creat d7/d14/d17/d1a/d8d/dea/f117 x:0 0 0 2024-04-19T02:18:35.664 INFO:tasks.workunit.client.0.smithi073.stdout:6/830: dwrite d8/de/d22/fc1 [0,4194304] 0 2024-04-19T02:18:35.665 INFO:tasks.workunit.client.0.smithi073.stdout:6/831: mknod d8/d4b/d93/d60/c110 0 2024-04-19T02:18:35.665 INFO:tasks.workunit.client.0.smithi073.stdout:6/832: write d8/f2e [7903729,44273] 0 2024-04-19T02:18:35.669 INFO:tasks.workunit.client.0.smithi073.stdout:2/940: sync 2024-04-19T02:18:35.689 INFO:tasks.workunit.client.0.smithi073.stdout:5/917: dread d0/f13 [0,4194304] 0 2024-04-19T02:18:35.690 INFO:tasks.workunit.client.0.smithi073.stdout:7/934: write d0/dc/d67/d2a/d117/f8c [286074,92221] 0 2024-04-19T02:18:35.690 INFO:tasks.workunit.client.0.smithi073.stdout:0/917: truncate d7/d14/d17/d69/f6a 4072407 0 2024-04-19T02:18:35.690 INFO:tasks.workunit.client.0.smithi073.stdout:6/833: truncate f3 562292 0 2024-04-19T02:18:35.690 INFO:tasks.workunit.client.0.smithi073.stdout:2/941: truncate d5/d10/d14/d18/d3e/de1/d130/f8c 991155 0 2024-04-19T02:18:35.691 INFO:tasks.workunit.client.0.smithi073.stdout:5/918: write d0/d1d/d64/dbd/fdb [683154,2194] 0 2024-04-19T02:18:35.691 INFO:tasks.workunit.client.0.smithi073.stdout:6/834: fdatasync d8/d4b/d8f/f95 0 2024-04-19T02:18:35.691 INFO:tasks.workunit.client.0.smithi073.stdout:6/835: chown d8/d71/d7d/dab/d10e 3785959 1 2024-04-19T02:18:35.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/919: symlink d0/d1d/d25/d37/d71/l122 0 2024-04-19T02:18:35.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/920: chown d0/d1d/d64/f6b 9 1 2024-04-19T02:18:35.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/921: chown d0/d2d/c44 40 1 2024-04-19T02:18:35.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/922: dread - d0/fa1 zero size 2024-04-19T02:18:35.694 INFO:tasks.workunit.client.0.smithi073.stdout:5/923: creat d0/d1d/d64/f123 x:0 0 0 2024-04-19T02:18:35.694 INFO:tasks.workunit.client.0.smithi073.stdout:2/942: write d5/d10/d14/db6/d101/f120 [1474838,85698] 0 2024-04-19T02:18:35.695 INFO:tasks.workunit.client.0.smithi073.stdout:2/943: write d5/d10/d14/d18/d3e/d51/fbf [132485,28767] 0 2024-04-19T02:18:35.696 INFO:tasks.workunit.client.0.smithi073.stdout:5/924: rename d0/d1d/d1e/f80 to d0/d1d/d64/dbd/df9/d110/f124 0 2024-04-19T02:18:35.696 INFO:tasks.workunit.client.0.smithi073.stdout:5/925: rmdir d0/d2d 39 2024-04-19T02:18:35.697 INFO:tasks.workunit.client.0.smithi073.stdout:0/918: dwrite d7/d14/f68 [4194304,4194304] 0 2024-04-19T02:18:35.697 INFO:tasks.workunit.client.0.smithi073.stdout:2/944: rename d5/l27 to d5/l14a 0 2024-04-19T02:18:35.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/935: dwrite d0/dc/d67/d2a/d117/f8c [0,4194304] 0 2024-04-19T02:18:35.698 INFO:tasks.workunit.client.0.smithi073.stdout:2/945: rmdir d5/d10/d14/d7a/dd1/d103 39 2024-04-19T02:18:35.698 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:35.696+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:35.698 INFO:tasks.workunit.client.0.smithi073.stdout:0/919: fdatasync d7/d14/d17/d1a/f3d 0 2024-04-19T02:18:35.699 INFO:tasks.workunit.client.0.smithi073.stdout:7/936: unlink d0/dc/d67/d15/f56 0 2024-04-19T02:18:35.699 INFO:tasks.workunit.client.0.smithi073.stdout:7/937: rmdir d0/dc/d33/d36/dce 39 2024-04-19T02:18:35.699 INFO:tasks.workunit.client.0.smithi073.stdout:2/946: truncate d5/d10/d14/f2c 5391081 0 2024-04-19T02:18:35.700 INFO:tasks.workunit.client.0.smithi073.stdout:7/938: write d0/dc/d67/d2a/d117/f8c [3459917,8363] 0 2024-04-19T02:18:35.701 INFO:tasks.workunit.client.0.smithi073.stdout:7/939: creat d0/dc/d33/f119 x:0 0 0 2024-04-19T02:18:35.701 INFO:tasks.workunit.client.0.smithi073.stdout:2/947: link d5/d10/d14/f8a d5/d10/d14/d18/d3e/de1/d130/d66/d7e/f14b 0 2024-04-19T02:18:35.701 INFO:tasks.workunit.client.0.smithi073.stdout:2/948: write d5/f11 [2748784,90206] 0 2024-04-19T02:18:35.703 INFO:tasks.workunit.client.0.smithi073.stdout:2/949: mknod d5/d10/c14c 0 2024-04-19T02:18:35.704 INFO:tasks.workunit.client.0.smithi073.stdout:1/943: sync 2024-04-19T02:18:35.704 INFO:tasks.workunit.client.0.smithi073.stdout:9/809: sync 2024-04-19T02:18:35.704 INFO:tasks.workunit.client.0.smithi073.stdout:5/926: sync 2024-04-19T02:18:35.704 INFO:tasks.workunit.client.0.smithi073.stdout:6/836: sync 2024-04-19T02:18:35.704 INFO:tasks.workunit.client.0.smithi073.stdout:8/940: sync 2024-04-19T02:18:35.704 INFO:tasks.workunit.client.0.smithi073.stdout:4/855: sync 2024-04-19T02:18:35.705 INFO:tasks.workunit.client.0.smithi073.stdout:2/950: dread - d5/d10/d14/d18/d3e/de1/d130/d66/d83/dbc/f125 zero size 2024-04-19T02:18:35.706 INFO:tasks.workunit.client.0.smithi073.stdout:5/927: creat d0/f125 x:0 0 0 2024-04-19T02:18:35.706 INFO:tasks.workunit.client.0.smithi073.stdout:9/810: write d0/df/d16/d19/db1/f37 [2636093,77223] 0 2024-04-19T02:18:35.707 INFO:tasks.workunit.client.0.smithi073.stdout:1/944: creat db/d7f/f151 x:0 0 0 2024-04-19T02:18:35.707 INFO:tasks.workunit.client.0.smithi073.stdout:8/941: readlink d14/d27/d4c/d75/l5f 0 2024-04-19T02:18:35.708 INFO:tasks.workunit.client.0.smithi073.stdout:6/837: chown d8/de/d58/d63/d82/fb0 1701831276 1 2024-04-19T02:18:35.708 INFO:tasks.workunit.client.0.smithi073.stdout:5/928: write d0/fa1 [505414,104528] 0 2024-04-19T02:18:35.708 INFO:tasks.workunit.client.0.smithi073.stdout:2/951: creat d5/d10/d14/d2e/da0/d12f/f14d x:0 0 0 2024-04-19T02:18:35.708 INFO:tasks.workunit.client.0.smithi073.stdout:0/920: dwrite d7/d6d/dbd/fd9 [4194304,4194304] 0 2024-04-19T02:18:35.709 INFO:tasks.workunit.client.0.smithi073.stdout:9/811: dread - d0/d81/dda/ddd/dc2/dec/f100 zero size 2024-04-19T02:18:35.709 INFO:tasks.workunit.client.0.smithi073.stdout:7/940: dwrite d0/dc/d67/d2a/d51/f100 [0,4194304] 0 2024-04-19T02:18:35.710 INFO:tasks.workunit.client.0.smithi073.stdout:6/838: symlink d8/d71/d107/d104/l111 0 2024-04-19T02:18:35.711 INFO:tasks.workunit.client.0.smithi073.stdout:7/941: chown d0/f3c 8387 1 2024-04-19T02:18:35.713 INFO:tasks.workunit.client.0.smithi073.stdout:6/839: truncate d8/d4b/d93/f65 4244018 0 2024-04-19T02:18:35.713 INFO:tasks.workunit.client.0.smithi073.stdout:8/942: rename d14/d15/d17/c22 to d14/d15/d17/d99/d106/c140 0 2024-04-19T02:18:35.714 INFO:tasks.workunit.client.0.smithi073.stdout:6/840: dread - d8/d4b/d93/d60/f105 zero size 2024-04-19T02:18:35.714 INFO:tasks.workunit.client.0.smithi073.stdout:0/921: truncate d7/d14/f1b 1381272 0 2024-04-19T02:18:35.715 INFO:tasks.workunit.client.0.smithi073.stdout:5/929: getdents d0/d1d/d64/dbd/df9/d110 0 2024-04-19T02:18:35.715 INFO:tasks.workunit.client.0.smithi073.stdout:8/943: stat d14/d27/d29/d64/fc5 0 2024-04-19T02:18:35.715 INFO:tasks.workunit.client.0.smithi073.stdout:7/942: mkdir d0/dc/d33/da7/d11a 0 2024-04-19T02:18:35.715 INFO:tasks.workunit.client.0.smithi073.stdout:6/841: symlink d8/de/d22/da8/l112 0 2024-04-19T02:18:35.715 INFO:tasks.workunit.client.0.smithi073.stdout:5/930: symlink d0/d1d/d25/d35/d96/dd3/l126 0 2024-04-19T02:18:35.716 INFO:tasks.workunit.client.0.smithi073.stdout:5/931: mkdir d0/d127 0 2024-04-19T02:18:35.716 INFO:tasks.workunit.client.0.smithi073.stdout:7/943: link d0/dc/d67/d15/f87 d0/dc/d67/d15/f11b 0 2024-04-19T02:18:35.717 INFO:tasks.workunit.client.0.smithi073.stdout:8/944: write d14/d27/d4c/d75/fb8 [1670004,53113] 0 2024-04-19T02:18:35.717 INFO:tasks.workunit.client.0.smithi073.stdout:9/812: dwrite d0/dad/fb7 [0,4194304] 0 2024-04-19T02:18:35.718 INFO:tasks.workunit.client.0.smithi073.stdout:1/945: write db/f17 [1970962,24260] 0 2024-04-19T02:18:35.718 INFO:tasks.workunit.client.0.smithi073.stdout:8/945: symlink d14/d27/d29/l141 0 2024-04-19T02:18:35.718 INFO:tasks.workunit.client.0.smithi073.stdout:0/922: dread d7/d14/d17/d1a/d21/dc9/ff1 [0,4194304] 0 2024-04-19T02:18:35.719 INFO:tasks.workunit.client.0.smithi073.stdout:8/946: chown d14/d27/d29/d31/d34/c7f 1 1 2024-04-19T02:18:35.721 INFO:tasks.workunit.client.0.smithi073.stdout:1/946: unlink db/d1c/d81/d83/db8/lfa 0 2024-04-19T02:18:35.721 INFO:tasks.workunit.client.0.smithi073.stdout:7/944: link d0/dc/d67/d2a/d117/ld4 d0/dc/d33/d5d/db0/l11c 0 2024-04-19T02:18:35.723 INFO:tasks.workunit.client.0.smithi073.stdout:1/947: mknod db/d1c/d81/d83/db8/dd1/c152 0 2024-04-19T02:18:35.723 INFO:tasks.workunit.client.0.smithi073.stdout:5/932: dwrite d0/d1d/d25/f6e [0,4194304] 0 2024-04-19T02:18:35.724 INFO:tasks.workunit.client.0.smithi073.stdout:1/948: chown db/d1c/d78/d8c 11372797 1 2024-04-19T02:18:35.724 INFO:tasks.workunit.client.0.smithi073.stdout:6/842: write d8/de/d22/f3a [2310625,89515] 0 2024-04-19T02:18:35.726 INFO:tasks.workunit.client.0.smithi073.stdout:6/843: readlink d8/de/d22/ld7 0 2024-04-19T02:18:35.727 INFO:tasks.workunit.client.0.smithi073.stdout:9/813: dwrite d0/df9/f119 [0,4194304] 0 2024-04-19T02:18:35.728 INFO:tasks.workunit.client.0.smithi073.stdout:1/949: write db/d1c/d81/d86/ddd/fff [211661,76120] 0 2024-04-19T02:18:35.730 INFO:tasks.workunit.client.0.smithi073.stdout:1/950: stat db/d41/d101 0 2024-04-19T02:18:35.730 INFO:tasks.workunit.client.0.smithi073.stdout:8/947: dwrite d14/d27/d29/f98 [0,4194304] 0 2024-04-19T02:18:35.731 INFO:tasks.workunit.client.0.smithi073.stdout:2/952: dwrite d5/d10/fec [0,4194304] 0 2024-04-19T02:18:35.731 INFO:tasks.workunit.client.0.smithi073.stdout:9/814: creat d0/df/d16/d19/d38/d5d/d76/f11c x:0 0 0 2024-04-19T02:18:35.733 INFO:tasks.workunit.client.0.smithi073.stdout:6/844: link d8/d4b/d93/c9a d8/d71/d107/d104/c113 0 2024-04-19T02:18:35.733 INFO:tasks.workunit.client.0.smithi073.stdout:8/948: creat d14/dbc/f142 x:0 0 0 2024-04-19T02:18:35.733 INFO:tasks.workunit.client.0.smithi073.stdout:4/856: sync 2024-04-19T02:18:35.734 INFO:tasks.workunit.client.0.smithi073.stdout:1/951: sync 2024-04-19T02:18:35.734 INFO:tasks.workunit.client.0.smithi073.stdout:9/815: symlink d0/df/df0/l11d 0 2024-04-19T02:18:35.734 INFO:tasks.workunit.client.0.smithi073.stdout:0/923: dwrite d7/d14/d17/d1a/d21/f53 [0,4194304] 0 2024-04-19T02:18:35.735 INFO:tasks.workunit.client.0.smithi073.stdout:7/945: write d0/dc/f8a [393396,17509] 0 2024-04-19T02:18:35.735 INFO:tasks.workunit.client.0.smithi073.stdout:2/953: fsync d5/d10/d14/d18/d3e/de1/d130/f8d 0 2024-04-19T02:18:35.735 INFO:tasks.workunit.client.0.smithi073.stdout:1/952: readlink db/d41/ld4 0 2024-04-19T02:18:35.735 INFO:tasks.workunit.client.0.smithi073.stdout:2/954: stat d5/d10/d14/cd0 0 2024-04-19T02:18:35.735 INFO:tasks.workunit.client.0.smithi073.stdout:5/933: dwrite d0/d1d/d90/da0/dbb/f10c [0,4194304] 0 2024-04-19T02:18:35.736 INFO:tasks.workunit.client.0.smithi073.stdout:5/934: readlink d0/d1d/l5f 0 2024-04-19T02:18:35.736 INFO:tasks.workunit.client.0.smithi073.stdout:2/955: read - d5/d10/d14/d18/d3e/d2d/d63/f13a zero size 2024-04-19T02:18:35.738 INFO:tasks.workunit.client.0.smithi073.stdout:7/946: symlink d0/l11d 0 2024-04-19T02:18:35.738 INFO:tasks.workunit.client.0.smithi073.stdout:4/857: readlink da/d27/d1b/d1d/d72/l10d 0 2024-04-19T02:18:35.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/924: mkdir d7/d14/d17/d1a/d21/d118 0 2024-04-19T02:18:35.739 INFO:tasks.workunit.client.0.smithi073.stdout:6/845: rename d8/de/ff to d8/d4b/df8/f114 0 2024-04-19T02:18:35.740 INFO:tasks.workunit.client.0.smithi073.stdout:2/956: link d5/d10/d14/d18/d3e/de1/d130/d66/d67/f48 d5/d10/d14/d18/d3e/d51/f14e 0 2024-04-19T02:18:35.741 INFO:tasks.workunit.client.0.smithi073.stdout:6/846: creat d8/d71/d7d/f115 x:0 0 0 2024-04-19T02:18:35.741 INFO:tasks.workunit.client.0.smithi073.stdout:7/947: creat d0/d114/f11e x:0 0 0 2024-04-19T02:18:35.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/925: write d7/d14/d17/d1a/d21/fce [317257,44962] 0 2024-04-19T02:18:35.744 INFO:tasks.workunit.client.0.smithi073.stdout:2/957: fdatasync d5/d10/d14/d18/d3e/de1/d130/d42/fa3 0 2024-04-19T02:18:35.744 INFO:tasks.workunit.client.0.smithi073.stdout:9/816: dwrite d0/f8b [4194304,4194304] 0 2024-04-19T02:18:35.744 INFO:tasks.workunit.client.0.smithi073.stdout:0/926: rename d7/d14/d17/d70/c110 to d7/d14/d17/d1a/d20/d50/d99/da7/d6f/c119 0 2024-04-19T02:18:35.745 INFO:tasks.workunit.client.0.smithi073.stdout:2/958: write d5/d10/d14/d18/d3e/d51/f109 [984390,3748] 0 2024-04-19T02:18:35.746 INFO:tasks.workunit.client.0.smithi073.stdout:9/817: getdents d0/df/d16 0 2024-04-19T02:18:35.746 INFO:tasks.workunit.client.0.smithi073.stdout:2/959: fdatasync d5/d10/d14/d18/f4d 0 2024-04-19T02:18:35.746 INFO:tasks.workunit.client.0.smithi073.stdout:0/927: symlink d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba/dcb/l11a 0 2024-04-19T02:18:35.748 INFO:tasks.workunit.client.0.smithi073.stdout:1/953: truncate db/d41/d101/fb5 2193727 0 2024-04-19T02:18:35.748 INFO:tasks.workunit.client.0.smithi073.stdout:6/847: dwrite d8/de/d78/f90 [0,4194304] 0 2024-04-19T02:18:35.748 INFO:tasks.workunit.client.0.smithi073.stdout:0/928: stat d7/d14/d17/d1a/fa0 0 2024-04-19T02:18:35.749 INFO:tasks.workunit.client.0.smithi073.stdout:2/960: rename d5/d10/d14/d18/d98/lf6 to d5/d10/d53/l14f 0 2024-04-19T02:18:35.749 INFO:tasks.workunit.client.0.smithi073.stdout:9/818: truncate d0/df/d16/d19/d38/d5d/d5e/f10f 907414 0 2024-04-19T02:18:35.749 INFO:tasks.workunit.client.0.smithi073.stdout:1/954: mkdir db/d1c/d54/d153 0 2024-04-19T02:18:35.750 INFO:tasks.workunit.client.0.smithi073.stdout:6/848: chown d8/d71/d107/fad 3554232 1 2024-04-19T02:18:35.750 INFO:tasks.workunit.client.0.smithi073.stdout:9/819: readlink d0/df/d16/l23 0 2024-04-19T02:18:35.751 INFO:tasks.workunit.client.0.smithi073.stdout:4/858: write da/d27/d1b/d1d/d72/d104/ddd/f40 [2141518,111758] 0 2024-04-19T02:18:35.751 INFO:tasks.workunit.client.0.smithi073.stdout:5/935: write d0/d1d/d25/d35/d39/f66 [4183729,81969] 0 2024-04-19T02:18:35.752 INFO:tasks.workunit.client.0.smithi073.stdout:6/849: dread - d8/d71/d7d/f115 zero size 2024-04-19T02:18:35.752 INFO:tasks.workunit.client.0.smithi073.stdout:2/961: unlink d5/d10/d14/d18/d3e/de1/d130/d66/c110 0 2024-04-19T02:18:35.752 INFO:tasks.workunit.client.0.smithi073.stdout:5/936: creat d0/d1d/d25/d35/dc7/f128 x:0 0 0 2024-04-19T02:18:35.753 INFO:tasks.workunit.client.0.smithi073.stdout:8/949: dwrite d14/d27/d29/d31/f5b [0,4194304] 0 2024-04-19T02:18:35.753 INFO:tasks.workunit.client.0.smithi073.stdout:4/859: creat da/d27/d1b/d1d/d72/d104/ddd/f12b x:0 0 0 2024-04-19T02:18:35.754 INFO:tasks.workunit.client.0.smithi073.stdout:4/860: fdatasync da/d27/d1b/d1d/f42 0 2024-04-19T02:18:35.754 INFO:tasks.workunit.client.0.smithi073.stdout:0/929: fsync d7/d14/d17/d1a/d21/fce 0 2024-04-19T02:18:35.755 INFO:tasks.workunit.client.0.smithi073.stdout:0/930: chown d7/d14/d17/d1a/d20/d50/d99/da7/d6f 7144 1 2024-04-19T02:18:35.755 INFO:tasks.workunit.client.0.smithi073.stdout:0/931: dread - d7/d6d/d101/f106 zero size 2024-04-19T02:18:35.757 INFO:tasks.workunit.client.0.smithi073.stdout:0/932: mknod d7/d6d/dbd/c11b 0 2024-04-19T02:18:35.759 INFO:tasks.workunit.client.0.smithi073.stdout:9/820: dread d0/df/d16/d19/d38/d5d/d76/ffd [0,4194304] 0 2024-04-19T02:18:35.760 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:35.759+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:35.761 INFO:tasks.workunit.client.0.smithi073.stdout:2/962: dwrite d5/d10/d14/d18/d98/d107/ff5 [4194304,4194304] 0 2024-04-19T02:18:35.761 INFO:tasks.workunit.client.0.smithi073.stdout:5/937: dwrite d0/d1d/d25/d35/f49 [0,4194304] 0 2024-04-19T02:18:35.762 INFO:tasks.workunit.client.0.smithi073.stdout:5/938: chown d0/d1d/d25/d35/d96/f108 1085 1 2024-04-19T02:18:35.763 INFO:tasks.workunit.client.0.smithi073.stdout:2/963: truncate d5/d10/d14/db6/fe6 412770 0 2024-04-19T02:18:35.763 INFO:tasks.workunit.client.0.smithi073.stdout:5/939: chown d0/d1d/d1e/f55 26016 1 2024-04-19T02:18:35.764 INFO:tasks.workunit.client.0.smithi073.stdout:5/940: dread - d0/ff6 zero size 2024-04-19T02:18:35.764 INFO:tasks.workunit.client.0.smithi073.stdout:0/933: dwrite d7/d14/d17/d70/fb9 [0,4194304] 0 2024-04-19T02:18:35.764 INFO:tasks.workunit.client.0.smithi073.stdout:2/964: mkdir d5/d10/d14/d18/d3e/de1/d130/d66/d67/d150 0 2024-04-19T02:18:35.765 INFO:tasks.workunit.client.0.smithi073.stdout:5/941: creat d0/d1d/d25/d35/d39/d10f/f129 x:0 0 0 2024-04-19T02:18:35.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/934: rename d7/d14/d17/d1a to d7/d14/d17/d1a/d21/dc9/d11c 22 2024-04-19T02:18:35.766 INFO:tasks.workunit.client.0.smithi073.stdout:6/850: truncate d8/de/d22/da8/fe1 3599460 0 2024-04-19T02:18:35.767 INFO:tasks.workunit.client.0.smithi073.stdout:2/965: symlink d5/d10/d14/d2e/da0/d12f/l151 0 2024-04-19T02:18:35.767 INFO:tasks.workunit.client.0.smithi073.stdout:4/861: write da/d27/d3a/d50/f8b [724681,33268] 0 2024-04-19T02:18:35.768 INFO:tasks.workunit.client.0.smithi073.stdout:6/851: mkdir d8/de/d22/da8/d116 0 2024-04-19T02:18:35.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/966: write d5/d10/d53/f93 [1617953,43052] 0 2024-04-19T02:18:35.768 INFO:tasks.workunit.client.0.smithi073.stdout:4/862: creat da/d27/d1b/d26/d2a/d46/f12c x:0 0 0 2024-04-19T02:18:35.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/967: sync 2024-04-19T02:18:35.768 INFO:tasks.workunit.client.0.smithi073.stdout:0/935: mknod d7/d14/d17/d1a/d20/d50/d99/da7/c11d 0 2024-04-19T02:18:35.769 INFO:tasks.workunit.client.0.smithi073.stdout:6/852: symlink d8/d4b/d93/d60/l117 0 2024-04-19T02:18:35.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/936: creat d7/d6d/dc7/f11e x:0 0 0 2024-04-19T02:18:35.769 INFO:tasks.workunit.client.0.smithi073.stdout:6/853: unlink d8/de/d78/f90 0 2024-04-19T02:18:35.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/937: fdatasync d7/d14/d17/d1a/f29 0 2024-04-19T02:18:35.769 INFO:tasks.workunit.client.0.smithi073.stdout:4/863: link da/d27/d1b/d1d/d72/l10d da/d27/d3a/d97/l12d 0 2024-04-19T02:18:35.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/938: write d7/d14/d17/d1a/d21/f3b [2020282,57360] 0 2024-04-19T02:18:35.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/864: creat da/d27/d3a/f12e x:0 0 0 2024-04-19T02:18:35.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/942: dwrite d0/d1d/d1e/f33 [0,4194304] 0 2024-04-19T02:18:35.772 INFO:tasks.workunit.client.0.smithi073.stdout:0/939: rename l1 to d7/d14/d17/d1a/l11f 0 2024-04-19T02:18:35.773 INFO:tasks.workunit.client.0.smithi073.stdout:9/821: read d0/df/d16/d19/db1/f52 [585584,122467] 0 2024-04-19T02:18:35.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/865: read - da/d27/d3a/d97/d122/d4d/f120 zero size 2024-04-19T02:18:35.774 INFO:tasks.workunit.client.0.smithi073.stdout:5/943: mknod d0/d1d/d25/d35/d88/c12a 0 2024-04-19T02:18:35.774 INFO:tasks.workunit.client.0.smithi073.stdout:0/940: chown d7/d14/d17/d1a/d21/dc9/ff1 46078835 1 2024-04-19T02:18:35.775 INFO:tasks.workunit.client.0.smithi073.stdout:9/822: mknod d0/df/d16/d19/db1/dd4/c11e 0 2024-04-19T02:18:35.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/866: chown da/d27/d1b/d1d/d72/f96 1922952528 1 2024-04-19T02:18:35.775 INFO:tasks.workunit.client.0.smithi073.stdout:0/941: creat d7/f120 x:0 0 0 2024-04-19T02:18:35.776 INFO:tasks.workunit.client.0.smithi073.stdout:5/944: write d0/d1d/d25/d35/dc7/f128 [626484,40452] 0 2024-04-19T02:18:35.776 INFO:tasks.workunit.client.0.smithi073.stdout:0/942: sync 2024-04-19T02:18:35.776 INFO:tasks.workunit.client.0.smithi073.stdout:6/854: dwrite d8/d4b/d8f/fbc [0,4194304] 0 2024-04-19T02:18:35.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/950: dread d14/d27/fb6 [0,4194304] 0 2024-04-19T02:18:35.778 INFO:tasks.workunit.client.0.smithi073.stdout:4/867: getdents da/d27/d1b 0 2024-04-19T02:18:35.779 INFO:tasks.workunit.client.0.smithi073.stdout:2/968: dread d5/d10/d14/d18/d3e/d51/f79 [0,4194304] 0 2024-04-19T02:18:35.780 INFO:tasks.workunit.client.0.smithi073.stdout:7/948: dread d0/d28/d63/f9e [0,4194304] 0 2024-04-19T02:18:35.780 INFO:tasks.workunit.client.0.smithi073.stdout:6/855: creat d8/de/d58/f118 x:0 0 0 2024-04-19T02:18:35.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/945: link d0/d2d/l10d d0/d1d/d64/dbd/df9/d110/l12b 0 2024-04-19T02:18:35.782 INFO:tasks.workunit.client.0.smithi073.stdout:6/856: read - d8/de/d58/d63/d82/ff5 zero size 2024-04-19T02:18:35.783 INFO:tasks.workunit.client.0.smithi073.stdout:6/857: rename d8/d71/d107/ce6 to d8/d4b/df8/c119 0 2024-04-19T02:18:35.784 INFO:tasks.workunit.client.0.smithi073.stdout:6/858: write d8/d71/d7d/fbd [2989744,100512] 0 2024-04-19T02:18:35.785 INFO:tasks.workunit.client.0.smithi073.stdout:8/951: dwrite d14/d27/d29/f79 [0,4194304] 0 2024-04-19T02:18:35.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/955: read db/d1c/d78/d8c/dd5/f3d [1279043,37163] 0 2024-04-19T02:18:35.786 INFO:tasks.workunit.client.0.smithi073.stdout:6/859: getdents d8/d4b/d93/d86 0 2024-04-19T02:18:35.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/952: symlink d14/d27/d29/d64/d13d/l143 0 2024-04-19T02:18:35.787 INFO:tasks.workunit.client.0.smithi073.stdout:1/956: readlink db/lf6 0 2024-04-19T02:18:35.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/953: sync 2024-04-19T02:18:35.787 INFO:tasks.workunit.client.0.smithi073.stdout:0/943: read - d7/d6d/dbd/f10b zero size 2024-04-19T02:18:35.788 INFO:tasks.workunit.client.0.smithi073.stdout:1/957: rmdir db/d1c/d81/d83/db8/d129 39 2024-04-19T02:18:35.788 INFO:tasks.workunit.client.0.smithi073.stdout:8/954: symlink d14/d15/d17/d48/d89/ddd/dfe/d102/l144 0 2024-04-19T02:18:35.788 INFO:tasks.workunit.client.0.smithi073.stdout:8/955: stat d14/d27/d29/d64 0 2024-04-19T02:18:35.788 INFO:tasks.workunit.client.0.smithi073.stdout:8/956: creat d14/d27/f145 x:0 0 0 2024-04-19T02:18:35.792 INFO:tasks.workunit.client.0.smithi073.stdout:6/860: dread d8/d4b/d93/d60/fc9 [0,4194304] 0 2024-04-19T02:18:35.792 INFO:tasks.workunit.client.0.smithi073.stdout:6/861: creat d8/de/d58/d63/d82/f11a x:0 0 0 2024-04-19T02:18:35.801 INFO:tasks.workunit.client.0.smithi073.stdout:2/969: dread d5/d10/d53/f73 [0,4194304] 0 2024-04-19T02:18:35.802 INFO:tasks.workunit.client.0.smithi073.stdout:2/970: write d5/d10/d14/d18/d3e/d2d/fc1 [9141591,83990] 0 2024-04-19T02:18:35.803 INFO:tasks.workunit.client.0.smithi073.stdout:2/971: chown d5/d10/d14/d18/d3e/de1/d130/d66/d67/d72/l91 29223 1 2024-04-19T02:18:35.805 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:35.805 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:35.805 INFO:tasks.workunit.client.0.smithi073.stdout:6/862: dread d8/f16 [0,4194304] 0 2024-04-19T02:18:35.806 INFO:tasks.workunit.client.0.smithi073.stdout:6/863: mkdir d8/d71/d7d/dab/d10e/d11b 0 2024-04-19T02:18:35.806 INFO:tasks.workunit.client.0.smithi073.stdout:6/864: rmdir d8/de/d78 39 2024-04-19T02:18:35.806 INFO:tasks.workunit.client.0.smithi073.stdout:6/865: dread - d8/d71/d75/fb8 zero size 2024-04-19T02:18:35.807 INFO:tasks.workunit.client.0.smithi073.stdout:2/972: dread d5/fb9 [0,4194304] 0 2024-04-19T02:18:35.807 INFO:tasks.workunit.client.0.smithi073.stdout:6/866: mkdir d8/de/d58/d11c 0 2024-04-19T02:18:35.807 INFO:tasks.workunit.client.0.smithi073.stdout:2/973: fdatasync d5/ffb 0 2024-04-19T02:18:35.808 INFO:tasks.workunit.client.0.smithi073.stdout:2/974: symlink d5/d10/d14/d18/d3e/d51/l152 0 2024-04-19T02:18:35.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/867: dwrite d8/f11 [0,4194304] 0 2024-04-19T02:18:35.813 INFO:tasks.workunit.client.0.smithi073.stdout:2/975: dwrite d5/d10/d14/d18/fae [0,4194304] 0 2024-04-19T02:18:35.813 INFO:tasks.workunit.client.0.smithi073.stdout:6/868: mkdir d8/d71/d7d/dab/d10e/d11d 0 2024-04-19T02:18:35.815 INFO:tasks.workunit.client.0.smithi073.stdout:2/976: creat d5/d10/d14/d18/d3e/d2d/d63/d138/f153 x:0 0 0 2024-04-19T02:18:35.816 INFO:tasks.workunit.client.0.smithi073.stdout:6/869: link d8/de/d58/d63/f6b d8/d71/d107/dae/f11e 0 2024-04-19T02:18:35.817 INFO:tasks.workunit.client.0.smithi073.stdout:2/977: rename d5/d10/d14/d18/d3e/d51/l61 to d5/d10/d14/d2e/da0/dff/l154 0 2024-04-19T02:18:35.817 INFO:tasks.workunit.client.0.smithi073.stdout:6/870: rename l7 to d8/de/d22/da8/dcf/l11f 0 2024-04-19T02:18:35.817 INFO:tasks.workunit.client.0.smithi073.stdout:2/978: mkdir d5/d10/d14/d18/d3e/de1/d130/d66/d7e/d108/d155 0 2024-04-19T02:18:35.818 INFO:tasks.workunit.client.0.smithi073.stdout:4/868: truncate da/d27/d1b/d26/f4a 8191620 0 2024-04-19T02:18:35.818 INFO:tasks.workunit.client.0.smithi073.stdout:2/979: fdatasync d5/d10/fec 0 2024-04-19T02:18:35.818 INFO:tasks.workunit.client.0.smithi073.stdout:6/871: dread - d8/de/d58/d63/d82/f11a zero size 2024-04-19T02:18:35.819 INFO:tasks.workunit.client.0.smithi073.stdout:4/869: rename da/d27/d1b/c123 to da/d27/d1b/d1d/d8d/c12f 0 2024-04-19T02:18:35.819 INFO:tasks.workunit.client.0.smithi073.stdout:2/980: symlink d5/d10/d14/d18/d3e/de1/d130/dcb/l156 0 2024-04-19T02:18:35.820 INFO:tasks.workunit.client.0.smithi073.stdout:7/949: write d0/dc/d67/f65 [1864545,61955] 0 2024-04-19T02:18:35.820 INFO:tasks.workunit.client.0.smithi073.stdout:5/946: truncate d0/d1d/d25/d35/d39/ffc 1090457 0 2024-04-19T02:18:35.820 INFO:tasks.workunit.client.0.smithi073.stdout:7/950: creat d0/dc/db7/f11f x:0 0 0 2024-04-19T02:18:35.821 INFO:tasks.workunit.client.0.smithi073.stdout:2/981: mkdir d5/d10/d14/d18/d3e/de1/d130/d66/d7e/d108/d157 0 2024-04-19T02:18:35.821 INFO:tasks.workunit.client.0.smithi073.stdout:5/947: chown d0/d1d/d25/l56 78762486 1 2024-04-19T02:18:35.822 INFO:tasks.workunit.client.0.smithi073.stdout:2/982: write d5/d10/d14/d2e/da0/dc0/f118 [487713,29815] 0 2024-04-19T02:18:35.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:35.824 INFO:tasks.workunit.client.0.smithi073.stdout:2/983: mknod d5/d10/d14/d2e/d9c/c158 0 2024-04-19T02:18:35.824 INFO:tasks.workunit.client.0.smithi073.stdout:2/984: symlink d5/d10/d14/db6/d101/l159 0 2024-04-19T02:18:35.824 INFO:tasks.workunit.client.0.smithi073.stdout:2/985: write d5/d10/f7d [538706,14136] 0 2024-04-19T02:18:35.825 INFO:tasks.workunit.client.0.smithi073.stdout:2/986: write d5/d10/d14/d18/d3e/de1/d130/d42/fa3 [71488,64032] 0 2024-04-19T02:18:35.827 INFO:tasks.workunit.client.0.smithi073.stdout:1/958: write db/d1c/d81/df9/f97 [1227737,127077] 0 2024-04-19T02:18:35.829 INFO:tasks.workunit.client.0.smithi073.stdout:7/951: truncate d0/d28/fc7 3439927 0 2024-04-19T02:18:35.830 INFO:tasks.workunit.client.0.smithi073.stdout:1/959: symlink db/d1c/d81/d83/db8/dd1/l154 0 2024-04-19T02:18:35.831 INFO:tasks.workunit.client.0.smithi073.stdout:7/952: stat d0/d28/d63/c108 0 2024-04-19T02:18:35.832 INFO:tasks.workunit.client.0.smithi073.stdout:4/870: mknod da/d27/d1b/d1d/d72/d2b/d2f/d68/de5/c130 0 2024-04-19T02:18:35.833 INFO:tasks.workunit.client.0.smithi073.stdout:0/944: dwrite d7/d14/d17/d1a/d20/d50/dc2/fdb [0,4194304] 0 2024-04-19T02:18:35.834 INFO:tasks.workunit.client.0.smithi073.stdout:8/957: dwrite d14/d15/d17/f1f [0,4194304] 0 2024-04-19T02:18:35.834 INFO:tasks.workunit.client.0.smithi073.stdout:2/987: dwrite d5/d10/d14/d18/d3e/de1/d130/d66/d67/f11a [0,4194304] 0 2024-04-19T02:18:35.835 INFO:tasks.workunit.client.0.smithi073.stdout:8/958: rmdir d14/d15/d17/d48/d89/d97/d124 39 2024-04-19T02:18:35.835 INFO:tasks.workunit.client.0.smithi073.stdout:7/953: mkdir d0/dc/d33/d36/d7b/db4/d10b/def/d120 0 2024-04-19T02:18:35.836 INFO:tasks.workunit.client.0.smithi073.stdout:4/871: link da/d27/d1b/d1d/d72/c33 da/d27/d2c/ddb/d107/c131 0 2024-04-19T02:18:35.836 INFO:tasks.workunit.client.0.smithi073.stdout:7/954: mkdir d0/dc/d33/d36/d7b/d93/d121 0 2024-04-19T02:18:35.837 INFO:tasks.workunit.client.0.smithi073.stdout:4/872: fsync da/d27/d2c/d60/f71 0 2024-04-19T02:18:35.838 INFO:tasks.workunit.client.0.smithi073.stdout:0/945: fdatasync d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba/fff 0 2024-04-19T02:18:35.838 INFO:tasks.workunit.client.0.smithi073.stdout:7/955: rename d0/d3/l1e to d0/d28/d63/l122 0 2024-04-19T02:18:35.838 INFO:tasks.workunit.client.0.smithi073.stdout:4/873: write da/d27/d2c/f30 [2228536,14264] 0 2024-04-19T02:18:35.839 INFO:tasks.workunit.client.0.smithi073.stdout:0/946: fsync d7/d14/d17/d1a/fa0 0 2024-04-19T02:18:35.839 INFO:tasks.workunit.client.0.smithi073.stdout:7/956: unlink d0/f6a 0 2024-04-19T02:18:35.840 INFO:tasks.workunit.client.0.smithi073.stdout:7/957: getdents d0/dc/d33/da7/d11a 0 2024-04-19T02:18:35.842 INFO:tasks.workunit.client.0.smithi073.stdout:7/958: creat d0/d3/d10d/f123 x:0 0 0 2024-04-19T02:18:35.842 INFO:tasks.workunit.client.0.smithi073.stdout:0/947: rename d7/d14/d17/d1a/d20/d50/d99/da7/fdc to d7/d14/d17/d1a/d20/d50/d99/f121 0 2024-04-19T02:18:35.842 INFO:tasks.workunit.client.0.smithi073.stdout:7/959: rmdir d0/dc/d67/d2a/d117/da3 39 2024-04-19T02:18:35.842 INFO:tasks.workunit.client.0.smithi073.stdout:0/948: creat d7/d6d/dc7/f122 x:0 0 0 2024-04-19T02:18:35.842 INFO:tasks.workunit.client.0.smithi073.stdout:7/960: mkdir d0/d3/dbb/d124 0 2024-04-19T02:18:35.843 INFO:tasks.workunit.client.0.smithi073.stdout:0/949: write d7/d14/d17/d1a/d20/d50/d99/da7/f65 [685624,78683] 0 2024-04-19T02:18:35.843 INFO:tasks.workunit.client.0.smithi073.stdout:8/959: read d14/d27/f30 [206672,120142] 0 2024-04-19T02:18:35.843 INFO:tasks.workunit.client.0.smithi073.stdout:0/950: creat d7/d14/f123 x:0 0 0 2024-04-19T02:18:35.844 INFO:tasks.workunit.client.0.smithi073.stdout:0/951: symlink d7/d6d/dbd/l124 0 2024-04-19T02:18:35.845 INFO:tasks.workunit.client.0.smithi073.stdout:0/952: mkdir d7/d14/d17/d1a/d125 0 2024-04-19T02:18:35.845 INFO:tasks.workunit.client.0.smithi073.stdout:8/960: rename d14/d27/d4c/d75/l5f to d14/d15/d17/d48/d89/l146 0 2024-04-19T02:18:35.846 INFO:tasks.workunit.client.0.smithi073.stdout:8/961: chown d14/d27/d29/d31/f5b 63319 1 2024-04-19T02:18:35.846 INFO:tasks.workunit.client.0.smithi073.stdout:9/823: dread d0/df/d16/d19/d38/fab [0,4194304] 0 2024-04-19T02:18:35.847 INFO:tasks.workunit.client.0.smithi073.stdout:8/962: symlink d14/d27/d29/d64/l147 0 2024-04-19T02:18:35.847 INFO:tasks.workunit.client.0.smithi073.stdout:9/824: creat d0/df/d16/d19/d38/d5d/d5e/f11f x:0 0 0 2024-04-19T02:18:35.848 INFO:tasks.workunit.client.0.smithi073.stdout:8/963: mknod d14/d87/c148 0 2024-04-19T02:18:35.849 INFO:tasks.workunit.client.0.smithi073.stdout:9/825: mknod d0/df/d16/d19/c120 0 2024-04-19T02:18:35.849 INFO:tasks.workunit.client.0.smithi073.stdout:8/964: truncate d14/d27/d4c/d75/fb8 6127723 0 2024-04-19T02:18:35.850 INFO:tasks.workunit.client.0.smithi073.stdout:8/965: mknod d14/d15/d17/d48/d119/c149 0 2024-04-19T02:18:35.851 INFO:tasks.workunit.client.0.smithi073.stdout:8/966: dread - d14/d15/d17/d48/d89/d97/d124/ff5 zero size 2024-04-19T02:18:35.851 INFO:tasks.workunit.client.0.smithi073.stdout:8/967: chown d14/f9f 137 1 2024-04-19T02:18:35.853 INFO:tasks.workunit.client.0.smithi073.stdout:1/960: sync 2024-04-19T02:18:35.855 INFO:tasks.workunit.client.0.smithi073.stdout:9/826: dwrite d0/f13 [4194304,4194304] 0 2024-04-19T02:18:35.858 INFO:tasks.workunit.client.0.smithi073.stdout:6/872: dread d8/d71/d75/f91 [0,4194304] 0 2024-04-19T02:18:35.858 INFO:tasks.workunit.client.0.smithi073.stdout:1/961: dread db/d1c/d54/f113 [0,4194304] 0 2024-04-19T02:18:35.858 INFO:tasks.workunit.client.0.smithi073.stdout:1/962: stat db/d1c/d81/d83 0 2024-04-19T02:18:35.858 INFO:tasks.workunit.client.0.smithi073.stdout:8/968: dwrite d14/d15/d17/d48/d89/d97/d124/fde [0,4194304] 0 2024-04-19T02:18:35.858 INFO:tasks.workunit.client.0.smithi073.stdout:1/963: unlink db/fac 0 2024-04-19T02:18:35.859 INFO:tasks.workunit.client.0.smithi073.stdout:6/873: creat d8/de/f120 x:0 0 0 2024-04-19T02:18:35.861 INFO:tasks.workunit.client.0.smithi073.stdout:8/969: fdatasync d14/d15/d17/d99/fcd 0 2024-04-19T02:18:35.862 INFO:tasks.workunit.client.0.smithi073.stdout:6/874: creat d8/d4b/d93/d60/f121 x:0 0 0 2024-04-19T02:18:35.863 INFO:tasks.workunit.client.0.smithi073.stdout:6/875: chown d8/de/c68 8681 1 2024-04-19T02:18:35.864 INFO:tasks.workunit.client.0.smithi073.stdout:9/827: dwrite d0/d81/dda/ddd/dc2/dce/fdc [0,4194304] 0 2024-04-19T02:18:35.865 INFO:tasks.workunit.client.0.smithi073.stdout:4/874: dread da/d27/d1b/d26/f4c [0,4194304] 0 2024-04-19T02:18:35.865 INFO:tasks.workunit.client.0.smithi073.stdout:8/970: write d14/d15/d17/d48/d89/d97/fdf [540504,58634] 0 2024-04-19T02:18:35.865 INFO:tasks.workunit.client.0.smithi073.stdout:6/876: truncate d8/de/d22/fb2 1866650 0 2024-04-19T02:18:35.865 INFO:tasks.workunit.client.0.smithi073.stdout:5/948: dread d0/d1d/f7d [4194304,4194304] 0 2024-04-19T02:18:35.866 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:35.864+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:35.868 INFO:tasks.workunit.client.0.smithi073.stdout:5/949: mkdir d0/d1d/d25/d37/d71/dd6/d12c 0 2024-04-19T02:18:35.868 INFO:tasks.workunit.client.0.smithi073.stdout:8/971: write d14/d27/da4/d13b/f115 [1117588,87175] 0 2024-04-19T02:18:35.869 INFO:tasks.workunit.client.0.smithi073.stdout:2/988: write d5/d10/d14/d18/d3e/de1/d130/d66/d7e/f14b [100676,48505] 0 2024-04-19T02:18:35.869 INFO:tasks.workunit.client.0.smithi073.stdout:7/961: truncate d0/dc/d67/fda 3160038 0 2024-04-19T02:18:35.869 INFO:tasks.workunit.client.0.smithi073.stdout:5/950: chown d0/d127 224583068 1 2024-04-19T02:18:35.870 INFO:tasks.workunit.client.0.smithi073.stdout:1/964: sync 2024-04-19T02:18:35.870 INFO:tasks.workunit.client.0.smithi073.stdout:2/989: write d5/f11 [1429238,72062] 0 2024-04-19T02:18:35.870 INFO:tasks.workunit.client.0.smithi073.stdout:5/951: chown d0/d1d/d24/d61 5902315 1 2024-04-19T02:18:35.873 INFO:tasks.workunit.client.0.smithi073.stdout:6/877: dwrite d8/de/d58/d63/fd4 [0,4194304] 0 2024-04-19T02:18:35.873 INFO:tasks.workunit.client.0.smithi073.stdout:4/875: dwrite da/d27/d3a/d49/fc4 [0,4194304] 0 2024-04-19T02:18:35.874 INFO:tasks.workunit.client.0.smithi073.stdout:1/965: write db/d7f/ded/df4/f10e [1719307,77234] 0 2024-04-19T02:18:35.875 INFO:tasks.workunit.client.0.smithi073.stdout:5/952: rmdir d0/d1d/d25/d35/d88/d119 0 2024-04-19T02:18:35.875 INFO:tasks.workunit.client.0.smithi073.stdout:2/990: rmdir d5/d10/d14/d18/d3e/de1/d130/d66/d7e/d108/d132 0 2024-04-19T02:18:35.876 INFO:tasks.workunit.client.0.smithi073.stdout:6/878: mknod d8/d71/d7d/dab/d10e/c122 0 2024-04-19T02:18:35.876 INFO:tasks.workunit.client.0.smithi073.stdout:1/966: mkdir db/d7f/ded/d155 0 2024-04-19T02:18:35.877 INFO:tasks.workunit.client.0.smithi073.stdout:2/991: readlink d5/d10/d14/d18/d3e/de1/d130/d66/d67/d72/l91 0 2024-04-19T02:18:35.879 INFO:tasks.workunit.client.0.smithi073.stdout:7/962: dwrite d0/dc/d67/d2a/d51/f6c [0,4194304] 0 2024-04-19T02:18:35.879 INFO:tasks.workunit.client.0.smithi073.stdout:2/992: fsync d5/f16 0 2024-04-19T02:18:35.879 INFO:tasks.workunit.client.0.smithi073.stdout:6/879: write d8/de/d7f/fa0 [1950202,46510] 0 2024-04-19T02:18:35.881 INFO:tasks.workunit.client.0.smithi073.stdout:8/972: dwrite d14/d15/df8/f107 [0,4194304] 0 2024-04-19T02:18:35.882 INFO:tasks.workunit.client.0.smithi073.stdout:1/967: rename db/d1c/d78/d8c/dd5/d50/lba to db/d41/d101/d13f/l156 0 2024-04-19T02:18:35.882 INFO:tasks.workunit.client.0.smithi073.stdout:2/993: creat d5/d10/d14/d18/d3e/d2d/f15a x:0 0 0 2024-04-19T02:18:35.882 INFO:tasks.workunit.client.0.smithi073.stdout:0/953: dread d7/d14/f15 [0,4194304] 0 2024-04-19T02:18:35.883 INFO:tasks.workunit.client.0.smithi073.stdout:7/963: fdatasync d0/dc/d67/d2a/d51/d7a/fa5 0 2024-04-19T02:18:35.883 INFO:tasks.workunit.client.0.smithi073.stdout:2/994: fsync d5/d10/d14/d7a/f10c 0 2024-04-19T02:18:35.883 INFO:tasks.workunit.client.0.smithi073.stdout:8/973: creat d14/d15/d17/d48/d89/ddd/f14a x:0 0 0 2024-04-19T02:18:35.883 INFO:tasks.workunit.client.0.smithi073.stdout:4/876: dwrite da/d27/d3a/d97/d122/f6e [4194304,4194304] 0 2024-04-19T02:18:35.885 INFO:tasks.workunit.client.0.smithi073.stdout:8/974: creat d14/d27/d4c/d101/f14b x:0 0 0 2024-04-19T02:18:35.885 INFO:tasks.workunit.client.0.smithi073.stdout:0/954: creat d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/d108/f126 x:0 0 0 2024-04-19T02:18:35.885 INFO:tasks.workunit.client.0.smithi073.stdout:2/995: rmdir d5/d10/d14/d2e/da0/dc0/d123 0 2024-04-19T02:18:35.886 INFO:tasks.workunit.client.0.smithi073.stdout:8/975: write d14/dbc/f142 [332073,113105] 0 2024-04-19T02:18:35.886 INFO:tasks.workunit.client.0.smithi073.stdout:8/976: sync 2024-04-19T02:18:35.888 INFO:tasks.workunit.client.0.smithi073.stdout:2/996: creat d5/d10/d14/d18/d3e/de1/d130/dcb/f15b x:0 0 0 2024-04-19T02:18:35.889 INFO:tasks.workunit.client.0.smithi073.stdout:2/997: mkdir d5/d10/d14/d18/d3e/de1/d130/d66/d67/df1/d15c 0 2024-04-19T02:18:35.889 INFO:tasks.workunit.client.0.smithi073.stdout:6/880: dwrite d8/fc0 [0,4194304] 0 2024-04-19T02:18:35.890 INFO:tasks.workunit.client.0.smithi073.stdout:2/998: readlink d5/d10/d14/d18/d3e/d2d/l6c 0 2024-04-19T02:18:35.890 INFO:tasks.workunit.client.0.smithi073.stdout:6/881: creat d8/de/d22/da8/f123 x:0 0 0 2024-04-19T02:18:35.893 INFO:tasks.workunit.client.0.smithi073.stdout:4/877: dwrite da/d27/feb [0,4194304] 0 2024-04-19T02:18:35.894 INFO:tasks.workunit.client.0.smithi073.stdout:6/882: creat d8/de/d22/da8/d116/f124 x:0 0 0 2024-04-19T02:18:35.894 INFO:tasks.workunit.client.0.smithi073.stdout:4/878: write da/d27/d1b/d8c/fc0 [860864,2247] 0 2024-04-19T02:18:35.898 INFO:tasks.workunit.client.0.smithi073.stdout:4/879: dwrite da/d27/d2c/da6/fcd [0,4194304] 0 2024-04-19T02:18:35.906 INFO:tasks.workunit.client.0.smithi073.stdout:9/828: dread d0/df/d1d/f32 [0,4194304] 0 2024-04-19T02:18:35.907 INFO:tasks.workunit.client.0.smithi073.stdout:9/829: unlink d0/df/df0/l11d 0 2024-04-19T02:18:35.911 INFO:tasks.workunit.client.0.smithi073.stdout:2/999: dread d5/d10/d14/d18/d3e/de1/d130/d66/d83/faa [0,4194304] 0 2024-04-19T02:18:35.917 INFO:tasks.workunit.client.0.smithi073.stdout:7/964: dread d0/d3/f46 [0,4194304] 0 2024-04-19T02:18:35.919 INFO:tasks.workunit.client.0.smithi073.stdout:4/880: dread da/d27/d1b/d1d/d72/d2b/faf [4194304,4194304] 0 2024-04-19T02:18:35.920 INFO:tasks.workunit.client.0.smithi073.stdout:4/881: getdents da/d27/d1b/d26/d2a 0 2024-04-19T02:18:35.922 INFO:tasks.workunit.client.0.smithi073.stdout:5/953: truncate d0/d1d/d1e/f2b 1804866 0 2024-04-19T02:18:35.923 INFO:tasks.workunit.client.0.smithi073.stdout:1/968: rename db/d1c/d78/d8c to db/d1c/d81/d86/d145/d157 0 2024-04-19T02:18:35.923 INFO:tasks.workunit.client.0.smithi073.stdout:8/977: rmdir d14/d15/d17/d48 39 2024-04-19T02:18:35.925 INFO:tasks.workunit.client.0.smithi073.stdout:0/955: rename d7/d14/d17/d1a/d21/f5e to d7/d14/d17/d1a/d20/d50/f127 0 2024-04-19T02:18:35.925 INFO:tasks.workunit.client.0.smithi073.stdout:8/978: chown d14/d27/d29/f79 194821 1 2024-04-19T02:18:35.925 INFO:tasks.workunit.client.0.smithi073.stdout:7/965: rename d0/dc/d67/d2a/l61 to d0/d3/d10d/l125 0 2024-04-19T02:18:35.925 INFO:tasks.workunit.client.0.smithi073.stdout:0/956: chown d7/d14/fdf 85137313 1 2024-04-19T02:18:35.926 INFO:tasks.workunit.client.0.smithi073.stdout:8/979: dread - d14/d27/d85/d9b/ff0 zero size 2024-04-19T02:18:35.928 INFO:tasks.workunit.client.0.smithi073.stdout:4/882: dwrite da/d27/d3a/d97/d122/d4d/f120 [0,4194304] 0 2024-04-19T02:18:35.928 INFO:tasks.workunit.client.0.smithi073.stdout:5/954: dread d0/d1d/d25/d35/f49 [0,4194304] 0 2024-04-19T02:18:35.929 INFO:tasks.workunit.client.0.smithi073.stdout:8/980: rename d14/d15/d17/d48/d89/d97 to d14/d27/d85/d14c 0 2024-04-19T02:18:35.930 INFO:tasks.workunit.client.0.smithi073.stdout:0/957: rename d7/d14/d17/d1a/d20/d50/d99/lc4 to d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/d108/l128 0 2024-04-19T02:18:35.930 INFO:tasks.workunit.client.0.smithi073.stdout:4/883: write da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/fce [4418327,20950] 0 2024-04-19T02:18:35.931 INFO:tasks.workunit.client.0.smithi073.stdout:6/883: dread d8/d4b/d93/f5d [0,4194304] 0 2024-04-19T02:18:35.931 INFO:tasks.workunit.client.0.smithi073.stdout:0/958: mkdir d7/d14/d17/d129 0 2024-04-19T02:18:35.931 INFO:tasks.workunit.client.0.smithi073.stdout:7/966: dread d0/dc/d67/d2a/d51/f6c [0,4194304] 0 2024-04-19T02:18:35.931 INFO:tasks.workunit.client.0.smithi073.stdout:6/884: write d8/de/f1f [2514213,124621] 0 2024-04-19T02:18:35.932 INFO:tasks.workunit.client.0.smithi073.stdout:7/967: stat d0/dc/l22 0 2024-04-19T02:18:35.932 INFO:tasks.workunit.client.0.smithi073.stdout:5/955: creat d0/d1d/d25/d35/d96/dd3/f12d x:0 0 0 2024-04-19T02:18:35.932 INFO:tasks.workunit.client.0.smithi073.stdout:0/959: stat d7/d14/d17/d1a/d20/d50/d99/da7/d87/ce0 0 2024-04-19T02:18:35.933 INFO:tasks.workunit.client.0.smithi073.stdout:5/956: fdatasync d0/d2d/f60 0 2024-04-19T02:18:35.933 INFO:tasks.workunit.client.0.smithi073.stdout:7/968: chown d0/dc/db7/f11f 24669822 1 2024-04-19T02:18:35.934 INFO:tasks.workunit.client.0.smithi073.stdout:7/969: dread - d0/dc/db7/f11f zero size 2024-04-19T02:18:35.935 INFO:tasks.workunit.client.0.smithi073.stdout:7/970: chown d0/d3/fc8 202905623 1 2024-04-19T02:18:35.935 INFO:tasks.workunit.client.0.smithi073.stdout:6/885: getdents d8/d71/d7d/dab 0 2024-04-19T02:18:35.936 INFO:tasks.workunit.client.0.smithi073.stdout:5/957: getdents d0/d1d/d25/d35/dbf/de9 0 2024-04-19T02:18:35.936 INFO:tasks.workunit.client.0.smithi073.stdout:4/884: dread da/d27/d1b/d1d/d72/d2b/faf [4194304,4194304] 0 2024-04-19T02:18:35.936 INFO:tasks.workunit.client.0.smithi073.stdout:9/830: dread d0/df/d1d/f44 [0,4194304] 0 2024-04-19T02:18:35.936 INFO:tasks.workunit.client.0.smithi073.stdout:9/831: sync 2024-04-19T02:18:35.937 INFO:tasks.workunit.client.0.smithi073.stdout:5/958: write d0/d1d/d90/da0/ffe [40319,25716] 0 2024-04-19T02:18:35.937 INFO:tasks.workunit.client.0.smithi073.stdout:6/886: dread - d8/de/d58/d63/d82/ff5 zero size 2024-04-19T02:18:35.938 INFO:tasks.workunit.client.0.smithi073.stdout:4/885: creat da/d27/d1b/d109/f132 x:0 0 0 2024-04-19T02:18:35.938 INFO:tasks.workunit.client.0.smithi073.stdout:9/832: mknod d0/df/d16/d19/d38/d5d/d5e/d83/c121 0 2024-04-19T02:18:35.939 INFO:tasks.workunit.client.0.smithi073.stdout:6/887: creat d8/d71/d107/f125 x:0 0 0 2024-04-19T02:18:35.939 INFO:tasks.workunit.client.0.smithi073.stdout:9/833: dread - d0/df/d60/fd7 zero size 2024-04-19T02:18:35.939 INFO:tasks.workunit.client.0.smithi073.stdout:1/969: dread db/d41/dc5/fe1 [0,4194304] 0 2024-04-19T02:18:35.939 INFO:tasks.workunit.client.0.smithi073.stdout:9/834: readlink d0/d81/d5c/l69 0 2024-04-19T02:18:35.940 INFO:tasks.workunit.client.0.smithi073.stdout:4/886: getdents da/d27 0 2024-04-19T02:18:35.941 INFO:tasks.workunit.client.0.smithi073.stdout:6/888: chown d8/de/d22/da8/dca/fff 67 1 2024-04-19T02:18:35.941 INFO:tasks.workunit.client.0.smithi073.stdout:7/971: dread d0/dc/d67/d2a/d117/f6b [0,4194304] 0 2024-04-19T02:18:35.941 INFO:tasks.workunit.client.0.smithi073.stdout:0/960: dwrite d7/d14/d17/d1a/d20/fd3 [0,4194304] 0 2024-04-19T02:18:35.941 INFO:tasks.workunit.client.0.smithi073.stdout:7/972: chown d0/d3/dbb 797194399 1 2024-04-19T02:18:35.942 INFO:tasks.workunit.client.0.smithi073.stdout:0/961: sync 2024-04-19T02:18:35.944 INFO:tasks.workunit.client.0.smithi073.stdout:4/887: truncate da/d27/d1b/d1d/d72/dd5/fe3 392865 0 2024-04-19T02:18:35.944 INFO:tasks.workunit.client.0.smithi073.stdout:5/959: dwrite d0/d1d/d64/ff4 [0,4194304] 0 2024-04-19T02:18:35.946 INFO:tasks.workunit.client.0.smithi073.stdout:7/973: getdents d0/dc/d33/d36/d7b/db4 0 2024-04-19T02:18:35.947 INFO:tasks.workunit.client.0.smithi073.stdout:5/960: symlink d0/d1d/d24/df5/l12e 0 2024-04-19T02:18:35.948 INFO:tasks.workunit.client.0.smithi073.stdout:0/962: truncate d7/d14/d17/d1a/d20/d50/d99/da7/d9e/dba/fff 479299 0 2024-04-19T02:18:35.948 INFO:tasks.workunit.client.0.smithi073.stdout:7/974: creat d0/dc/d33/d36/d7b/f126 x:0 0 0 2024-04-19T02:18:35.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/981: dwrite d14/d27/d4c/f6b [0,4194304] 0 2024-04-19T02:18:35.949 INFO:tasks.workunit.client.0.smithi073.stdout:4/888: read da/d27/d3a/d97/fbb [135430,61943] 0 2024-04-19T02:18:35.949 INFO:tasks.workunit.client.0.smithi073.stdout:5/961: write d0/d1d/d25/d35/d39/d10f/f129 [562414,47506] 0 2024-04-19T02:18:35.949 INFO:tasks.workunit.client.0.smithi073.stdout:8/982: write d14/d87/f96 [761159,59098] 0 2024-04-19T02:18:35.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/975: mkdir d0/dc/d39/d40/d127 0 2024-04-19T02:18:35.954 INFO:tasks.workunit.client.0.smithi073.stdout:8/983: write d14/d15/d17/da1/f12a [158157,44906] 0 2024-04-19T02:18:35.954 INFO:tasks.workunit.client.0.smithi073.stdout:1/970: dwrite db/d1c/d81/d83/db8/dd1/f14e [0,4194304] 0 2024-04-19T02:18:35.955 INFO:tasks.workunit.client.0.smithi073.stdout:7/976: truncate d0/dc/d33/f119 407237 0 2024-04-19T02:18:35.956 INFO:tasks.workunit.client.0.smithi073.stdout:1/971: write db/d1c/d78/dcf/fde [625087,105060] 0 2024-04-19T02:18:35.957 INFO:tasks.workunit.client.0.smithi073.stdout:0/963: dwrite d7/d14/d17/d1a/d21/dc9/f10c [0,4194304] 0 2024-04-19T02:18:35.957 INFO:tasks.workunit.client.0.smithi073.stdout:6/889: dread d8/de/d78/f7e [0,4194304] 0 2024-04-19T02:18:35.958 INFO:tasks.workunit.client.0.smithi073.stdout:4/889: dwrite da/d27/feb [0,4194304] 0 2024-04-19T02:18:35.959 INFO:tasks.workunit.client.0.smithi073.stdout:0/964: fsync d7/d14/d17/d1a/d20/f4c 0 2024-04-19T02:18:35.959 INFO:tasks.workunit.client.0.smithi073.stdout:1/972: symlink db/d1c/d81/d86/d145/d157/d10c/l158 0 2024-04-19T02:18:35.959 INFO:tasks.workunit.client.0.smithi073.stdout:6/890: unlink d8/d4b/d93/d86/fa6 0 2024-04-19T02:18:35.960 INFO:tasks.workunit.client.0.smithi073.stdout:1/973: fsync db/d1c/d81/df9/f47 0 2024-04-19T02:18:35.960 INFO:tasks.workunit.client.0.smithi073.stdout:5/962: truncate d0/d1d/d25/d37/f118 4096015 0 2024-04-19T02:18:35.960 INFO:tasks.workunit.client.0.smithi073.stdout:6/891: fsync d8/d4b/d93/fde 0 2024-04-19T02:18:35.960 INFO:tasks.workunit.client.0.smithi073.stdout:4/890: chown da/d27/d1b/d1d/d72/dd5/c10b 3577288 1 2024-04-19T02:18:35.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/965: chown d7/d14/d17/d1a/d20/d50/d99/da7/d87/l97 438 1 2024-04-19T02:18:35.960 INFO:tasks.workunit.client.0.smithi073.stdout:5/963: readlink d0/d1d/d25/d37/l58 0 2024-04-19T02:18:35.961 INFO:tasks.workunit.client.0.smithi073.stdout:1/974: chown db/d1c/d81/df9/ce8 186 1 2024-04-19T02:18:35.961 INFO:tasks.workunit.client.0.smithi073.stdout:6/892: write d8/d71/d107/f125 [661782,50113] 0 2024-04-19T02:18:35.961 INFO:tasks.workunit.client.0.smithi073.stdout:4/891: chown da/d27/d2c/d80/fee 45 1 2024-04-19T02:18:35.962 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:35.959+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:35.962 INFO:tasks.workunit.client.0.smithi073.stdout:5/964: unlink d0/d1d/d25/d35/d96/lea 0 2024-04-19T02:18:35.962 INFO:tasks.workunit.client.0.smithi073.stdout:5/965: sync 2024-04-19T02:18:35.962 INFO:tasks.workunit.client.0.smithi073.stdout:6/893: mknod d8/d71/d107/dae/dc3/c126 0 2024-04-19T02:18:35.964 INFO:tasks.workunit.client.0.smithi073.stdout:4/892: mknod da/d27/d1b/d1d/c133 0 2024-04-19T02:18:35.964 INFO:tasks.workunit.client.0.smithi073.stdout:4/893: write da/d27/d1b/d1d/d72/dd5/f101 [1490683,101097] 0 2024-04-19T02:18:35.966 INFO:tasks.workunit.client.0.smithi073.stdout:4/894: rename da/d27/d2c/ddb/d107/dfc/d110/f11b to da/d27/d3a/d97/f134 0 2024-04-19T02:18:35.967 INFO:tasks.workunit.client.0.smithi073.stdout:0/966: truncate d7/d6d/f91 3557598 0 2024-04-19T02:18:35.967 INFO:tasks.workunit.client.0.smithi073.stdout:4/895: write da/d27/d1b/d1d/d72/f96 [199781,84184] 0 2024-04-19T02:18:35.968 INFO:tasks.workunit.client.0.smithi073.stdout:0/967: mkdir d7/d14/d17/d69/d7c/d12a 0 2024-04-19T02:18:35.968 INFO:tasks.workunit.client.0.smithi073.stdout:1/975: dwrite db/d1c/d81/d86/d145/d157/dd5/f61 [0,4194304] 0 2024-04-19T02:18:35.968 INFO:tasks.workunit.client.0.smithi073.stdout:4/896: symlink da/d27/d1b/d26/l135 0 2024-04-19T02:18:35.969 INFO:tasks.workunit.client.0.smithi073.stdout:7/977: dread d0/f3c [0,4194304] 0 2024-04-19T02:18:35.969 INFO:tasks.workunit.client.0.smithi073.stdout:4/897: symlink da/d27/d3a/d97/d122/d4d/l136 0 2024-04-19T02:18:35.969 INFO:tasks.workunit.client.0.smithi073.stdout:0/968: write d7/d14/d17/d1a/d8d/dea/fe2 [988329,13106] 0 2024-04-19T02:18:35.970 INFO:tasks.workunit.client.0.smithi073.stdout:4/898: creat da/d27/d1b/d1d/d8d/f137 x:0 0 0 2024-04-19T02:18:35.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/976: rename db/d1c/d81/d83/db8/dd1/f105 to db/d1c/d81/d86/d145/d157/dd5/f159 0 2024-04-19T02:18:35.970 INFO:tasks.workunit.client.0.smithi073.stdout:0/969: mkdir d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d12b 0 2024-04-19T02:18:35.971 INFO:tasks.workunit.client.0.smithi073.stdout:4/899: mknod da/d27/d1b/d1d/d72/dd5/de7/c138 0 2024-04-19T02:18:35.971 INFO:tasks.workunit.client.0.smithi073.stdout:5/966: read d0/d1d/d25/d37/d71/dd6/f92 [2292012,96354] 0 2024-04-19T02:18:35.971 INFO:tasks.workunit.client.0.smithi073.stdout:0/970: creat d7/d14/d17/d69/f12c x:0 0 0 2024-04-19T02:18:35.972 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:35.972 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:35.973 INFO:tasks.workunit.client.0.smithi073.stdout:1/977: creat db/d1c/d81/d86/d145/d157/dd5/d50/f15a x:0 0 0 2024-04-19T02:18:35.973 INFO:tasks.workunit.client.0.smithi073.stdout:0/971: chown d7/d14/d17/d1a/d21/f53 133219015 1 2024-04-19T02:18:35.973 INFO:tasks.workunit.client.0.smithi073.stdout:4/900: rmdir da/d27/d1b/d1d/d72/d104/ddd/d95 39 2024-04-19T02:18:35.973 INFO:tasks.workunit.client.0.smithi073.stdout:5/967: creat d0/d1d/d25/d35/dbf/de9/f12f x:0 0 0 2024-04-19T02:18:35.973 INFO:tasks.workunit.client.0.smithi073.stdout:0/972: fsync d7/d14/d17/d1a/fa0 0 2024-04-19T02:18:35.973 INFO:tasks.workunit.client.0.smithi073.stdout:5/968: stat d0/d1d/d25/d35/l43 0 2024-04-19T02:18:35.974 INFO:tasks.workunit.client.0.smithi073.stdout:1/978: link db/d1c/d78/dcf/f123 db/d1c/d81/d86/d145/d148/f15b 0 2024-04-19T02:18:35.974 INFO:tasks.workunit.client.0.smithi073.stdout:0/973: creat d7/d14/d17/d1a/d8d/dea/f12d x:0 0 0 2024-04-19T02:18:35.974 INFO:tasks.workunit.client.0.smithi073.stdout:5/969: unlink d0/d1d/d25/d35/f42 0 2024-04-19T02:18:35.975 INFO:tasks.workunit.client.0.smithi073.stdout:0/974: sync 2024-04-19T02:18:35.975 INFO:tasks.workunit.client.0.smithi073.stdout:1/979: mkdir db/d41/d15c 0 2024-04-19T02:18:35.975 INFO:tasks.workunit.client.0.smithi073.stdout:5/970: creat d0/d1d/d25/d37/f130 x:0 0 0 2024-04-19T02:18:35.976 INFO:tasks.workunit.client.0.smithi073.stdout:0/975: unlink d7/d14/d17/d1a/d8d/dea/fe2 0 2024-04-19T02:18:35.976 INFO:tasks.workunit.client.0.smithi073.stdout:1/980: chown db/d1c/d81/d86/d145/d157/dd5/d50/c11e 1624888 1 2024-04-19T02:18:35.976 INFO:tasks.workunit.client.0.smithi073.stdout:0/976: stat d7/d14/d17/d1a/d21/dc9/f10c 0 2024-04-19T02:18:35.976 INFO:tasks.workunit.client.0.smithi073.stdout:5/971: unlink d0/d1d/d90/da0/dbb/fe6 0 2024-04-19T02:18:35.976 INFO:tasks.workunit.client.0.smithi073.stdout:1/981: chown db/d1c/d78/dcf 0 1 2024-04-19T02:18:35.977 INFO:tasks.workunit.client.0.smithi073.stdout:0/977: dread d7/d14/d17/d1a/fb0 [0,4194304] 0 2024-04-19T02:18:35.978 INFO:tasks.workunit.client.0.smithi073.stdout:0/978: chown d7/d14/d17/d1a/d20/d50/d99/da7/f5a 229 1 2024-04-19T02:18:35.978 INFO:tasks.workunit.client.0.smithi073.stdout:0/979: creat d7/d14/d17/d69/d7c/f12e x:0 0 0 2024-04-19T02:18:35.979 INFO:tasks.workunit.client.0.smithi073.stdout:0/980: stat d7/d14/d17/d69/d7c/f8b 0 2024-04-19T02:18:35.979 INFO:tasks.workunit.client.0.smithi073.stdout:0/981: write d7/d14/d17/fa8 [126712,49731] 0 2024-04-19T02:18:35.980 INFO:tasks.workunit.client.0.smithi073.stdout:5/972: dread d0/d1d/d25/d35/f3a [0,4194304] 0 2024-04-19T02:18:35.980 INFO:tasks.workunit.client.0.smithi073.stdout:0/982: stat d7/d14/d17/d69/l103 0 2024-04-19T02:18:35.980 INFO:tasks.workunit.client.0.smithi073.stdout:5/973: sync 2024-04-19T02:18:35.981 INFO:tasks.workunit.client.0.smithi073.stdout:5/974: chown d0/d2d/dac/f10a 6 1 2024-04-19T02:18:35.982 INFO:tasks.workunit.client.0.smithi073.stdout:0/983: getdents d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/d108 0 2024-04-19T02:18:35.984 INFO:tasks.workunit.client.0.smithi073.stdout:9/835: dread d0/df/d16/d19/d38/d5d/d45/f7a [0,4194304] 0 2024-04-19T02:18:35.984 INFO:tasks.workunit.client.0.smithi073.stdout:1/982: read f9 [463260,116305] 0 2024-04-19T02:18:35.985 INFO:tasks.workunit.client.0.smithi073.stdout:9/836: write d0/df/d60/d72/d8e/ff7 [88209,6173] 0 2024-04-19T02:18:35.986 INFO:tasks.workunit.client.0.smithi073.stdout:5/975: dread d0/d1d/d1e/fda [0,4194304] 0 2024-04-19T02:18:35.986 INFO:tasks.workunit.client.0.smithi073.stdout:1/983: link db/d1c/f121 db/d1c/d54/d8b/f15d 0 2024-04-19T02:18:35.987 INFO:tasks.workunit.client.0.smithi073.stdout:5/976: fdatasync d0/d1d/d64/dbd/df9/d110/f124 0 2024-04-19T02:18:35.988 INFO:tasks.workunit.client.0.smithi073.stdout:5/977: write d0/d1d/d25/d35/dc7/f106 [731799,11059] 0 2024-04-19T02:18:35.988 INFO:tasks.workunit.client.0.smithi073.stdout:1/984: mkdir db/d1c/d81/d86/d145/d157/dd5/d50/d62/d15e 0 2024-04-19T02:18:35.988 INFO:tasks.workunit.client.0.smithi073.stdout:0/984: dwrite d7/d14/d17/d69/ffa [0,4194304] 0 2024-04-19T02:18:35.989 INFO:tasks.workunit.client.0.smithi073.stdout:5/978: stat d0/d1d/d25/d35/d39/d10f/f129 0 2024-04-19T02:18:35.989 INFO:tasks.workunit.client.0.smithi073.stdout:5/979: chown d0/d1d/d1e/fda 0 1 2024-04-19T02:18:35.989 INFO:tasks.workunit.client.0.smithi073.stdout:1/985: rmdir db/d1c/d81/d86/d145/d157/dd5/de3/d13e 0 2024-04-19T02:18:35.990 INFO:tasks.workunit.client.0.smithi073.stdout:0/985: mkdir d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d12b/d12f 0 2024-04-19T02:18:35.991 INFO:tasks.workunit.client.0.smithi073.stdout:1/986: symlink db/d1c/d78/dcf/l15f 0 2024-04-19T02:18:35.991 INFO:tasks.workunit.client.0.smithi073.stdout:0/986: rmdir d7/d6d/dbd 39 2024-04-19T02:18:35.991 INFO:tasks.workunit.client.0.smithi073.stdout:5/980: getdents d0/d1d/d25/d35/d96/df0 0 2024-04-19T02:18:35.992 INFO:tasks.workunit.client.0.smithi073.stdout:1/987: truncate db/d1c/f39 324307 0 2024-04-19T02:18:35.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:35.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/988: sync 2024-04-19T02:18:35.993 INFO:tasks.workunit.client.0.smithi073.stdout:0/987: chown d7/d14/d17/d1a/d20/d50/dc2/lf4 96822973 1 2024-04-19T02:18:35.993 INFO:tasks.workunit.client.0.smithi073.stdout:5/981: rename d0/d1d/ce4 to d0/d1d/d25/d35/d39/dd8/c131 0 2024-04-19T02:18:35.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/989: mknod db/d1c/d81/d86/d145/d148/c160 0 2024-04-19T02:18:35.993 INFO:tasks.workunit.client.0.smithi073.stdout:0/988: fdatasync d7/d14/d17/d1a/d8d/fab 0 2024-04-19T02:18:35.993 INFO:tasks.workunit.client.0.smithi073.stdout:6/894: write d8/d71/d7d/f87 [473931,71683] 0 2024-04-19T02:18:35.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/895: write d8/de/d22/fe5 [155253,25694] 0 2024-04-19T02:18:35.994 INFO:tasks.workunit.client.0.smithi073.stdout:4/901: truncate da/d27/d1b/d8c/fc0 828830 0 2024-04-19T02:18:35.995 INFO:tasks.workunit.client.0.smithi073.stdout:5/982: rename d0/c10e to d0/d1d/d25/d35/d96/c132 0 2024-04-19T02:18:35.995 INFO:tasks.workunit.client.0.smithi073.stdout:6/896: unlink d8/d71/d107/d104/c113 0 2024-04-19T02:18:35.997 INFO:tasks.workunit.client.0.smithi073.stdout:6/897: chown d8/cef 1019141 1 2024-04-19T02:18:36.001 INFO:tasks.workunit.client.0.smithi073.stdout:6/898: chown d8/de/d22/da8/dca/lcc 8282 1 2024-04-19T02:18:36.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/989: dwrite d7/d14/d17/d1a/d20/f7a [0,4194304] 0 2024-04-19T02:18:36.002 INFO:tasks.workunit.client.0.smithi073.stdout:6/899: symlink d8/d71/d7d/dab/l127 0 2024-04-19T02:18:36.002 INFO:tasks.workunit.client.0.smithi073.stdout:9/837: dwrite d0/df/d16/d19/d38/d5d/d45/f48 [0,4194304] 0 2024-04-19T02:18:36.003 INFO:tasks.workunit.client.0.smithi073.stdout:4/902: dwrite da/d27/d1b/d26/d2a/d46/fb4 [0,4194304] 0 2024-04-19T02:18:36.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/900: mkdir d8/d4b/d93/d128 0 2024-04-19T02:18:36.004 INFO:tasks.workunit.client.0.smithi073.stdout:4/903: write da/d27/d3a/d50/fbe [1833519,35838] 0 2024-04-19T02:18:36.005 INFO:tasks.workunit.client.0.smithi073.stdout:0/990: write d7/d6d/dbd/f10b [891150,119813] 0 2024-04-19T02:18:36.005 INFO:tasks.workunit.client.0.smithi073.stdout:6/901: mknod d8/d71/d7d/dab/d10e/d11d/c129 0 2024-04-19T02:18:36.009 INFO:tasks.workunit.client.0.smithi073.stdout:8/984: dread d14/d27/d29/d31/d34/f40 [0,4194304] 0 2024-04-19T02:18:36.009 INFO:tasks.workunit.client.0.smithi073.stdout:0/991: mkdir d7/d14/d17/d1a/d21/d130 0 2024-04-19T02:18:36.009 INFO:tasks.workunit.client.0.smithi073.stdout:4/904: mkdir da/d27/d3a/d97/def/d139 0 2024-04-19T02:18:36.009 INFO:tasks.workunit.client.0.smithi073.stdout:0/992: stat d7/d14/c93 0 2024-04-19T02:18:36.010 INFO:tasks.workunit.client.0.smithi073.stdout:4/905: write da/d27/d1b/fbd [2550810,107831] 0 2024-04-19T02:18:36.010 INFO:tasks.workunit.client.0.smithi073.stdout:0/993: truncate d7/d14/d17/d1a/d8d/fab 1494140 0 2024-04-19T02:18:36.012 INFO:tasks.workunit.client.0.smithi073.stdout:8/985: read d14/d27/d29/f52 [1123185,112174] 0 2024-04-19T02:18:36.012 INFO:tasks.workunit.client.0.smithi073.stdout:7/978: dread d0/dc/f5a [0,4194304] 0 2024-04-19T02:18:36.013 INFO:tasks.workunit.client.0.smithi073.stdout:8/986: mkdir d14/d15/d17/da1/d14d 0 2024-04-19T02:18:36.013 INFO:tasks.workunit.client.0.smithi073.stdout:7/979: symlink d0/dc/d67/d2a/d51/l128 0 2024-04-19T02:18:36.013 INFO:tasks.workunit.client.0.smithi073.stdout:8/987: chown d14/d27/d85/d14c/d124/lec 4460 1 2024-04-19T02:18:36.014 INFO:tasks.workunit.client.0.smithi073.stdout:0/994: dread d7/d14/d17/d1a/d20/f7a [0,4194304] 0 2024-04-19T02:18:36.014 INFO:tasks.workunit.client.0.smithi073.stdout:7/980: mkdir d0/d28/d129 0 2024-04-19T02:18:36.015 INFO:tasks.workunit.client.0.smithi073.stdout:7/981: readlink d0/dc/d67/d2a/ld8 0 2024-04-19T02:18:36.015 INFO:tasks.workunit.client.0.smithi073.stdout:0/995: chown d7/d14/d17/d1a/d21/f64 184169 1 2024-04-19T02:18:36.016 INFO:tasks.workunit.client.0.smithi073.stdout:7/982: chown d0/d28/d63/f7f 31 1 2024-04-19T02:18:36.016 INFO:tasks.workunit.client.0.smithi073.stdout:7/983: sync 2024-04-19T02:18:36.017 INFO:tasks.workunit.client.0.smithi073.stdout:7/984: creat d0/d28/f12a x:0 0 0 2024-04-19T02:18:36.018 INFO:tasks.workunit.client.0.smithi073.stdout:7/985: chown d0/l53 1410 1 2024-04-19T02:18:36.018 INFO:tasks.workunit.client.0.smithi073.stdout:0/996: truncate d7/d14/d17/d1a/d20/d50/d99/da7/d6f/d82/d108/f126 412549 0 2024-04-19T02:18:36.019 INFO:tasks.workunit.client.0.smithi073.stdout:4/906: dwrite da/d27/d3a/d97/d122/d4d/d7b/f92 [0,4194304] 0 2024-04-19T02:18:36.019 INFO:tasks.workunit.client.0.smithi073.stdout:7/986: dread - d0/d28/f12a zero size 2024-04-19T02:18:36.019 INFO:tasks.workunit.client.0.smithi073.stdout:4/907: readlink da/d27/d1b/d26/d2a/l38 0 2024-04-19T02:18:36.019 INFO:tasks.workunit.client.0.smithi073.stdout:7/987: mknod d0/d28/c12b 0 2024-04-19T02:18:36.020 INFO:tasks.workunit.client.0.smithi073.stdout:4/908: creat da/d27/d1b/d1d/d72/d2b/d2f/f13a x:0 0 0 2024-04-19T02:18:36.022 INFO:tasks.workunit.client.0.smithi073.stdout:4/909: truncate da/d27/d3a/d97/d122/f51 4063310 0 2024-04-19T02:18:36.022 INFO:tasks.workunit.client.0.smithi073.stdout:4/910: stat da/d27/d3a/f9b 0 2024-04-19T02:18:36.023 INFO:tasks.workunit.client.0.smithi073.stdout:4/911: readlink da/d27/d3a/d49/l93 0 2024-04-19T02:18:36.024 INFO:tasks.workunit.client.0.smithi073.stdout:7/988: read d0/dc/d67/f71 [2678099,37638] 0 2024-04-19T02:18:36.024 INFO:tasks.workunit.client.0.smithi073.stdout:7/989: sync 2024-04-19T02:18:36.025 INFO:tasks.workunit.client.0.smithi073.stdout:7/990: creat d0/dc/d67/d2a/d51/f12c x:0 0 0 2024-04-19T02:18:36.025 INFO:tasks.workunit.client.0.smithi073.stdout:7/991: write d0/d3/d10d/f10e [1098088,18502] 0 2024-04-19T02:18:36.026 INFO:tasks.workunit.client.0.smithi073.stdout:7/992: truncate d0/dc/d33/f35 293903 0 2024-04-19T02:18:36.032 INFO:tasks.workunit.client.0.smithi073.stdout:7/993: dwrite d0/d28/d63/f9e [0,4194304] 0 2024-04-19T02:18:36.033 INFO:tasks.workunit.client.0.smithi073.stdout:7/994: mkdir d0/d3/d10d/d12d 0 2024-04-19T02:18:36.033 INFO:tasks.workunit.client.0.smithi073.stdout:7/995: sync 2024-04-19T02:18:36.033 INFO:tasks.workunit.client.0.smithi073.stdout:8/988: dread d14/d15/d17/d99/d106/f10a [0,4194304] 0 2024-04-19T02:18:36.035 INFO:tasks.workunit.client.0.smithi073.stdout:8/989: rename d14/d27/d4c/f6b to d14/d27/d85/f14e 0 2024-04-19T02:18:36.038 INFO:tasks.workunit.client.0.smithi073.stdout:7/996: dwrite d0/dc/d33/da7/fe6 [0,4194304] 0 2024-04-19T02:18:36.040 INFO:tasks.workunit.client.0.smithi073.stdout:7/997: creat d0/dc/d33/d36/d7b/db4/d10b/f12e x:0 0 0 2024-04-19T02:18:36.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/990: dwrite d14/d27/d7b/fda [0,4194304] 0 2024-04-19T02:18:36.042 INFO:tasks.workunit.client.0.smithi073.stdout:7/998: write d0/dc/d33/d36/f3b [1319437,50084] 0 2024-04-19T02:18:36.042 INFO:tasks.workunit.client.0.smithi073.stdout:7/999: fdatasync d0/d28/d63/f7f 0 2024-04-19T02:18:36.043 INFO:tasks.workunit.client.0.smithi073.stdout:4/912: dread da/d27/d1b/d1d/d72/dd5/f101 [0,4194304] 0 2024-04-19T02:18:36.043 INFO:tasks.workunit.client.0.smithi073.stdout:8/991: getdents d14/d27/da4 0 2024-04-19T02:18:36.043 INFO:tasks.workunit.client.0.smithi073.stdout:8/992: sync 2024-04-19T02:18:36.044 INFO:tasks.workunit.client.0.smithi073.stdout:8/993: creat d14/d15/d17/da1/f14f x:0 0 0 2024-04-19T02:18:36.045 INFO:tasks.workunit.client.0.smithi073.stdout:8/994: symlink d14/d27/d29/de1/l150 0 2024-04-19T02:18:36.046 INFO:tasks.workunit.client.0.smithi073.stdout:6/902: read d8/de/f2a [866382,79124] 0 2024-04-19T02:18:36.046 INFO:tasks.workunit.client.0.smithi073.stdout:6/903: creat d8/d4b/d8f/f12a x:0 0 0 2024-04-19T02:18:36.046 INFO:tasks.workunit.client.0.smithi073.stdout:8/995: mknod d14/d27/d85/d14c/c151 0 2024-04-19T02:18:36.046 INFO:tasks.workunit.client.0.smithi073.stdout:8/996: write d14/d27/d7b/fac [194004,130291] 0 2024-04-19T02:18:36.047 INFO:tasks.workunit.client.0.smithi073.stdout:6/904: link d8/d4b/cc2 d8/de/d58/d11c/c12b 0 2024-04-19T02:18:36.047 INFO:tasks.workunit.client.0.smithi073.stdout:8/997: rename d14/d27/da4/d13b/f8c to d14/d27/d7b/f152 0 2024-04-19T02:18:36.048 INFO:tasks.workunit.client.0.smithi073.stdout:6/905: rename d8/d4b/d93/d86 to d8/d71/d107/d12c 0 2024-04-19T02:18:36.048 INFO:tasks.workunit.client.0.smithi073.stdout:8/998: write d14/d27/d29/d31/d34/fa8 [1398670,29555] 0 2024-04-19T02:18:36.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/906: write d8/de/d7f/fe0 [1737466,95275] 0 2024-04-19T02:18:36.049 INFO:tasks.workunit.client.0.smithi073.stdout:8/999: creat d14/d27/d29/de1/f153 x:0 0 0 2024-04-19T02:18:36.050 INFO:tasks.workunit.client.0.smithi073.stdout:6/907: mkdir d8/d4b/d8f/d12d 0 2024-04-19T02:18:36.050 INFO:tasks.workunit.client.0.smithi073.stdout:6/908: fsync d8/de/d58/d63/d82/f11a 0 2024-04-19T02:18:36.051 INFO:tasks.workunit.client.0.smithi073.stdout:6/909: write d8/f108 [585579,89146] 0 2024-04-19T02:18:36.051 INFO:tasks.workunit.client.0.smithi073.stdout:6/910: chown d8/d4b/df8/f114 10879 1 2024-04-19T02:18:36.052 INFO:tasks.workunit.client.0.smithi073.stdout:6/911: creat d8/d4b/d8f/dd9/f12e x:0 0 0 2024-04-19T02:18:36.053 INFO:tasks.workunit.client.0.smithi073.stdout:6/912: mkdir d8/d4b/d93/d128/d12f 0 2024-04-19T02:18:36.053 INFO:tasks.workunit.client.0.smithi073.stdout:0/997: dread d7/d14/d17/d1a/f7e [0,4194304] 0 2024-04-19T02:18:36.054 INFO:tasks.workunit.client.0.smithi073.stdout:0/998: fdatasync d7/d14/d17/d1a/fc6 0 2024-04-19T02:18:36.055 INFO:tasks.workunit.client.0.smithi073.stdout:0/999: symlink d7/d6d/dbd/l131 0 2024-04-19T02:18:36.056 INFO:tasks.workunit.client.0.smithi073.stdout:1/990: dread db/f30 [0,4194304] 0 2024-04-19T02:18:36.057 INFO:tasks.workunit.client.0.smithi073.stdout:1/991: getdents db/d1c/d81/d83/db8 0 2024-04-19T02:18:36.058 INFO:tasks.workunit.client.0.smithi073.stdout:5/983: dread d0/d1d/d64/dbd/df9/d110/f124 [0,4194304] 0 2024-04-19T02:18:36.059 INFO:tasks.workunit.client.0.smithi073.stdout:5/984: getdents d0/d1d/d25/d35/dbf 0 2024-04-19T02:18:36.060 INFO:tasks.workunit.client.0.smithi073.stdout:5/985: chown d0/d1d/d25/d35/dbf 13656 1 2024-04-19T02:18:36.061 INFO:tasks.workunit.client.0.smithi073.stdout:1/992: truncate db/d41/dc5/fe1 33308 0 2024-04-19T02:18:36.061 INFO:tasks.workunit.client.0.smithi073.stdout:1/993: stat db/d1c/d81/d86/f9e 0 2024-04-19T02:18:36.061 INFO:tasks.workunit.client.0.smithi073.stdout:5/986: creat d0/d1d/d64/dbd/df9/d110/f133 x:0 0 0 2024-04-19T02:18:36.062 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:36.060+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:36.063 INFO:tasks.workunit.client.0.smithi073.stdout:5/987: truncate d0/d1d/d1e/f40 983094 0 2024-04-19T02:18:36.064 INFO:tasks.workunit.client.0.smithi073.stdout:5/988: sync 2024-04-19T02:18:36.064 INFO:tasks.workunit.client.0.smithi073.stdout:5/989: rmdir d0/d1d/d25/d35/dc7 39 2024-04-19T02:18:36.065 INFO:tasks.workunit.client.0.smithi073.stdout:5/990: link d0/d1d/d25/d35/d39/d10f/f129 d0/d1d/d25/d35/d96/f134 0 2024-04-19T02:18:36.065 INFO:tasks.workunit.client.0.smithi073.stdout:5/991: stat d0/l17 0 2024-04-19T02:18:36.066 INFO:tasks.workunit.client.0.smithi073.stdout:5/992: stat d0/d1d/d25/d37/d71/dd6/f92 0 2024-04-19T02:18:36.066 INFO:tasks.workunit.client.0.smithi073.stdout:5/993: fdatasync d0/d1d/d24/d61/fb1 0 2024-04-19T02:18:36.070 INFO:tasks.workunit.client.0.smithi073.stdout:5/994: truncate d0/f5d 3300364 0 2024-04-19T02:18:36.071 INFO:tasks.workunit.client.0.smithi073.stdout:4/913: dread da/d27/d1b/d26/d2a/ff4 [0,4194304] 0 2024-04-19T02:18:36.071 INFO:tasks.workunit.client.0.smithi073.stdout:9/838: dread d0/df/d16/d19/db1/f52 [0,4194304] 0 2024-04-19T02:18:36.071 INFO:tasks.workunit.client.0.smithi073.stdout:5/995: unlink d0/d1d/d25/d37/d71/lcf 0 2024-04-19T02:18:36.072 INFO:tasks.workunit.client.0.smithi073.stdout:4/914: mknod da/d27/d1b/d109/c13b 0 2024-04-19T02:18:36.072 INFO:tasks.workunit.client.0.smithi073.stdout:9/839: mknod d0/df/d16/c122 0 2024-04-19T02:18:36.072 INFO:tasks.workunit.client.0.smithi073.stdout:5/996: mkdir d0/d1d/d90/d135 0 2024-04-19T02:18:36.074 INFO:tasks.workunit.client.0.smithi073.stdout:4/915: rename da/d27/d3a/d97/d122/d4d/d7b/f92 to da/d27/d1b/d1d/d72/d104/ddd/d95/f13c 0 2024-04-19T02:18:36.074 INFO:tasks.workunit.client.0.smithi073.stdout:4/916: mknod da/d27/d1b/d26/d2a/d46/c13d 0 2024-04-19T02:18:36.075 INFO:tasks.workunit.client.0.smithi073.stdout:4/917: chown da/d27/d1b/d1d/d8d/f89 36919091 1 2024-04-19T02:18:36.076 INFO:tasks.workunit.client.0.smithi073.stdout:4/918: rmdir da/d27/d3a/d97/d122/d4d/d7b 39 2024-04-19T02:18:36.077 INFO:tasks.workunit.client.0.smithi073.stdout:4/919: stat da/d27/d1b/d1d/d72/d104 0 2024-04-19T02:18:36.077 INFO:tasks.workunit.client.0.smithi073.stdout:9/840: dwrite d0/df/f21 [0,4194304] 0 2024-04-19T02:18:36.078 INFO:tasks.workunit.client.0.smithi073.stdout:9/841: chown d0/d81/dda/l102 536 1 2024-04-19T02:18:36.078 INFO:tasks.workunit.client.0.smithi073.stdout:4/920: getdents da/d27/d1b/d1d/d72/d2b/d2f/d105 0 2024-04-19T02:18:36.079 INFO:tasks.workunit.client.0.smithi073.stdout:6/913: dread d8/de/d58/d63/d82/f83 [4194304,4194304] 0 2024-04-19T02:18:36.080 INFO:tasks.workunit.client.0.smithi073.stdout:6/914: write d8/de/f32 [651750,105952] 0 2024-04-19T02:18:36.080 INFO:tasks.workunit.client.0.smithi073.stdout:4/921: truncate da/d27/d1b/d26/f4a 8073178 0 2024-04-19T02:18:36.081 INFO:tasks.workunit.client.0.smithi073.stdout:5/997: truncate d0/fa1 418548 0 2024-04-19T02:18:36.082 INFO:tasks.workunit.client.0.smithi073.stdout:4/922: rmdir da/d27/d1b/d1d/d72/d2b/d2f 39 2024-04-19T02:18:36.082 INFO:tasks.workunit.client.0.smithi073.stdout:6/915: link d8/de/d22/da8/l10a d8/de/d7f/dc6/l130 0 2024-04-19T02:18:36.082 INFO:tasks.workunit.client.0.smithi073.stdout:9/842: chown d0/df/d16/d19/db1/d2c/d6b/cf3 15537 1 2024-04-19T02:18:36.083 INFO:tasks.workunit.client.0.smithi073.stdout:4/923: mknod da/d27/d3a/d97/c13e 0 2024-04-19T02:18:36.083 INFO:tasks.workunit.client.0.smithi073.stdout:5/998: link d0/d1d/d25/d35/d88/fc3 d0/d1d/d25/d35/d39/dd8/f136 0 2024-04-19T02:18:36.083 INFO:tasks.workunit.client.0.smithi073.stdout:1/994: dread db/d7f/ded/df4/f10e [0,4194304] 0 2024-04-19T02:18:36.084 INFO:tasks.workunit.client.0.smithi073.stdout:4/924: mkdir da/d27/d1b/d1d/d72/d104/d13f 0 2024-04-19T02:18:36.084 INFO:tasks.workunit.client.0.smithi073.stdout:9/843: rename d0/df/d60/f90 to d0/df/f123 0 2024-04-19T02:18:36.084 INFO:tasks.workunit.client.0.smithi073.stdout:5/999: mknod d0/d1d/d25/d35/d39/dd8/c137 0 2024-04-19T02:18:36.084 INFO:tasks.workunit.client.0.smithi073.stdout:1/995: mkdir db/d1c/d81/d83/db8/d161 0 2024-04-19T02:18:36.084 INFO:tasks.workunit.client.0.smithi073.stdout:4/925: mknod da/d27/d2c/d80/c140 0 2024-04-19T02:18:36.085 INFO:tasks.workunit.client.0.smithi073.stdout:9/844: mknod d0/df/d16/da9/c124 0 2024-04-19T02:18:36.085 INFO:tasks.workunit.client.0.smithi073.stdout:4/926: chown da/d27/d2c/d80/c140 153 1 2024-04-19T02:18:36.085 INFO:tasks.workunit.client.0.smithi073.stdout:1/996: rename db/d1c/d81/d86/l150 to db/d41/d101/d13f/l162 0 2024-04-19T02:18:36.085 INFO:tasks.workunit.client.0.smithi073.stdout:1/997: mkdir db/d41/d101/d163 0 2024-04-19T02:18:36.086 INFO:tasks.workunit.client.0.smithi073.stdout:1/998: mkdir db/d7f/d125/d164 0 2024-04-19T02:18:36.087 INFO:tasks.workunit.client.0.smithi073.stdout:9/845: link d0/df/d16/d19/d38/d5d/d5e/d83/lc8 d0/d81/dda/ddd/dc2/dce/l125 0 2024-04-19T02:18:36.087 INFO:tasks.workunit.client.0.smithi073.stdout:9/846: creat d0/df/d16/d19/d38/d5d/d45/f126 x:0 0 0 2024-04-19T02:18:36.088 INFO:tasks.workunit.client.0.smithi073.stdout:9/847: write d0/f13 [197224,98471] 0 2024-04-19T02:18:36.089 INFO:tasks.workunit.client.0.smithi073.stdout:4/927: dread da/d27/d1b/d1d/d72/d104/ddd/d95/f13c [0,4194304] 0 2024-04-19T02:18:36.089 INFO:tasks.workunit.client.0.smithi073.stdout:4/928: chown da/ff7 221978 1 2024-04-19T02:18:36.090 INFO:tasks.workunit.client.0.smithi073.stdout:4/929: symlink da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/l141 0 2024-04-19T02:18:36.091 INFO:tasks.workunit.client.0.smithi073.stdout:6/916: truncate d8/dda/ff1 2417870 0 2024-04-19T02:18:36.091 INFO:tasks.workunit.client.0.smithi073.stdout:4/930: write da/d27/d1b/d1d/d72/d2b/f32 [3467320,102271] 0 2024-04-19T02:18:36.092 INFO:tasks.workunit.client.0.smithi073.stdout:6/917: dread - d8/de/d7f/dc6/f100 zero size 2024-04-19T02:18:36.093 INFO:tasks.workunit.client.0.smithi073.stdout:6/918: mkdir d8/d4b/d8f/d131 0 2024-04-19T02:18:36.093 INFO:tasks.workunit.client.0.smithi073.stdout:6/919: symlink d8/de/d22/da8/l132 0 2024-04-19T02:18:36.094 INFO:tasks.workunit.client.0.smithi073.stdout:9/848: dwrite d0/df/d16/d19/d38/d5d/d5e/d83/fd2 [0,4194304] 0 2024-04-19T02:18:36.095 INFO:tasks.workunit.client.0.smithi073.stdout:9/849: fdatasync d0/f1f 0 2024-04-19T02:18:36.096 INFO:tasks.workunit.client.0.smithi073.stdout:1/999: write db/d1c/d81/d83/db8/dd1/f104 [3165029,86665] 0 2024-04-19T02:18:36.096 INFO:tasks.workunit.client.0.smithi073.stdout:9/850: unlink d0/df/f21 0 2024-04-19T02:18:36.097 INFO:tasks.workunit.client.0.smithi073.stdout:9/851: creat d0/df/d16/d19/d38/d5d/d76/d7d/d88/f127 x:0 0 0 2024-04-19T02:18:36.099 INFO:tasks.workunit.client.0.smithi073.stdout:9/852: rename d0/df/d16/d19/d38/l59 to d0/df/d16/d19/db1/d2c/d2e/l128 0 2024-04-19T02:18:36.099 INFO:tasks.workunit.client.0.smithi073.stdout:9/853: rmdir d0/d81/dda 39 2024-04-19T02:18:36.099 INFO:tasks.workunit.client.0.smithi073.stdout:4/931: dwrite da/d27/d1b/d8c/db7/fd1 [0,4194304] 0 2024-04-19T02:18:36.101 INFO:tasks.workunit.client.0.smithi073.stdout:4/932: write da/d27/d2c/da6/f100 [153743,125960] 0 2024-04-19T02:18:36.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/854: truncate d0/df/d16/d19/d38/d5d/d45/f105 361797 0 2024-04-19T02:18:36.102 INFO:tasks.workunit.client.0.smithi073.stdout:4/933: creat da/d27/d3a/d97/def/d139/f142 x:0 0 0 2024-04-19T02:18:36.103 INFO:tasks.workunit.client.0.smithi073.stdout:9/855: write d0/df/d16/d19/d38/d5d/d76/f10a [226576,87750] 0 2024-04-19T02:18:36.104 INFO:tasks.workunit.client.0.smithi073.stdout:9/856: symlink d0/df/d16/d19/d38/d5d/d5e/l129 0 2024-04-19T02:18:36.104 INFO:tasks.workunit.client.0.smithi073.stdout:9/857: chown d0/df/d16/d19/db1/f52 2 1 2024-04-19T02:18:36.105 INFO:tasks.workunit.client.0.smithi073.stdout:9/858: fsync d0/df/f78 0 2024-04-19T02:18:36.106 INFO:tasks.workunit.client.0.smithi073.stdout:9/859: chown d0/d81/dda/ddd/dc2/dec/f100 24400786 1 2024-04-19T02:18:36.108 INFO:tasks.workunit.client.0.smithi073.stdout:4/934: dwrite da/d27/d1b/d1d/d8d/d84/f9e [0,4194304] 0 2024-04-19T02:18:36.109 INFO:tasks.workunit.client.0.smithi073.stdout:4/935: symlink da/d27/d2c/ddb/l143 0 2024-04-19T02:18:36.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/936: truncate da/d27/d2c/da6/f100 1045893 0 2024-04-19T02:18:36.113 INFO:tasks.workunit.client.0.smithi073.stdout:9/860: dwrite d0/df/d16/d19/db1/f63 [4194304,4194304] 0 2024-04-19T02:18:36.114 INFO:tasks.workunit.client.0.smithi073.stdout:9/861: creat d0/d81/dda/ddd/dc2/dce/f12a x:0 0 0 2024-04-19T02:18:36.115 INFO:tasks.workunit.client.0.smithi073.stdout:9/862: write d0/df/d16/d19/db1/d2c/d2e/f4b [1603710,70758] 0 2024-04-19T02:18:36.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/863: fsync d0/d81/dda/ddd/dc2/dce/fdc 0 2024-04-19T02:18:36.116 INFO:tasks.workunit.client.0.smithi073.stdout:6/920: dread d8/de/d22/fb2 [0,4194304] 0 2024-04-19T02:18:36.117 INFO:tasks.workunit.client.0.smithi073.stdout:6/921: stat d8/d4b/d8f/f12a 0 2024-04-19T02:18:36.117 INFO:tasks.workunit.client.0.smithi073.stdout:9/864: write d0/df9/f119 [2233019,76296] 0 2024-04-19T02:18:36.118 INFO:tasks.workunit.client.0.smithi073.stdout:4/937: dwrite da/d27/d2c/d80/f8e [8388608,4194304] 0 2024-04-19T02:18:36.118 INFO:tasks.workunit.client.0.smithi073.stdout:9/865: mknod d0/df/d16/d19/db1/d2c/d2e/c12b 0 2024-04-19T02:18:36.118 INFO:tasks.workunit.client.0.smithi073.stdout:4/938: fdatasync da/d27/d3a/d50/fbe 0 2024-04-19T02:18:36.119 INFO:tasks.workunit.client.0.smithi073.stdout:9/866: creat d0/df/d16/d19/db1/dd4/f12c x:0 0 0 2024-04-19T02:18:36.123 INFO:tasks.workunit.client.0.smithi073.stdout:6/922: sync 2024-04-19T02:18:36.123 INFO:tasks.workunit.client.0.smithi073.stdout:6/923: rmdir d8/de/d58 39 2024-04-19T02:18:36.124 INFO:tasks.workunit.client.0.smithi073.stdout:6/924: mkdir d8/de/d58/d63/d133 0 2024-04-19T02:18:36.125 INFO:tasks.workunit.client.0.smithi073.stdout:6/925: dread - d8/de/d7f/dc6/f100 zero size 2024-04-19T02:18:36.126 INFO:tasks.workunit.client.0.smithi073.stdout:6/926: link d8/d4b/d93/c3e d8/de/d58/c134 0 2024-04-19T02:18:36.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/867: write d0/df/d1d/f32 [457962,101715] 0 2024-04-19T02:18:36.127 INFO:tasks.workunit.client.0.smithi073.stdout:6/927: creat d8/d71/d103/f135 x:0 0 0 2024-04-19T02:18:36.127 INFO:tasks.workunit.client.0.smithi073.stdout:9/868: readlink d0/df/d16/l23 0 2024-04-19T02:18:36.133 INFO:tasks.workunit.client.0.smithi073.stdout:6/928: dwrite f3 [0,4194304] 0 2024-04-19T02:18:36.133 INFO:tasks.workunit.client.0.smithi073.stdout:4/939: dread da/d27/d1b/d1d/d8d/fb3 [0,4194304] 0 2024-04-19T02:18:36.134 INFO:tasks.workunit.client.0.smithi073.stdout:9/869: dwrite d0/df/d16/d19/d38/d5d/d45/f126 [0,4194304] 0 2024-04-19T02:18:36.134 INFO:tasks.workunit.client.0.smithi073.stdout:6/929: write d8/de/f32 [1763187,33112] 0 2024-04-19T02:18:36.134 INFO:tasks.workunit.client.0.smithi073.stdout:4/940: mknod da/d27/d1b/d8c/c144 0 2024-04-19T02:18:36.135 INFO:tasks.workunit.client.0.smithi073.stdout:9/870: mknod d0/df/d16/d19/d38/d5d/d5e/da0/c12d 0 2024-04-19T02:18:36.138 INFO:tasks.workunit.client.0.smithi073.stdout:4/941: link da/d27/d1b/d1d/d72/d2b/d2f/f13a da/d27/d1b/d1d/d72/d104/ddd/d95/f145 0 2024-04-19T02:18:36.139 INFO:tasks.workunit.client.0.smithi073.stdout:6/930: truncate d8/de/d58/d63/f6b 752236 0 2024-04-19T02:18:36.139 INFO:tasks.workunit.client.0.smithi073.stdout:4/942: read da/d27/d1b/d1d/d72/d2b/faf [4780609,5244] 0 2024-04-19T02:18:36.140 INFO:tasks.workunit.client.0.smithi073.stdout:6/931: write d8/de/d22/da8/dca/ffa [386034,80629] 0 2024-04-19T02:18:36.140 INFO:tasks.workunit.client.0.smithi073.stdout:4/943: symlink da/d27/d1b/d1d/d72/d104/ddd/d95/l146 0 2024-04-19T02:18:36.141 INFO:tasks.workunit.client.0.smithi073.stdout:4/944: mkdir da/d27/d3a/d50/d147 0 2024-04-19T02:18:36.142 INFO:tasks.workunit.client.0.smithi073.stdout:6/932: read d8/d71/d75/fd0 [1736009,48154] 0 2024-04-19T02:18:36.142 INFO:tasks.workunit.client.0.smithi073.stdout:9/871: dread d0/df/d16/d19/db1/d2c/d2e/f7f [0,4194304] 0 2024-04-19T02:18:36.143 INFO:tasks.workunit.client.0.smithi073.stdout:6/933: link d8/de/d58/d63/d82/fb0 d8/d71/d7d/dab/d10e/d11b/f136 0 2024-04-19T02:18:36.144 INFO:tasks.workunit.client.0.smithi073.stdout:6/934: creat d8/d71/d7d/dab/d10e/d11d/f137 x:0 0 0 2024-04-19T02:18:36.145 INFO:tasks.workunit.client.0.smithi073.stdout:4/945: dread da/d27/d1b/d1d/d72/d104/ddd/d95/f13c [0,4194304] 0 2024-04-19T02:18:36.146 INFO:tasks.workunit.client.0.smithi073.stdout:4/946: unlink da/d27/d1b/d1d/d72/d104/ddd/f12b 0 2024-04-19T02:18:36.147 INFO:tasks.workunit.client.0.smithi073.stdout:9/872: dwrite d0/f30 [0,4194304] 0 2024-04-19T02:18:36.150 INFO:tasks.workunit.client.0.smithi073.stdout:4/947: rename da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/dd8 to da/d27/d1b/d1d/d72/d2b/d2f/d91/d148 0 2024-04-19T02:18:36.151 INFO:tasks.workunit.client.0.smithi073.stdout:6/935: dwrite d8/de/d22/fc1 [4194304,4194304] 0 2024-04-19T02:18:36.152 INFO:tasks.workunit.client.0.smithi073.stdout:6/936: dread - d8/d4b/d93/d60/f121 zero size 2024-04-19T02:18:36.152 INFO:tasks.workunit.client.0.smithi073.stdout:6/937: write d8/de/f2a [1036916,52605] 0 2024-04-19T02:18:36.153 INFO:tasks.workunit.client.0.smithi073.stdout:4/948: mknod da/d27/d1b/d1d/d72/d2b/d2f/d105/c149 0 2024-04-19T02:18:36.154 INFO:tasks.workunit.client.0.smithi073.stdout:6/938: rename d8/de/d58/cb4 to d8/c138 0 2024-04-19T02:18:36.154 INFO:tasks.workunit.client.0.smithi073.stdout:9/873: dwrite d0/d35/fe2 [0,4194304] 0 2024-04-19T02:18:36.154 INFO:tasks.workunit.client.0.smithi073.stdout:6/939: rmdir d8/de/d58/d63/d82 39 2024-04-19T02:18:36.155 INFO:tasks.workunit.client.0.smithi073.stdout:9/874: mkdir d0/df/d16/d19/db1/d2c/d6b/d12e 0 2024-04-19T02:18:36.155 INFO:tasks.workunit.client.0.smithi073.stdout:6/940: rename d8/de/d58/c6d to d8/de/d22/da8/dcf/c139 0 2024-04-19T02:18:36.156 INFO:tasks.workunit.client.0.smithi073.stdout:6/941: symlink d8/d4b/d8f/d131/l13a 0 2024-04-19T02:18:36.162 INFO:tasks.workunit.client.0.smithi073.stdout:9/875: truncate d0/df/d1d/f17 3742605 0 2024-04-19T02:18:36.163 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:36.159+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:36.163 INFO:tasks.workunit.client.0.smithi073.stdout:6/942: dwrite d8/de/d58/d63/d82/ff5 [0,4194304] 0 2024-04-19T02:18:36.163 INFO:tasks.workunit.client.0.smithi073.stdout:9/876: write d0/df/d16/d19/db1/d2c/d2e/f82 [2040189,120491] 0 2024-04-19T02:18:36.164 INFO:tasks.workunit.client.0.smithi073.stdout:6/943: truncate d8/d71/d107/f109 415797 0 2024-04-19T02:18:36.164 INFO:tasks.workunit.client.0.smithi073.stdout:4/949: dwrite da/ff7 [0,4194304] 0 2024-04-19T02:18:36.165 INFO:tasks.workunit.client.0.smithi073.stdout:9/877: unlink d0/df/d16/d19/d38/d5d/d5e/f11f 0 2024-04-19T02:18:36.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/944: chown d8/de/d58/d63/f6b 460144 1 2024-04-19T02:18:36.166 INFO:tasks.workunit.client.0.smithi073.stdout:6/945: mknod d8/d4b/d93/d60/c13b 0 2024-04-19T02:18:36.166 INFO:tasks.workunit.client.0.smithi073.stdout:6/946: sync 2024-04-19T02:18:36.166 INFO:tasks.workunit.client.0.smithi073.stdout:4/950: rename da/d27/d3a/d97/d122/d4d/d7b/la3 to da/d27/d2c/ddb/d107/dfc/l14a 0 2024-04-19T02:18:36.166 INFO:tasks.workunit.client.0.smithi073.stdout:9/878: truncate d0/df/d16/d19/d38/d5d/d5e/d83/f99 976125 0 2024-04-19T02:18:36.167 INFO:tasks.workunit.client.0.smithi073.stdout:9/879: readlink d0/d81/d5c/l6c 0 2024-04-19T02:18:36.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/947: link d8/d71/l7a d8/d71/d103/l13c 0 2024-04-19T02:18:36.167 INFO:tasks.workunit.client.0.smithi073.stdout:9/880: fsync d0/df/d60/fd7 0 2024-04-19T02:18:36.168 INFO:tasks.workunit.client.0.smithi073.stdout:4/951: rename da/d27/d1b/d1d/d8d/f98 to da/d27/d1b/d1d/d72/d2b/f14b 0 2024-04-19T02:18:36.168 INFO:tasks.workunit.client.0.smithi073.stdout:4/952: chown da/d27/d2c/d60/ff8 1887 1 2024-04-19T02:18:36.169 INFO:tasks.workunit.client.0.smithi073.stdout:6/948: truncate d8/de/d58/d63/d82/f83 9402383 0 2024-04-19T02:18:36.169 INFO:tasks.workunit.client.0.smithi073.stdout:9/881: getdents d0/df/d16/d19/d38/d5d/d76/d7d 0 2024-04-19T02:18:36.169 INFO:tasks.workunit.client.0.smithi073.stdout:6/949: chown d8/de/d7f/dc6/lc4 545386 1 2024-04-19T02:18:36.170 INFO:tasks.workunit.client.0.smithi073.stdout:9/882: link d0/d81/d5c/c79 d0/df/d60/c12f 0 2024-04-19T02:18:36.172 INFO:tasks.workunit.client.0.smithi073.stdout:9/883: mknod d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8/c130 0 2024-04-19T02:18:36.174 INFO:tasks.workunit.client.0.smithi073.stdout:9/884: truncate d0/df/d16/d19/d38/d5d/d76/d7d/fe8 509473 0 2024-04-19T02:18:36.175 INFO:tasks.workunit.client.0.smithi073.stdout:6/950: dwrite d8/de/d58/d63/d82/f106 [0,4194304] 0 2024-04-19T02:18:36.176 INFO:tasks.workunit.client.0.smithi073.stdout:6/951: creat d8/d71/d7d/dab/f13d x:0 0 0 2024-04-19T02:18:36.179 INFO:tasks.workunit.client.0.smithi073.stdout:4/953: dread da/d27/d1b/d8c/fc0 [0,4194304] 0 2024-04-19T02:18:36.180 INFO:tasks.workunit.client.0.smithi073.stdout:9/885: dwrite d0/d81/d5c/fe6 [0,4194304] 0 2024-04-19T02:18:36.180 INFO:tasks.workunit.client.0.smithi073.stdout:4/954: creat da/d27/d2c/dc1/f14c x:0 0 0 2024-04-19T02:18:36.185 INFO:tasks.workunit.client.0.smithi073.stdout:4/955: dwrite da/d27/d1b/d1d/d72/d2b/f32 [4194304,4194304] 0 2024-04-19T02:18:36.186 INFO:tasks.workunit.client.0.smithi073.stdout:4/956: readlink da/d27/d1b/d1d/d72/d104/ddd/d95/l146 0 2024-04-19T02:18:36.187 INFO:tasks.workunit.client.0.smithi073.stdout:6/952: dread d8/de/d58/d63/d82/fb0 [0,4194304] 0 2024-04-19T02:18:36.188 INFO:tasks.workunit.client.0.smithi073.stdout:4/957: mknod da/d27/d1b/d1d/d8d/d84/c14d 0 2024-04-19T02:18:36.189 INFO:tasks.workunit.client.0.smithi073.stdout:6/953: link d8/de/d58/l7c d8/d4b/d93/d128/d12f/l13e 0 2024-04-19T02:18:36.190 INFO:tasks.workunit.client.0.smithi073.stdout:6/954: chown d8/de/d7f/dc6/l10c 8 1 2024-04-19T02:18:36.190 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:36.190 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:36.191 INFO:tasks.workunit.client.0.smithi073.stdout:4/958: link da/d27/d1b/d1d/d72/d104/ddd/df5/c10a da/d27/d3a/d97/d122/c14e 0 2024-04-19T02:18:36.191 INFO:tasks.workunit.client.0.smithi073.stdout:6/955: creat d8/d4b/d8f/d12d/f13f x:0 0 0 2024-04-19T02:18:36.191 INFO:tasks.workunit.client.0.smithi073.stdout:4/959: readlink da/d27/d1b/d26/d2a/l57 0 2024-04-19T02:18:36.192 INFO:tasks.workunit.client.0.smithi073.stdout:6/956: fsync d8/d4b/d93/f57 0 2024-04-19T02:18:36.192 INFO:tasks.workunit.client.0.smithi073.stdout:6/957: creat d8/de/d22/da8/f140 x:0 0 0 2024-04-19T02:18:36.193 INFO:tasks.workunit.client.0.smithi073.stdout:6/958: creat d8/de/d22/da8/dcf/f141 x:0 0 0 2024-04-19T02:18:36.193 INFO:tasks.workunit.client.0.smithi073.stdout:6/959: chown d8/d71/d7d/dab/d10e/d11d 1 1 2024-04-19T02:18:36.198 INFO:tasks.workunit.client.0.smithi073.stdout:6/960: dwrite d8/de/d22/da8/dca/fff [0,4194304] 0 2024-04-19T02:18:36.200 INFO:tasks.workunit.client.0.smithi073.stdout:4/960: write da/d27/d1b/d1d/d72/d104/ddd/d95/f145 [214408,16347] 0 2024-04-19T02:18:36.205 INFO:tasks.workunit.client.0.smithi073.stdout:6/961: dwrite d8/d4b/d8f/d12d/f13f [0,4194304] 0 2024-04-19T02:18:36.207 INFO:tasks.workunit.client.0.smithi073.stdout:6/962: dread d8/de/d22/fb2 [0,4194304] 0 2024-04-19T02:18:36.207 INFO:tasks.workunit.client.0.smithi073.stdout:6/963: symlink d8/l142 0 2024-04-19T02:18:36.208 INFO:tasks.workunit.client.0.smithi073.stdout:9/886: dread d0/d81/dda/ddd/dc2/fe0 [0,4194304] 0 2024-04-19T02:18:36.209 INFO:tasks.workunit.client.0.smithi073.stdout:9/887: symlink d0/df/d16/da9/l131 0 2024-04-19T02:18:36.209 INFO:tasks.workunit.client.0.smithi073.stdout:9/888: dread - d0/d81/dda/ddd/f104 zero size 2024-04-19T02:18:36.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:36.212 INFO:tasks.workunit.client.0.smithi073.stdout:9/889: mknod d0/df/d16/d19/d38/d5d/d76/c132 0 2024-04-19T02:18:36.214 INFO:tasks.workunit.client.0.smithi073.stdout:9/890: truncate d0/df/d16/d19/d38/d5d/d5e/f10f 464749 0 2024-04-19T02:18:36.216 INFO:tasks.workunit.client.0.smithi073.stdout:9/891: truncate d0/df/d16/d19/d38/d5d/d76/d7d/fe8 899336 0 2024-04-19T02:18:36.228 INFO:tasks.workunit.client.0.smithi073.stdout:4/961: sync 2024-04-19T02:18:36.228 INFO:tasks.workunit.client.0.smithi073.stdout:9/892: sync 2024-04-19T02:18:36.228 INFO:tasks.workunit.client.0.smithi073.stdout:4/962: fdatasync da/d27/d1b/d1d/d72/dd5/fe3 0 2024-04-19T02:18:36.228 INFO:tasks.workunit.client.0.smithi073.stdout:4/963: chown da/d27/d3a 15 1 2024-04-19T02:18:36.230 INFO:tasks.workunit.client.0.smithi073.stdout:4/964: read da/d27/d1b/d1d/d8d/fb3 [4061145,36252] 0 2024-04-19T02:18:36.231 INFO:tasks.workunit.client.0.smithi073.stdout:6/964: dread d8/fa4 [0,4194304] 0 2024-04-19T02:18:36.231 INFO:tasks.workunit.client.0.smithi073.stdout:6/965: dread - d8/de/d58/d63/d82/de2/fe4 zero size 2024-04-19T02:18:36.232 INFO:tasks.workunit.client.0.smithi073.stdout:6/966: read - d8/d71/d107/fad zero size 2024-04-19T02:18:36.232 INFO:tasks.workunit.client.0.smithi073.stdout:9/893: truncate d0/d81/dda/ddd/dc2/f101 1809639 0 2024-04-19T02:18:36.233 INFO:tasks.workunit.client.0.smithi073.stdout:9/894: creat d0/df/d16/d19/db1/d2c/d6b/d12e/f133 x:0 0 0 2024-04-19T02:18:36.249 INFO:tasks.workunit.client.0.smithi073.stdout:4/965: dread da/d27/d2c/d60/fa1 [0,4194304] 0 2024-04-19T02:18:36.250 INFO:tasks.workunit.client.0.smithi073.stdout:4/966: mkdir da/d27/d1b/d26/d14f 0 2024-04-19T02:18:36.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/967: stat da/d27/d1b/d1d/d72/d2b/d2f/d91/dcc/fce 0 2024-04-19T02:18:36.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/968: chown da/d27/d3a/d49/c58 2118650637 1 2024-04-19T02:18:36.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/969: write da/d27/d2c/dc1/f14c [487649,79053] 0 2024-04-19T02:18:36.252 INFO:tasks.workunit.client.0.smithi073.stdout:4/970: rmdir da/d27/d3a/d97/d122/d4d/dde 39 2024-04-19T02:18:36.253 INFO:tasks.workunit.client.0.smithi073.stdout:4/971: unlink da/d27/d3a/d50/cb6 0 2024-04-19T02:18:36.254 INFO:tasks.workunit.client.0.smithi073.stdout:9/895: dread d0/df/f123 [0,4194304] 0 2024-04-19T02:18:36.254 INFO:tasks.workunit.client.0.smithi073.stdout:9/896: creat d0/df/d16/d19/f134 x:0 0 0 2024-04-19T02:18:36.255 INFO:tasks.workunit.client.0.smithi073.stdout:9/897: rename d0/df/c115 to d0/dad/c135 0 2024-04-19T02:18:36.258 INFO:tasks.workunit.client.0.smithi073.stdout:4/972: dwrite da/d27/d3a/ff1 [0,4194304] 0 2024-04-19T02:18:36.261 INFO:tasks.workunit.client.0.smithi073.stdout:9/898: dwrite d0/df/d16/d19/db1/f3a [0,4194304] 0 2024-04-19T02:18:36.265 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:36.260+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:36.267 INFO:tasks.workunit.client.0.smithi073.stdout:4/973: dwrite da/d27/d1b/d26/d2a/f11c [0,4194304] 0 2024-04-19T02:18:36.268 INFO:tasks.workunit.client.0.smithi073.stdout:4/974: creat da/d27/d3a/d97/d122/f150 x:0 0 0 2024-04-19T02:18:36.268 INFO:tasks.workunit.client.0.smithi073.stdout:4/975: write da/d27/d3a/f12e [621180,78191] 0 2024-04-19T02:18:36.269 INFO:tasks.workunit.client.0.smithi073.stdout:4/976: creat da/d27/d2c/ddb/d107/dfc/f151 x:0 0 0 2024-04-19T02:18:36.274 INFO:tasks.workunit.client.0.smithi073.stdout:4/977: getdents da/d27/d1b/d26 0 2024-04-19T02:18:36.276 INFO:tasks.workunit.client.0.smithi073.stdout:6/967: dread d8/d4b/d8f/fbc [0,4194304] 0 2024-04-19T02:18:36.277 INFO:tasks.workunit.client.0.smithi073.stdout:6/968: mknod d8/de/d58/d63/d82/de2/dea/c143 0 2024-04-19T02:18:36.280 INFO:tasks.workunit.client.0.smithi073.stdout:4/978: dwrite da/d27/d3a/d97/def/d139/f142 [0,4194304] 0 2024-04-19T02:18:36.280 INFO:tasks.workunit.client.0.smithi073.stdout:4/979: write da/ff7 [1246124,126708] 0 2024-04-19T02:18:36.282 INFO:tasks.workunit.client.0.smithi073.stdout:6/969: dwrite d8/d71/d7d/f87 [0,4194304] 0 2024-04-19T02:18:36.286 INFO:tasks.workunit.client.0.smithi073.stdout:6/970: mkdir d8/de/d22/d144 0 2024-04-19T02:18:36.288 INFO:tasks.workunit.client.0.smithi073.stdout:6/971: getdents d8/d71/d7d/dab/d10e/d11b 0 2024-04-19T02:18:36.288 INFO:tasks.workunit.client.0.smithi073.stdout:6/972: fsync d8/d4b/d93/f57 0 2024-04-19T02:18:36.288 INFO:tasks.workunit.client.0.smithi073.stdout:6/973: chown d8/d71/d7d/dab/d10e/d11d 0 1 2024-04-19T02:18:36.289 INFO:tasks.workunit.client.0.smithi073.stdout:6/974: fsync d8/f16 0 2024-04-19T02:18:36.289 INFO:tasks.workunit.client.0.smithi073.stdout:6/975: fsync d8/de/d22/da8/d116/f124 0 2024-04-19T02:18:36.290 INFO:tasks.workunit.client.0.smithi073.stdout:4/980: dread da/d27/d1b/d1d/d72/d2b/d2f/d68/f9f [0,4194304] 0 2024-04-19T02:18:36.290 INFO:tasks.workunit.client.0.smithi073.stdout:6/976: dread - d8/d4b/d93/d60/f121 zero size 2024-04-19T02:18:36.291 INFO:tasks.workunit.client.0.smithi073.stdout:4/981: write da/d27/d1b/d1d/d72/fd9 [1204445,50506] 0 2024-04-19T02:18:36.291 INFO:tasks.workunit.client.0.smithi073.stdout:4/982: chown da/d27/d1b/d26/f4a 348 1 2024-04-19T02:18:36.292 INFO:tasks.workunit.client.0.smithi073.stdout:4/983: mknod da/d27/d1b/c152 0 2024-04-19T02:18:36.292 INFO:tasks.workunit.client.0.smithi073.stdout:4/984: mknod da/d27/d3a/c153 0 2024-04-19T02:18:36.293 INFO:tasks.workunit.client.0.smithi073.stdout:4/985: chown da/d27/d1b/d26/d2a/l56 337 1 2024-04-19T02:18:36.293 INFO:tasks.workunit.client.0.smithi073.stdout:9/899: dread d0/df/d16/d19/d38/d5d/d5e/d83/f99 [0,4194304] 0 2024-04-19T02:18:36.294 INFO:tasks.workunit.client.0.smithi073.stdout:9/900: creat d0/df/d16/d19/d38/d5d/d76/d7d/d88/f136 x:0 0 0 2024-04-19T02:18:36.295 INFO:tasks.workunit.client.0.smithi073.stdout:9/901: getdents d0/df/d60/d72/d10e 0 2024-04-19T02:18:36.296 INFO:tasks.workunit.client.0.smithi073.stdout:9/902: link d0/d81/f51 d0/df/d16/da9/f137 0 2024-04-19T02:18:36.301 INFO:tasks.workunit.client.0.smithi073.stdout:9/903: getdents d0/df/d16/da9 0 2024-04-19T02:18:36.301 INFO:tasks.workunit.client.0.smithi073.stdout:9/904: creat d0/d81/dda/ddd/dc2/f138 x:0 0 0 2024-04-19T02:18:36.302 INFO:tasks.workunit.client.0.smithi073.stdout:9/905: fdatasync d0/fa 0 2024-04-19T02:18:36.303 INFO:tasks.workunit.client.0.smithi073.stdout:9/906: creat d0/df/d16/f139 x:0 0 0 2024-04-19T02:18:36.303 INFO:tasks.workunit.client.0.smithi073.stdout:9/907: getdents d0/d81/d5c 0 2024-04-19T02:18:36.304 INFO:tasks.workunit.client.0.smithi073.stdout:9/908: chown d0/df/d16/d19/d38/d5d/d5e/c8a 2 1 2024-04-19T02:18:36.305 INFO:tasks.workunit.client.0.smithi073.stdout:9/909: creat d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8/f13a x:0 0 0 2024-04-19T02:18:36.330 INFO:tasks.workunit.client.0.smithi073.stdout:4/986: sync 2024-04-19T02:18:36.330 INFO:tasks.workunit.client.0.smithi073.stdout:4/987: chown da/d27/d1b/d8c 37 1 2024-04-19T02:18:36.331 INFO:tasks.workunit.client.0.smithi073.stdout:4/988: symlink da/d27/d1b/d1d/d72/d104/ddd/dd0/l154 0 2024-04-19T02:18:36.332 INFO:tasks.workunit.client.0.smithi073.stdout:4/989: rename da/d27/d1b/d1d/d72/d2b/l113 to da/d27/d3a/l155 0 2024-04-19T02:18:36.332 INFO:tasks.workunit.client.0.smithi073.stdout:4/990: rmdir da/d27/d3a/d50/d9c 39 2024-04-19T02:18:36.333 INFO:tasks.workunit.client.0.smithi073.stdout:4/991: mkdir da/d27/d1b/d1d/d72/d104/ddd/df5/d156 0 2024-04-19T02:18:36.333 INFO:tasks.workunit.client.0.smithi073.stdout:4/992: chown da/d27/d3a/c153 0 1 2024-04-19T02:18:36.334 INFO:tasks.workunit.client.0.smithi073.stdout:4/993: creat da/d27/d3a/d50/d9c/dba/f157 x:0 0 0 2024-04-19T02:18:36.335 INFO:tasks.workunit.client.0.smithi073.stdout:4/994: link da/d27/f6f da/d27/d1b/d1d/d72/d104/ddd/df5/f158 0 2024-04-19T02:18:36.336 INFO:tasks.workunit.client.0.smithi073.stdout:4/995: symlink da/d27/d1b/d1d/d72/d2b/d2f/d91/l159 0 2024-04-19T02:18:36.337 INFO:tasks.workunit.client.0.smithi073.stdout:4/996: link da/d27/d3a/f12e da/d27/d1b/d1d/d72/f15a 0 2024-04-19T02:18:36.340 INFO:tasks.workunit.client.0.smithi073.stdout:9/910: read d0/d81/dda/ddd/fd6 [4114339,4563] 0 2024-04-19T02:18:36.342 INFO:tasks.workunit.client.0.smithi073.stdout:4/997: dwrite da/d27/d1b/d1d/d8d/f89 [0,4194304] 0 2024-04-19T02:18:36.342 INFO:tasks.workunit.client.0.smithi073.stdout:9/911: rename d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8/ff4 to d0/df/d16/d19/db1/d2c/d6b/d12e/f13b 0 2024-04-19T02:18:36.343 INFO:tasks.workunit.client.0.smithi073.stdout:4/998: mknod da/d27/d1b/d26/d14f/c15b 0 2024-04-19T02:18:36.344 INFO:tasks.workunit.client.0.smithi073.stdout:9/912: link d0/df/d16/d19/db1/d2c/d2e/fc3 d0/f13c 0 2024-04-19T02:18:36.344 INFO:tasks.workunit.client.0.smithi073.stdout:4/999: getdents da/d27/d1b/d1d/d72/d2b/d2f/d91/d148 0 2024-04-19T02:18:36.344 INFO:tasks.workunit.client.0.smithi073.stdout:9/913: chown d0/df/d16/d19/d38/d5d/d5e/da0/led 29039 1 2024-04-19T02:18:36.346 INFO:tasks.workunit.client.0.smithi073.stdout:9/914: truncate d0/df/d16/d19/db1/d2c/d6b/d12e/f13b 848410 0 2024-04-19T02:18:36.346 INFO:tasks.workunit.client.0.smithi073.stdout:9/915: symlink d0/df/d16/d19/db1/d2c/d6b/l13d 0 2024-04-19T02:18:36.351 INFO:tasks.workunit.client.0.smithi073.stdout:9/916: dwrite d0/df/d16/d19/d38/d5d/d45/f6a [4194304,4194304] 0 2024-04-19T02:18:36.352 INFO:tasks.workunit.client.0.smithi073.stdout:9/917: mknod d0/df/d16/d19/d38/d5d/d5e/da0/c13e 0 2024-04-19T02:18:36.353 INFO:tasks.workunit.client.0.smithi073.stdout:9/918: getdents d0/d81/dda/ddd/dc2/dce 0 2024-04-19T02:18:36.354 INFO:tasks.workunit.client.0.smithi073.stdout:9/919: truncate d0/d81/d5c/fe6 4584854 0 2024-04-19T02:18:36.354 INFO:tasks.workunit.client.0.smithi073.stdout:9/920: creat d0/df/d16/d19/d38/d5d/d5e/f13f x:0 0 0 2024-04-19T02:18:36.357 INFO:tasks.workunit.client.0.smithi073.stdout:9/921: dread d0/f30 [0,4194304] 0 2024-04-19T02:18:36.358 INFO:tasks.workunit.client.0.smithi073.stdout:9/922: creat d0/df/d16/d19/db1/d2c/f140 x:0 0 0 2024-04-19T02:18:36.359 INFO:tasks.workunit.client.0.smithi073.stdout:9/923: getdents d0/df/d16/d19/d38/d5d/d5e/d83 0 2024-04-19T02:18:36.361 INFO:tasks.workunit.client.0.smithi073.stdout:9/924: read d0/f54 [3607030,37883] 0 2024-04-19T02:18:36.364 INFO:tasks.workunit.client.0.smithi073.stdout:9/925: dread d0/df/d16/d19/d38/d5d/f4a [0,4194304] 0 2024-04-19T02:18:36.365 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:36.360+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:36.365 INFO:tasks.workunit.client.0.smithi073.stdout:9/926: rename d0/df/d16/d19/d38/d5d/d45/f126 to d0/d81/dda/ddd/dc2/d107/f141 0 2024-04-19T02:18:36.366 INFO:tasks.workunit.client.0.smithi073.stdout:9/927: write d0/d81/dda/ddd/dc2/d107/f141 [2882072,89789] 0 2024-04-19T02:18:36.366 INFO:tasks.workunit.client.0.smithi073.stdout:9/928: chown d0/df/d16/d19/f134 513532899 1 2024-04-19T02:18:36.373 INFO:tasks.workunit.client.0.smithi073.stdout:6/977: dread d8/de/f1f [0,4194304] 0 2024-04-19T02:18:36.374 INFO:tasks.workunit.client.0.smithi073.stdout:9/929: dwrite d0/df/d16/d19/db1/d2c/f77 [0,4194304] 0 2024-04-19T02:18:36.377 INFO:tasks.workunit.client.0.smithi073.stdout:9/930: read d0/df/d16/d19/d38/d5d/d76/ffd [3740029,49547] 0 2024-04-19T02:18:36.377 INFO:tasks.workunit.client.0.smithi073.stdout:6/978: write d8/de/d58/d63/f74 [1144530,82278] 0 2024-04-19T02:18:36.378 INFO:tasks.workunit.client.0.smithi073.stdout:6/979: fdatasync d8/d71/d75/f8d 0 2024-04-19T02:18:36.378 INFO:tasks.workunit.client.0.smithi073.stdout:9/931: chown d0/d81/dda/ddd/dc2/dce/fdc 7084 1 2024-04-19T02:18:36.379 INFO:tasks.workunit.client.0.smithi073.stdout:6/980: unlink d8/d4b/d93/f4a 0 2024-04-19T02:18:36.379 INFO:tasks.workunit.client.0.smithi073.stdout:9/932: creat d0/df/d16/d19/d38/d5d/d76/f142 x:0 0 0 2024-04-19T02:18:36.381 INFO:tasks.workunit.client.0.smithi073.stdout:6/981: creat d8/d4b/d93/f145 x:0 0 0 2024-04-19T02:18:36.381 INFO:tasks.workunit.client.0.smithi073.stdout:9/933: write d0/df/d16/d19/db1/dd4/f112 [3863996,27843] 0 2024-04-19T02:18:36.381 INFO:tasks.workunit.client.0.smithi073.stdout:6/982: dread f3 [0,4194304] 0 2024-04-19T02:18:36.382 INFO:tasks.workunit.client.0.smithi073.stdout:6/983: rmdir d8/d4b/d8f/d131 39 2024-04-19T02:18:36.382 INFO:tasks.workunit.client.0.smithi073.stdout:6/984: rename d8/d71/d7d/dab/l10d to d8/d71/d107/d104/l146 0 2024-04-19T02:18:36.383 INFO:tasks.workunit.client.0.smithi073.stdout:6/985: chown d8/d4b/d93/d60/c10f 0 1 2024-04-19T02:18:36.384 INFO:tasks.workunit.client.0.smithi073.stdout:6/986: getdents d8/d4b/d93/d128/d12f 0 2024-04-19T02:18:36.384 INFO:tasks.workunit.client.0.smithi073.stdout:6/987: stat d8/f108 0 2024-04-19T02:18:36.385 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:36.385 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:36.390 INFO:tasks.workunit.client.0.smithi073.stdout:6/988: truncate d8/de/f1f 897542 0 2024-04-19T02:18:36.390 INFO:tasks.workunit.client.0.smithi073.stdout:9/934: write d0/df/d16/d19/db1/fbd [1102345,113659] 0 2024-04-19T02:18:36.391 INFO:tasks.workunit.client.0.smithi073.stdout:9/935: chown d0/fc 169 1 2024-04-19T02:18:36.391 INFO:tasks.workunit.client.0.smithi073.stdout:6/989: dread - d8/de/d22/da8/dca/ffc zero size 2024-04-19T02:18:36.391 INFO:tasks.workunit.client.0.smithi073.stdout:6/990: mknod d8/de/d58/d63/d82/de2/c147 0 2024-04-19T02:18:36.391 INFO:tasks.workunit.client.0.smithi073.stdout:9/936: symlink d0/df/d16/d19/d38/d5d/d76/d7d/d88/dd8/l143 0 2024-04-19T02:18:36.393 INFO:tasks.workunit.client.0.smithi073.stdout:9/937: link d0/df/d16/d19/db1/d2c/d2e/fc3 d0/df/d16/f144 0 2024-04-19T02:18:36.393 INFO:tasks.workunit.client.0.smithi073.stdout:9/938: symlink d0/df/l145 0 2024-04-19T02:18:36.394 INFO:tasks.workunit.client.0.smithi073.stdout:9/939: chown d0/df/d16/da9/l131 4 1 2024-04-19T02:18:36.395 INFO:tasks.workunit.client.0.smithi073.stdout:9/940: mkdir d0/df/d60/d72/d10e/d146 0 2024-04-19T02:18:36.396 INFO:tasks.workunit.client.0.smithi073.stdout:9/941: creat d0/df/d16/d19/d38/d5d/d76/dbc/f147 x:0 0 0 2024-04-19T02:18:36.397 INFO:tasks.workunit.client.0.smithi073.stdout:6/991: dwrite d8/de/d58/d63/d82/f106 [0,4194304] 0 2024-04-19T02:18:36.397 INFO:tasks.workunit.client.0.smithi073.stdout:9/942: mkdir d0/df/d16/d19/d38/d148 0 2024-04-19T02:18:36.398 INFO:tasks.workunit.client.0.smithi073.stdout:6/992: creat d8/d71/d107/d12c/f148 x:0 0 0 2024-04-19T02:18:36.398 INFO:tasks.workunit.client.0.smithi073.stdout:9/943: unlink d0/d81/dda/ddd/dc2/lea 0 2024-04-19T02:18:36.399 INFO:tasks.workunit.client.0.smithi073.stdout:6/993: mkdir d8/de/d22/d144/d149 0 2024-04-19T02:18:36.399 INFO:tasks.workunit.client.0.smithi073.stdout:6/994: rmdir d8/de/d58/d63/d82/de2/dea 39 2024-04-19T02:18:36.399 INFO:tasks.workunit.client.0.smithi073.stdout:9/944: write d0/df/d16/d19/db1/d2c/d2e/f7f [1850426,66621] 0 2024-04-19T02:18:36.400 INFO:tasks.workunit.client.0.smithi073.stdout:9/945: chown d0/df/d16/d19/db1/d2c/l9d 18 1 2024-04-19T02:18:36.402 INFO:tasks.workunit.client.0.smithi073.stdout:6/995: dread d8/de/d58/d63/d82/ff5 [0,4194304] 0 2024-04-19T02:18:36.403 INFO:tasks.workunit.client.0.smithi073.stdout:9/946: rename d0/df/d16 to d0/df/d1d/d149 0 2024-04-19T02:18:36.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:36.405 INFO:tasks.workunit.client.0.smithi073.stdout:6/996: rename d8/de/d78/c8e to d8/de/d58/d63/c14a 0 2024-04-19T02:18:36.405 INFO:tasks.workunit.client.0.smithi073.stdout:9/947: creat d0/df/d1d/d149/d19/db1/d2c/d6b/d12e/f14a x:0 0 0 2024-04-19T02:18:36.410 INFO:tasks.workunit.client.0.smithi073.stdout:9/948: dwrite d0/d81/dda/ddd/dc2/f101 [0,4194304] 0 2024-04-19T02:18:36.411 INFO:tasks.workunit.client.0.smithi073.stdout:9/949: symlink d0/df/l14b 0 2024-04-19T02:18:36.412 INFO:tasks.workunit.client.0.smithi073.stdout:9/950: stat d0/dad/lc1 0 2024-04-19T02:18:36.412 INFO:tasks.workunit.client.0.smithi073.stdout:9/951: read - d0/df/d1d/d149/d19/db1/d2c/d6b/d12e/f133 zero size 2024-04-19T02:18:36.413 INFO:tasks.workunit.client.0.smithi073.stdout:9/952: creat d0/d81/dda/f14c x:0 0 0 2024-04-19T02:18:36.438 INFO:tasks.workunit.client.0.smithi073.stdout:9/953: dread d0/df/d1d/d149/d19/d38/f66 [0,4194304] 0 2024-04-19T02:18:36.439 INFO:tasks.workunit.client.0.smithi073.stdout:9/954: rename d0/df/d1d/d149/fe7 to d0/df/d1d/f14d 0 2024-04-19T02:18:36.439 INFO:tasks.workunit.client.0.smithi073.stdout:9/955: stat d0/d81/d5c/c79 0 2024-04-19T02:18:36.440 INFO:tasks.workunit.client.0.smithi073.stdout:9/956: rmdir d0/df/d1d/d149/d19/d38/d5d/d76/d7d/d88 39 2024-04-19T02:18:36.461 INFO:tasks.workunit.client.0.smithi073.stdout:9/957: dread d0/df/d1d/d149/d19/db1/d2c/fef [0,4194304] 0 2024-04-19T02:18:36.462 INFO:tasks.workunit.client.0.smithi073.stdout:6/997: sync 2024-04-19T02:18:36.462 INFO:tasks.workunit.client.0.smithi073.stdout:9/958: mkdir d0/d81/d5c/d14e 0 2024-04-19T02:18:36.463 INFO:tasks.workunit.client.0.smithi073.stdout:9/959: creat d0/d81/d5c/f14f x:0 0 0 2024-04-19T02:18:36.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/998: truncate d8/de/d58/f118 12736 0 2024-04-19T02:18:36.463 INFO:tasks.workunit.client.0.smithi073.stdout:9/960: symlink d0/df/d1d/d149/d19/db1/dd4/l150 0 2024-04-19T02:18:36.464 INFO:tasks.workunit.client.0.smithi073.stdout:6/999: mknod d8/d4b/d93/d128/d12f/c14b 0 2024-04-19T02:18:36.464 INFO:tasks.workunit.client.0.smithi073.stdout:9/961: stat d0/df/d1d/d149/d19/db1/f63 0 2024-04-19T02:18:36.465 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:36.463+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:36.484 INFO:tasks.workunit.client.0.smithi073.stdout:9/962: dread d0/df/d1d/d149/d19/db1/f3b [0,4194304] 0 2024-04-19T02:18:36.485 INFO:tasks.workunit.client.0.smithi073.stdout:9/963: fsync d0/df/d1d/d149/d19/d38/d5d/d5e/d83/feb 0 2024-04-19T02:18:36.486 INFO:tasks.workunit.client.0.smithi073.stdout:9/964: mkdir d0/df/d1d/d149/d19/d38/d5d/d76/dbc/d151 0 2024-04-19T02:18:36.486 INFO:tasks.workunit.client.0.smithi073.stdout:9/965: mknod d0/df/d1d/d149/d19/d38/c152 0 2024-04-19T02:18:36.487 INFO:tasks.workunit.client.0.smithi073.stdout:9/966: creat d0/d81/d5c/d14e/f153 x:0 0 0 2024-04-19T02:18:36.488 INFO:tasks.workunit.client.0.smithi073.stdout:9/967: unlink d0/df/d1d/d149/d19/db1/dd4/l150 0 2024-04-19T02:18:36.488 INFO:tasks.workunit.client.0.smithi073.stdout:9/968: rename d0/df/l14b to d0/d81/d5c/d14e/l154 0 2024-04-19T02:18:36.490 INFO:tasks.workunit.client.0.smithi073.stdout:9/969: truncate d0/df/d1d/d149/d19/db1/d2c/d2e/f82 4473099 0 2024-04-19T02:18:36.492 INFO:tasks.workunit.client.0.smithi073.stdout:9/970: dread d0/d81/dda/ddd/dc2/f101 [0,4194304] 0 2024-04-19T02:18:36.493 INFO:tasks.workunit.client.0.smithi073.stdout:9/971: chown d0/df/d1d/d149/d19/d38/d5d/d76/la2 13 1 2024-04-19T02:18:36.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/972: dread d0/d81/dda/ddd/dc2/fe0 [0,4194304] 0 2024-04-19T02:18:36.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/973: chown d0/df/d60/d72/d8e 10 1 2024-04-19T02:18:36.497 INFO:tasks.workunit.client.0.smithi073.stdout:9/974: write d0/df/d1d/d149/d19/db1/d2c/fef [1680530,10754] 0 2024-04-19T02:18:36.530 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:36.530 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:36.536 INFO:tasks.workunit.client.0.smithi073.stdout:9/975: dread d0/df/d1d/d149/d19/d38/d5d/d5e/f8d [0,4194304] 0 2024-04-19T02:18:36.538 INFO:tasks.workunit.client.0.smithi073.stdout:9/976: readlink d0/df/d1d/d149/d19/d38/d5d/d76/d7d/lc5 0 2024-04-19T02:18:36.544 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:36.545 INFO:tasks.workunit.client.0.smithi073.stdout:9/977: dwrite d0/df/d1d/d149/d19/db1/f3b [0,4194304] 0 2024-04-19T02:18:36.545 INFO:tasks.workunit.client.0.smithi073.stdout:9/978: mknod d0/df/d1d/d149/d19/d38/d5d/df2/c155 0 2024-04-19T02:18:36.546 INFO:tasks.workunit.client.0.smithi073.stdout:9/979: write d0/df/d1d/d149/d19/d38/d5d/d76/d7d/d88/f92 [705168,55195] 0 2024-04-19T02:18:36.547 INFO:tasks.workunit.client.0.smithi073.stdout:9/980: mkdir d0/df/d1d/d149/d19/d38/d5d/d76/d7d/d88/d156 0 2024-04-19T02:18:36.548 INFO:tasks.workunit.client.0.smithi073.stdout:9/981: unlink d0/d81/dda/ddd/dc2/dce/fdc 0 2024-04-19T02:18:36.549 INFO:tasks.workunit.client.0.smithi073.stdout:9/982: symlink d0/df/d1d/l157 0 2024-04-19T02:18:36.549 INFO:tasks.workunit.client.0.smithi073.stdout:9/983: fdatasync d0/df/d1d/d149/d19/d38/d5d/d45/f48 0 2024-04-19T02:18:36.550 INFO:tasks.workunit.client.0.smithi073.stdout:9/984: mkdir d0/df/d1d/d149/d19/d38/d5d/df2/d158 0 2024-04-19T02:18:36.555 INFO:tasks.workunit.client.0.smithi073.stdout:9/985: dwrite d0/d35/fbb [0,4194304] 0 2024-04-19T02:18:36.556 INFO:tasks.workunit.client.0.smithi073.stdout:9/986: mkdir d0/df/d1d/d149/d19/d38/d5d/d76/d7d/d88/d159 0 2024-04-19T02:18:36.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/987: truncate d0/df9/f119 2702708 0 2024-04-19T02:18:36.563 INFO:tasks.workunit.client.0.smithi073.stdout:9/988: chown d0/d81/dda/ddd/dc2/dce 1398286 1 2024-04-19T02:18:36.563 INFO:tasks.workunit.client.0.smithi073.stdout:9/989: creat d0/d81/dda/ddd/dc2/d107/f15a x:0 0 0 2024-04-19T02:18:36.565 INFO:tasks.workunit.client.0.smithi073.stdout:9/990: getdents d0/df/d60/d72/d8e 0 2024-04-19T02:18:36.565 INFO:tasks.workunit.client.0.smithi073.stdout:9/991: readlink d0/df/ld3 0 2024-04-19T02:18:36.565 INFO:tasks.workunit.client.0.smithi073.stdout:9/992: dread - d0/df/d1d/d149/d19/db1/d2c/f46 zero size 2024-04-19T02:18:36.566 INFO:tasks.workunit.client.0.smithi073.stdout:9/993: creat d0/df/f15b x:0 0 0 2024-04-19T02:18:36.567 INFO:tasks.workunit.client.0.smithi073.stdout:9/994: write d0/d81/dda/ddd/f10c [105990,70649] 0 2024-04-19T02:18:36.573 INFO:tasks.workunit.client.0.smithi073.stdout:9/995: dwrite d0/df/d1d/d149/d19/d38/d5d/d45/f7a [4194304,4194304] 0 2024-04-19T02:18:36.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/996: chown d0/df/d1d/d149/da9/l131 209 1 2024-04-19T02:18:36.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/997: readlink d0/d81/dda/ddd/dc2/l117 0 2024-04-19T02:18:36.576 INFO:tasks.workunit.client.0.smithi073.stdout:9/998: creat d0/d81/dda/f15c x:0 0 0 2024-04-19T02:18:36.577 INFO:tasks.workunit.client.0.smithi073.stdout:9/999: mknod d0/df/d60/d72/d10e/c15d 0 2024-04-19T02:18:36.580 INFO:tasks.workunit.client.0.smithi073.stderr:+ rm -rf -- ./tmp.l7tSRLsH4W 2024-04-19T02:18:36.590 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:36.588+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:36.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-19T02:18:36.666 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:36.664+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:36.684 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:36.684 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:36.701 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:36.768 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:36.767+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:36.869 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:36.864+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:36.873 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:36.873 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:36.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:36.969 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:36.964+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.026 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:37.027 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:37.042 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:37.070 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:37.068+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.164 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:37.164 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:37.170 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:37.167+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:37.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:37.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:37.271 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:37.268+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.340 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:37.340 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:37.356 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:37.402 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:37.400+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:18:37.416 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:37.417 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:37.417 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:37.434 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:37.438 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:37.439 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:37.473 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:37.468+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.490 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:37.490 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:37.490 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:37.490 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:37.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:37.594 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:37.592+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.674 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:37.671+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:37.678 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:37.678 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:37.678 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:37.678 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:37.678 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:37.693 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:37.782 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:37.780+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.513015819, 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:37.872 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:37.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:37.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:37.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:37.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:37.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.499787756, 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:37.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.499693041, 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:37.884 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:37.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.498311265000002, 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.889 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:37.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.893 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.493661126999999, 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.894 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:37.898 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.477256519000001, 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.899 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:37.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:37.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.468038335999999, 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:37.904 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:37.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:37.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.465227636000002, 2024-04-19T02:18:37.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:37.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.456241554000002, 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:37.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.453668748999998, 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.920 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:37.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.924 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.446441451999998, 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:37.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:37.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.930 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.441214187, 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:37.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.935 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.937 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.937 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.429462053000002, 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:37.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:37.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.422286883000002, 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:37.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:37.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.7059074019999994, 2024-04-19T02:18:37.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:37.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:37.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:37.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6936230390000002, 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:37.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:37.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:37.958 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5909764279999994, 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:37.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:37.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.963 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5897747189999993, 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:37.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:37.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:37.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.968 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.586288369, 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:37.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.5859364570000007, 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:37.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:37.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:37.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:37.978 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:37.980 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:37.976+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:37.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:38.080 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:38.079+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:38.119 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3425 3.18 e65/15 3:1cc859d9:::200.00000012:head v 65'377, mlcod=65'374)", 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:38.118955+0000", 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0018538020000000001, 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018874580000000001, 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.118955+0000", 2024-04-19T02:18:38.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.118955+0000", 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.118955+0000", 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.118966+0000", 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1345999999999999e-05 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.118992+0000", 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6322999999999999e-05 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.119002+0000", 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8719999999999997e-06 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.119104+0000", 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101821 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.119143+0000", 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9496999999999998e-05 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3426 3.18 e65/15 3:1cc859d9:::200.00000012:head v 65'378, mlcod=65'374)", 2024-04-19T02:18:38.123 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:38.120437+0000", 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00037208299999999999, 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00051222699999999997, 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120437+0000", 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120437+0000", 2024-04-19T02:18:38.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120436+0000", 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120446+0000", 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6670000000000008e-06 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120468+0000", 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120476+0000", 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5469999999999999e-06 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120575+0000", 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9599999999999995e-05 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:38.120615+0000", 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9128999999999998e-05 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 2 2024-04-19T02:18:38.127 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:38.135 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:38.181 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:38.176+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:38.282 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:38.280+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:38.315 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:38.316 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:38.316 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:38.316 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:38.316 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:38.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:38.384 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:38.380+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:38.388 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.158011583, 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.467 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:38.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:38.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:38.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:38.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:38.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.111750065999999, 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:38.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.098808399999999, 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:38.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:38.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.098746849000001, 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.485 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:38.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:38.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.097795780999999, 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:38.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:38.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:38.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:38.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:38.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:38.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.090655454, 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:38.498 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.504 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.504 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:38.504 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.082823350999998, 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.052757884999998, 2024-04-19T02:18:38.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:38.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:38.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.050216037999999, 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1614999959999999, 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.523 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.963515203, 2024-04-19T02:18:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:38.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:38.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.8649913209999998, 2024-04-19T02:18:38.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:38.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.8611504560000007, 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:38.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:38.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:38.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7031278489999995, 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.551 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.551 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:38.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:38.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:38.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:38.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6739045140000002, 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:38.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:38.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6547316419999998, 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:38.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6509632019999998, 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:38.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:38.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:38.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.3292784910000002, 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:38.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:38.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:38.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2695394310000001, 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:38.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.6539128749999996, 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:38.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:38.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:38.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:38.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:38.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:38.591 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:38.592 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:38.593 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:38.591+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:38.693 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:38.688+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:4557 3.18 3:1cc859d9:::200.00000012:head [write 4028368~9670 [fadvise_dontneed] in=9670b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:38.773024+0000", 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.000565333, 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058753699999999996, 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:38.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773024+0000", 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773024+0000", 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773023+0000", 2024-04-19T02:18:38.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773031+0000", 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.568e-06 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773042+0000", 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0645999999999999e-05 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:38.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773046+0000", 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3139999999999997e-06 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773086+0000", 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9869000000000001e-05 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773166+0000", 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9235999999999998e-05 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:38.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:38.773284+0000", 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118806 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 1 2024-04-19T02:18:38.777 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:38.789 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:38.830 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:38.828+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:38.894 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:38.891+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:38.947 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:38.947 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:38.948 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:38.948 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:38.948 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:38.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:39.006 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:39.004+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:39.081 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.726667546000002, 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:39.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:39.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.713439482999998, 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.088 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:39.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:39.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:39.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:39.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:39.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:39.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.713344767999999, 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:39.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.098 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.711962992, 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.099 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:39.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.104 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.707312854000001, 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:39.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:39.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:39.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:39.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:39.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:39.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:39.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:39.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:39.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:39.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:39.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.111 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.112 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.112 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:39.112 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.690908245999999, 2024-04-19T02:18:39.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:39.112 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.112 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.113 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.113 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.113 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.113 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:39.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.113 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:39.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:39.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:39.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:39.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:39.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:39.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:39.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.681690063000001, 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.120 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:39.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:39.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:39.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.125 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.678879363, 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:39.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:39.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:39.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:39.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.669893281, 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:39.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:39.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:39.136 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.667320476, 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:39.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:39.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.660093179, 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:39.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:39.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.654865913999998, 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:39.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.64311378, 2024-04-19T02:18:39.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:39.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:39.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.63593861, 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:39.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:39.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9195591289999996, 2024-04-19T02:18:39.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9072747660000005, 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.8046281549999996, 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.8034264459999996, 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.7999400960000003, 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.7995881839999992, 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:39.199 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:39.201 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:39.196+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:39.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:39.302 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:39.299+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:39.338 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:39.338 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:39.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.338 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:4689 3.e 3:715f5c78:::200.00000013:head [write 2064962~14902 [fadvise_dontneed] in=14902b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-19T02:18:39.338 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:39.336235+0000", 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0030185239999999999, 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003086933, 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336235+0000", 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:39.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336235+0000", 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336234+0000", 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336249+0000", 2024-04-19T02:18:39.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4936999999999999e-05 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336290+0000", 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0856000000000003e-05 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336304+0000", 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3726999999999999e-05 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:39.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336404+0000", 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9951000000000006e-05 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.336639+0000", 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023494 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.339092+0000", 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024536950000000001 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:39.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:39.339231+0000", 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138274 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 1 2024-04-19T02:18:39.343 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:39.353 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:39.403 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:39.400+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:39.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:39.504 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:39.500+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:39.510 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:39.511 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:39.526 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:39.581 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:39.582 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:39.582 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:39.605 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:39.600+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:39.606 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:39.606 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:39.609 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:39.609 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:39.684 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:39.684 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:39.706 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:39.700+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:39.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:39.806 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:39.803+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:39.825 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:39.825 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:39.840 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:39.884 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-19T02:18:39.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T02:18:39.907 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:39.907+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:39.971 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:39.971 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:39.986 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:40.030 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:40.028+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:40.109 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:40.109 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:40.110 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:40.104+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:40.124 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:40.211 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:40.207+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:40.256 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:40.256 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:40.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:40.312 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:40.308+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:40.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:18:40.413 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:40.408+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:40.435 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:40.435 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:40.449 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:40.513 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:40.511+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:40.573 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:40.573 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:40.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:40.638 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:40.636+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:40.716 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:40.715+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:40.764 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:40.764 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:40.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:40.822 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:40.820+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:40.917 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:40.915+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:40.947 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:40.947 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:40.963 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:41.017 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:41.012+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:41.083 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:41.084 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:41.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:41.138 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:41.136+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:41.219 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:41.216+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:41.236 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:41.236 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:41.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:41.319 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:41.315+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:41.370 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:41.371 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:41.385 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:18:41.432 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:41.431+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:41.521 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:41.519+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:41.566 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:41.567 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:41.582 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:41.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:41.626 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:41.624+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:41.711 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:41.711 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:41.723 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:41.720+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:41.726 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:41.746 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:41.747 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:41.747 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:41.765 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:41.769 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:41.770 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:41.823 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:41.820+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:41.889 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:41.889 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:41.889 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:41.889 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:41.889 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:41.903 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:41.946 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:41.944+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:42.025 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:42.023+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.711048904999998, 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:42.068 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:42.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:42.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.697820841999999, 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.074 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:42.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.697726126999999, 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:42.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.696344351, 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:42.083 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:42.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.691694213000002, 2024-04-19T02:18:42.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:42.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:42.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.675289605, 2024-04-19T02:18:42.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:42.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.666071422000002, 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:42.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:42.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.663260722, 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:42.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:42.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.654274640000001, 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:42.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.651701835000001, 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:42.114 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:42.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:42.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.644474538000001, 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:42.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:42.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.639247272999999, 2024-04-19T02:18:42.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:42.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:42.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.627495139000001, 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:42.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:42.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.620319969000001, 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:42.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:42.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:42.141 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.903940488, 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:42.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.146 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.891656125000001, 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.789009514, 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:42.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:42.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.787807805, 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:42.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:42.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.784321455000001, 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:42.161 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.165 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.783969543, 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.166 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:42.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.170 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.171 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.171 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:42.171 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:42.171 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:42.172 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:42.168+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:42.173 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:42.273 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:42.271+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:42.305 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:42.305 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:42.305 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:42.305 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:42.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:42.373 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:42.372+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:42.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-19T02:18:42.474 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:42.472+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:42.486 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:42.486 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:42.487 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:42.487 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:42.487 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:42.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:42.575 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:42.571+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:42.640 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:42.640 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:42.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:42.640 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:42.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.640 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.333812008999999, 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:42.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:42.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:42.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:42.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.287550492000001, 2024-04-19T02:18:42.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:42.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:42.653 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.274608826000001, 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:42.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:42.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.274547275, 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.658 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:42.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.273596207000001, 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:42.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:42.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.266455879999999, 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:42.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.258623777, 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:42.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.228558311, 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:42.679 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.226016464000001, 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:42.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:42.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.337300422, 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:42.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.139315629, 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:42.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:42.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:42.701 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.040791747, 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:42.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.036950881999999, 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.707 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:42.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:42.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:42.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.878928275, 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.849704940000001, 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:42.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:42.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:42.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830532068, 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:42.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.730 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.826763628, 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:42.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.505078917000001, 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:42.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.741 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.445339857, 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.742 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:42.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:42.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.829713301, 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:42.747 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:42.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:42.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.752 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.752 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.752 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:42.752 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:42.752 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:42.753 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:42.754 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:42.748+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:42.854 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:42.851+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:42.868 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:42.869 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:42.869 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:42.869 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:42.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:42.955 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:42.952+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:43.004 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:43.004 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:43.004 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:43.004 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:43.004 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:43.018 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:43.056 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:43.055+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:43.157 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:43.155+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:43.197 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:43.197 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:43.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:43.197 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.840244855000002, 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.198 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:43.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:43.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.827016791999998, 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:43.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.826922076999999, 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.208 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:43.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.825540301, 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:43.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.820890163000001, 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:43.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:43.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:43.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:43.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.804485554999999, 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:43.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.227 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.795267372000001, 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.232 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.792456672, 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.233 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:43.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:43.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.78347059, 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:43.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.780897785000001, 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.243 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.247 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.773670488, 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:43.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:43.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.768443222999998, 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:43.253 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:43.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:43.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.258 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.756691089, 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:43.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.749515919, 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.264 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:43.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:43.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.033136438, 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:43.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.020852075000001, 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.275 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:43.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.279 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.918205464, 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.280 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:43.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:43.284 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.917003755, 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:43.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.913517405, 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:43.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.913165492999999, 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:43.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:43.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:43.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:43.299 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:43.301 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:43.296+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:43.301 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:43.401 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:43.396+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:43.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:18:43.432 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:43.432 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:43.432 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:43.432 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:43.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:43.502 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:43.500+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:43.567 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:43.567 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:43.567 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:43.567 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:43.567 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:43.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:43.627 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:43.627+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:43.705 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:43.703+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:43.737 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.431830339999998, 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.738 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:43.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:43.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.743 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.385568823, 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:43.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.372627156999997, 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.749 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:43.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.372565606000002, 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.754 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:43.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:43.760 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.371614538000003, 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:43.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:43.767 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.364474211000001, 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:43.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:43.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.356642108000003, 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.773 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:43.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:43.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.326576641999999, 2024-04-19T02:18:43.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:43.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:43.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.324034795000003, 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.790 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.435318753000001, 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.791 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:43.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:43.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.797 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.237333960000001, 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:43.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:43.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.138810078000001, 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.803 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:43.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:43.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.808 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.134969213, 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:43.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:43.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:43.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.976946606, 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:43.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.947723270999999, 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:43.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:43.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:43.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:43.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.928550399000001, 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:43.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:43.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:43.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.832 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.924781959000001, 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.833 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:43.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.838 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.603097247999999, 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:43.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:43.844 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.543358187999999, 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:43.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:43.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.9277316320000004, 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:43.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:43.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:43.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:43.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:43.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:43.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:43.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:43.855 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:43.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:43.858 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:43.859 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:43.852+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:43.959 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:43.956+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:43.982 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:43.982 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:43.996 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:44.011 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:44.011 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:44.011 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:44.032 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:44.036 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:44.036 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:44.060 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.059+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.161 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.159+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.167 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:44.167 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:44.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:44.262 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.259+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.308 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:44.308 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:44.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:44.368 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.367+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.416 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:18:44.458 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:44.458 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:44.465 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.463+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:44.566 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.563+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.657 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:44.657 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:44.666 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:44.664+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:44.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:44.767 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.763+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.865 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:44.865 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:44.868 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.867+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:44.879 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:44.968 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:44.967+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:45.000 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:45.000 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:45.014 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:45.070 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:45.071+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:45.136 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:45.136 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:45.151 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:45.170 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:45.167+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:45.271 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:45.271+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:45.280 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:45.280 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:45.294 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:45.373 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:45.368+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:45.426 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:45.426 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:45.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:45.474 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:45.468+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:45.563 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:45.563 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:45.575 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:45.571+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:45.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:45.675 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:45.672+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:45.777 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:45.772+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:45.777 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:45.777 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:45.791 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:45.877 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:45.872+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:45.914 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:45.915 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:45.930 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:45.979 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:45.975+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:46.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:46.080 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:46.076+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:46.097 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:46.097 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:46.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:46.202 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:46.202 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:46.203 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:46.203 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:46.200+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:46.220 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:46.221 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:46.224 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:46.224 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:46.282 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:46.280+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:46.283 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:46.283 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:46.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:46.283 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.926639240999997, 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:46.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.913411177999997, 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:46.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:46.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:46.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.913316463000001, 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:46.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:46.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:46.298 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.911934686999999, 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.299 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:46.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:46.304 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.907284549000003, 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:46.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:46.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.890879941000001, 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.311 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:46.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:46.316 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.881661758, 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:46.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:46.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.878851058000002, 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.322 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:46.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.327 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.869864976000002, 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:46.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.867292171000003, 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:46.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:46.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.860064874000003, 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.337 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:46.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:46.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.854837609, 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.345 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:46.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:46.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.843085475000002, 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.835910304999999, 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.358 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:46.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:46.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.119530824000002, 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:46.364 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.107246460999999, 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:46.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:46.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.004599850000002, 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.375 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:46.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:46.380 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.003398141000002, 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:46.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.999911790999999, 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:46.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.999559879, 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:46.391 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:46.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:46.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:46.396 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:46.398 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:46.392+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:46.398 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:46.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:18:46.499 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:46.495+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:46.528 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:46.529 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:46.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:46.636 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:46.635+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:46.700 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:46.699+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:46.748 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:46.748 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:46.748 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:46.748 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:46.748 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:46.771 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:46.800 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:46.796+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:46.902 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:46.899+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:46.938 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.632685465999998, 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.586423949, 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.573482282999997, 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.573420732000002, 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.572469664000003, 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.565329337000001, 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.557497234000003, 2024-04-19T02:18:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.527431768, 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.524889921000003, 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.636173879000001, 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.438189086000001, 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:47.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:47.011 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.339665203999999, 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:47.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:47.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.017 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.335824338999998, 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.018 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:47.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:47.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.177801731999999, 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:47.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:47.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.148578397000001, 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.030 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:47.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:47.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.129405524999999, 2024-04-19T02:18:47.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:47.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.125637085000001, 2024-04-19T02:18:47.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:47.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.803952374000001, 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:47.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.744213314, 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:47.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:47.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:47.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.128586758000001, 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:47.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:47.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:47.067 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:47.067 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:47.068 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:47.069 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:47.068+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:47.169 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:47.167+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:47.197 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:47.197 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:47.197 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:47.213 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:47.270 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:47.268+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:47.328 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:47.329 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:47.329 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:47.329 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:47.329 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:47.342 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:47.371 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:47.367+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:47.418 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:18:47.472 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:47.471+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.157929959000001, 2024-04-19T02:18:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:47.521 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.144701896000001, 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:47.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.144607180999998, 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:47.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:47.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:47.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.143225405000003, 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:47.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:47.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.138575267, 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:47.535 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:47.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:47.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.122170658999998, 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.112952475999997, 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.110141775999999, 2024-04-19T02:18:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.101155693999999, 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.098582888999999, 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.091355591999999, 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.086128326999997, 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.074376192999999, 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.067201023000003, 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.350821541999998, 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.338537178999999, 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.235890567999999, 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.234688858999998, 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.231202508999999, 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.230850597, 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:47.623 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:47.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:47.625 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:47.623+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:47.725 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:47.720+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:47.800 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:47.801 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:47.801 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:47.814 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:47.826 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:47.824+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:47.927 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:47.924+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:47.928 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:47.929 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:47.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:48.028 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:48.027+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:48.066 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:48.066 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:48.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:48.066 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:48.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.759917129999998, 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:48.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:48.071 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.713655613, 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.072 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.077 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.700713946999997, 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.700652396000002, 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:48.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.699701328000003, 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.088 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:48.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.692561001000001, 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.094 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:48.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.095 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.684728898000003, 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:48.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.654663432, 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:48.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.112 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.652121585000003, 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:48.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:48.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:48.118 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.763405543000001, 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:48.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:48.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.565420750000001, 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:48.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.466896867999999, 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:48.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.463056002999998, 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:48.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:48.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.142 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.305033395999999, 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.143 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:48.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.148 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.275810061000001, 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:48.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:48.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.256637188999999, 2024-04-19T02:18:48.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:48.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:48.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.252868749000001, 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:48.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.931184038000001, 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:48.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:48.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.171 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.871444978, 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.172 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:48.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:48.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.255818422000001, 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:48.177 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:48.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:48.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:48.182 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:48.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:48.184 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:48.183+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:48.226 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:48.285 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:48.280+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:48.325 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:48.325 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:48.325 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:48.325 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:48.341 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:48.370 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:48.371 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:48.371 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:48.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-19T02:18:48.386 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:48.383+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:48.392 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:48.395 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:48.396 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:48.487 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:48.483+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:48.512 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:48.512 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:48.528 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:48.587 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:48.584+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:48.664 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:48.664 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:48.685 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:48.689 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:48.687+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:48.789 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:48.784+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:48.839 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:48.839 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:48.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:48.896 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:48.895+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:48.971 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:48.985 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:48.992 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:48.988+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:49.093 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:49.088+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:49.147 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:49.148 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:49.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:49.195 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:49.191+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:49.295 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:49.292+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:49.296 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:49.297 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:49.313 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:49.396 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:49.395+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:49.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:18:49.483 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:49.483 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:49.497 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:49.492+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:49.500 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:49.598 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:49.596+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:49.682 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:49.682 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:49.701 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:49.695+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:49.703 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:49.800 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:49.799+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:49.840 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:49.840 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:49.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:49.902 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:49.896+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.003 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:50.000+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.013 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:50.014 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:50.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:50.105 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:50.100+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.149 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:50.150 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:50.164 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:50.210 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:50.208+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.306 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:50.304+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.308 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:50.308 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:50.325 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:50.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:50.409 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:50.407+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:50.437 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:18:50.495 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:50.495 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:50.510 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:50.510 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:50.504+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.540 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:50.540 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:50.541 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:50.558 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:50.559 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:50.561 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:50.562 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:50.610 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:50.608+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.707 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.351805112000001, 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.708 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:50.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:50.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:50.714 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:50.715 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.338577049000001, 2024-04-19T02:18:50.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:50.715 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.715 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.715 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:50.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:50.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.338482333999998, 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:50.721 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.725 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.337100558000003, 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:50.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.731 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.332450420000001, 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:50.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:50.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:50.736 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.316045811999999, 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:50.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:50.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:50.741 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.306827628999997, 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:50.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:50.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.304016928999999, 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:50.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:50.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.295030847, 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.752 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.756 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.292458042, 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:50.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.285230745, 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.761 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:50.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:50.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:50.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:50.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.280003479999998, 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:50.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:50.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.268251346, 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:50.776 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.261076176000003, 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:50.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:50.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:50.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.544696694999999, 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.782 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:50.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:50.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.532412332, 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.787 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.429765720999999, 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.792 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:50.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.428564011999999, 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:50.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:50.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:50.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.425077662, 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:50.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.42472575, 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:50.806 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:50.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:50.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:50.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:50.811 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:50.813 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:50.808+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:50.813 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:50.913 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:50.911+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:50.936 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17836 3.1a 3:5d7bf03a:::200.0000001e:head [write 604224~3243 [fadvise_dontneed] in=3243b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:50.935459+0000", 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0023330320000000001, 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023920970000000001, 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935459+0000", 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:50.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935459+0000", 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935458+0000", 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:50.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935463+0000", 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6049999999999997e-06 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935473+0000", 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6770000000000007e-06 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935479+0000", 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9270000000000002e-06 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:50.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935528+0000", 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8619000000000003e-05 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935606+0000", 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8659999999999996e-05 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.935719+0000", 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011280799999999999 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.936919+0000", 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011995420000000001 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937830+0000", 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000911391 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17837 3.1a 3:5d7bf03a:::200.0000001e:head [write 607467~9780 [fadvise_dontneed] in=9780b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:50.941 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:50.937047+0000", 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00074494000000000003, 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001006636, 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937047+0000", 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937047+0000", 2024-04-19T02:18:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937046+0000", 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937056+0000", 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6539999999999994e-06 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:50.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937066+0000", 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0182e-05 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937071+0000", 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6049999999999997e-06 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937114+0000", 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2846999999999998e-05 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937195+0000", 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1088999999999996e-05 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:50.937312+0000", 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000116733 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 2 2024-04-19T02:18:50.945 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:50.952 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:51.015 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:51.012+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:51.116 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:51.115+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:51.116 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:51.116 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:51.116 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:51.116 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:51.116 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:51.132 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:51.224 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:51.223+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:51.309 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.001042634000001, 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.954781117000003, 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.941839451, 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.941777899999998, 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.940826831999999, 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.933686504999997, 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.925854401999999, 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.895788936000002, 2024-04-19T02:18:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.893247088999999, 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.004531047, 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.806546254000001, 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.708022371999999, 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.704181507000001, 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.546158900000002, 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:51.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:51.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.516935565000001, 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:51.393 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:51.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:51.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:51.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.497762692999999, 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:51.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:51.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.404 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.493994253, 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.405 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:51.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:51.410 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.172309542000001, 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:51.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.112570481999999, 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.496943926, 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:51.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:51.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:51.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:51.426 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:51.426 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:51.427 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:51.428 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:51.424+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:51.530 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:51.527+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:51.564 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:51.564 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:51.565 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:51.565 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:51.579 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:51.632 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:51.631+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:51.726 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:51.726 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:51.733 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:51.731+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:51.748 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:51.834 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:51.831+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:51.889 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:51.889 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:51.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:51.889 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:51.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.534080617999997, 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.890 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:51.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.895 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.520852554999998, 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:51.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.520757840000002, 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:51.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.904 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.519376063999999, 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:51.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:51.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.514725925999997, 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.910 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:51.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:51.914 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.498321318000002, 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.915 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.489103135000001, 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:51.920 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.486292435000003, 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.477306353000003, 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:51.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.935 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.474733548000003, 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:51.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.467506251000003, 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:51.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:51.945 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.462278986000001, 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:51.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:51.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.450526852000003, 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.951 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:51.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.443351681999999, 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:51.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.726972200999999, 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:51.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:51.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.714687838, 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.612041226999999, 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.972 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:51.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.610839517999999, 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.977 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:51.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.981 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.607353167999999, 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:51.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.607001256, 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:51.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:51.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:51.992 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:51.992 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:51.993 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:51.994 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:51.991+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:52.023 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-19T02:18:52.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-19T02:18:52.094 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:52.092+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:52.124 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:52.124 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:52.124 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:52.124 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:52.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:52.195 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:52.191+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:52.260 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:52.260 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:52.260 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:52.260 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:52.260 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:52.273 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:52.296 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:52.292+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:52.306 DEBUG:teuthology.parallel:result is None 2024-04-19T02:18:52.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-19T02:18:52.324 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-19T02:18:52.324 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-19T02:18:52.340 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-19T02:18:52.340 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:18:52.340 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-19T02:18:52.373 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:18:52.373 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-19T02:18:52.397 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:52.395+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:52.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.129278284999998, 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:52.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.083016768, 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:52.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:52.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:52.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.070075101999997, 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:52.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.070013551000002, 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:52.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:52.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:52.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.458 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.069062483000003, 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:52.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:52.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.061922156000001, 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:52.464 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:52.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:52.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:52.469 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.054090053000003, 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:52.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:52.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.024024587, 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:52.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.021482740000003, 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:52.480 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:52.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.132766698000001, 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.487 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:52.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.494 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.934781905000001, 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.499 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.836258022999999, 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:52.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.832417157999998, 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:52.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:52.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.674394550999999, 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:52.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.645171216000001, 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.517 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:52.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.625998343999999, 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:52.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.622229904000001, 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.529 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:52.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:52.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.300545193000001, 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:52.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:52.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:52.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.240806133, 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:52.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:52.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:52.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.625179577000001, 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:52.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:52.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:52.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:52.550 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:52.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:18:52.553 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:52.554 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:52.552+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:52.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:52.654 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:52.651+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:52.697 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:52.697 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:52.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.698 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19303 3.7 3:e16fc02e:::100000026ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.698 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.693628+0000", 2024-04-19T02:18:52.698 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001490498, 2024-04-19T02:18:52.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015072219999999999, 2024-04-19T02:18:52.698 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.698 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.698 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693628+0000", 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693628+0000", 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693626+0000", 2024-04-19T02:18:52.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693637+0000", 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0406e-05 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693658+0000", 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0982e-05 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693668+0000", 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0720000000000001e-05 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693718+0000", 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9101000000000003e-05 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693836+0000", 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011856100000000001 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.701 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19304 4.37 4:ede1fc03:::100000026cb.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.693820+0000", 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0012987960000000001, 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013740219999999999, 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693820+0000", 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693820+0000", 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693818+0000", 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693825+0000", 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0400000000000004e-06 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693839+0000", 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3191e-05 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693847+0000", 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4120000000000001e-06 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693876+0000", 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8855000000000001e-05 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693945+0000", 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9512999999999997e-05 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693996+0000", 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0173999999999998e-05 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19305 3.1e 3:7e40d615:::100000026cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.693997+0000", 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001121234, 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001275118, 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693997+0000", 2024-04-19T02:18:52.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693997+0000", 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.693996+0000", 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694005+0000", 2024-04-19T02:18:52.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9309999999999997e-06 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694016+0000", 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1199999999999999e-05 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694024+0000", 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6000000000000001e-06 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694110+0000", 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5563999999999996e-05 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694309+0000", 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019961600000000001 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19270 4.1 4:8252992f:::1000000269d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.686474+0000", 2024-04-19T02:18:52.709 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0086450120000000005, 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0088644510000000006, 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686474+0000", 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686474+0000", 2024-04-19T02:18:52.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686473+0000", 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686477+0000", 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9720000000000003e-06 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686485+0000", 2024-04-19T02:18:52.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2120000000000003e-06 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686492+0000", 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9299999999999997e-06 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686538+0000", 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6427000000000001e-05 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686681+0000", 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014265400000000001 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.686812+0000", 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013080899999999999 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.687663+0000", 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00085066899999999997 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19306 4.0 4:020bcee2:::100000026d0.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.694044+0000", 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.001074455, 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001401795, 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694044+0000", 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694044+0000", 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694043+0000", 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694049+0000", 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5539999999999997e-06 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694065+0000", 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6211000000000001e-05 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694080+0000", 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5065000000000001e-05 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694131+0000", 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1285000000000001e-05 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.694259+0000", 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127494 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695324+0000", 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00106517 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.717 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:19262 4.f e70/16 ondisk, result = 0)", 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695246+0000", 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9998727, 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026965799999999999, 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695246+0000", 2024-04-19T02:18:52.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695246+0000", 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695246+0000", 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695248+0000", 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3080000000000002e-06 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695256+0000", 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7579999999999992e-06 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695260+0000", 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5519999999999998e-06 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695317+0000", 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7281000000000003e-05 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695334+0000", 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6133999999999998e-05 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:19251 4.1 e70/38)", 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695412+0000", 2024-04-19T02:18:52.721 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9997067, 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016786399999999999, 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695412+0000", 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695412+0000", 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695412+0000", 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695415+0000", 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2610000000000002e-06 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695469+0000", 2024-04-19T02:18:52.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4318999999999999e-05 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695476+0000", 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2280000000000003e-06 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695556+0000", 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0507999999999996e-05 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695574+0000", 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8233999999999999e-05 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:19265 4.1 e70/38)", 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695484+0000", 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9996343, 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015755700000000001, 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695484+0000", 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695484+0000", 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695484+0000", 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695487+0000", 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6199999999999999e-06 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695493+0000", 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.421e-06 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695498+0000", 2024-04-19T02:18:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6879999999999998e-06 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop_reply(mds.0.3:19270 4.1 e70/38)", 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695538+0000", 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9995809, 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016006200000000001, 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "queued for pg", 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695538+0000", 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695538+0000", 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695537+0000", 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695541+0000", 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1400000000000002e-06 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695548+0000", 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0299999999999996e-06 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695554+0000", 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6910000000000002e-06 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19277 4.10 4:0ba24450:::100000026a7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.687533+0000", 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0075857909999999997, 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0082166199999999991, 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.687533+0000", 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.687533+0000", 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.687532+0000", 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.687536+0000", 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.912e-06 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.687543+0000", 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2969999999999998e-06 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.687548+0000", 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9840000000000001e-06 2024-04-19T02:18:52.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688172+0000", 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00062378800000000001 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688315+0000", 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014334100000000001 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688473+0000", 2024-04-19T02:18:52.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157474 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690212+0000", 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017387730000000001 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:19296 4.6 e70/16 4:629ddb34:::100000026c3.00000000:head v 70'383, mlcod=70'381)", 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695557+0000", 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9995613, 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025961000000000002, 2024-04-19T02:18:52.735 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695557+0000", 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695557+0000", 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695557+0000", 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695569+0000", 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2300000000000001e-05 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695574+0000", 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1829999999999996e-06 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695577+0000", 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.163e-06 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695618+0000", 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1624e-05 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695637+0000", 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8501000000000001e-05 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.738 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:19299 4.3e e70/16 4:7d19ed31:::100000026c6.00000000:head v 70'384, mlcod=70'382)", 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695592+0000", 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9995265, 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027910599999999999, 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695592+0000", 2024-04-19T02:18:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695592+0000", 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695592+0000", 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695595+0000", 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8020000000000002e-06 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695601+0000", 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9320000000000001e-06 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695606+0000", 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0329999999999999e-06 2024-04-19T02:18:52.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695635+0000", 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8396999999999999e-05 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695654+0000", 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9572000000000002e-05 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19280 4.12 4:4bba1fe4:::100000026aa.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.688475+0000", 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0066432260000000003, 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074519879999999997, 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688475+0000", 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688475+0000", 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688475+0000", 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688478+0000", 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3299999999999999e-06 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688485+0000", 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8929999999999999e-06 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688491+0000", 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9449999999999998e-06 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688573+0000", 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2138999999999994e-05 2024-04-19T02:18:52.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.688820+0000", 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024716400000000002 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.689017+0000", 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000197176 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.689987+0000", 2024-04-19T02:18:52.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00096979900000000003 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:19301 4.3b e70/16 4:dda1eed9:::100000026c8.00000000:head v 70'390, mlcod=70'388)", 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695611+0000", 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9995079, 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039361499999999999, 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695611+0000", 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695611+0000", 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695611+0000", 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695617+0000", 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6660000000000002e-06 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695623+0000", 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4929999999999998e-06 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695627+0000", 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2209999999999999e-06 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695697+0000", 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0501999999999997e-05 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695739+0000", 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1690000000000002e-05 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.750 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(mds.0.3:19300 4.6 e70/16 4:63e80714:::100000026c7.00000000:head v 70'384, mlcod=70'381)", 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695635+0000", 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9994841, 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000440316, 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695635+0000", 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695635+0000", 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695634+0000", 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967296 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695637+0000", 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8880000000000001e-06 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695643+0000", 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1999999999999999e-06 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695648+0000", 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.515e-06 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695994+0000", 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000345545 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.696011+0000", 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7496e-05 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19309 4.35 4:afc5e4fe:::100000026d3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695701+0000", 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.9994178, 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041306099999999999, 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.754 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695701+0000", 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695701+0000", 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695694+0000", 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999928 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695710+0000", 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6433999999999999e-05 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695732+0000", 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1559000000000001e-05 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695747+0000", 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4914e-05 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695820+0000", 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3361000000000005e-05 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695931+0000", 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011150999999999999 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.757 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19312 4.38 4:1e71179b:::100000026da.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.695787+0000", 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4294967295.999332, 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036283700000000002, 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695787+0000", 2024-04-19T02:18:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695787+0000", 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695785+0000", 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695831+0000", 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6093000000000001e-05 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695852+0000", 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0333999999999999e-05 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.695865+0000", 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3037000000000001e-05 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.696022+0000", 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015714599999999999 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19287 3.18 3:1f97b850:::100000026b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.690156+0000", 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0049621819999999999, 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060237019999999997, 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690156+0000", 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690156+0000", 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690155+0000", 2024-04-19T02:18:52.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690161+0000", 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8139999999999997e-06 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690177+0000", 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5719999999999999e-05 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690189+0000", 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690276+0000", 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7192000000000001e-05 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690431+0000", 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015480600000000001 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:19289 4.2d 4:b6cd159d:::100000026b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:52.690644+0000", 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0044750809999999997, 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055700250000000001, 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690644+0000", 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690644+0000", 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690643+0000", 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690648+0000", 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0270000000000003e-06 2024-04-19T02:18:52.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690660+0000", 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1909000000000001e-05 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690667+0000", 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.34e-06 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690714+0000", 2024-04-19T02:18:52.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6681999999999998e-05 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690815+0000", 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010141000000000001 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.690866+0000", 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1038999999999997e-05 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:52.691590+0000", 2024-04-19T02:18:52.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072357599999999997 2024-04-19T02:18:52.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.769 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:52.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:52.769 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-19T02:18:52.769 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 19 2024-04-19T02:18:52.769 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:52.770 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:52.771 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:52.767+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:52.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:52.779 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:52.779 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:52.782 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:52.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:52.862 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:18:52.862 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":70,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:18:50.426617+0000","last_up_change":"2024-04-19T02:17:11.442750+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":0.5,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":0,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":30},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1","osds":[2,0]},{"pgid":"4.3a","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.3a","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:18:52.871 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:52.867+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:52.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.5, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}] 2024-04-19T02:18:52.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:18:52.890 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:52.890 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:52.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:52.972 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:52.968+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.024 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:53.024 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:53.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:53.084 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:53.083+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:53.156 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-19T02:18:53.168 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:53.168 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:53.174 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:18:53.175 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.172+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:53.276 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.272+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.346 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:53.347 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:53.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:53.376 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.376+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.466 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-19T02:18:53.478 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:53.478 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:53.478 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.476+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T02:18:53.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:53.497 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:18:53.578 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:53.575+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:53.625 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:53.626 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:53.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:53.690 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.688+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.763 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-19T02:18:53.780 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.776+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T02:18:53.799 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:53.800 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:53.823 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:53.910 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.908+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.981 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:53.981 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:53.982 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:53.976+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:53.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:54.054 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-19T02:18:54.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-19T02:18:54.082 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:54.079+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:54.123 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:54.123 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:54.138 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:54.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-19T02:18:54.224 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:54.223+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:54.285 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:54.284+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:54.301 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:54.302 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:54.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:54.354 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-19T02:18:54.371 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-19T02:18:54.371 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-19T02:18:54.377 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:18:54.385 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:54.384+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:54.479 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:54.479 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:54.486 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:54.483+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:54.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:54.588 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:54.587+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:54.626 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:54.627 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:54.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:54.690 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:54.687+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:54.714 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:18:54.714 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":71,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:18:53.481347+0000","last_up_change":"2024-04-19T02:17:11.442750+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":0.5,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.66666668653488159,"average_primary_affinity":1,"average_primary_affinity_weighted":0.67000001668930054}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":0,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":21483},{"type":"v1","addr":"172.21.15.136:6801","nonce":21483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":21483},{"type":"v1","addr":"172.21.15.136:6803","nonce":21483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":21483},{"type":"v1","addr":"172.21.15.136:6807","nonce":21483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":21483},{"type":"v1","addr":"172.21.15.136:6805","nonce":21483}]},"public_addr":"172.21.15.136:6801/21483","cluster_addr":"172.21.15.136:6803/21483","heartbeat_back_addr":"172.21.15.136:6807/21483","heartbeat_front_addr":"172.21.15.136:6805/21483","state":["exists"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":30},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1","osds":[2,0]},{"pgid":"4.3a","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.3a","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:18:54.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:16:14.248072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.5, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:16:18.602050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:16:22.904068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:16:23.465439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}] 2024-04-19T02:18:54.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:18:54.769 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:54.769 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:54.783 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:54.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:54.789 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:54.787+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:54.890 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:54.887+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:54.903 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:54.903 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:54.917 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:54.921 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:54.940 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:54.940 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:54.943 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:54.943 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:54.991 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:54.988+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:55.021 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-19T02:18:55.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:18:55.048 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:55.049 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:55.064 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:55.092 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:55.092+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:55.185 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:55.186 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:55.186 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:55.192 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:55.191+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:55.200 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:55.293 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:55.288+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:55.313 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-19T02:18:55.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T02:18:55.372 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:55.372 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:55.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:55.372 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:55.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.372 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.064388844, 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:55.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.018127327000002, 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:55.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:55.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.005185660999999, 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:55.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:55.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.005124109999997, 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:55.387 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:55.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:55.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.004173041999998, 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:55.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:55.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:55.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 43.997032715000003, 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:55.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:55.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 43.989200611999998, 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.404 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:55.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 43.959135146000001, 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.409 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:55.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:55.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.414 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 43.956593298999998, 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.415 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:55.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:55.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:55.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.067877256999999, 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:55.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:55.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:55.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.869892463999999, 2024-04-19T02:18:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:55.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.431 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.771368582000001, 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:55.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.767527717, 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:55.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.443 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.609505110000001, 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:55.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.580281775, 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.450 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:55.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:55.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:55.455 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.561108903000001, 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.557340462999999, 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:55.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.235655752, 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:55.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.473 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.175916692000001, 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:55.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.560290135999999, 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.479 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:55.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:55.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.484 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:55.484 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:55.484 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:55.485 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:55.486 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:55.483+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:55.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:18:55.586 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:55.580+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:55.615 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-19T02:18:55.618 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:55.618 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:55.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:55.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T02:18:55.686 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:55.687+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:55.787 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:55.784+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:55.796 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:55.796 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:55.796 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:55.796 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:55.796 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:55.810 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:55.888 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:55.887+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-19T02:18:55.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-19T02:18:55.978 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.621461762999999, 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.6082337, 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.608138984999997, 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.606757209000001, 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.602107070999999, 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.585702462999997, 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.576484280000003, 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.573673579999998, 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.564687497999998, 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.562114692999998, 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.554887395999998, 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.549660131000003, 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.537907996999998, 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.530732827000001, 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.814353346000001, 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.802068983000002, 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.699422372000001, 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.698220663000001, 2024-04-19T02:18:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.694734313000001, 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.694382400999999, 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:56.082 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:56.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:56.084 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:56.083+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:56.185 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:56.184+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:56.214 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:56.214 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:56.214 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:18:56.214 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:56.223 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-19T02:18:56.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:56.241 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-04-19T02:18:56.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:18:56.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-19T02:18:56.286 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:56.284+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:56.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[22751]: fuse finished with error 0 and tester_r 0 2024-04-19T02:18:56.337 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:18:56.359 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:56.359 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:18:56.359 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:18:56.359 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:18:56.359 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:56.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:56.389 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:56.384+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:56.488 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:56.487+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:56.508 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.200308945000003, 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:56.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:56.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:56.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.154047427999998, 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:56.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:56.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.141105762000002, 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:56.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:56.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:56.524 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.141044211000001, 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:56.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.140093143000001, 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:56.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:56.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.132952816, 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:56.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:56.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.541 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.125120713000001, 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:56.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:56.546 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.095055246999998, 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.547 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:56.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.092513400000001, 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:56.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:56.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.203797357999999, 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:56.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:56.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.005812564999999, 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:56.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:56.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.907288683000001, 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:56.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:56.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.576 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.903447818, 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:56.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:56.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.582 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.745425211000001, 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:56.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.588 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.716201876, 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:56.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:56.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.697029004000001, 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:56.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.600 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.693260563999999, 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:56.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:56.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.606 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.371575853, 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:56.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:56.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.311836793000001, 2024-04-19T02:18:56.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.696210236999999, 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:56.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:56.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.622 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:56.623 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:56.623 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:56.625 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-19T02:18:56.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:56.627 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:56.620+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:56.725 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:56.723+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:56.755 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:56.755 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:56.769 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:56.826 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:56.820+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:56.890 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:56.891 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:56.891 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:56.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:56.927 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:56.927+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:56.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:18:57.028 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:57.027+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:57.069 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:57.069 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:57.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:57.069 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:57.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.069 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.069 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.712777072000002, 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:18:57.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:18:57.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:57.075 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.699549009000002, 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.699454293999999, 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.080 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:18:57.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.698072518000004, 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:18:57.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:18:57.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.693422380000001, 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.090 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:18:57.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:18:57.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.095 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.677017771999999, 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:57.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:18:57.100 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.667799588999998, 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.101 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:18:57.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.664988889, 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:18:57.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:18:57.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:18:57.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.656002807, 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.116 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.653430002, 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:18:57.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:18:57.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.646202705, 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:18:57.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.126 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.640975439999998, 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.127 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.629223306, 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:18:57.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.622048135999997, 2024-04-19T02:18:57.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:18:57.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.905668654999999, 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:18:57.143 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:18:57.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:57.148 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.893384292, 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:57.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.153 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.790737681, 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:18:57.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:18:57.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.789535971999999, 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:18:57.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:18:57.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:18:57.163 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.786049622, 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:18:57.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:18:57.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.785697710000001, 2024-04-19T02:18:57.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:18:57.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:18:57.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:18:57.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:18:57.173 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:57.174 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:57.175 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:57.176 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:57.176 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:57.172+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:57.177 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:57.177 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:57.177 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:57.178 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:57.275 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:57.274+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:57.308 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:57.308 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:57.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:57.376 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:57.376+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:57.477 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:57.476+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:57.479 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:57.480 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:57.493 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:57.578 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:57.574+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:57.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:57.679 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:57.678+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:57.756 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:57.756 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:57.771 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:57.780 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:57.778+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:57.881 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:57.876+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:57.888 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:57.888 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:57.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:57.982 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:57.978+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:58.070 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:58.070 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:58.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:58.084 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:58.082+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:58.185 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:58.180+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:58.212 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:58.213 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:58.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:58.286 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:58.282+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:58.344 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:58.344 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:58.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:58.387 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:58.384+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:58.488 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:58.486+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:58.521 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:58.521 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:58.535 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:58.588 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:58.586+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:58.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:18:58.667 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:58.668 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:58.683 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:58.726 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:58.724+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:58.790 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:58.788+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:58.800 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:58.800 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:58.815 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:58.903 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:58.900+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:58.981 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:58.981 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:58.992 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:58.988+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:58.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:18:59.093 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:59.092+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:59.126 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:59.126 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:59.140 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:18:59.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:18:59.194 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:59.192+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:59.256 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:18:59.257 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:18:59.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:18:59.294 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:59.292+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:59.325 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:18:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:18:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:18:59.345 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:18:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:18:59.348 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:18:59.348 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:18:59.395 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.089354096000001, 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.396 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.043092579000003, 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:18:59.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:18:59.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:18:59.406 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.030150913, 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:18:59.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:18:59.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.030089361999998, 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:18:59.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:18:59.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.029138293999999, 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:18:59.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:18:59.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.422 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.021997966999997, 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:18:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:18:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:18:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 48.014165863999999, 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:18:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.984100398000002, 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:18:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.981558550999999, 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:18:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:18:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:18:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:18:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.092842509, 2024-04-19T02:18:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:18:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:18:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.894857716000001, 2024-04-19T02:18:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:18:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.796333833999999, 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:18:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:18:59.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:18:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:59.462 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.792492969000001, 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:18:59.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:18:59.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.634470361999998, 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:18:59.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:18:59.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:18:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.605247027000001, 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:18:59.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:18:59.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.586074154999999, 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:18:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:18:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:18:59.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.582305715, 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:18:59.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:18:59.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:18:59.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.260621004000001, 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.492 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:18:59.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:18:59.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.200881943999999, 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.498 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:18:59.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.585255388, 2024-04-19T02:18:59.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:18:59.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:18:59.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:18:59.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:18:59.508 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:18:59.509 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:59.394+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:59.510 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:18:59.541 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-19T02:18:59.552 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:59.550+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:59.612 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:59.608+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:59.643 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:59.643 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:18:59.643 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:59.657 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:18:59.746 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:18:59.744+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:18:59.814 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:59.810+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:59.819 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:59.819 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:18:59.819 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:18:59.819 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:18:59.819 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:18:59.833 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:18:59.915 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:18:59.914+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:18:59.998 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.642033235, 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:18:59.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:19:00.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.628805172, 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:19:00.009 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.628710456999997, 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:19:00.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:19:00.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:19:00.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:19:00.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.014 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.627328681000002, 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.015 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:19:00.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:19:00.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:19:00.020 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.622678542999999, 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:19:00.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:19:00.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:19:00.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.606273934999997, 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:19:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:19:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.597055752000003, 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:19:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.594245051999998, 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:19:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:19:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:19:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:19:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:19:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:19:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.585258969999998, 2024-04-19T02:19:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:19:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:19:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:19:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.582686164999998, 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:19:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.575458867999998, 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:19:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:19:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:19:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:19:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:19:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.570231603000003, 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:19:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.558479468999998, 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:19:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.551304299000002, 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:19:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:19:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.834924818000001, 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:19:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.822640454999998, 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:19:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:19:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.719993844000001, 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:19:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:19:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:19:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:19:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.718792135000001, 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:19:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.715305784999998, 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:19:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:19:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.714953872999999, 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:00.113 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:19:00.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-19T02:19:00.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:19:00.115 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:19:00.114+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:19:00.215 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:00.212+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:00.247 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:19:00.247 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:19:00.247 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:19:00.247 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:19:00.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:19:00.316 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:00.316+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:00.377 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:19:00.378 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:19:00.378 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-19T02:19:00.378 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-19T02:19:00.378 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:19:00.391 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:19:00.417 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:00.416+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.203454379999997, 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.185850401, 2024-04-19T02:19:00.510 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305389+0000", 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.305385+0000", 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311565+0000", 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006179342 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311609+0000", 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4518999999999998e-05 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311631+0000", 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985999999999999e-05 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.311839+0000", 2024-04-19T02:19:00.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020798400000000001 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.312028+0000", 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018832199999999999 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491145+0000", 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.17911750900000001 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491176+0000", 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.133e-05 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.491240+0000", 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3225999999999994e-05 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.157192862999999, 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099057645999999999, 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 6 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351651+0000", 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.351647+0000", 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999962 2024-04-19T02:19:00.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357893+0000", 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062462780000000001 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357936+0000", 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2870000000000001e-05 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.357959+0000", 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2884999999999999e-05 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358037+0000", 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7752999999999999e-05 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.358235+0000", 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019840600000000001 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450573+0000", 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092337660000000002 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450628+0000", 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5263999999999998e-05 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.450708+0000", 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0112999999999997e-05 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4564.0:5 4.10 e57/16 4:09a4c37f:::10000000003.00000001:head v 57'1, mlcod=0'0)", 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.144251197000003, 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12778084000000001, 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364592+0000", 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364591+0000", 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369798+0000", 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052067379999999998 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369808+0000", 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0209e-05 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369814+0000", 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369854+0000", 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9425000000000003e-05 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.369874+0000", 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9820999999999999e-05 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492339+0000", 2024-04-19T02:19:00.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.12246588899999999 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.492373+0000", 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3763000000000002e-05 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.144189646000001, 2024-04-19T02:19:00.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19260011199999999, 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364654+0000", 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364653+0000", 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364718+0000", 2024-04-19T02:19:00.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4876999999999996e-05 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364740+0000", 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997e-05 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364771+0000", 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1609000000000002e-05 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364826+0000", 2024-04-19T02:19:00.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4378e-05 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364889+0000", 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3031e-05 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.364972+0000", 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3795999999999995e-05 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368155+0000", 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031829520000000002 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557150+0000", 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18899486600000001 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557211+0000", 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0742999999999998e-05 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557254+0000", 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.143238578000002, 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.19178589700000001, 2024-04-19T02:19:00.531 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 12 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365605+0000", 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365603+0000", 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365615+0000", 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1382e-05 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365639+0000", 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3964e-05 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365653+0000", 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4297000000000001e-05 2024-04-19T02:19:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365698+0000", 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5055999999999997e-05 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365782+0000", 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3750000000000003e-05 2024-04-19T02:19:00.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.365858+0000", 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5983999999999996e-05 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.368638+0000", 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002780336 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557305+0000", 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.18866648799999999 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557349+0000", 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4867000000000003e-05 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.557391+0000", 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1495000000000002e-05 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.136098251, 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112709581, 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 19 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372745+0000", 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372744+0000", 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372753+0000", 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-19T02:19:00.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372772+0000", 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9233999999999999e-05 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372783+0000", 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0508e-05 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372841+0000", 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8146999999999997e-05 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.372975+0000", 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013422600000000001 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485307+0000", 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.112332108 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485358+0000", 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0856000000000002e-05 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485455+0000", 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6754000000000002e-05 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.543 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.128266148000002, 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.105008322, 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 28 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380577+0000", 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380576+0000", 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380585+0000", 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7479999999999999e-06 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380603+0000", 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8788e-05 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380615+0000", 2024-04-19T02:19:00.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1121000000000001e-05 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380672+0000", 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7453e-05 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.380809+0000", 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136895 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485472+0000", 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.104662967 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485510+0000", 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7786e-05 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.485586+0000", 2024-04-19T02:19:00.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6038000000000006e-05 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.098200681999998, 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.15349649300000001, 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410643+0000", 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410642+0000", 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410649+0000", 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-19T02:19:00.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410663+0000", 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.43e-05 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410671+0000", 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410730+0000", 2024-04-19T02:19:00.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9128e-05 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.410896+0000", 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016593599999999999 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.411082+0000", 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186176 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.414109+0000", 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030268780000000002 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564081+0000", 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14997254700000001 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564114+0000", 2024-04-19T02:19:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2409000000000001e-05 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564139+0000", 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5541000000000002e-05 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:19:00.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.095658835000002, 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.151116051, 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:19:00.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413185+0000", 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413184+0000", 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413190+0000", 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413204+0000", 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3427999999999999e-05 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413211+0000", 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1790000000000002e-06 2024-04-19T02:19:00.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413262+0000", 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1310999999999997e-05 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413465+0000", 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202874 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.413663+0000", 2024-04-19T02:19:00.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019850400000000001 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.417737+0000", 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040731159999999999 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564193+0000", 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.14645613499999999 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564261+0000", 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8677000000000007e-05 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:11.564301+0000", 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9449999999999997e-05 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10678 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.206942793, 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10187387000000001, 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10678 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.562 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301901+0000", 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.301899+0000", 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311483+0000", 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095843249999999994 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311510+0000", 2024-04-19T02:19:00.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7591000000000001e-05 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311524+0000", 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3196999999999999e-05 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.311691+0000", 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016715499999999999 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312106+0000", 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000414745 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.312456+0000", 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035014699999999998 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.364853+0000", 2024-04-19T02:19:00.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052397273000000001 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403646+0000", 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038793246000000003 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403720+0000", 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3798000000000001e-05 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.403775+0000", 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4660999999999997e-05 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10707 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.008958, 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100644186, 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.568 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10707 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499886+0000", 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.499883+0000", 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999971 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503928+0000", 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040449539999999999 2024-04-19T02:19:00.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503968+0000", 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0399999999999999e-05 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.503987+0000", 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8989000000000001e-05 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504135+0000", 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014771399999999999 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.504377+0000", 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242229 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600407+0000", 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.096029738000000003 2024-04-19T02:19:00.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600456+0000", 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9540999999999999e-05 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.600530+0000", 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3343999999999994e-05 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10724 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.910434118000001, 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.11252651599999999, 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10724 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598409+0000", 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.598408+0000", 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602159+0000", 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003750621 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602176+0000", 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7133e-05 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602184+0000", 2024-04-19T02:19:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3590000000000008e-06 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602269+0000", 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5216999999999994e-05 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602409+0000", 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013947699999999999 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602553+0000", 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014429699999999999 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.625467+0000", 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022913863999999999 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710868+0000", 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.085401353999999999 2024-04-19T02:19:00.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710897+0000", 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8779999999999999e-05 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.710936+0000", 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8729999999999997e-05 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10726 4.19 4:9a5899f2:::100000030c3.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.906593253, 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.108924058, 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10726 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602250+0000", 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602371+0000", 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121332 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602390+0000", 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8899e-05 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.602396+0000", 2024-04-19T02:19:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4659999999999996e-06 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623118+0000", 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020721296 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623210+0000", 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1784000000000001e-05 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.623373+0000", 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016324699999999999 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.626131+0000", 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027584530000000001 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711000+0000", 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.084868391000000001 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711081+0000", 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1217999999999994e-05 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.711174+0000", 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3502e-05 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10790 4.19 4:9a5899f2:::100000030c3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.748570646000001, 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.095773931000000007, 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10790 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760273+0000", 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.760271+0000", 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764185+0000", 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136529999999996 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764204+0000", 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.764213+0000", 2024-04-19T02:19:00.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1749999999999994e-06 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787051+0000", 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022837059 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787121+0000", 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0647000000000003e-05 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.787232+0000", 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011071800000000001 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814463+0000", 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02723155 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.855943+0000", 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041479574999999998 2024-04-19T02:19:00.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856003+0000", 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9908000000000003e-05 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856047+0000", 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3925999999999999e-05 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10799 4.19 4:9943069b:::100000030ce.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.719347311, 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.122917323, 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10799 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789496+0000", 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.789495+0000", 2024-04-19T02:19:00.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793872+0000", 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043772250000000002 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793955+0000", 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3367000000000003e-05 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.793967+0000", 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1195999999999999e-05 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814478+0000", 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020511931000000001 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814526+0000", 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7252000000000001e-05 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.814609+0000", 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3219000000000004e-05 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.861233+0000", 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046624227999999997 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912359+0000", 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.051126285 2024-04-19T02:19:00.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912391+0000", 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1646000000000002e-05 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912414+0000", 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2481e-05 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10809 4.19 4:9943069b:::100000030ce.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.700174439000001, 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10390157899999999, 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10809 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808669+0000", 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.808668+0000", 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-19T02:19:00.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812398+0000", 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003729666 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812417+0000", 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8521000000000001e-05 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812425+0000", 2024-04-19T02:19:00.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9390000000000003e-06 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838359+0000", 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025934008000000001 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838463+0000", 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103546 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.838617+0000", 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015427099999999999 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.862557+0000", 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023939881999999999 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912469+0000", 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.049911364999999999 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912535+0000", 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6371000000000005e-05 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912571+0000", 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5797000000000003e-05 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.603 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10810 4.19 4:9943069b:::100000030ce.00000000:head [write 3801088~393216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.696405999, 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10027889, 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10810 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812438+0000", 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812436+0000", 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812586+0000", 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150309 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812597+0000", 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.096e-05 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.812605+0000", 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7719999999999994e-06 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856082+0000", 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043477235000000003 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856206+0000", 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012348 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.856356+0000", 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015024400000000001 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912331+0000", 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055974538999999997 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912610+0000", 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027945800000000001 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912679+0000", 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8977e-05 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:29.912716+0000", 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7453000000000002e-05 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10958 4.3f 4:fe9b302b:::10000003112.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.374721288, 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.100377914, 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10958 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134122+0000", 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.134121+0000", 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139144+0000", 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050234390000000002 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139166+0000", 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1503999999999999e-05 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139179+0000", 2024-04-19T02:19:00.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139246+0000", 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6896000000000005e-05 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139395+0000", 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014967 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-19T02:19:00.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.139553+0000", 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000157484 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.167051+0000", 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027498517 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234381+0000", 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067329443000000003 2024-04-19T02:19:00.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234451+0000", 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0786999999999998e-05 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.234500+0000", 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8751000000000001e-05 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:10992 4.2a 4:56da044e:::100000031af.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 30.314982228000002, 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.099367713999999996, 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 10992 2024-04-19T02:19:00.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.193861+0000", 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200839+0000", 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069779229999999996 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200856+0000", 2024-04-19T02:19:00.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7153999999999999e-05 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.200865+0000", 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270735+0000", 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069869179000000003 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.270879+0000", 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144291 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293096+0000", 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022217509999999999 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293151+0000", 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4666999999999997e-05 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:30.293229+0000", 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7918999999999997e-05 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4564.0:13560 4.e 4:70553bfa:::10000003718.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.699355671999999, 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.10015769300000001, 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-19T02:19:00.621 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4564", 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13560 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809488+0000", 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.809487+0000", 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816919+0000", 2024-04-19T02:19:00.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074319950000000003 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816933+0000", 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4612e-05 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.816942+0000", 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.901e-06 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-19T02:19:00.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817051+0000", 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109082 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.817236+0000", 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018478799999999999 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909561+0000", 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.092325470000000007 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909588+0000", 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6475999999999999e-05 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-19T02:18:33.909646+0000", 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7623e-05 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-19T02:19:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-19T02:19:00.627 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:19:00.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:19:00.629 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:00.624+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:00.729 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:00.724+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:00.755 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:19:00.755 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:19:00.755 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-19T02:19:00.755 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:19:00.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:19:00.854 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:00.852+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:00.930 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:00.928+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:00.934 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:19:00.934 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-19T02:19:00.935 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-19T02:19:00.935 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-19T02:19:00.935 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:19:00.949 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:19:01.034 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:01.032+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:01.115 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-19T02:19:01.115 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-19T02:19:01.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-19T02:19:01.115 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-19T02:19:01.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.758405437999997, 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.209726041, 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.116 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 5 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354212+0000", 2024-04-19T02:19:01.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.354209+0000", 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363447+0000", 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092381149999999999 2024-04-19T02:19:01.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363475+0000", 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8081000000000001e-05 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363498+0000", 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2558999999999999e-05 2024-04-19T02:19:01.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363607+0000", 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108541 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.363827+0000", 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022084900000000001 2024-04-19T02:19:01.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.364088+0000", 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026095699999999998 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558017+0000", 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.193928921 2024-04-19T02:19:01.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563897+0000", 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058797739999999999 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563920+0000", 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3351999999999999e-05 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563938+0000", 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7748e-05 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:11 4.28 e57/16 4:177a762d:::10000000201.00000000:head v 57'1, mlcod=0'0)", 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.745177374999997, 2024-04-19T02:19:01.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18926235999999999, 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367440+0000", 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367438+0000", 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367459+0000", 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0709000000000001e-05 2024-04-19T02:19:01.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367490+0000", 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1492000000000003e-05 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367509+0000", 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367579+0000", 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9826000000000005e-05 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367625+0000", 2024-04-19T02:19:01.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5460999999999997e-05 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556682+0000", 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18905767300000001 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556703+0000", 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0166999999999999e-05 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.128 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:12 4.28 e57/16 4:15246602:::10000000202.00000000:head v 57'2, mlcod=0'0)", 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.745082660000001, 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18918460300000001, 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367535+0000", 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367534+0000", 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367555+0000", 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1305999999999999e-05 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367575+0000", 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9126e-05 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.367600+0000", 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5819000000000001e-05 2024-04-19T02:19:01.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368146+0000", 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054533200000000004 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368175+0000", 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9264999999999998e-05 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556706+0000", 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.188530488 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556720+0000", 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4011e-05 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.743700883999999, 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18787500900000001, 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 15 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368917+0000", 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368908+0000", 2024-04-19T02:19:01.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999914 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368937+0000", 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8365e-05 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368963+0000", 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6069000000000001e-05 2024-04-19T02:19:01.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.368986+0000", 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3402000000000001e-05 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369093+0000", 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106525 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.369367+0000", 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027420899999999998 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556726+0000", 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18735934400000001 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556752+0000", 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5890000000000001e-05 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556792+0000", 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9750999999999999e-05 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.739050745999997, 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.18328570999999999, 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 20 2024-04-19T02:19:01.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373567+0000", 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373565+0000", 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373578+0000", 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373604+0000", 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6291999999999998e-05 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373621+0000", 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7011999999999999e-05 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373692+0000", 2024-04-19T02:19:01.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0610000000000003e-05 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.373861+0000", 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016843500000000001 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556797+0000", 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.182936608 2024-04-19T02:19:01.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556819+0000", 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1942000000000001e-05 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556853+0000", 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:38 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~3886] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.722646138000002, 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.166942547, 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 38 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389971+0000", 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389969+0000", 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.389993+0000", 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3676000000000002e-05 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390045+0000", 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1993999999999997e-05 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390061+0000", 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6099e-05 2024-04-19T02:19:01.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390156+0000", 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5129000000000003e-05 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.390376+0000", 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021966499999999999 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556858+0000", 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.16648222600000001 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556880+0000", 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2144999999999999e-05 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556914+0000", 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4047000000000001e-05 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:48 4.30 4:0cc9e906:::10000000227.00000000:head [write 0~1384] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:19:01.154 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.713427955, 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.157785127, 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 48 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399190+0000", 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399188+0000", 2024-04-19T02:19:01.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399201+0000", 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3166000000000001e-05 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399233+0000", 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1848999999999999e-05 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399253+0000", 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9981999999999999e-05 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399361+0000", 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108625 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.399752+0000", 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039107999999999998 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556920+0000", 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15716733599999999 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556941+0000", 2024-04-19T02:19:01.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1401999999999999e-05 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556975+0000", 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3800999999999997e-05 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.710617255000003, 2024-04-19T02:19:01.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.161986771, 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 51 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402000+0000", 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.401998+0000", 2024-04-19T02:19:01.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402012+0000", 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4379000000000001e-05 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402044+0000", 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1188e-05 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.402069+0000", 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5916000000000001e-05 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556589+0000", 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15451957799999999 2024-04-19T02:19:01.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556901+0000", 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000312238 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.557250+0000", 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034822599999999998 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559475+0000", 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022252399999999999 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563944+0000", 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044688760000000001 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563963+0000", 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9635000000000001e-05 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563987+0000", 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3833999999999999e-05 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:60 4.28 e57/16 4:14ce3b86:::10000000233.00000000:head v 57'3, mlcod=0'0)", 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.701631173000003, 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15268725399999999, 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410986+0000", 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410985+0000", 2024-04-19T02:19:01.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.410998+0000", 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2733e-05 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411029+0000", 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1333e-05 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.411042+0000", 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556534+0000", 2024-04-19T02:19:01.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14549163900000001 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556546+0000", 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2092e-05 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563651+0000", 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071047910000000001 2024-04-19T02:19:01.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563674+0000", 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2804000000000001e-05 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4564.0:63 4.28 e57/16 4:1537fa38:::10000000236.00000000:head v 57'4, mlcod=0'0)", 2024-04-19T02:19:01.173 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.699058368000003, 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.15013333500000001, 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413559+0000", 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413558+0000", 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999986 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413569+0000", 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0814e-05 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413592+0000", 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2926999999999999e-05 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.413604+0000", 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2075999999999999e-05 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556988+0000", 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14338431600000001 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.556998+0000", 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0317e-05 2024-04-19T02:19:01.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563675+0000", 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066770379999999997 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563693+0000", 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7084000000000001e-05 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.178 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.691831071000003, 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.14324341099999999, 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 71 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420787+0000", 2024-04-19T02:19:01.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420785+0000", 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420797+0000", 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.218e-05 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420825+0000", 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7738000000000001e-05 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.420841+0000", 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6489000000000001e-05 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558081+0000", 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13723981599999999 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558381+0000", 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000300301 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558713+0000", 2024-04-19T02:19:01.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033151300000000002 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.561045+0000", 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023324230000000001 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563994+0000", 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029484670000000002 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564014+0000", 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0327999999999999e-05 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564030+0000", 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6045999999999998e-05 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.686603806000001, 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.1377797, 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 77 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426014+0000", 2024-04-19T02:19:01.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426012+0000", 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426025+0000", 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2901999999999999e-05 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426052+0000", 2024-04-19T02:19:01.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7878999999999999e-05 2024-04-19T02:19:01.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.426067+0000", 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4283e-05 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558035+0000", 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13196825500000001 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558108+0000", 2024-04-19T02:19:01.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3440000000000002e-05 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563723+0000", 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056142020000000004 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563749+0000", 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6508000000000001e-05 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563793+0000", 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4307000000000001e-05 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.674851672000003, 2024-04-19T02:19:01.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.126085957, 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 89 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437766+0000", 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437764+0000", 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437777+0000", 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3665999999999999e-05 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437808+0000", 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0818000000000002e-05 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.437822+0000", 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4348999999999999e-05 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558346+0000", 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120523173 2024-04-19T02:19:01.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.558409+0000", 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3788999999999995e-05 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563798+0000", 2024-04-19T02:19:01.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005388444 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563818+0000", 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0645999999999999e-05 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.563852+0000", 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3371999999999998e-05 2024-04-19T02:19:01.198 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.667676501999999, 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119190141, 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.199 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 96 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444941+0000", 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444939+0000", 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444953+0000", 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3969e-05 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444982+0000", 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8881999999999999e-05 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.444999+0000", 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7846000000000002e-05 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559563+0000", 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.114563581 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.559892+0000", 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032907100000000001 2024-04-19T02:19:01.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.560242+0000", 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000349542 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.562468+0000", 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002226057 2024-04-19T02:19:01.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564091+0000", 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016233700000000001 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564112+0000", 2024-04-19T02:19:01.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1053999999999999e-05 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:11.564131+0000", 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9099000000000001e-05 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10640 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.951297020999998, 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119225452, 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10640 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161321+0000", 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.161318+0000", 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172910+0000", 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011591499 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172953+0000", 2024-04-19T02:19:01.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3285000000000003e-05 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.172974+0000", 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1246e-05 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173079+0000", 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000104782 2024-04-19T02:19:01.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173204+0000", 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012552 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280112+0000", 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10690812299999999 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280324+0000", 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021188700000000001 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280546+0000", 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022164 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.212 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10643 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.939012657999999, 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.13013791299999999, 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.213 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10643 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173605+0000", 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.173604+0000", 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.999999 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182093+0000", 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008488911 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182124+0000", 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1708999999999997e-05 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.182140+0000", 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5780000000000001e-05 2024-04-19T02:19:01.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202113+0000", 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019972832999999999 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.202338+0000", 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022451900000000001 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303531+0000", 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.10119325999999999 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303613+0000", 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2064999999999994e-05 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.303743+0000", 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012990899999999999 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10662 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.836366046999999, 2024-04-19T02:19:01.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12538445500000001, 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10662 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276252+0000", 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.276249+0000", 2024-04-19T02:19:01.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281183+0000", 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049341970000000004 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281223+0000", 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0262000000000002e-05 2024-04-19T02:19:01.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281266+0000", 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3472e-05 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281391+0000", 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012436599999999999 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281535+0000", 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144425 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401425+0000", 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.119889261 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401505+0000", 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0451999999999995e-05 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401636+0000", 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013101599999999999 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:258 3.13 3:ceffbd45:::200.0000000a:head [write 3665267~1957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.835164337999998, 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.123825635, 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:19:01.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277453+0000", 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277451+0000", 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999976 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277465+0000", 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4173e-05 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277493+0000", 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8313000000000001e-05 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.277508+0000", 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4610000000000001e-05 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309454+0000", 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.031945915999999998 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.309661+0000", 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000207517 2024-04-19T02:19:01.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401118+0000", 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.091456714999999994 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401175+0000", 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7012000000000002e-05 2024-04-19T02:19:01.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401279+0000", 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103686 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(mds.0.3:259 3.13 3:ceffbd45:::200.0000000a:head [write 3667224~10504 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:19:01.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.831677987999999, 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.120531971, 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280940+0000", 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280937+0000", 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999971 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.280966+0000", 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8996000000000002e-05 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281003+0000", 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7058999999999999e-05 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281024+0000", 2024-04-19T02:19:01.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0876000000000001e-05 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311082+0000", 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.030058457 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311302+0000", 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021975900000000001 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401293+0000", 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.089991273999999996 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401357+0000", 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3539000000000003e-05 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401472+0000", 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000114645 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4564.0:10663 4.2b 4:d738455c:::100000030db.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:19:01.237 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.831326076, 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.12052367, 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4564", 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "192.168.0.1:0/2500730957", 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 10663 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281291+0000", 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.281290+0000", 2024-04-19T02:19:01.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4294967295.9999981 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285880+0000", 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045904439999999999 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285906+0000", 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5989000000000001e-05 2024-04-19T02:19:01.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.285918+0000", 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2217e-05 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311054+0000", 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025135336000000001 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.311433+0000", 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037973800000000002 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401663+0000", 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.090229384999999995 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401721+0000", 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8325999999999997e-05 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-19T02:18:29.401815+0000", 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4081999999999998e-05 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-19T02:19:01.244 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-19T02:19:01.244 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-19T02:19:01.245 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:01.240+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:01.246 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:19:01.346 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:19:01.342+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:19:01.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:19:01.376 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-19T02:19:01.376 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-19T02:19:01.377 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-19T02:19:01.377 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-19T02:19:01.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:19:01.477 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:19:01.474+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:19:01.504 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-19T02:19:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:19:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-19T02:19:01.524 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-19T02:19:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:19:01.527 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:19:01.528 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:19:01.547 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:19:01.542+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:19:01.562 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:01.562 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:01.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:19:01.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:19:01.668 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:19:01.666+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:19:01.742 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:01.743 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:01.748 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:01.748+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:01.757 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:19:01.849 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:19:01.846+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:19:01.890 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:01.890 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:01.903 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:19:01.950 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:01.948+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:02.034 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:19:02.078 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:02.076+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:02.152 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-04-19T02:19:02.150+0000 7fdd66466640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21422) UID: 0 2024-04-19T02:19:02.195 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:02.195 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:02.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:19:02.253 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:02.248+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:02.343 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:02.363 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:02.365 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:19:02.366 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:02.360+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:02.439 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-19T02:19:02.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:19:02.439 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-19T02:19:02.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:19:02.459 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-19T02:19:02.466 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:02.464+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:02.487 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:02.487 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:02.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:19:02.507 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-19T02:19:02.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:19:02.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-19T02:19:02.559 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:19:02.566 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:02.564+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:02.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T02:19:02.568 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-19T02:19:02.625 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:02.625 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:02.639 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:19:02.687 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-19T02:19:02.684+0000 7faac215b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21521) UID: 0 2024-04-19T02:19:02.755 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-19T02:19:02.764 INFO:tasks.thrashosds:joining thrashosds 2024-04-19T02:19:02.771 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:02.772 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:02.785 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:19:02.946 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:02.946 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:02.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:19:03.077 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-19T02:19:03.078 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:19:04.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:19:05.573 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-19T02:19:05.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:19:05.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-19T02:19:06.583 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-19T02:19:11.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-19T02:19:17.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-19T02:19:23.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-04-19T02:19:29.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-04-19T02:19:34.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-04-19T02:19:40.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-04-19T02:19:46.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2024-04-19T02:19:52.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~158s 2024-04-19T02:19:58.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~164s 2024-04-19T02:20:03.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~169s 2024-04-19T02:20:09.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2024-04-19T02:20:15.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~181s 2024-04-19T02:20:20.533 DEBUG:teuthology.orchestra.console.smithi136:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6E 43 GUID: 00000000 0000 0000 0000 0CC47AD93B1A DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.136 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6e:43)... Configuring (net0 0c:c4:7a:88:6e:43).... Configuring (net0 0c:c4:7a:88:6e:43)..... Configuring (net0 0c:c4:7a:88:6e:43)...... ok     * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.737 MHz processor [ 0.000418] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000597] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001888] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.008235] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008248] Using GB pages for direct mapping [ 0.008347] RAMDISK: [mem 0x300d1000-0x3405ffff] [ 0.008353] ACPI: Early table checksum verification disabled [ 0.008356] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008360] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.008365] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008370] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008373] ACPI: FACS 0x0000000079D49F80 000040 [ 0.008375] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008378] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008381] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008384] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008386] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008389] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008392] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008395] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008398] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008401] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008404] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008406] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008409] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008412] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008415] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008418] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008421] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008423] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.008425] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.008426] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.008427] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.008428] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.008429] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.008429] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.008430] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.008431] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.008432] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.008433] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.008434] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.008435] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.008436] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.008437] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.008438] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.008439] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.008440] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.008441] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.008442] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.008537] No NUMA configuration found [ 0.008538] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008547] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008876] Zone ranges: [ 0.008877] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008879] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008880] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008882] Device empty [ 0.008883] Movable zone start for each node [ 0.008886] Early memory node ranges [ 0.008886] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008888] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.008889] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008893] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008898] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008933] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.080504] On node 0, zone Normal: 29010 pages in unavailable ranges [ 0.080619] ACPI: PM-Timer IO Port: 0x408 [ 0.080628] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080629] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080630] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080631] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080632] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080633] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080634] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080635] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080644] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080649] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080651] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080653] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080656] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080658] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080661] TSC deadline timer available [ 0.080663] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080672] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080674] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.080675] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080677] PM: hibernation: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.080678] PM: hibernation: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.080679] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.080680] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.080681] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080681] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080682] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080683] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080685] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080686] Booting paravirtualized kernel on bare hardware [ 0.080688] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080694] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080911] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080943] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.080945] Policy zone: Normal [ 0.080946] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081005] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.083159] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084305] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084400] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170585] Memory: 32672616K/33437920K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765044K reserved, 0K cma-reserved) [ 0.170870] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170885] Kernel/User page tables isolation: enabled [ 0.170916] ftrace: allocating 50694 entries in 199 pages [ 0.190764] ftrace: allocated 199 pages with 5 groups [ 0.190884] rcu: Hierarchical RCU implementation. [ 0.190885] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190887] Rude variant of Tasks RCU enabled. [ 0.190888] Tracing variant of Tasks RCU enabled. [ 0.190888] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190889] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194309] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194507] random: crng init done [ 0.199403] Console: colour VGA+ 80x25 [ 0.210714] printk: console [tty0] enabled [ 1.182088] printk: console [ttyS1] enabled [ 1.186348] ACPI: Core revision 20210730 [ 1.190509] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.199740] APIC: Switch to symmetric I/O mode setup [ 1.204778] DMAR: Host address width 46 [ 1.208688] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.214076] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.222175] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.229609] DMAR: ATSR flags: 0x0 [ 1.232997] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.239332] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.245756] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.252176] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.257644] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.257645] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.272832] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.278205] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.284504] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.307747] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32725850a05, max_idle_ns: 440795315679 ns [ 1.318361] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.47 BogoMIPS (lpj=13998948) [ 1.322377] CPU0: Thermal monitoring enabled (TM1) [ 1.326412] process: using mwait in idle threads [ 1.330361] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.334359] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.338360] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.342360] Spectre V2 : Mitigation: Retpolines [ 1.346359] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.350359] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.354359] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.358360] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.362359] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.366359] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.370362] MDS: Mitigation: Clear CPU buffers [ 1.374359] TAA: Mitigation: Clear CPU buffers [ 1.378359] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.382364] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.386359] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.390359] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.394359] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.398359] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.420066] Freeing SMP alternatives memory: 44K [ 1.422360] pid_max: default: 32768 minimum: 301 [ 1.426380] LSM: Security Framework initializing [ 1.430368] landlock: Up and running. [ 1.434359] Yama: becoming mindful. [ 1.438376] AppArmor: AppArmor initialized [ 1.442419] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.446399] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.450720] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.454364] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.458467] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.462360] ... version: 3 [ 1.466359] ... bit width: 48 [ 1.470359] ... generic registers: 4 [ 1.474359] ... value mask: 0000ffffffffffff [ 1.478359] ... max period: 00007fffffffffff [ 1.482359] ... fixed-purpose events: 3 [ 1.486359] ... event mask: 000000070000000f [ 1.490420] signal: max sigframe size: 1776 [ 1.494374] rcu: Hierarchical SRCU implementation. [ 1.499073] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.502424] smp: Bringing up secondary CPUs ... [ 1.506440] x86: Booting SMP configuration: [ 1.510361] .... node #0, CPUs: #1 #2 #3 #4 [ 1.518446] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.526360] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.530359] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.534457] #5 #6 #7 [ 1.534914] smp: Brought up 1 node, 8 CPUs [ 1.542361] smpboot: Max logical packages: 1 [ 1.546359] smpboot: Total of 8 processors activated (55995.79 BogoMIPS) [ 1.554706] devtmpfs: initialized [ 1.557771] x86/mm: Memory block size: 128MB [ 1.559974] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.562436] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.566369] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.570405] pinctrl core: initialized pinctrl subsystem [ 1.574451] PM: RTC time: 02:19:47, date: 2024-04-19 [ 1.578466] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.582692] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.586658] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.590694] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.594370] audit: initializing netlink subsys (disabled) [ 1.598377] audit: type=2000 audit(1713493185.356:1): state=initialized audit_enabled=0 res=1 [ 1.598477] thermal_sys: Registered thermal governor 'fair_share' [ 1.602361] thermal_sys: Registered thermal governor 'bang_bang' [ 1.606359] thermal_sys: Registered thermal governor 'step_wise' [ 1.610359] thermal_sys: Registered thermal governor 'user_space' [ 1.614359] thermal_sys: Registered thermal governor 'power_allocator' [ 1.618364] EISA bus registered [ 1.625573] cpuidle: using governor ladder [ 1.626361] cpuidle: using governor menu [ 1.630376] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.634360] ACPI: bus type PCI registered [ 1.638361] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.642415] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.646361] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.650372] PCI: Using configuration type 1 for base access [ 1.655380] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.658376] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.662360] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.666435] ACPI: Added _OSI(Module Device) [ 1.670361] ACPI: Added _OSI(Processor Device) [ 1.674367] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.678359] ACPI: Added _OSI(Processor Aggregator Device) [ 1.682359] ACPI: Added _OSI(Linux-Dell-Video) [ 1.686359] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.690359] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.741076] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.745682] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.750510] ACPI: Dynamic OEM Table Load: [ 1.782296] ACPI: Interpreter enabled [ 1.782370] ACPI: PM: (supports S0 S4 S5) [ 1.786360] ACPI: Using IOAPIC for interrupt routing [ 1.790382] HEST: Enabling Firmware First mode for corrected errors. [ 1.794438] HEST: Table parsing has been initialized. [ 1.798508] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.802361] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.806359] PCI: Using E820 reservations for host bridge windows [ 1.811049] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.851432] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.854362] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.860342] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.863412] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.866359] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.870390] PCI host bridge to bus 0000:ff [ 1.874360] pci_bus 0000:ff: root bus resource [bus ff] [ 1.878370] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.882424] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.886412] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.890411] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.894412] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.898414] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.902410] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.906411] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.910415] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.914410] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.918411] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.922410] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.926411] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.930412] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.934412] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.938412] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.942413] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.946410] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.950410] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.954385] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.958421] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.962553] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.966426] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.970424] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.974426] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.978423] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.982423] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.986413] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.990414] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.994424] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.998424] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.002423] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.006425] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.010412] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.014413] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.018412] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.022415] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.026423] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.030424] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.034425] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.038427] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.042417] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.046412] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.050414] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.054415] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.058413] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.062412] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.066413] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.070418] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.074414] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.078411] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.082412] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.086385] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.090413] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.094411] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.102817] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.106362] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.110703] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.114834] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.118360] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.122650] PCI host bridge to bus 0000:00 [ 2.126360] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.130359] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.134359] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.138359] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.142359] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.146359] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.150359] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.154466] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.158570] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.162425] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.166532] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.170424] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.174526] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.178425] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.182519] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.186378] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.190555] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.194378] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.198552] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.202378] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.206554] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.210378] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.214550] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.218378] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.222557] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.226378] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.230551] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.234378] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.238552] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.242378] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.246505] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.250582] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.254508] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.258529] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.262373] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.266600] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.270653] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.274381] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.278371] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.282371] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.286371] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.290371] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.294371] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.298400] pci 0000:00:11.4: PME# supported from D3hot [ 2.302514] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.306385] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.310435] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.314509] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.318385] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.322436] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.326506] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.330385] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.334436] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.338517] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.342382] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.346464] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.350520] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.354449] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.358523] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.362451] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.366521] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.370451] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.374530] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.378382] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.382464] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.386516] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.390635] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.394379] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.398369] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.402369] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.406369] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.410369] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.414369] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.418394] pci 0000:00:1f.2: PME# supported from D3hot [ 2.422503] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.426385] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.430391] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.434575] acpiphp: Slot [1] registered [ 2.438376] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.442539] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.446380] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.450401] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.454362] pci 0000:02:00.0: enabling Extended Tags [ 2.458465] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.462361] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.466544] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.470381] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.474368] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.478382] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.482368] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.486400] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.490380] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.494359] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.498372] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.502359] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.506522] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.510381] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.514368] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.518382] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.522368] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.526400] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.530376] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.534359] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.538373] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.542359] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.546492] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.550360] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.554360] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.558361] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.562390] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.566425] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.570448] pci 0000:05:00.0: enabling Extended Tags [ 2.574432] pci 0000:05:00.0: supports D1 D2 [ 2.578359] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.582547] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.586361] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.590361] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.594408] pci_bus 0000:06: extended config space not accessible [ 2.598392] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.602392] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.606376] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.610376] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.614444] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.618401] pci 0000:06:00.0: supports D1 D2 [ 2.622359] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.626470] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.630365] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.634362] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.638457] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.642386] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.646387] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.650373] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.654494] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.658398] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.662359] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.666385] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.670359] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.674535] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.678386] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.682388] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.686373] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.690489] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.694397] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.698359] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.702385] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.706359] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.710515] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.714361] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.718361] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.722362] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.727284] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.730409] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.734408] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.738407] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.742409] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.746359] ACPI: PCI: Interrupt link LNKE disabled [ 2.750407] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.754359] ACPI: PCI: Interrupt link LNKF disabled [ 2.758407] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.762359] ACPI: PCI: Interrupt link LNKG disabled [ 2.766407] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.770359] ACPI: PCI: Interrupt link LNKH disabled [ 2.774548] iommu: Default domain type: Translated [ 2.778361] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.782484] SCSI subsystem initialized [ 2.786371] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.790358] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.790360] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.794359] vgaarb: loaded [ 2.797148] ACPI: bus type USB registered [ 2.798369] usbcore: registered new interface driver usbfs [ 2.802363] usbcore: registered new interface driver hub [ 2.806364] usbcore: registered new device driver usb [ 2.810374] pps_core: LinuxPPS API ver. 1 registered [ 2.814359] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.818362] PTP clock support registered [ 2.822373] EDAC MC: Ver: 3.0.0 [ 2.825672] NetLabel: Initializing [ 2.826360] NetLabel: domain hash size = 128 [ 2.830359] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.834370] NetLabel: unlabeled traffic allowed by default [ 2.838369] PCI: Using ACPI for IRQ routing [ 2.847648] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.850360] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.856399] clocksource: Switched to clocksource tsc-early [ 2.868578] VFS: Disk quotas dquot_6.6.0 [ 2.872583] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.879624] AppArmor: AppArmor Filesystem Enabled [ 2.884424] pnp: PnP ACPI init [ 2.888015] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.894010] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.899998] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.905986] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.911976] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.917963] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.923944] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.930630] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.937312] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.943994] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.950677] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.957360] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.964043] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.970936] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.976922] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.982909] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.988890] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.994879] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.001842] pnp: PnP ACPI: found 5 devices [ 3.011425] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.020427] NET: Registered PF_INET protocol family [ 3.025539] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.034834] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.043652] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.051650] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.060058] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.067598] TCP: Hash tables configured (established 262144 bind 65536) [ 3.074425] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.082203] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.089222] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.096677] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.102403] NET: Registered PF_XDP protocol family [ 3.107285] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.118859] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.126779] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.131824] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.136857] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.143724] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.151379] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.159378] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.167117] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.175205] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.182858] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.190860] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.198596] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.206686] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.214337] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.222338] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.230077] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.238166] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.245820] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.253820] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.261558] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.269645] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.274675] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.280844] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.287699] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.295535] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.300583] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.305618] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.311791] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.318665] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.323958] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.330119] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.336984] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.344814] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.352735] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.360572] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.368492] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.373519] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.379681] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.386538] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.394372] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.400617] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.414666] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.421609] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.428553] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.435496] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.442438] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.448772] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.454413] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.460743] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.468053] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.473689] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.480020] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.485661] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.491998] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.497639] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.503976] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.511604] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.540007] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20622 usecs [ 3.572002] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23915 usecs [ 3.579501] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.586054] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.586056] Trying to unpack rootfs image as initramfs... [ 3.592561] software IO TLB: mapped [mem 0x0000000074eae000-0x0000000078eae000] (64MB) [ 3.606526] Initialise system trusted keyrings [ 3.611047] Key type blacklist registered [ 3.615177] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.622648] zbud: loaded [ 3.625454] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.631525] fuse: init (API version 7.34) [ 3.635752] integrity: Platform Keyring initialized [ 3.648539] Key type asymmetric registered [ 3.652713] Asymmetric key parser 'x509' registered [ 3.657685] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.665227] io scheduler mq-deadline registered [ 3.670418] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.676462] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.682484] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.688457] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.694435] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.700398] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.706369] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.713289] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.719048] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.727519] ACPI: button: Power Button [PWRB] [ 3.731982] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.739505] ACPI: button: Power Button [PWRF] [ 3.745163] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.752734] pstore: Registered erst as persistent store backend [ 3.758851] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.785791] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.814723] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.824362] Linux agpgart interface v0.103 [ 3.830280] loop: module loaded [ 3.833747] tun: Universal TUN/TAP device driver, 1.6 [ 3.838910] PPP generic driver version 2.4.2 [ 3.843321] VFIO - User Level meta-driver version: 0.3 [ 3.848643] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.855242] ehci-pci: EHCI PCI platform driver [ 3.859909] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.865210] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.872707] ehci-pci 0000:00:1a.0: debug port 2 [ 3.881225] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.899893] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.905753] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.914108] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.921421] usb usb1: Product: EHCI Host Controller [ 3.926369] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.932885] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.937733] hub 1-0:1.0: USB hub found [ 3.939940] Freeing initrd memory: 65084K [ 3.941569] hub 1-0:1.0: 2 ports detected [ 3.949975] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.955272] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.962762] ehci-pci 0000:00:1d.0: debug port 2 [ 3.971250] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.991904] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.997757] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.006108] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.013413] usb usb2: Product: EHCI Host Controller [ 4.018358] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.024861] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.029656] hub 2-0:1.0: USB hub found [ 4.033479] hub 2-0:1.0: 2 ports detected [ 4.037671] ehci-platform: EHCI generic platform driver [ 4.042982] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.049227] ohci-pci: OHCI PCI platform driver [ 4.053756] ohci-platform: OHCI generic platform driver [ 4.059048] uhci_hcd: USB Universal Host Controller Interface driver [ 4.065517] i8042: PNP: No PS/2 controller found. [ 4.070349] mousedev: PS/2 mouse device common for all mice [ 4.076063] rtc_cmos 00:00: RTC can wake from S4 [ 4.080944] rtc_cmos 00:00: registered as rtc0 [ 4.085482] rtc_cmos 00:00: setting system clock to 2024-04-19T02:19:50 UTC (1713493190) [ 4.093686] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.100457] i2c_dev: i2c /dev entries driver [ 4.104957] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.117242] device-mapper: uevent: version 1.0.3 [ 4.121988] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.130533] platform eisa.0: Probing EISA bus 0 [ 4.135126] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.141979] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.148486] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.154994] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.161505] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.168013] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.174524] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.181032] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.187540] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.194052] platform eisa.0: EISA: Detected 0 cards [ 4.199002] intel_pstate: Intel P-state driver initializing [ 4.205590] ledtrig-cpu: registered to indicate activity on CPUs [ 4.211814] drop_monitor: Initializing network drop monitor service [ 4.218261] NET: Registered PF_INET6 protocol family [ 4.230488] Segment Routing with IPv6 [ 4.234227] In-situ OAM (IOAM) with IPv6 [ 4.238233] NET: Registered PF_PACKET protocol family [ 4.243386] Key type dns_resolver registered [ 4.248270] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.254275] microcode: Microcode Update Driver: v2.2. [ 4.254362] resctrl: L3 allocation detected [ 4.263726] resctrl: L3 monitoring detected [ 4.267976] IPI shorthand broadcast: enabled [ 4.272330] sched_clock: Marking stable (3224455077, 1047857077)->(5258834249, -986522095) [ 4.280920] registered taskstats version 1 [ 4.285294] Loading compiled-in X.509 certificates [ 4.287893] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.290751] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.307183] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.317687] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.327776] blacklist: Loading compiled-in revocation X.509 certificates [ 4.334558] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.344478] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.355009] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.365887] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.376412] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.379935] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.393802] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.404599] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.415388] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.427189] zswap: loaded using pool lzo/zbud [ 4.431913] Key type .fscrypt registered [ 4.435904] Key type fscrypt-provisioning registered [ 4.440994] pstore: Using crash dump compression: deflate [ 4.448752] Key type encrypted registered [ 4.452827] AppArmor: AppArmor sha1 policy hashing enabled [ 4.456289] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.458402] ima: No TPM chip found, activating TPM-bypass! [ 4.466664] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.472235] Loading compiled-in module X.509 certificates [ 4.492971] hub 1-1:1.0: USB hub found [ 4.493234] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.496937] hub 1-1:1.0: 6 ports detected [ 4.506802] ima: Allocated hash algorithm: sha1 [ 4.506823] ima: No architecture policies found [ 4.520121] evm: Initialising EVM extended attributes: [ 4.525322] evm: security.selinux [ 4.528708] evm: security.SMACK64 [ 4.532088] evm: security.SMACK64EXEC [ 4.535813] evm: security.SMACK64TRANSMUTE [ 4.539975] evm: security.SMACK64MMAP [ 4.543700] evm: security.apparmor [ 4.544294] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.547169] evm: security.ima [ 4.547169] evm: security.capability [ 4.547170] evm: HMAC attrs: 0x1 [ 4.547454] PM: Magic number: 4:894:308 [ 4.555447] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.558503] tty tty37: hash matches [ 4.580380] memory memory166: hash matches [ 4.584778] RAS: Correctable Errors collector initialized. [ 4.584849] hub 2-1:1.0: USB hub found [ 4.594322] hub 2-1:1.0: 8 ports detected [ 4.598716] Freeing unused decrypted memory: 2036K [ 4.604039] Freeing unused kernel image (initmem) memory: 3352K [ 4.623919] Write protecting the kernel read-only data: 30720k [ 4.630231] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.637142] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.639924] tsc: Refined TSC clocksource calibration: 3499.989 MHz [ 4.650098] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327346e9ce8, max_idle_ns: 440795304517 ns [ 4.698612] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.705119] x86/mm: Checking user space page tables [ 4.710077] clocksource: Switched to clocksource tsc [ 4.747307] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.753814] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.892468] dca service started, version 1.12.1 [ 4.901014] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.906604] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.912135] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.915322] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.922359] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.929595] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.930063] nvme nvme0: pci function 0000:02:00.0 [ 4.934989] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.935929] nvme nvme0: 8/0/0 default/read/poll queues [ 4.940283] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.967066] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.973437] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.981792] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.989119] usb usb3: Product: xHCI Host Controller [ 4.994063] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.000573] usb usb3: SerialNumber: 0000:00:14.0 [ 5.005367] hub 3-0:1.0: USB hub found [ 5.009220] hub 3-0:1.0: 15 ports detected [ 5.013555] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.017971] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.019033] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.027380] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.040328] usb usb4: Product: xHCI Host Controller [ 5.045275] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.051788] usb usb4: SerialNumber: 0000:00:14.0 [ 5.056556] hub 4-0:1.0: USB hub found [ 5.060387] hub 4-0:1.0: 6 ports detected [ 5.060615] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.072658] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.080664] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.086831] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.087025] igb 0000:07:00.0: added PHC on eth0 [ 5.097285] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.104230] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1a [ 5.111510] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.116731] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.124174] scsi host0: ahci [ 5.127486] scsi host1: ahci [ 5.130587] scsi host2: ahci [ 5.133684] scsi host3: ahci [ 5.136672] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 5.144171] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 5.151650] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 5.159129] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 5.166812] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.175085] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.180431] igb 0000:07:00.1: added PHC on eth1 [ 5.187369] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.194307] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1b [ 5.201589] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.206792] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.240569] scsi host4: ahci [ 5.243715] scsi host5: ahci [ 5.246782] scsi host6: ahci [ 5.249851] scsi host7: ahci [ 5.252921] scsi host8: ahci [ 5.255972] scsi host9: ahci [ 5.258946] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 5.266428] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 5.273908] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 5.281385] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 5.288865] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 5.296345] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 5.347941] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.478968] ata3: SATA link down (SStatus 0 SControl 300) [ 5.484459] ata1: SATA link down (SStatus 0 SControl 300) [ 5.489960] ata4: SATA link down (SStatus 0 SControl 300) [ 5.495475] ata2: SATA link down (SStatus 0 SControl 300) [ 5.512178] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.520547] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.528273] hub 3-12:1.0: USB hub found [ 5.532279] hub 3-12:1.0: 4 ports detected [ 5.618816] ata8: SATA link down (SStatus 0 SControl 300) [ 5.624316] ata6: SATA link down (SStatus 0 SControl 300) [ 5.629816] ata10: SATA link down (SStatus 0 SControl 300) [ 5.635408] ata7: SATA link down (SStatus 0 SControl 300) [ 5.640913] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.647193] ata9: SATA link down (SStatus 0 SControl 300) [ 5.721443] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.728340] ata5.00: NCQ Send/Recv Log not supported [ 5.733393] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.741974] ata5.00: NCQ Send747031] ata5.00:5.751598] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.760092] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.760232] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.773271] sd 4:0:0:0: [sda] Write Protect is off [ 5.778164] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.807343] sda: sda1 [ 5.810029] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.816896] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.840401] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.843878] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.980253] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.988826] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.011998] hid: raw HID events driver (C) Jiri Kosina [ 6.024777] usbcore: registered new interface driver usbhid [ 6.030442] usbhid: USB HID core driver [ 6.036680] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.108092] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.120061] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.131991] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.288665] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.299069] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.315782] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.322040] ixgbe 0000:03:00.0: 0c:c4:7a:88:6e:42 [ 6.330465] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.500656] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.511055] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.519677] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.526808] ixgbe 0000:03:00.1: 0c:c4:7a:88:6e:43 [ 6.535180] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.543322] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.576790] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 197335/61054976 files, 6481379/244190336 blocks done. [ 13.495231] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.341852] systemd[1]: Inserted module 'autofs4' [ 14.476216] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.528043] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.579848] systemd[1]: Hostname set to . [ 15.955187] systemd[1]: Queued start job for default target Graphical Interface. [ 15.964250] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 15.984825] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.008677] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.032078] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.052121] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.076327] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.104049] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.132006] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.160010] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.188000] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.215999] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.243994] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.272086] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.296033] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.316041] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.340141] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.364255] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.390250] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.416270] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.436237] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.460117] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.484448] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.504265] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.528274] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.548372] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.572308] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.592202] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.613700] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.633718] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.657485] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.681654] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.701802] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.719994] RPC: Registered named UNIX socket transport module. [ 16.725998] RPC: Registered udp transport module. [ 16.730773] RPC: Registered tcp transport module. [ 16.735540] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.742841] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.767969] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.778719] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.801016] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.824862] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.856945] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 16.880900] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 16.900809] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.925020] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 16.952827] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 16.972867] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 16.997115] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.016427] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 17.023802] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.043924] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.053660] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.064374] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.084902] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.102748] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.112460] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.134420] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ 17.158520] lp: driver loaded but no devices found [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesyst[ 17.189554] Loading iSCSI transport class v2.0-870. em. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.471898] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.541964] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 17.712309] systemd-journald[367]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Create Volatile Files and Directories... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Set console font and keymap. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Created slice Slice /system/lvm2-pvscan. Starting LVM event activation on device 259:0... [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Load AppArmor profiles. [ OK ] Found device /dev/ttyS1. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Started ifup for enp3s0f1. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Record successful boot for GRUB. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Wait for Network to be Configured. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Started System Logging Service. [ OK ] Started User Login Management. Starting GRUB failed boot detection... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] A start job is running for Raise network interfaces (7s / 5min 3s) M [** ] A start job is running for Raise network interfaces (7s / 5min 3s) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' Starting NFS status monitor for NFSv2/3 locking.... ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started Network Time Service. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... + myips=172.21.15.136 + attempts=1 + sleep 1 [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished Permit User Sessions. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.136 '!=' '' ']' + set -e + '[' -n 172.21.15.136 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.136 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.136 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started (i)SCSI target daemon. + newhostname=smithi136.front.sepia.ceph.com + '[' -n smithi136.front.sepia.ceph.com ']' + hostname smithi136.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi136 + echo smithi136 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.136 smithi136.front.sepia.ceph.com smithi136/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi136.front.sepia.ceph.com ttyS1 2024-04-19T02:20:20.534 DEBUG:teuthology.orchestra.console.smithi136:expect after: smithi136 login: 2024-04-19T02:20:20.588 DEBUG:teuthology.orchestra.console.smithi136:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6E 43 GUID: 00000000 0000 0000 0000 0CC47AD93B1A DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.136 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6e:43)... Configuring (net0 0c:c4:7a:88:6e:43).... Configuring (net0 0c:c4:7a:88:6e:43)..... Configuring (net0 0c:c4:7a:88:6e:43)...... ok     * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.737 MHz processor [ 0.000418] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000597] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001888] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.008235] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008248] Using GB pages for direct mapping [ 0.008347] RAMDISK: [mem 0x300d1000-0x3405ffff] [ 0.008353] ACPI: Early table checksum verification disabled [ 0.008356] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008360] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.008365] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008370] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008373] ACPI: FACS 0x0000000079D49F80 000040 [ 0.008375] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008378] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008381] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008384] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008386] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008389] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008392] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008395] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008398] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008401] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008404] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008406] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008409] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008412] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008415] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008418] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008421] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008423] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.008425] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.008426] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.008427] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.008428] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.008429] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.008429] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.008430] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.008431] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.008432] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.008433] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.008434] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.008435] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.008436] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.008437] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.008438] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.008439] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.008440] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.008441] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.008442] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.008537] No NUMA configuration found [ 0.008538] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008547] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008876] Zone ranges: [ 0.008877] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008879] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008880] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008882] Device empty [ 0.008883] Movable zone start for each node [ 0.008886] Early memory node ranges [ 0.008886] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008888] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.008889] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008893] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008898] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008933] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.080504] On node 0, zone Normal: 29010 pages in unavailable ranges [ 0.080619] ACPI: PM-Timer IO Port: 0x408 [ 0.080628] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080629] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080630] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080631] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080632] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080633] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080634] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080635] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080644] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080649] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080651] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080653] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080656] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080658] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080661] TSC deadline timer available [ 0.080663] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080672] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080674] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.080675] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080677] PM: hibernation: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.080678] PM: hibernation: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.080679] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.080680] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.080681] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080681] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080682] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080683] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080685] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080686] Booting paravirtualized kernel on bare hardware [ 0.080688] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080694] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080911] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080943] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.080945] Policy zone: Normal [ 0.080946] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081005] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.083159] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084305] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084400] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170585] Memory: 32672616K/33437920K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765044K reserved, 0K cma-reserved) [ 0.170870] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170885] Kernel/User page tables isolation: enabled [ 0.170916] ftrace: allocating 50694 entries in 199 pages [ 0.190764] ftrace: allocated 199 pages with 5 groups [ 0.190884] rcu: Hierarchical RCU implementation. [ 0.190885] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190887] Rude variant of Tasks RCU enabled. [ 0.190888] Tracing variant of Tasks RCU enabled. [ 0.190888] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190889] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194309] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194507] random: crng init done [ 0.199403] Console: colour VGA+ 80x25 [ 0.210714] printk: console [tty0] enabled [ 1.182088] printk: console [ttyS1] enabled [ 1.186348] ACPI: Core revision 20210730 [ 1.190509] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.199740] APIC: Switch to symmetric I/O mode setup [ 1.204778] DMAR: Host address width 46 [ 1.208688] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.214076] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.222175] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.229609] DMAR: ATSR flags: 0x0 [ 1.232997] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.239332] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.245756] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.252176] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.257644] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.257645] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.272832] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.278205] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.284504] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.307747] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32725850a05, max_idle_ns: 440795315679 ns [ 1.318361] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.47 BogoMIPS (lpj=13998948) [ 1.322377] CPU0: Thermal monitoring enabled (TM1) [ 1.326412] process: using mwait in idle threads [ 1.330361] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.334359] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.338360] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.342360] Spectre V2 : Mitigation: Retpolines [ 1.346359] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.350359] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.354359] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.358360] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.362359] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.366359] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.370362] MDS: Mitigation: Clear CPU buffers [ 1.374359] TAA: Mitigation: Clear CPU buffers [ 1.378359] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.382364] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.386359] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.390359] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.394359] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.398359] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.420066] Freeing SMP alternatives memory: 44K [ 1.422360] pid_max: default: 32768 minimum: 301 [ 1.426380] LSM: Security Framework initializing [ 1.430368] landlock: Up and running. [ 1.434359] Yama: becoming mindful. [ 1.438376] AppArmor: AppArmor initialized [ 1.442419] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.446399] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.450720] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.454364] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.458467] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.462360] ... version: 3 [ 1.466359] ... bit width: 48 [ 1.470359] ... generic registers: 4 [ 1.474359] ... value mask: 0000ffffffffffff [ 1.478359] ... max period: 00007fffffffffff [ 1.482359] ... fixed-purpose events: 3 [ 1.486359] ... event mask: 000000070000000f [ 1.490420] signal: max sigframe size: 1776 [ 1.494374] rcu: Hierarchical SRCU implementation. [ 1.499073] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.502424] smp: Bringing up secondary CPUs ... [ 1.506440] x86: Booting SMP configuration: [ 1.510361] .... node #0, CPUs: #1 #2 #3 #4 [ 1.518446] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.526360] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.530359] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.534457] #5 #6 #7 [ 1.534914] smp: Brought up 1 node, 8 CPUs [ 1.542361] smpboot: Max logical packages: 1 [ 1.546359] smpboot: Total of 8 processors activated (55995.79 BogoMIPS) [ 1.554706] devtmpfs: initialized [ 1.557771] x86/mm: Memory block size: 128MB [ 1.559974] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.562436] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.566369] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.570405] pinctrl core: initialized pinctrl subsystem [ 1.574451] PM: RTC time: 02:19:47, date: 2024-04-19 [ 1.578466] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.582692] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.586658] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.590694] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.594370] audit: initializing netlink subsys (disabled) [ 1.598377] audit: type=2000 audit(1713493185.356:1): state=initialized audit_enabled=0 res=1 [ 1.598477] thermal_sys: Registered thermal governor 'fair_share' [ 1.602361] thermal_sys: Registered thermal governor 'bang_bang' [ 1.606359] thermal_sys: Registered thermal governor 'step_wise' [ 1.610359] thermal_sys: Registered thermal governor 'user_space' [ 1.614359] thermal_sys: Registered thermal governor 'power_allocator' [ 1.618364] EISA bus registered [ 1.625573] cpuidle: using governor ladder [ 1.626361] cpuidle: using governor menu [ 1.630376] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.634360] ACPI: bus type PCI registered [ 1.638361] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.642415] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.646361] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.650372] PCI: Using configuration type 1 for base access [ 1.655380] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.658376] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.662360] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.666435] ACPI: Added _OSI(Module Device) [ 1.670361] ACPI: Added _OSI(Processor Device) [ 1.674367] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.678359] ACPI: Added _OSI(Processor Aggregator Device) [ 1.682359] ACPI: Added _OSI(Linux-Dell-Video) [ 1.686359] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.690359] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.741076] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.745682] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.750510] ACPI: Dynamic OEM Table Load: [ 1.782296] ACPI: Interpreter enabled [ 1.782370] ACPI: PM: (supports S0 S4 S5) [ 1.786360] ACPI: Using IOAPIC for interrupt routing [ 1.790382] HEST: Enabling Firmware First mode for corrected errors. [ 1.794438] HEST: Table parsing has been initialized. [ 1.798508] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.802361] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.806359] PCI: Using E820 reservations for host bridge windows [ 1.811049] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.851432] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.854362] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.860342] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.863412] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.866359] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.870390] PCI host bridge to bus 0000:ff [ 1.874360] pci_bus 0000:ff: root bus resource [bus ff] [ 1.878370] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.882424] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.886412] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.890411] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.894412] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.898414] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.902410] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.906411] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.910415] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.914410] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.918411] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.922410] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.926411] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.930412] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.934412] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.938412] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.942413] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.946410] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.950410] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.954385] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.958421] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.962553] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.966426] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.970424] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.974426] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.978423] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.982423] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.986413] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.990414] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.994424] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.998424] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.002423] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.006425] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.010412] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.014413] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.018412] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.022415] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.026423] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.030424] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.034425] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.038427] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.042417] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.046412] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.050414] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.054415] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.058413] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.062412] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.066413] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.070418] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.074414] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.078411] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.082412] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.086385] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.090413] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.094411] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.102817] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.106362] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.110703] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.114834] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.118360] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.122650] PCI host bridge to bus 0000:00 [ 2.126360] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.130359] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.134359] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.138359] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.142359] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.146359] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.150359] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.154466] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.158570] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.162425] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.166532] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.170424] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.174526] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.178425] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.182519] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.186378] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.190555] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.194378] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.198552] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.202378] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.206554] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.210378] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.214550] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.218378] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.222557] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.226378] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.230551] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.234378] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.238552] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.242378] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.246505] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.250582] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.254508] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.258529] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.262373] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.266600] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.270653] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.274381] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.278371] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.282371] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.286371] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.290371] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.294371] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.298400] pci 0000:00:11.4: PME# supported from D3hot [ 2.302514] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.306385] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.310435] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.314509] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.318385] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.322436] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.326506] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.330385] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.334436] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.338517] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.342382] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.346464] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.350520] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.354449] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.358523] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.362451] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.366521] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.370451] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.374530] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.378382] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.382464] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.386516] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.390635] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.394379] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.398369] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.402369] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.406369] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.410369] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.414369] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.418394] pci 0000:00:1f.2: PME# supported from D3hot [ 2.422503] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.426385] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.430391] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.434575] acpiphp: Slot [1] registered [ 2.438376] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.442539] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.446380] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.450401] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.454362] pci 0000:02:00.0: enabling Extended Tags [ 2.458465] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.462361] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.466544] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.470381] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.474368] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.478382] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.482368] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.486400] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.490380] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.494359] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.498372] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.502359] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.506522] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.510381] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.514368] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.518382] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.522368] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.526400] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.530376] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.534359] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.538373] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.542359] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.546492] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.550360] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.554360] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.558361] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.562390] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.566425] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.570448] pci 0000:05:00.0: enabling Extended Tags [ 2.574432] pci 0000:05:00.0: supports D1 D2 [ 2.578359] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.582547] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.586361] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.590361] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.594408] pci_bus 0000:06: extended config space not accessible [ 2.598392] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.602392] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.606376] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.610376] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.614444] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.618401] pci 0000:06:00.0: supports D1 D2 [ 2.622359] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.626470] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.630365] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.634362] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.638457] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.642386] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.646387] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.650373] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.654494] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.658398] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.662359] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.666385] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.670359] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.674535] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.678386] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.682388] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.686373] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.690489] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.694397] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.698359] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.702385] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.706359] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.710515] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.714361] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.718361] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.722362] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.727284] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.730409] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.734408] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.738407] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.742409] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.746359] ACPI: PCI: Interrupt link LNKE disabled [ 2.750407] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.754359] ACPI: PCI: Interrupt link LNKF disabled [ 2.758407] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.762359] ACPI: PCI: Interrupt link LNKG disabled [ 2.766407] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.770359] ACPI: PCI: Interrupt link LNKH disabled [ 2.774548] iommu: Default domain type: Translated [ 2.778361] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.782484] SCSI subsystem initialized [ 2.786371] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.790358] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.790360] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.794359] vgaarb: loaded [ 2.797148] ACPI: bus type USB registered [ 2.798369] usbcore: registered new interface driver usbfs [ 2.802363] usbcore: registered new interface driver hub [ 2.806364] usbcore: registered new device driver usb [ 2.810374] pps_core: LinuxPPS API ver. 1 registered [ 2.814359] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.818362] PTP clock support registered [ 2.822373] EDAC MC: Ver: 3.0.0 [ 2.825672] NetLabel: Initializing [ 2.826360] NetLabel: domain hash size = 128 [ 2.830359] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.834370] NetLabel: unlabeled traffic allowed by default [ 2.838369] PCI: Using ACPI for IRQ routing [ 2.847648] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.850360] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.856399] clocksource: Switched to clocksource tsc-early [ 2.868578] VFS: Disk quotas dquot_6.6.0 [ 2.872583] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.879624] AppArmor: AppArmor Filesystem Enabled [ 2.884424] pnp: PnP ACPI init [ 2.888015] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.894010] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.899998] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.905986] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.911976] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.917963] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.923944] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.930630] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.937312] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.943994] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.950677] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.957360] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.964043] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.970936] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.976922] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.982909] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.988890] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.994879] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.001842] pnp: PnP ACPI: found 5 devices [ 3.011425] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.020427] NET: Registered PF_INET protocol family [ 3.025539] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.034834] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.043652] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.051650] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.060058] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.067598] TCP: Hash tables configured (established 262144 bind 65536) [ 3.074425] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.082203] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.089222] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.096677] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.102403] NET: Registered PF_XDP protocol family [ 3.107285] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.118859] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.126779] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.131824] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.136857] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.143724] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.151379] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.159378] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.167117] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.175205] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.182858] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.190860] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.198596] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.206686] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.214337] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.222338] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.230077] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.238166] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.245820] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.253820] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.261558] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.269645] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.274675] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.280844] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.287699] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.295535] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.300583] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.305618] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.311791] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.318665] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.323958] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.330119] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.336984] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.344814] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.352735] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.360572] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.368492] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.373519] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.379681] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.386538] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.394372] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.400617] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.414666] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.421609] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.428553] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.435496] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.442438] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.448772] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.454413] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.460743] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.468053] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.473689] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.480020] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.485661] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.491998] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.497639] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.503976] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.511604] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.540007] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20622 usecs [ 3.572002] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23915 usecs [ 3.579501] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.586054] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.586056] Trying to unpack rootfs image as initramfs... [ 3.592561] software IO TLB: mapped [mem 0x0000000074eae000-0x0000000078eae000] (64MB) [ 3.606526] Initialise system trusted keyrings [ 3.611047] Key type blacklist registered [ 3.615177] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.622648] zbud: loaded [ 3.625454] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.631525] fuse: init (API version 7.34) [ 3.635752] integrity: Platform Keyring initialized [ 3.648539] Key type asymmetric registered [ 3.652713] Asymmetric key parser 'x509' registered [ 3.657685] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.665227] io scheduler mq-deadline registered [ 3.670418] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.676462] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.682484] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.688457] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.694435] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.700398] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.706369] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.713289] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.719048] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.727519] ACPI: button: Power Button [PWRB] [ 3.731982] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.739505] ACPI: button: Power Button [PWRF] [ 3.745163] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.752734] pstore: Registered erst as persistent store backend [ 3.758851] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.785791] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.814723] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.824362] Linux agpgart interface v0.103 [ 3.830280] loop: module loaded [ 3.833747] tun: Universal TUN/TAP device driver, 1.6 [ 3.838910] PPP generic driver version 2.4.2 [ 3.843321] VFIO - User Level meta-driver version: 0.3 [ 3.848643] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.855242] ehci-pci: EHCI PCI platform driver [ 3.859909] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.865210] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.872707] ehci-pci 0000:00:1a.0: debug port 2 [ 3.881225] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.899893] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.905753] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.914108] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.921421] usb usb1: Product: EHCI Host Controller [ 3.926369] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.932885] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.937733] hub 1-0:1.0: USB hub found [ 3.939940] Freeing initrd memory: 65084K [ 3.941569] hub 1-0:1.0: 2 ports detected [ 3.949975] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.955272] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.962762] ehci-pci 0000:00:1d.0: debug port 2 [ 3.971250] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.991904] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.997757] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.006108] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.013413] usb usb2: Product: EHCI Host Controller [ 4.018358] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.024861] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.029656] hub 2-0:1.0: USB hub found [ 4.033479] hub 2-0:1.0: 2 ports detected [ 4.037671] ehci-platform: EHCI generic platform driver [ 4.042982] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.049227] ohci-pci: OHCI PCI platform driver [ 4.053756] ohci-platform: OHCI generic platform driver [ 4.059048] uhci_hcd: USB Universal Host Controller Interface driver [ 4.065517] i8042: PNP: No PS/2 controller found. [ 4.070349] mousedev: PS/2 mouse device common for all mice [ 4.076063] rtc_cmos 00:00: RTC can wake from S4 [ 4.080944] rtc_cmos 00:00: registered as rtc0 [ 4.085482] rtc_cmos 00:00: setting system clock to 2024-04-19T02:19:50 UTC (1713493190) [ 4.093686] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.100457] i2c_dev: i2c /dev entries driver [ 4.104957] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.117242] device-mapper: uevent: version 1.0.3 [ 4.121988] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.130533] platform eisa.0: Probing EISA bus 0 [ 4.135126] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.141979] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.148486] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.154994] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.161505] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.168013] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.174524] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.181032] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.187540] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.194052] platform eisa.0: EISA: Detected 0 cards [ 4.199002] intel_pstate: Intel P-state driver initializing [ 4.205590] ledtrig-cpu: registered to indicate activity on CPUs [ 4.211814] drop_monitor: Initializing network drop monitor service [ 4.218261] NET: Registered PF_INET6 protocol family [ 4.230488] Segment Routing with IPv6 [ 4.234227] In-situ OAM (IOAM) with IPv6 [ 4.238233] NET: Registered PF_PACKET protocol family [ 4.243386] Key type dns_resolver registered [ 4.248270] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.254275] microcode: Microcode Update Driver: v2.2. [ 4.254362] resctrl: L3 allocation detected [ 4.263726] resctrl: L3 monitoring detected [ 4.267976] IPI shorthand broadcast: enabled [ 4.272330] sched_clock: Marking stable (3224455077, 1047857077)->(5258834249, -986522095) [ 4.280920] registered taskstats version 1 [ 4.285294] Loading compiled-in X.509 certificates [ 4.287893] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.290751] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.307183] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.317687] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.327776] blacklist: Loading compiled-in revocation X.509 certificates [ 4.334558] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.344478] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.355009] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.365887] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.376412] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.379935] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.393802] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.404599] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.415388] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.427189] zswap: loaded using pool lzo/zbud [ 4.431913] Key type .fscrypt registered [ 4.435904] Key type fscrypt-provisioning registered [ 4.440994] pstore: Using crash dump compression: deflate [ 4.448752] Key type encrypted registered [ 4.452827] AppArmor: AppArmor sha1 policy hashing enabled [ 4.456289] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.458402] ima: No TPM chip found, activating TPM-bypass! [ 4.466664] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.472235] Loading compiled-in module X.509 certificates [ 4.492971] hub 1-1:1.0: USB hub found [ 4.493234] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.496937] hub 1-1:1.0: 6 ports detected [ 4.506802] ima: Allocated hash algorithm: sha1 [ 4.506823] ima: No architecture policies found [ 4.520121] evm: Initialising EVM extended attributes: [ 4.525322] evm: security.selinux [ 4.528708] evm: security.SMACK64 [ 4.532088] evm: security.SMACK64EXEC [ 4.535813] evm: security.SMACK64TRANSMUTE [ 4.539975] evm: security.SMACK64MMAP [ 4.543700] evm: security.apparmor [ 4.544294] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.547169] evm: security.ima [ 4.547169] evm: security.capability [ 4.547170] evm: HMAC attrs: 0x1 [ 4.547454] PM: Magic number: 4:894:308 [ 4.555447] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.558503] tty tty37: hash matches [ 4.580380] memory memory166: hash matches [ 4.584778] RAS: Correctable Errors collector initialized. [ 4.584849] hub 2-1:1.0: USB hub found [ 4.594322] hub 2-1:1.0: 8 ports detected [ 4.598716] Freeing unused decrypted memory: 2036K [ 4.604039] Freeing unused kernel image (initmem) memory: 3352K [ 4.623919] Write protecting the kernel read-only data: 30720k [ 4.630231] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.637142] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.639924] tsc: Refined TSC clocksource calibration: 3499.989 MHz [ 4.650098] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327346e9ce8, max_idle_ns: 440795304517 ns [ 4.698612] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.705119] x86/mm: Checking user space page tables [ 4.710077] clocksource: Switched to clocksource tsc [ 4.747307] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.753814] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.892468] dca service started, version 1.12.1 [ 4.901014] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.906604] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.912135] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.915322] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.922359] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.929595] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.930063] nvme nvme0: pci function 0000:02:00.0 [ 4.934989] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.935929] nvme nvme0: 8/0/0 default/read/poll queues [ 4.940283] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.967066] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.973437] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.981792] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.989119] usb usb3: Product: xHCI Host Controller [ 4.994063] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.000573] usb usb3: SerialNumber: 0000:00:14.0 [ 5.005367] hub 3-0:1.0: USB hub found [ 5.009220] hub 3-0:1.0: 15 ports detected [ 5.013555] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.017971] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.019033] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.027380] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.040328] usb usb4: Product: xHCI Host Controller [ 5.045275] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.051788] usb usb4: SerialNumber: 0000:00:14.0 [ 5.056556] hub 4-0:1.0: USB hub found [ 5.060387] hub 4-0:1.0: 6 ports detected [ 5.060615] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.072658] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.080664] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.086831] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.087025] igb 0000:07:00.0: added PHC on eth0 [ 5.097285] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.104230] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1a [ 5.111510] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.116731] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.124174] scsi host0: ahci [ 5.127486] scsi host1: ahci [ 5.130587] scsi host2: ahci [ 5.133684] scsi host3: ahci [ 5.136672] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 5.144171] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 5.151650] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 5.159129] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 5.166812] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.175085] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.180431] igb 0000:07:00.1: added PHC on eth1 [ 5.187369] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.194307] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1b [ 5.201589] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.206792] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.240569] scsi host4: ahci [ 5.243715] scsi host5: ahci [ 5.246782] scsi host6: ahci [ 5.249851] scsi host7: ahci [ 5.252921] scsi host8: ahci [ 5.255972] scsi host9: ahci [ 5.258946] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 5.266428] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 5.273908] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 5.281385] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 5.288865] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 5.296345] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 5.347941] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.478968] ata3: SATA link down (SStatus 0 SControl 300) [ 5.484459] ata1: SATA link down (SStatus 0 SControl 300) [ 5.489960] ata4: SATA link down (SStatus 0 SControl 300) [ 5.495475] ata2: SATA link down (SStatus 0 SControl 300) [ 5.512178] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.520547] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.528273] hub 3-12:1.0: USB hub found [ 5.532279] hub 3-12:1.0: 4 ports detected [ 5.618816] ata8: SATA link down (SStatus 0 SControl 300) [ 5.624316] ata6: SATA link down (SStatus 0 SControl 300) [ 5.629816] ata10: SATA link down (SStatus 0 SControl 300) [ 5.635408] ata7: SATA link down (SStatus 0 SControl 300) [ 5.640913] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.647193] ata9: SATA link down (SStatus 0 SControl 300) [ 5.721443] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.728340] ata5.00: NCQ Send/Recv Log not supported [ 5.733393] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.741974] ata5.00: NCQ Send747031] ata5.00:5.751598] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.760092] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.760232] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.773271] sd 4:0:0:0: [sda] Write Protect is off [ 5.778164] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.807343] sda: sda1 [ 5.810029] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.816896] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.840401] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.843878] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.980253] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.988826] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.011998] hid: raw HID events driver (C) Jiri Kosina [ 6.024777] usbcore: registered new interface driver usbhid [ 6.030442] usbhid: USB HID core driver [ 6.036680] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.108092] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.120061] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.131991] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.288665] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.299069] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.315782] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.322040] ixgbe 0000:03:00.0: 0c:c4:7a:88:6e:42 [ 6.330465] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.500656] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.511055] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.519677] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.526808] ixgbe 0000:03:00.1: 0c:c4:7a:88:6e:43 [ 6.535180] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.543322] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.576790] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 197335/61054976 files, 6481379/244190336 blocks done. [ 13.495231] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.341852] systemd[1]: Inserted module 'autofs4' [ 14.476216] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.528043] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.579848] systemd[1]: Hostname set to . [ 15.955187] systemd[1]: Queued start job for default target Graphical Interface. [ 15.964250] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 15.984825] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.008677] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.032078] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.052121] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.076327] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.104049] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.132006] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.160010] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.188000] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.215999] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.243994] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.272086] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.296033] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.316041] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.340141] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.364255] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.390250] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.416270] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.436237] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.460117] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.484448] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.504265] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.528274] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.548372] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.572308] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.592202] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.613700] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.633718] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.657485] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.681654] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.701802] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.719994] RPC: Registered named UNIX socket transport module. [ 16.725998] RPC: Registered udp transport module. [ 16.730773] RPC: Registered tcp transport module. [ 16.735540] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.742841] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.767969] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.778719] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.801016] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.824862] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.856945] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 16.880900] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 16.900809] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.925020] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 16.952827] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 16.972867] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 16.997115] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.016427] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 17.023802] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.043924] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.053660] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.064374] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.084902] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.102748] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.112460] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.134420] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ 17.158520] lp: driver loaded but no devices found [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesyst[ 17.189554] Loading iSCSI transport class v2.0-870. em. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.471898] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.541964] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 17.712309] systemd-journald[367]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Create Volatile Files and Directories... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Set console font and keymap. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Created slice Slice /system/lvm2-pvscan. Starting LVM event activation on device 259:0... [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Load AppArmor profiles. [ OK ] Found device /dev/ttyS1. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Started ifup for enp3s0f1. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Record successful boot for GRUB. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Wait for Network to be Configured. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Started System Logging Service. [ OK ] Started User Login Management. Starting GRUB failed boot detection... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] A start job is running for Raise network interfaces (7s / 5min 3s) M [** ] A start job is running for Raise network interfaces (7s / 5min 3s) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' Starting NFS status monitor for NFSv2/3 locking.... ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started Network Time Service. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... + myips=172.21.15.136 + attempts=1 + sleep 1 [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished Permit User Sessions. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.136 '!=' '' ']' + set -e + '[' -n 172.21.15.136 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.136 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.136 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started (i)SCSI target daemon. + newhostname=smithi136.front.sepia.ceph.com + '[' -n smithi136.front.sepia.ceph.com ']' + hostname smithi136.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi136 + echo smithi136 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.136 smithi136.front.sepia.ceph.com smithi136/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi136.front.sepia.ceph.com ttyS1 smithi136 login: [disconnect] 2024-04-19T02:20:20.690 INFO:teuthology.misc:Re-opening connections... 2024-04-19T02:20:20.690 INFO:teuthology.misc:trying to connect to ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:20:20.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:20:20.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:20:21.022 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-19T02:20:21.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~187s 2024-04-19T02:20:21.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-19T02:20:21.460 DEBUG:teuthology.misc:waited 0.7703423500061035 2024-04-19T02:20:22.461 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:20:22.461 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi136.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-19T02:20:22.461 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T02:20:22.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:20:22.583 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T02:20:22.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T02:20:22.628 INFO:tasks.ceph.osd.1:Started 2024-04-19T02:20:22.628 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:20:22.753 INFO:teuthology.orchestra.run.smithi136.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-19T02:20:22.755 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T02:20:22.756 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-19T02:20:23.689 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:20:23.504+0000 7fd6188f17c0 -1 Falling back to public interface 2024-04-19T02:20:27.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-19T02:20:27.658 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:20:27.472+0000 7fd6188f17c0 -1 osd.1 30 log_to_monitors true 2024-04-19T02:20:27.757 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:20:27.882 INFO:teuthology.orchestra.run.smithi136.stderr:no valid command found; 10 closest matches: 2024-04-19T02:20:27.882 INFO:teuthology.orchestra.run.smithi136.stderr:0 2024-04-19T02:20:27.882 INFO:teuthology.orchestra.run.smithi136.stderr:1 2024-04-19T02:20:27.882 INFO:teuthology.orchestra.run.smithi136.stderr:2 2024-04-19T02:20:27.882 INFO:teuthology.orchestra.run.smithi136.stderr:abort 2024-04-19T02:20:27.882 INFO:teuthology.orchestra.run.smithi136.stderr:assert 2024-04-19T02:20:27.883 INFO:teuthology.orchestra.run.smithi136.stderr:bluefs debug_inject_read_zeros 2024-04-19T02:20:27.883 INFO:teuthology.orchestra.run.smithi136.stderr:bluefs files list 2024-04-19T02:20:27.883 INFO:teuthology.orchestra.run.smithi136.stderr:bluefs stats 2024-04-19T02:20:27.883 INFO:teuthology.orchestra.run.smithi136.stderr:bluestore allocator dump block 2024-04-19T02:20:27.883 INFO:teuthology.orchestra.run.smithi136.stderr:bluestore allocator fragmentation block 2024-04-19T02:20:27.883 INFO:teuthology.orchestra.run.smithi136.stderr:admin_socket: invalid command 2024-04-19T02:20:27.885 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T02:20:27.885 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-19T02:20:28.596 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-19T02:20:28.412+0000 7fd60c6c9640 -1 osd.1 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:20:32.886 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:20:33.022 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-19T02:20:33.023 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-19T02:20:33.023 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-19T02:20:33.023 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-19T02:20:33.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T02:20:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T02:20:34.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T02:20:35.187 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T02:20:35.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T02:20:36.188 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T02:20:36.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T02:20:36.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:36.520 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:36.536 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-04-19T02:20:36.290473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":167,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":296660,"kb_used_data":60184,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282818860,"statfs":{"total":289910292480,"available":289606512640,"internally_reserved":0,"allocated":61628416,"data_stored":205501104,"data_compressed":16754932,"data_compressed_allocated":26832896,"data_compressed_original":171843584,"omap_allocated":10357,"internal_metadata":242079627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7137,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.782635"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179986+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:34.179986+0000","last_peered":"2024-04-19T02:20:34.179986+0000","last_clean":"2024-04-19T02:20:34.179986+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:34.179986+0000","last_undegraded":"2024-04-19T02:20:34.179986+0000","last_fullsized":"2024-04-19T02:20:34.179986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":559,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179348+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:34.179348+0000","last_peered":"2024-04-19T02:20:34.179348+0000","last_clean":"2024-04-19T02:20:34.179348+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:34.179348+0000","last_undegraded":"2024-04-19T02:20:34.179348+0000","last_fullsized":"2024-04-19T02:20:34.179348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":482,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.179596+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:33.179596+0000","last_peered":"2024-04-19T02:20:33.179596+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:33.179596+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":464,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175052+0000","last_change":"2024-04-19T02:20:31.651928+0000","last_active":"2024-04-19T02:20:33.175052+0000","last_peered":"2024-04-19T02:20:33.175052+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.649181+0000","last_became_peered":"2024-04-19T02:20:31.649181+0000","last_unstale":"2024-04-19T02:20:33.175052+0000","last_undegraded":"2024-04-19T02:20:31.509915+0000","last_fullsized":"2024-04-19T02:20:31.496882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:43.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":507,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178379+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:33.178379+0000","last_peered":"2024-04-19T02:20:33.178379+0000","last_clean":"2024-04-19T02:20:33.178379+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:33.178379+0000","last_undegraded":"2024-04-19T02:20:33.178379+0000","last_fullsized":"2024-04-19T02:20:33.178379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":534,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176018+0000","last_change":"2024-04-19T02:20:31.666551+0000","last_active":"2024-04-19T02:20:33.176018+0000","last_peered":"2024-04-19T02:20:33.176018+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:33.176018+0000","last_undegraded":"2024-04-19T02:20:31.515010+0000","last_fullsized":"2024-04-19T02:20:31.499321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.214784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":517,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173778+0000","last_change":"2024-04-19T02:20:31.645598+0000","last_active":"2024-04-19T02:20:33.173778+0000","last_peered":"2024-04-19T02:20:33.173778+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.642919+0000","last_became_peered":"2024-04-19T02:20:31.642919+0000","last_unstale":"2024-04-19T02:20:33.173778+0000","last_undegraded":"2024-04-19T02:20:31.514540+0000","last_fullsized":"2024-04-19T02:20:31.495453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:26.195278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":581,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173804+0000","last_change":"2024-04-19T02:20:31.662166+0000","last_active":"2024-04-19T02:20:33.173804+0000","last_peered":"2024-04-19T02:20:33.173804+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657980+0000","last_became_peered":"2024-04-19T02:20:31.657980+0000","last_unstale":"2024-04-19T02:20:33.173804+0000","last_undegraded":"2024-04-19T02:20:31.505252+0000","last_fullsized":"2024-04-19T02:20:31.495352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:37.286269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":528,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.174771+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:33.174771+0000","last_peered":"2024-04-19T02:20:33.174771+0000","last_clean":"2024-04-19T02:20:33.174771+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:33.174771+0000","last_undegraded":"2024-04-19T02:20:33.174771+0000","last_fullsized":"2024-04-19T02:20:33.174771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":519,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179400+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:33.179400+0000","last_peered":"2024-04-19T02:20:33.179400+0000","last_clean":"2024-04-19T02:20:33.179400+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:33.179400+0000","last_undegraded":"2024-04-19T02:20:33.179400+0000","last_fullsized":"2024-04-19T02:20:33.179400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":456,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175328+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:33.175328+0000","last_peered":"2024-04-19T02:20:33.175328+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:33.175328+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":552,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180212+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:33.180212+0000","last_peered":"2024-04-19T02:20:33.180212+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:33.180212+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":503,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178058+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:33.178058+0000","last_peered":"2024-04-19T02:20:33.178058+0000","last_clean":"2024-04-19T02:20:33.178058+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:33.178058+0000","last_undegraded":"2024-04-19T02:20:33.178058+0000","last_fullsized":"2024-04-19T02:20:33.178058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":506,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176903+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:33.176903+0000","last_peered":"2024-04-19T02:20:33.176903+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:33.176903+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":528,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176487+0000","last_change":"2024-04-19T02:20:31.645793+0000","last_active":"2024-04-19T02:20:33.176487+0000","last_peered":"2024-04-19T02:20:33.176487+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.642921+0000","last_became_peered":"2024-04-19T02:20:31.642921+0000","last_unstale":"2024-04-19T02:20:33.176487+0000","last_undegraded":"2024-04-19T02:20:31.516270+0000","last_fullsized":"2024-04-19T02:20:31.499244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:22.064964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":575,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173589+0000","last_change":"2024-04-19T02:20:31.664110+0000","last_active":"2024-04-19T02:20:33.173589+0000","last_peered":"2024-04-19T02:20:33.173589+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658002+0000","last_became_peered":"2024-04-19T02:20:31.658002+0000","last_unstale":"2024-04-19T02:20:33.173589+0000","last_undegraded":"2024-04-19T02:20:31.509127+0000","last_fullsized":"2024-04-19T02:20:31.495181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176278+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:33.176278+0000","last_peered":"2024-04-19T02:20:33.176278+0000","last_clean":"2024-04-19T02:20:33.176278+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:33.176278+0000","last_undegraded":"2024-04-19T02:20:33.176278+0000","last_fullsized":"2024-04-19T02:20:33.176278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":503,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179821+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:33.179821+0000","last_peered":"2024-04-19T02:20:33.179821+0000","last_clean":"2024-04-19T02:20:33.179821+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:33.179821+0000","last_undegraded":"2024-04-19T02:20:33.179821+0000","last_fullsized":"2024-04-19T02:20:33.179821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":614,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175541+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:33.175541+0000","last_peered":"2024-04-19T02:20:33.175541+0000","last_clean":"2024-04-19T02:20:33.175541+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:33.175541+0000","last_undegraded":"2024-04-19T02:20:33.175541+0000","last_fullsized":"2024-04-19T02:20:33.175541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":510,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175725+0000","last_change":"2024-04-19T02:20:31.664482+0000","last_active":"2024-04-19T02:20:33.175725+0000","last_peered":"2024-04-19T02:20:33.175725+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658147+0000","last_became_peered":"2024-04-19T02:20:31.658147+0000","last_unstale":"2024-04-19T02:20:33.175725+0000","last_undegraded":"2024-04-19T02:20:31.527172+0000","last_fullsized":"2024-04-19T02:20:31.514881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.179528+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:33.179528+0000","last_peered":"2024-04-19T02:20:33.179528+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:33.179528+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":683,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178418+0000","last_change":"2024-04-19T02:20:31.672278+0000","last_active":"2024-04-19T02:20:33.178418+0000","last_peered":"2024-04-19T02:20:33.178418+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:33.178418+0000","last_undegraded":"2024-04-19T02:20:31.524382+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":509,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174061+0000","last_change":"2024-04-19T02:20:31.648151+0000","last_active":"2024-04-19T02:20:33.174061+0000","last_peered":"2024-04-19T02:20:33.174061+0000","last_clean":"2024-04-19T02:17:07.001190+0000","last_became_active":"2024-04-19T02:20:31.643057+0000","last_became_peered":"2024-04-19T02:20:31.643057+0000","last_unstale":"2024-04-19T02:20:33.174061+0000","last_undegraded":"2024-04-19T02:20:31.508039+0000","last_fullsized":"2024-04-19T02:20:31.495604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:01.698284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":534,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176212+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:33.176212+0000","last_peered":"2024-04-19T02:20:33.176212+0000","last_clean":"2024-04-19T02:20:33.176212+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:33.176212+0000","last_undegraded":"2024-04-19T02:20:33.176212+0000","last_fullsized":"2024-04-19T02:20:33.176212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":521,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.232504+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:34.232504+0000","last_peered":"2024-04-19T02:20:34.232504+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:34.232504+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":701,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176023+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:33.176023+0000","last_peered":"2024-04-19T02:20:33.176023+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:33.176023+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":554,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180813+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:33.180813+0000","last_peered":"2024-04-19T02:20:33.180813+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:33.180813+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":455,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180872+0000","last_change":"2024-04-19T02:20:31.656392+0000","last_active":"2024-04-19T02:20:33.180872+0000","last_peered":"2024-04-19T02:20:33.180872+0000","last_clean":"2024-04-19T02:17:09.445020+0000","last_became_active":"2024-04-19T02:20:31.653744+0000","last_became_peered":"2024-04-19T02:20:31.653744+0000","last_unstale":"2024-04-19T02:20:33.180872+0000","last_undegraded":"2024-04-19T02:20:31.524100+0000","last_fullsized":"2024-04-19T02:20:31.504419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:54.935253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":158,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":505,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.178474+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:34.178474+0000","last_peered":"2024-04-19T02:20:34.178474+0000","last_clean":"2024-04-19T02:20:34.178474+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:34.178474+0000","last_undegraded":"2024-04-19T02:20:34.178474+0000","last_fullsized":"2024-04-19T02:20:34.178474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":619,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.179865+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:34.179865+0000","last_peered":"2024-04-19T02:20:34.179865+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:34.179865+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":582,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.176337+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:34.176337+0000","last_peered":"2024-04-19T02:20:34.176337+0000","last_clean":"2024-04-19T02:20:34.176337+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:34.176337+0000","last_undegraded":"2024-04-19T02:20:34.176337+0000","last_fullsized":"2024-04-19T02:20:34.176337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":523,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174290+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:33.174290+0000","last_peered":"2024-04-19T02:20:33.174290+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:33.174290+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":463,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180918+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:33.180918+0000","last_peered":"2024-04-19T02:20:33.180918+0000","last_clean":"2024-04-19T02:20:33.180918+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:33.180918+0000","last_undegraded":"2024-04-19T02:20:33.180918+0000","last_fullsized":"2024-04-19T02:20:33.180918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.187866+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:34.187866+0000","last_peered":"2024-04-19T02:20:34.187866+0000","last_clean":"2024-04-19T02:20:34.187866+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:34.187866+0000","last_undegraded":"2024-04-19T02:20:34.187866+0000","last_fullsized":"2024-04-19T02:20:34.187866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":512,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180001+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:33.180001+0000","last_peered":"2024-04-19T02:20:33.180001+0000","last_clean":"2024-04-19T02:20:33.180001+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:33.180001+0000","last_undegraded":"2024-04-19T02:20:33.180001+0000","last_fullsized":"2024-04-19T02:20:33.180001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175440+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:33.175440+0000","last_peered":"2024-04-19T02:20:33.175440+0000","last_clean":"2024-04-19T02:20:33.175440+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:33.175440+0000","last_undegraded":"2024-04-19T02:20:33.175440+0000","last_fullsized":"2024-04-19T02:20:33.175440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":596,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178988+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:33.178988+0000","last_peered":"2024-04-19T02:20:33.178988+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:33.178988+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":159,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177114+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:33.177114+0000","last_peered":"2024-04-19T02:20:33.177114+0000","last_clean":"2024-04-19T02:20:33.177114+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:33.177114+0000","last_undegraded":"2024-04-19T02:20:33.177114+0000","last_fullsized":"2024-04-19T02:20:33.177114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":531,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.184998+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:34.184998+0000","last_peered":"2024-04-19T02:20:34.184998+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:34.184998+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176497+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:33.176497+0000","last_peered":"2024-04-19T02:20:33.176497+0000","last_clean":"2024-04-19T02:20:33.176497+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:33.176497+0000","last_undegraded":"2024-04-19T02:20:33.176497+0000","last_fullsized":"2024-04-19T02:20:33.176497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":256,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.185519+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:33.185519+0000","last_peered":"2024-04-19T02:20:33.185519+0000","last_clean":"2024-04-19T02:20:33.185519+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:33.185519+0000","last_undegraded":"2024-04-19T02:20:33.185519+0000","last_fullsized":"2024-04-19T02:20:33.185519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":502,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176561+0000","last_change":"2024-04-19T02:20:31.662057+0000","last_active":"2024-04-19T02:20:33.176561+0000","last_peered":"2024-04-19T02:20:33.176561+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:20:31.657714+0000","last_became_peered":"2024-04-19T02:20:31.657714+0000","last_unstale":"2024-04-19T02:20:33.176561+0000","last_undegraded":"2024-04-19T02:20:31.509606+0000","last_fullsized":"2024-04-19T02:20:31.499247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:39.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.187216+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:34.187216+0000","last_peered":"2024-04-19T02:20:34.187216+0000","last_clean":"2024-04-19T02:20:34.187216+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:34.187216+0000","last_undegraded":"2024-04-19T02:20:34.187216+0000","last_fullsized":"2024-04-19T02:20:34.187216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":532,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178614+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:33.178614+0000","last_peered":"2024-04-19T02:20:33.178614+0000","last_clean":"2024-04-19T02:20:33.178614+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:33.178614+0000","last_undegraded":"2024-04-19T02:20:33.178614+0000","last_fullsized":"2024-04-19T02:20:33.178614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":678,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.182133+0000","last_change":"2024-04-19T02:20:34.182555+0000","last_active":"2024-04-19T02:20:34.182133+0000","last_peered":"2024-04-19T02:20:33.409500+0000","last_clean":"2024-04-19T02:16:24.498760+0000","last_became_active":"2024-04-19T02:20:31.664145+0000","last_became_peered":"2024-04-19T02:20:31.664145+0000","last_unstale":"2024-04-19T02:20:34.182133+0000","last_undegraded":"2024-04-19T02:20:34.182133+0000","last_fullsized":"2024-04-19T02:20:34.182133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:19.433305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":490,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177517+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:33.177517+0000","last_peered":"2024-04-19T02:20:33.177517+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:33.177517+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176367+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:33.176367+0000","last_peered":"2024-04-19T02:20:33.176367+0000","last_clean":"2024-04-19T02:20:33.176367+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:33.176367+0000","last_undegraded":"2024-04-19T02:20:33.176367+0000","last_fullsized":"2024-04-19T02:20:33.176367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":647,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177228+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:33.177228+0000","last_peered":"2024-04-19T02:20:33.177228+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:33.177228+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":226,"reported_epoch":83,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.512221+0000","last_change":"2024-04-19T02:20:34.232333+0000","last_active":"2024-04-19T02:20:34.512221+0000","last_peered":"2024-04-19T02:20:34.512221+0000","last_clean":"2024-04-19T02:17:07.002985+0000","last_became_active":"2024-04-19T02:20:31.675121+0000","last_became_peered":"2024-04-19T02:20:31.675121+0000","last_unstale":"2024-04-19T02:20:34.512221+0000","last_undegraded":"2024-04-19T02:20:31.539277+0000","last_fullsized":"2024-04-19T02:20:31.536894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:44.980081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":3}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":530,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176825+0000","last_change":"2024-04-19T02:20:31.664858+0000","last_active":"2024-04-19T02:20:33.176825+0000","last_peered":"2024-04-19T02:20:33.176825+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658577+0000","last_became_peered":"2024-04-19T02:20:31.658577+0000","last_unstale":"2024-04-19T02:20:33.176825+0000","last_undegraded":"2024-04-19T02:20:31.520194+0000","last_fullsized":"2024-04-19T02:20:31.497338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:24.362286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":286,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.186437+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:34.186437+0000","last_peered":"2024-04-19T02:20:34.186437+0000","last_clean":"2024-04-19T02:20:34.186437+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:34.186437+0000","last_undegraded":"2024-04-19T02:20:34.186437+0000","last_fullsized":"2024-04-19T02:20:34.186437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":582,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180311+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:33.180311+0000","last_peered":"2024-04-19T02:20:33.180311+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:33.180311+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177346+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:33.177346+0000","last_peered":"2024-04-19T02:20:33.177346+0000","last_clean":"2024-04-19T02:20:33.177346+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:33.177346+0000","last_undegraded":"2024-04-19T02:20:33.177346+0000","last_fullsized":"2024-04-19T02:20:33.177346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":449,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178715+0000","last_change":"2024-04-19T02:20:31.660785+0000","last_active":"2024-04-19T02:20:33.178715+0000","last_peered":"2024-04-19T02:20:33.178715+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657307+0000","last_became_peered":"2024-04-19T02:20:31.657307+0000","last_unstale":"2024-04-19T02:20:33.178715+0000","last_undegraded":"2024-04-19T02:20:31.516112+0000","last_fullsized":"2024-04-19T02:20:31.501819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:42.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":467,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176771+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:33.176771+0000","last_peered":"2024-04-19T02:20:33.176771+0000","last_clean":"2024-04-19T02:20:33.176771+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:33.176771+0000","last_undegraded":"2024-04-19T02:20:33.176771+0000","last_fullsized":"2024-04-19T02:20:33.176771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175290+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:33.175290+0000","last_peered":"2024-04-19T02:20:33.175290+0000","last_clean":"2024-04-19T02:20:33.175290+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:33.175290+0000","last_undegraded":"2024-04-19T02:20:33.175290+0000","last_fullsized":"2024-04-19T02:20:33.175290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179850+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:33.179850+0000","last_peered":"2024-04-19T02:20:33.179850+0000","last_clean":"2024-04-19T02:20:33.179850+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:33.179850+0000","last_undegraded":"2024-04-19T02:20:33.179850+0000","last_fullsized":"2024-04-19T02:20:33.179850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179851+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:33.179851+0000","last_peered":"2024-04-19T02:20:33.179851+0000","last_clean":"2024-04-19T02:20:33.179851+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:33.179851+0000","last_undegraded":"2024-04-19T02:20:33.179851+0000","last_fullsized":"2024-04-19T02:20:33.179851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":839,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.178347+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:34.178347+0000","last_peered":"2024-04-19T02:20:34.178347+0000","last_clean":"2024-04-19T02:20:34.178347+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:34.178347+0000","last_undegraded":"2024-04-19T02:20:34.178347+0000","last_fullsized":"2024-04-19T02:20:34.178347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":567,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178836+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:33.178836+0000","last_peered":"2024-04-19T02:20:33.178836+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:33.178836+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179280+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:33.179280+0000","last_peered":"2024-04-19T02:20:33.179280+0000","last_clean":"2024-04-19T02:20:33.179280+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:33.179280+0000","last_undegraded":"2024-04-19T02:20:33.179280+0000","last_fullsized":"2024-04-19T02:20:33.179280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":268,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:34.231378+0000","last_change":"2024-04-19T02:20:34.231378+0000","last_active":"2024-04-19T02:20:34.231378+0000","last_peered":"2024-04-19T02:20:34.231378+0000","last_clean":"2024-04-19T02:17:07.001902+0000","last_became_active":"2024-04-19T02:20:31.670290+0000","last_became_peered":"2024-04-19T02:20:31.670290+0000","last_unstale":"2024-04-19T02:20:34.231378+0000","last_undegraded":"2024-04-19T02:20:34.231378+0000","last_fullsized":"2024-04-19T02:20:31.530008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:38.658447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":521,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180077+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:33.180077+0000","last_peered":"2024-04-19T02:20:33.180077+0000","last_clean":"2024-04-19T02:20:33.180077+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:33.180077+0000","last_undegraded":"2024-04-19T02:20:33.180077+0000","last_fullsized":"2024-04-19T02:20:33.180077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176796+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:33.176796+0000","last_peered":"2024-04-19T02:20:33.176796+0000","last_clean":"2024-04-19T02:20:33.176796+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:33.176796+0000","last_undegraded":"2024-04-19T02:20:33.176796+0000","last_fullsized":"2024-04-19T02:20:33.176796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.186887+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:34.186887+0000","last_peered":"2024-04-19T02:20:34.186887+0000","last_clean":"2024-04-19T02:20:34.186887+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:34.186887+0000","last_undegraded":"2024-04-19T02:20:34.186887+0000","last_fullsized":"2024-04-19T02:20:34.186887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":433,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175598+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:33.175598+0000","last_peered":"2024-04-19T02:20:33.175598+0000","last_clean":"2024-04-19T02:20:33.175598+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:33.175598+0000","last_undegraded":"2024-04-19T02:20:33.175598+0000","last_fullsized":"2024-04-19T02:20:33.175598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179484+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:33.179484+0000","last_peered":"2024-04-19T02:20:33.179484+0000","last_clean":"2024-04-19T02:20:33.179484+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:33.179484+0000","last_undegraded":"2024-04-19T02:20:33.179484+0000","last_fullsized":"2024-04-19T02:20:33.179484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178714+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:33.178714+0000","last_peered":"2024-04-19T02:20:33.178714+0000","last_clean":"2024-04-19T02:20:33.178714+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:33.178714+0000","last_undegraded":"2024-04-19T02:20:33.178714+0000","last_fullsized":"2024-04-19T02:20:33.178714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":535,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.180187+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:34.180187+0000","last_peered":"2024-04-19T02:20:34.180187+0000","last_clean":"2024-04-19T02:20:34.180187+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:34.180187+0000","last_undegraded":"2024-04-19T02:20:34.180187+0000","last_fullsized":"2024-04-19T02:20:34.180187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":532,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.180380+0000","last_change":"2024-04-19T02:20:34.181337+0000","last_active":"2024-04-19T02:20:34.180380+0000","last_peered":"2024-04-19T02:20:33.228520+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:20:31.664433+0000","last_became_peered":"2024-04-19T02:20:31.664433+0000","last_unstale":"2024-04-19T02:20:34.180380+0000","last_undegraded":"2024-04-19T02:20:34.180380+0000","last_fullsized":"2024-04-19T02:20:34.180380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:36.450902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177218+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:33.177218+0000","last_peered":"2024-04-19T02:20:33.177218+0000","last_clean":"2024-04-19T02:20:33.177218+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:33.177218+0000","last_undegraded":"2024-04-19T02:20:33.177218+0000","last_fullsized":"2024-04-19T02:20:33.177218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":491,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.179334+0000","last_change":"2024-04-19T02:20:31.666219+0000","last_active":"2024-04-19T02:20:34.179334+0000","last_peered":"2024-04-19T02:20:34.179334+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:20:31.663303+0000","last_became_peered":"2024-04-19T02:20:31.663303+0000","last_unstale":"2024-04-19T02:20:34.179334+0000","last_undegraded":"2024-04-19T02:20:31.509883+0000","last_fullsized":"2024-04-19T02:20:31.499264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:54.685515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.181085+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:34.181085+0000","last_peered":"2024-04-19T02:20:34.181085+0000","last_clean":"2024-04-19T02:20:34.181085+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:34.181085+0000","last_undegraded":"2024-04-19T02:20:34.181085+0000","last_fullsized":"2024-04-19T02:20:34.181085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.181089+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:33.181089+0000","last_peered":"2024-04-19T02:20:33.181089+0000","last_clean":"2024-04-19T02:20:33.181089+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:33.181089+0000","last_undegraded":"2024-04-19T02:20:33.181089+0000","last_fullsized":"2024-04-19T02:20:33.181089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":576,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.178664+0000","last_change":"2024-04-19T02:20:31.663405+0000","last_active":"2024-04-19T02:20:34.178664+0000","last_peered":"2024-04-19T02:20:34.178664+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:20:31.659420+0000","last_became_peered":"2024-04-19T02:20:31.659420+0000","last_unstale":"2024-04-19T02:20:34.178664+0000","last_undegraded":"2024-04-19T02:20:31.528128+0000","last_fullsized":"2024-04-19T02:20:31.503952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176467+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:33.176467+0000","last_peered":"2024-04-19T02:20:33.176467+0000","last_clean":"2024-04-19T02:20:33.176467+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:33.176467+0000","last_undegraded":"2024-04-19T02:20:33.176467+0000","last_fullsized":"2024-04-19T02:20:33.176467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178731+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:33.178731+0000","last_peered":"2024-04-19T02:20:33.178731+0000","last_clean":"2024-04-19T02:20:33.178731+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:33.178731+0000","last_undegraded":"2024-04-19T02:20:33.178731+0000","last_fullsized":"2024-04-19T02:20:33.178731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178367+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:33.178367+0000","last_peered":"2024-04-19T02:20:33.178367+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:33.178367+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":169,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178486+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:33.178486+0000","last_peered":"2024-04-19T02:20:33.178486+0000","last_clean":"2024-04-19T02:20:33.178486+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:33.178486+0000","last_undegraded":"2024-04-19T02:20:33.178486+0000","last_fullsized":"2024-04-19T02:20:33.178486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.181600+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:33.181600+0000","last_peered":"2024-04-19T02:20:33.181600+0000","last_clean":"2024-04-19T02:20:33.181600+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:33.181600+0000","last_undegraded":"2024-04-19T02:20:33.181600+0000","last_fullsized":"2024-04-19T02:20:33.181600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":543,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.173682+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:33.173682+0000","last_peered":"2024-04-19T02:20:33.173682+0000","last_clean":"2024-04-19T02:20:33.173682+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:33.173682+0000","last_undegraded":"2024-04-19T02:20:33.173682+0000","last_fullsized":"2024-04-19T02:20:33.173682+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":500,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177217+0000","last_change":"2024-04-19T02:20:31.663417+0000","last_active":"2024-04-19T02:20:33.177217+0000","last_peered":"2024-04-19T02:20:33.177217+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.659358+0000","last_became_peered":"2024-04-19T02:20:31.659358+0000","last_unstale":"2024-04-19T02:20:33.177217+0000","last_undegraded":"2024-04-19T02:20:31.524667+0000","last_fullsized":"2024-04-19T02:20:31.500013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:52.738849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":548,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.184833+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:33.184833+0000","last_peered":"2024-04-19T02:20:33.184833+0000","last_clean":"2024-04-19T02:20:33.184833+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:33.184833+0000","last_undegraded":"2024-04-19T02:20:33.184833+0000","last_fullsized":"2024-04-19T02:20:33.184833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":520,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.173929+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:33.173929+0000","last_peered":"2024-04-19T02:20:33.173929+0000","last_clean":"2024-04-19T02:20:33.173929+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:33.173929+0000","last_undegraded":"2024-04-19T02:20:33.173929+0000","last_fullsized":"2024-04-19T02:20:33.173929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":181,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180900+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:33.180900+0000","last_peered":"2024-04-19T02:20:33.180900+0000","last_clean":"2024-04-19T02:20:33.180900+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:33.180900+0000","last_undegraded":"2024-04-19T02:20:33.180900+0000","last_fullsized":"2024-04-19T02:20:33.180900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":403,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.182792+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:33.182792+0000","last_peered":"2024-04-19T02:20:33.182792+0000","last_clean":"2024-04-19T02:20:33.182792+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:33.182792+0000","last_undegraded":"2024-04-19T02:20:33.182792+0000","last_fullsized":"2024-04-19T02:20:33.182792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":578,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175458+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:33.175458+0000","last_peered":"2024-04-19T02:20:33.175458+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:33.175458+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176212+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:33.176212+0000","last_peered":"2024-04-19T02:20:33.176212+0000","last_clean":"2024-04-19T02:20:33.176212+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:33.176212+0000","last_undegraded":"2024-04-19T02:20:33.176212+0000","last_fullsized":"2024-04-19T02:20:33.176212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":594,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.174690+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:33.174690+0000","last_peered":"2024-04-19T02:20:33.174690+0000","last_clean":"2024-04-19T02:20:33.174690+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:33.174690+0000","last_undegraded":"2024-04-19T02:20:33.174690+0000","last_fullsized":"2024-04-19T02:20:33.174690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":550,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.180399+0000","last_change":"2024-04-19T02:20:31.661716+0000","last_active":"2024-04-19T02:20:34.180399+0000","last_peered":"2024-04-19T02:20:34.180399+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:20:31.657888+0000","last_became_peered":"2024-04-19T02:20:31.657888+0000","last_unstale":"2024-04-19T02:20:34.180399+0000","last_undegraded":"2024-04-19T02:20:31.528667+0000","last_fullsized":"2024-04-19T02:20:31.510002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:00.802247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":162,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":648,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175299+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:33.175299+0000","last_peered":"2024-04-19T02:20:33.175299+0000","last_clean":"2024-04-19T02:20:33.175299+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:33.175299+0000","last_undegraded":"2024-04-19T02:20:33.175299+0000","last_fullsized":"2024-04-19T02:20:33.175299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176778+0000","last_change":"2024-04-19T02:20:31.663278+0000","last_active":"2024-04-19T02:20:33.176778+0000","last_peered":"2024-04-19T02:20:33.176778+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:20:31.657854+0000","last_became_peered":"2024-04-19T02:20:31.657854+0000","last_unstale":"2024-04-19T02:20:33.176778+0000","last_undegraded":"2024-04-19T02:20:31.511694+0000","last_fullsized":"2024-04-19T02:20:31.499301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:06.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":418,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:34.181030+0000","last_change":"2024-04-19T02:20:34.181547+0000","last_active":"2024-04-19T02:20:34.181030+0000","last_peered":"2024-04-19T02:20:34.181030+0000","last_clean":"2024-04-19T02:17:07.001688+0000","last_became_active":"2024-04-19T02:20:31.668954+0000","last_became_peered":"2024-04-19T02:20:31.668954+0000","last_unstale":"2024-04-19T02:20:34.181030+0000","last_undegraded":"2024-04-19T02:20:31.529544+0000","last_fullsized":"2024-04-19T02:20:31.517909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:00.949255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":496,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177946+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:33.177946+0000","last_peered":"2024-04-19T02:20:33.177946+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:33.177946+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":573,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180649+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:33.180649+0000","last_peered":"2024-04-19T02:20:33.180649+0000","last_clean":"2024-04-19T02:20:33.180649+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:33.180649+0000","last_undegraded":"2024-04-19T02:20:33.180649+0000","last_fullsized":"2024-04-19T02:20:33.180649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":515,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179879+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:33.179879+0000","last_peered":"2024-04-19T02:20:33.179879+0000","last_clean":"2024-04-19T02:20:33.179879+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:33.179879+0000","last_undegraded":"2024-04-19T02:20:33.179879+0000","last_fullsized":"2024-04-19T02:20:33.179879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178692+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:33.178692+0000","last_peered":"2024-04-19T02:20:33.178692+0000","last_clean":"2024-04-19T02:20:33.178692+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:33.178692+0000","last_undegraded":"2024-04-19T02:20:33.178692+0000","last_fullsized":"2024-04-19T02:20:33.178692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":465,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175527+0000","last_change":"2024-04-19T02:20:31.665847+0000","last_active":"2024-04-19T02:20:33.175527+0000","last_peered":"2024-04-19T02:20:33.175527+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:33.175527+0000","last_undegraded":"2024-04-19T02:20:31.510138+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":406,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.182107+0000","last_change":"2024-04-19T02:20:34.182360+0000","last_active":"2024-04-19T02:20:34.182107+0000","last_peered":"2024-04-19T02:20:33.576289+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:20:31.669330+0000","last_became_peered":"2024-04-19T02:20:31.669330+0000","last_unstale":"2024-04-19T02:20:34.182107+0000","last_undegraded":"2024-04-19T02:20:34.182107+0000","last_fullsized":"2024-04-19T02:20:34.182107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:38.881973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":494,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174974+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:33.174974+0000","last_peered":"2024-04-19T02:20:33.174974+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:33.174974+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":466,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.181971+0000","last_change":"2024-04-19T02:20:34.182211+0000","last_active":"2024-04-19T02:20:34.181971+0000","last_peered":"2024-04-19T02:20:34.020377+0000","last_clean":"2024-04-19T02:17:09.446016+0000","last_became_active":"2024-04-19T02:20:31.665063+0000","last_became_peered":"2024-04-19T02:20:31.665063+0000","last_unstale":"2024-04-19T02:20:34.181971+0000","last_undegraded":"2024-04-19T02:20:34.181971+0000","last_fullsized":"2024-04-19T02:20:34.181971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:33.904940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":598,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177633+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:33.177633+0000","last_peered":"2024-04-19T02:20:33.177633+0000","last_clean":"2024-04-19T02:20:33.177633+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:33.177633+0000","last_undegraded":"2024-04-19T02:20:33.177633+0000","last_fullsized":"2024-04-19T02:20:33.177633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177368+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:33.177368+0000","last_peered":"2024-04-19T02:20:33.177368+0000","last_clean":"2024-04-19T02:20:33.177368+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:33.177368+0000","last_undegraded":"2024-04-19T02:20:33.177368+0000","last_fullsized":"2024-04-19T02:20:33.177368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":557,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174157+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:33.174157+0000","last_peered":"2024-04-19T02:20:33.174157+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:33.174157+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179083+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:34.179083+0000","last_peered":"2024-04-19T02:20:34.179083+0000","last_clean":"2024-04-19T02:20:34.179083+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:34.179083+0000","last_undegraded":"2024-04-19T02:20:34.179083+0000","last_fullsized":"2024-04-19T02:20:34.179083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":88,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62783488,"data_stored":229521765,"data_compressed":19386051,"data_compressed_allocated":30105600,"data_compressed_original":196911104,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":61,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124620,"kb_used_data":27128,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247220,"statfs":{"total":96636764160,"available":96509153280,"internally_reserved":0,"allocated":27779072,"data_stored":81498533,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":78,"seq":335007449090,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":5260,"kb_used_omap":7,"kb_used_meta":27512,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":5386240,"data_stored":37881567,"data_compressed":3459370,"data_compressed_allocated":4624384,"data_compressed_original":37507072,"omap_allocated":7169,"internal_metadata":28173311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139240,"kb_used_data":27796,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232600,"statfs":{"total":96636764160,"available":96494182400,"internally_reserved":0,"allocated":28463104,"data_stored":86121004,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7991296,"data_stored":63171636,"data_compressed":6098522,"data_compressed_allocated":7933952,"data_compressed_original":63148032,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:36.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:36.873 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:36.875 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:36.891 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-04-19T02:20:36.290473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":167,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":296660,"kb_used_data":60184,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282818860,"statfs":{"total":289910292480,"available":289606512640,"internally_reserved":0,"allocated":61628416,"data_stored":205501104,"data_compressed":16754932,"data_compressed_allocated":26832896,"data_compressed_original":171843584,"omap_allocated":10357,"internal_metadata":242079627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7137,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.782635"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179986+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:34.179986+0000","last_peered":"2024-04-19T02:20:34.179986+0000","last_clean":"2024-04-19T02:20:34.179986+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:34.179986+0000","last_undegraded":"2024-04-19T02:20:34.179986+0000","last_fullsized":"2024-04-19T02:20:34.179986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":559,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179348+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:34.179348+0000","last_peered":"2024-04-19T02:20:34.179348+0000","last_clean":"2024-04-19T02:20:34.179348+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:34.179348+0000","last_undegraded":"2024-04-19T02:20:34.179348+0000","last_fullsized":"2024-04-19T02:20:34.179348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":482,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.179596+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:33.179596+0000","last_peered":"2024-04-19T02:20:33.179596+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:33.179596+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":464,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175052+0000","last_change":"2024-04-19T02:20:31.651928+0000","last_active":"2024-04-19T02:20:33.175052+0000","last_peered":"2024-04-19T02:20:33.175052+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.649181+0000","last_became_peered":"2024-04-19T02:20:31.649181+0000","last_unstale":"2024-04-19T02:20:33.175052+0000","last_undegraded":"2024-04-19T02:20:31.509915+0000","last_fullsized":"2024-04-19T02:20:31.496882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:43.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":507,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178379+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:33.178379+0000","last_peered":"2024-04-19T02:20:33.178379+0000","last_clean":"2024-04-19T02:20:33.178379+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:33.178379+0000","last_undegraded":"2024-04-19T02:20:33.178379+0000","last_fullsized":"2024-04-19T02:20:33.178379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":534,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176018+0000","last_change":"2024-04-19T02:20:31.666551+0000","last_active":"2024-04-19T02:20:33.176018+0000","last_peered":"2024-04-19T02:20:33.176018+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:33.176018+0000","last_undegraded":"2024-04-19T02:20:31.515010+0000","last_fullsized":"2024-04-19T02:20:31.499321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.214784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":517,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173778+0000","last_change":"2024-04-19T02:20:31.645598+0000","last_active":"2024-04-19T02:20:33.173778+0000","last_peered":"2024-04-19T02:20:33.173778+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.642919+0000","last_became_peered":"2024-04-19T02:20:31.642919+0000","last_unstale":"2024-04-19T02:20:33.173778+0000","last_undegraded":"2024-04-19T02:20:31.514540+0000","last_fullsized":"2024-04-19T02:20:31.495453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:26.195278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":581,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173804+0000","last_change":"2024-04-19T02:20:31.662166+0000","last_active":"2024-04-19T02:20:33.173804+0000","last_peered":"2024-04-19T02:20:33.173804+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657980+0000","last_became_peered":"2024-04-19T02:20:31.657980+0000","last_unstale":"2024-04-19T02:20:33.173804+0000","last_undegraded":"2024-04-19T02:20:31.505252+0000","last_fullsized":"2024-04-19T02:20:31.495352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:37.286269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":528,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.174771+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:33.174771+0000","last_peered":"2024-04-19T02:20:33.174771+0000","last_clean":"2024-04-19T02:20:33.174771+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:33.174771+0000","last_undegraded":"2024-04-19T02:20:33.174771+0000","last_fullsized":"2024-04-19T02:20:33.174771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":519,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179400+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:33.179400+0000","last_peered":"2024-04-19T02:20:33.179400+0000","last_clean":"2024-04-19T02:20:33.179400+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:33.179400+0000","last_undegraded":"2024-04-19T02:20:33.179400+0000","last_fullsized":"2024-04-19T02:20:33.179400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":456,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175328+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:33.175328+0000","last_peered":"2024-04-19T02:20:33.175328+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:33.175328+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":552,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180212+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:33.180212+0000","last_peered":"2024-04-19T02:20:33.180212+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:33.180212+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":503,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178058+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:33.178058+0000","last_peered":"2024-04-19T02:20:33.178058+0000","last_clean":"2024-04-19T02:20:33.178058+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:33.178058+0000","last_undegraded":"2024-04-19T02:20:33.178058+0000","last_fullsized":"2024-04-19T02:20:33.178058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":506,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176903+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:33.176903+0000","last_peered":"2024-04-19T02:20:33.176903+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:33.176903+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":528,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176487+0000","last_change":"2024-04-19T02:20:31.645793+0000","last_active":"2024-04-19T02:20:33.176487+0000","last_peered":"2024-04-19T02:20:33.176487+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.642921+0000","last_became_peered":"2024-04-19T02:20:31.642921+0000","last_unstale":"2024-04-19T02:20:33.176487+0000","last_undegraded":"2024-04-19T02:20:31.516270+0000","last_fullsized":"2024-04-19T02:20:31.499244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:22.064964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":575,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173589+0000","last_change":"2024-04-19T02:20:31.664110+0000","last_active":"2024-04-19T02:20:33.173589+0000","last_peered":"2024-04-19T02:20:33.173589+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658002+0000","last_became_peered":"2024-04-19T02:20:31.658002+0000","last_unstale":"2024-04-19T02:20:33.173589+0000","last_undegraded":"2024-04-19T02:20:31.509127+0000","last_fullsized":"2024-04-19T02:20:31.495181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176278+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:33.176278+0000","last_peered":"2024-04-19T02:20:33.176278+0000","last_clean":"2024-04-19T02:20:33.176278+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:33.176278+0000","last_undegraded":"2024-04-19T02:20:33.176278+0000","last_fullsized":"2024-04-19T02:20:33.176278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":503,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179821+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:33.179821+0000","last_peered":"2024-04-19T02:20:33.179821+0000","last_clean":"2024-04-19T02:20:33.179821+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:33.179821+0000","last_undegraded":"2024-04-19T02:20:33.179821+0000","last_fullsized":"2024-04-19T02:20:33.179821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":614,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175541+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:33.175541+0000","last_peered":"2024-04-19T02:20:33.175541+0000","last_clean":"2024-04-19T02:20:33.175541+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:33.175541+0000","last_undegraded":"2024-04-19T02:20:33.175541+0000","last_fullsized":"2024-04-19T02:20:33.175541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":510,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175725+0000","last_change":"2024-04-19T02:20:31.664482+0000","last_active":"2024-04-19T02:20:33.175725+0000","last_peered":"2024-04-19T02:20:33.175725+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658147+0000","last_became_peered":"2024-04-19T02:20:31.658147+0000","last_unstale":"2024-04-19T02:20:33.175725+0000","last_undegraded":"2024-04-19T02:20:31.527172+0000","last_fullsized":"2024-04-19T02:20:31.514881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.179528+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:33.179528+0000","last_peered":"2024-04-19T02:20:33.179528+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:33.179528+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":683,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178418+0000","last_change":"2024-04-19T02:20:31.672278+0000","last_active":"2024-04-19T02:20:33.178418+0000","last_peered":"2024-04-19T02:20:33.178418+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:33.178418+0000","last_undegraded":"2024-04-19T02:20:31.524382+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":509,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174061+0000","last_change":"2024-04-19T02:20:31.648151+0000","last_active":"2024-04-19T02:20:33.174061+0000","last_peered":"2024-04-19T02:20:33.174061+0000","last_clean":"2024-04-19T02:17:07.001190+0000","last_became_active":"2024-04-19T02:20:31.643057+0000","last_became_peered":"2024-04-19T02:20:31.643057+0000","last_unstale":"2024-04-19T02:20:33.174061+0000","last_undegraded":"2024-04-19T02:20:31.508039+0000","last_fullsized":"2024-04-19T02:20:31.495604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:01.698284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":534,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176212+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:33.176212+0000","last_peered":"2024-04-19T02:20:33.176212+0000","last_clean":"2024-04-19T02:20:33.176212+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:33.176212+0000","last_undegraded":"2024-04-19T02:20:33.176212+0000","last_fullsized":"2024-04-19T02:20:33.176212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":521,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.232504+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:34.232504+0000","last_peered":"2024-04-19T02:20:34.232504+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:34.232504+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":701,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176023+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:33.176023+0000","last_peered":"2024-04-19T02:20:33.176023+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:33.176023+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":554,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180813+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:33.180813+0000","last_peered":"2024-04-19T02:20:33.180813+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:33.180813+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":455,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180872+0000","last_change":"2024-04-19T02:20:31.656392+0000","last_active":"2024-04-19T02:20:33.180872+0000","last_peered":"2024-04-19T02:20:33.180872+0000","last_clean":"2024-04-19T02:17:09.445020+0000","last_became_active":"2024-04-19T02:20:31.653744+0000","last_became_peered":"2024-04-19T02:20:31.653744+0000","last_unstale":"2024-04-19T02:20:33.180872+0000","last_undegraded":"2024-04-19T02:20:31.524100+0000","last_fullsized":"2024-04-19T02:20:31.504419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:54.935253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":158,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":505,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.178474+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:34.178474+0000","last_peered":"2024-04-19T02:20:34.178474+0000","last_clean":"2024-04-19T02:20:34.178474+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:34.178474+0000","last_undegraded":"2024-04-19T02:20:34.178474+0000","last_fullsized":"2024-04-19T02:20:34.178474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":619,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.179865+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:34.179865+0000","last_peered":"2024-04-19T02:20:34.179865+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:34.179865+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":582,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.176337+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:34.176337+0000","last_peered":"2024-04-19T02:20:34.176337+0000","last_clean":"2024-04-19T02:20:34.176337+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:34.176337+0000","last_undegraded":"2024-04-19T02:20:34.176337+0000","last_fullsized":"2024-04-19T02:20:34.176337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":523,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174290+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:33.174290+0000","last_peered":"2024-04-19T02:20:33.174290+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:33.174290+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":463,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180918+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:33.180918+0000","last_peered":"2024-04-19T02:20:33.180918+0000","last_clean":"2024-04-19T02:20:33.180918+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:33.180918+0000","last_undegraded":"2024-04-19T02:20:33.180918+0000","last_fullsized":"2024-04-19T02:20:33.180918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.187866+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:34.187866+0000","last_peered":"2024-04-19T02:20:34.187866+0000","last_clean":"2024-04-19T02:20:34.187866+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:34.187866+0000","last_undegraded":"2024-04-19T02:20:34.187866+0000","last_fullsized":"2024-04-19T02:20:34.187866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":512,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180001+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:33.180001+0000","last_peered":"2024-04-19T02:20:33.180001+0000","last_clean":"2024-04-19T02:20:33.180001+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:33.180001+0000","last_undegraded":"2024-04-19T02:20:33.180001+0000","last_fullsized":"2024-04-19T02:20:33.180001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175440+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:33.175440+0000","last_peered":"2024-04-19T02:20:33.175440+0000","last_clean":"2024-04-19T02:20:33.175440+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:33.175440+0000","last_undegraded":"2024-04-19T02:20:33.175440+0000","last_fullsized":"2024-04-19T02:20:33.175440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":596,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178988+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:33.178988+0000","last_peered":"2024-04-19T02:20:33.178988+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:33.178988+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":159,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177114+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:33.177114+0000","last_peered":"2024-04-19T02:20:33.177114+0000","last_clean":"2024-04-19T02:20:33.177114+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:33.177114+0000","last_undegraded":"2024-04-19T02:20:33.177114+0000","last_fullsized":"2024-04-19T02:20:33.177114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":531,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.184998+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:34.184998+0000","last_peered":"2024-04-19T02:20:34.184998+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:34.184998+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176497+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:33.176497+0000","last_peered":"2024-04-19T02:20:33.176497+0000","last_clean":"2024-04-19T02:20:33.176497+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:33.176497+0000","last_undegraded":"2024-04-19T02:20:33.176497+0000","last_fullsized":"2024-04-19T02:20:33.176497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":256,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.185519+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:33.185519+0000","last_peered":"2024-04-19T02:20:33.185519+0000","last_clean":"2024-04-19T02:20:33.185519+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:33.185519+0000","last_undegraded":"2024-04-19T02:20:33.185519+0000","last_fullsized":"2024-04-19T02:20:33.185519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":502,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176561+0000","last_change":"2024-04-19T02:20:31.662057+0000","last_active":"2024-04-19T02:20:33.176561+0000","last_peered":"2024-04-19T02:20:33.176561+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:20:31.657714+0000","last_became_peered":"2024-04-19T02:20:31.657714+0000","last_unstale":"2024-04-19T02:20:33.176561+0000","last_undegraded":"2024-04-19T02:20:31.509606+0000","last_fullsized":"2024-04-19T02:20:31.499247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:39.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.187216+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:34.187216+0000","last_peered":"2024-04-19T02:20:34.187216+0000","last_clean":"2024-04-19T02:20:34.187216+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:34.187216+0000","last_undegraded":"2024-04-19T02:20:34.187216+0000","last_fullsized":"2024-04-19T02:20:34.187216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":532,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178614+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:33.178614+0000","last_peered":"2024-04-19T02:20:33.178614+0000","last_clean":"2024-04-19T02:20:33.178614+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:33.178614+0000","last_undegraded":"2024-04-19T02:20:33.178614+0000","last_fullsized":"2024-04-19T02:20:33.178614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":678,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.182133+0000","last_change":"2024-04-19T02:20:34.182555+0000","last_active":"2024-04-19T02:20:34.182133+0000","last_peered":"2024-04-19T02:20:33.409500+0000","last_clean":"2024-04-19T02:16:24.498760+0000","last_became_active":"2024-04-19T02:20:31.664145+0000","last_became_peered":"2024-04-19T02:20:31.664145+0000","last_unstale":"2024-04-19T02:20:34.182133+0000","last_undegraded":"2024-04-19T02:20:34.182133+0000","last_fullsized":"2024-04-19T02:20:34.182133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:19.433305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":490,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177517+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:33.177517+0000","last_peered":"2024-04-19T02:20:33.177517+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:33.177517+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176367+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:33.176367+0000","last_peered":"2024-04-19T02:20:33.176367+0000","last_clean":"2024-04-19T02:20:33.176367+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:33.176367+0000","last_undegraded":"2024-04-19T02:20:33.176367+0000","last_fullsized":"2024-04-19T02:20:33.176367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":647,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177228+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:33.177228+0000","last_peered":"2024-04-19T02:20:33.177228+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:33.177228+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":226,"reported_epoch":83,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.512221+0000","last_change":"2024-04-19T02:20:34.232333+0000","last_active":"2024-04-19T02:20:34.512221+0000","last_peered":"2024-04-19T02:20:34.512221+0000","last_clean":"2024-04-19T02:17:07.002985+0000","last_became_active":"2024-04-19T02:20:31.675121+0000","last_became_peered":"2024-04-19T02:20:31.675121+0000","last_unstale":"2024-04-19T02:20:34.512221+0000","last_undegraded":"2024-04-19T02:20:31.539277+0000","last_fullsized":"2024-04-19T02:20:31.536894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:44.980081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":3}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":530,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176825+0000","last_change":"2024-04-19T02:20:31.664858+0000","last_active":"2024-04-19T02:20:33.176825+0000","last_peered":"2024-04-19T02:20:33.176825+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658577+0000","last_became_peered":"2024-04-19T02:20:31.658577+0000","last_unstale":"2024-04-19T02:20:33.176825+0000","last_undegraded":"2024-04-19T02:20:31.520194+0000","last_fullsized":"2024-04-19T02:20:31.497338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:24.362286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":286,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.186437+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:34.186437+0000","last_peered":"2024-04-19T02:20:34.186437+0000","last_clean":"2024-04-19T02:20:34.186437+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:34.186437+0000","last_undegraded":"2024-04-19T02:20:34.186437+0000","last_fullsized":"2024-04-19T02:20:34.186437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":582,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180311+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:33.180311+0000","last_peered":"2024-04-19T02:20:33.180311+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:33.180311+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177346+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:33.177346+0000","last_peered":"2024-04-19T02:20:33.177346+0000","last_clean":"2024-04-19T02:20:33.177346+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:33.177346+0000","last_undegraded":"2024-04-19T02:20:33.177346+0000","last_fullsized":"2024-04-19T02:20:33.177346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":449,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178715+0000","last_change":"2024-04-19T02:20:31.660785+0000","last_active":"2024-04-19T02:20:33.178715+0000","last_peered":"2024-04-19T02:20:33.178715+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657307+0000","last_became_peered":"2024-04-19T02:20:31.657307+0000","last_unstale":"2024-04-19T02:20:33.178715+0000","last_undegraded":"2024-04-19T02:20:31.516112+0000","last_fullsized":"2024-04-19T02:20:31.501819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:42.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":467,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176771+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:33.176771+0000","last_peered":"2024-04-19T02:20:33.176771+0000","last_clean":"2024-04-19T02:20:33.176771+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:33.176771+0000","last_undegraded":"2024-04-19T02:20:33.176771+0000","last_fullsized":"2024-04-19T02:20:33.176771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175290+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:33.175290+0000","last_peered":"2024-04-19T02:20:33.175290+0000","last_clean":"2024-04-19T02:20:33.175290+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:33.175290+0000","last_undegraded":"2024-04-19T02:20:33.175290+0000","last_fullsized":"2024-04-19T02:20:33.175290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179850+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:33.179850+0000","last_peered":"2024-04-19T02:20:33.179850+0000","last_clean":"2024-04-19T02:20:33.179850+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:33.179850+0000","last_undegraded":"2024-04-19T02:20:33.179850+0000","last_fullsized":"2024-04-19T02:20:33.179850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179851+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:33.179851+0000","last_peered":"2024-04-19T02:20:33.179851+0000","last_clean":"2024-04-19T02:20:33.179851+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:33.179851+0000","last_undegraded":"2024-04-19T02:20:33.179851+0000","last_fullsized":"2024-04-19T02:20:33.179851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":839,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.178347+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:34.178347+0000","last_peered":"2024-04-19T02:20:34.178347+0000","last_clean":"2024-04-19T02:20:34.178347+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:34.178347+0000","last_undegraded":"2024-04-19T02:20:34.178347+0000","last_fullsized":"2024-04-19T02:20:34.178347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":567,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178836+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:33.178836+0000","last_peered":"2024-04-19T02:20:33.178836+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:33.178836+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179280+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:33.179280+0000","last_peered":"2024-04-19T02:20:33.179280+0000","last_clean":"2024-04-19T02:20:33.179280+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:33.179280+0000","last_undegraded":"2024-04-19T02:20:33.179280+0000","last_fullsized":"2024-04-19T02:20:33.179280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":268,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:34.231378+0000","last_change":"2024-04-19T02:20:34.231378+0000","last_active":"2024-04-19T02:20:34.231378+0000","last_peered":"2024-04-19T02:20:34.231378+0000","last_clean":"2024-04-19T02:17:07.001902+0000","last_became_active":"2024-04-19T02:20:31.670290+0000","last_became_peered":"2024-04-19T02:20:31.670290+0000","last_unstale":"2024-04-19T02:20:34.231378+0000","last_undegraded":"2024-04-19T02:20:34.231378+0000","last_fullsized":"2024-04-19T02:20:31.530008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:38.658447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":521,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180077+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:33.180077+0000","last_peered":"2024-04-19T02:20:33.180077+0000","last_clean":"2024-04-19T02:20:33.180077+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:33.180077+0000","last_undegraded":"2024-04-19T02:20:33.180077+0000","last_fullsized":"2024-04-19T02:20:33.180077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176796+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:33.176796+0000","last_peered":"2024-04-19T02:20:33.176796+0000","last_clean":"2024-04-19T02:20:33.176796+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:33.176796+0000","last_undegraded":"2024-04-19T02:20:33.176796+0000","last_fullsized":"2024-04-19T02:20:33.176796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.186887+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:34.186887+0000","last_peered":"2024-04-19T02:20:34.186887+0000","last_clean":"2024-04-19T02:20:34.186887+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:34.186887+0000","last_undegraded":"2024-04-19T02:20:34.186887+0000","last_fullsized":"2024-04-19T02:20:34.186887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":433,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175598+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:33.175598+0000","last_peered":"2024-04-19T02:20:33.175598+0000","last_clean":"2024-04-19T02:20:33.175598+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:33.175598+0000","last_undegraded":"2024-04-19T02:20:33.175598+0000","last_fullsized":"2024-04-19T02:20:33.175598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179484+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:33.179484+0000","last_peered":"2024-04-19T02:20:33.179484+0000","last_clean":"2024-04-19T02:20:33.179484+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:33.179484+0000","last_undegraded":"2024-04-19T02:20:33.179484+0000","last_fullsized":"2024-04-19T02:20:33.179484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178714+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:33.178714+0000","last_peered":"2024-04-19T02:20:33.178714+0000","last_clean":"2024-04-19T02:20:33.178714+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:33.178714+0000","last_undegraded":"2024-04-19T02:20:33.178714+0000","last_fullsized":"2024-04-19T02:20:33.178714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":535,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.180187+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:34.180187+0000","last_peered":"2024-04-19T02:20:34.180187+0000","last_clean":"2024-04-19T02:20:34.180187+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:34.180187+0000","last_undegraded":"2024-04-19T02:20:34.180187+0000","last_fullsized":"2024-04-19T02:20:34.180187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":532,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.180380+0000","last_change":"2024-04-19T02:20:34.181337+0000","last_active":"2024-04-19T02:20:34.180380+0000","last_peered":"2024-04-19T02:20:33.228520+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:20:31.664433+0000","last_became_peered":"2024-04-19T02:20:31.664433+0000","last_unstale":"2024-04-19T02:20:34.180380+0000","last_undegraded":"2024-04-19T02:20:34.180380+0000","last_fullsized":"2024-04-19T02:20:34.180380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:36.450902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177218+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:33.177218+0000","last_peered":"2024-04-19T02:20:33.177218+0000","last_clean":"2024-04-19T02:20:33.177218+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:33.177218+0000","last_undegraded":"2024-04-19T02:20:33.177218+0000","last_fullsized":"2024-04-19T02:20:33.177218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":491,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.179334+0000","last_change":"2024-04-19T02:20:31.666219+0000","last_active":"2024-04-19T02:20:34.179334+0000","last_peered":"2024-04-19T02:20:34.179334+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:20:31.663303+0000","last_became_peered":"2024-04-19T02:20:31.663303+0000","last_unstale":"2024-04-19T02:20:34.179334+0000","last_undegraded":"2024-04-19T02:20:31.509883+0000","last_fullsized":"2024-04-19T02:20:31.499264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:54.685515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.181085+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:34.181085+0000","last_peered":"2024-04-19T02:20:34.181085+0000","last_clean":"2024-04-19T02:20:34.181085+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:34.181085+0000","last_undegraded":"2024-04-19T02:20:34.181085+0000","last_fullsized":"2024-04-19T02:20:34.181085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.181089+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:33.181089+0000","last_peered":"2024-04-19T02:20:33.181089+0000","last_clean":"2024-04-19T02:20:33.181089+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:33.181089+0000","last_undegraded":"2024-04-19T02:20:33.181089+0000","last_fullsized":"2024-04-19T02:20:33.181089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":576,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.178664+0000","last_change":"2024-04-19T02:20:31.663405+0000","last_active":"2024-04-19T02:20:34.178664+0000","last_peered":"2024-04-19T02:20:34.178664+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:20:31.659420+0000","last_became_peered":"2024-04-19T02:20:31.659420+0000","last_unstale":"2024-04-19T02:20:34.178664+0000","last_undegraded":"2024-04-19T02:20:31.528128+0000","last_fullsized":"2024-04-19T02:20:31.503952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176467+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:33.176467+0000","last_peered":"2024-04-19T02:20:33.176467+0000","last_clean":"2024-04-19T02:20:33.176467+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:33.176467+0000","last_undegraded":"2024-04-19T02:20:33.176467+0000","last_fullsized":"2024-04-19T02:20:33.176467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178731+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:33.178731+0000","last_peered":"2024-04-19T02:20:33.178731+0000","last_clean":"2024-04-19T02:20:33.178731+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:33.178731+0000","last_undegraded":"2024-04-19T02:20:33.178731+0000","last_fullsized":"2024-04-19T02:20:33.178731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178367+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:33.178367+0000","last_peered":"2024-04-19T02:20:33.178367+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:33.178367+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":169,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178486+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:33.178486+0000","last_peered":"2024-04-19T02:20:33.178486+0000","last_clean":"2024-04-19T02:20:33.178486+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:33.178486+0000","last_undegraded":"2024-04-19T02:20:33.178486+0000","last_fullsized":"2024-04-19T02:20:33.178486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.181600+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:33.181600+0000","last_peered":"2024-04-19T02:20:33.181600+0000","last_clean":"2024-04-19T02:20:33.181600+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:33.181600+0000","last_undegraded":"2024-04-19T02:20:33.181600+0000","last_fullsized":"2024-04-19T02:20:33.181600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":543,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.173682+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:33.173682+0000","last_peered":"2024-04-19T02:20:33.173682+0000","last_clean":"2024-04-19T02:20:33.173682+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:33.173682+0000","last_undegraded":"2024-04-19T02:20:33.173682+0000","last_fullsized":"2024-04-19T02:20:33.173682+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":500,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177217+0000","last_change":"2024-04-19T02:20:31.663417+0000","last_active":"2024-04-19T02:20:33.177217+0000","last_peered":"2024-04-19T02:20:33.177217+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.659358+0000","last_became_peered":"2024-04-19T02:20:31.659358+0000","last_unstale":"2024-04-19T02:20:33.177217+0000","last_undegraded":"2024-04-19T02:20:31.524667+0000","last_fullsized":"2024-04-19T02:20:31.500013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:52.738849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":548,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.184833+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:33.184833+0000","last_peered":"2024-04-19T02:20:33.184833+0000","last_clean":"2024-04-19T02:20:33.184833+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:33.184833+0000","last_undegraded":"2024-04-19T02:20:33.184833+0000","last_fullsized":"2024-04-19T02:20:33.184833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":520,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.173929+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:33.173929+0000","last_peered":"2024-04-19T02:20:33.173929+0000","last_clean":"2024-04-19T02:20:33.173929+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:33.173929+0000","last_undegraded":"2024-04-19T02:20:33.173929+0000","last_fullsized":"2024-04-19T02:20:33.173929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":181,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180900+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:33.180900+0000","last_peered":"2024-04-19T02:20:33.180900+0000","last_clean":"2024-04-19T02:20:33.180900+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:33.180900+0000","last_undegraded":"2024-04-19T02:20:33.180900+0000","last_fullsized":"2024-04-19T02:20:33.180900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":403,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.182792+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:33.182792+0000","last_peered":"2024-04-19T02:20:33.182792+0000","last_clean":"2024-04-19T02:20:33.182792+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:33.182792+0000","last_undegraded":"2024-04-19T02:20:33.182792+0000","last_fullsized":"2024-04-19T02:20:33.182792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":578,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175458+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:33.175458+0000","last_peered":"2024-04-19T02:20:33.175458+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:33.175458+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176212+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:33.176212+0000","last_peered":"2024-04-19T02:20:33.176212+0000","last_clean":"2024-04-19T02:20:33.176212+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:33.176212+0000","last_undegraded":"2024-04-19T02:20:33.176212+0000","last_fullsized":"2024-04-19T02:20:33.176212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":594,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.174690+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:33.174690+0000","last_peered":"2024-04-19T02:20:33.174690+0000","last_clean":"2024-04-19T02:20:33.174690+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:33.174690+0000","last_undegraded":"2024-04-19T02:20:33.174690+0000","last_fullsized":"2024-04-19T02:20:33.174690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":550,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.180399+0000","last_change":"2024-04-19T02:20:31.661716+0000","last_active":"2024-04-19T02:20:34.180399+0000","last_peered":"2024-04-19T02:20:34.180399+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:20:31.657888+0000","last_became_peered":"2024-04-19T02:20:31.657888+0000","last_unstale":"2024-04-19T02:20:34.180399+0000","last_undegraded":"2024-04-19T02:20:31.528667+0000","last_fullsized":"2024-04-19T02:20:31.510002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:00.802247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":162,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":648,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175299+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:33.175299+0000","last_peered":"2024-04-19T02:20:33.175299+0000","last_clean":"2024-04-19T02:20:33.175299+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:33.175299+0000","last_undegraded":"2024-04-19T02:20:33.175299+0000","last_fullsized":"2024-04-19T02:20:33.175299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176778+0000","last_change":"2024-04-19T02:20:31.663278+0000","last_active":"2024-04-19T02:20:33.176778+0000","last_peered":"2024-04-19T02:20:33.176778+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:20:31.657854+0000","last_became_peered":"2024-04-19T02:20:31.657854+0000","last_unstale":"2024-04-19T02:20:33.176778+0000","last_undegraded":"2024-04-19T02:20:31.511694+0000","last_fullsized":"2024-04-19T02:20:31.499301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:06.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":418,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:34.181030+0000","last_change":"2024-04-19T02:20:34.181547+0000","last_active":"2024-04-19T02:20:34.181030+0000","last_peered":"2024-04-19T02:20:34.181030+0000","last_clean":"2024-04-19T02:17:07.001688+0000","last_became_active":"2024-04-19T02:20:31.668954+0000","last_became_peered":"2024-04-19T02:20:31.668954+0000","last_unstale":"2024-04-19T02:20:34.181030+0000","last_undegraded":"2024-04-19T02:20:31.529544+0000","last_fullsized":"2024-04-19T02:20:31.517909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:00.949255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":496,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177946+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:33.177946+0000","last_peered":"2024-04-19T02:20:33.177946+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:33.177946+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":573,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180649+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:33.180649+0000","last_peered":"2024-04-19T02:20:33.180649+0000","last_clean":"2024-04-19T02:20:33.180649+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:33.180649+0000","last_undegraded":"2024-04-19T02:20:33.180649+0000","last_fullsized":"2024-04-19T02:20:33.180649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":515,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179879+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:33.179879+0000","last_peered":"2024-04-19T02:20:33.179879+0000","last_clean":"2024-04-19T02:20:33.179879+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:33.179879+0000","last_undegraded":"2024-04-19T02:20:33.179879+0000","last_fullsized":"2024-04-19T02:20:33.179879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178692+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:33.178692+0000","last_peered":"2024-04-19T02:20:33.178692+0000","last_clean":"2024-04-19T02:20:33.178692+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:33.178692+0000","last_undegraded":"2024-04-19T02:20:33.178692+0000","last_fullsized":"2024-04-19T02:20:33.178692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":465,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175527+0000","last_change":"2024-04-19T02:20:31.665847+0000","last_active":"2024-04-19T02:20:33.175527+0000","last_peered":"2024-04-19T02:20:33.175527+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:33.175527+0000","last_undegraded":"2024-04-19T02:20:31.510138+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":406,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.182107+0000","last_change":"2024-04-19T02:20:34.182360+0000","last_active":"2024-04-19T02:20:34.182107+0000","last_peered":"2024-04-19T02:20:33.576289+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:20:31.669330+0000","last_became_peered":"2024-04-19T02:20:31.669330+0000","last_unstale":"2024-04-19T02:20:34.182107+0000","last_undegraded":"2024-04-19T02:20:34.182107+0000","last_fullsized":"2024-04-19T02:20:34.182107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:38.881973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":494,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174974+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:33.174974+0000","last_peered":"2024-04-19T02:20:33.174974+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:33.174974+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":466,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.181971+0000","last_change":"2024-04-19T02:20:34.182211+0000","last_active":"2024-04-19T02:20:34.181971+0000","last_peered":"2024-04-19T02:20:34.020377+0000","last_clean":"2024-04-19T02:17:09.446016+0000","last_became_active":"2024-04-19T02:20:31.665063+0000","last_became_peered":"2024-04-19T02:20:31.665063+0000","last_unstale":"2024-04-19T02:20:34.181971+0000","last_undegraded":"2024-04-19T02:20:34.181971+0000","last_fullsized":"2024-04-19T02:20:34.181971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:33.904940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":598,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177633+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:33.177633+0000","last_peered":"2024-04-19T02:20:33.177633+0000","last_clean":"2024-04-19T02:20:33.177633+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:33.177633+0000","last_undegraded":"2024-04-19T02:20:33.177633+0000","last_fullsized":"2024-04-19T02:20:33.177633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177368+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:33.177368+0000","last_peered":"2024-04-19T02:20:33.177368+0000","last_clean":"2024-04-19T02:20:33.177368+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:33.177368+0000","last_undegraded":"2024-04-19T02:20:33.177368+0000","last_fullsized":"2024-04-19T02:20:33.177368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":557,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174157+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:33.174157+0000","last_peered":"2024-04-19T02:20:33.174157+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:33.174157+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179083+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:34.179083+0000","last_peered":"2024-04-19T02:20:34.179083+0000","last_clean":"2024-04-19T02:20:34.179083+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:34.179083+0000","last_undegraded":"2024-04-19T02:20:34.179083+0000","last_fullsized":"2024-04-19T02:20:34.179083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":88,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62783488,"data_stored":229521765,"data_compressed":19386051,"data_compressed_allocated":30105600,"data_compressed_original":196911104,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":61,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124620,"kb_used_data":27128,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247220,"statfs":{"total":96636764160,"available":96509153280,"internally_reserved":0,"allocated":27779072,"data_stored":81498533,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":78,"seq":335007449090,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":5260,"kb_used_omap":7,"kb_used_meta":27512,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":5386240,"data_stored":37881567,"data_compressed":3459370,"data_compressed_allocated":4624384,"data_compressed_original":37507072,"omap_allocated":7169,"internal_metadata":28173311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139240,"kb_used_data":27796,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232600,"statfs":{"total":96636764160,"available":96494182400,"internally_reserved":0,"allocated":28463104,"data_stored":86121004,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7991296,"data_stored":63171636,"data_compressed":6098522,"data_compressed_allocated":7933952,"data_compressed_original":63148032,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:36.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:20:37.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:37.280 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 7164/110 objects degraded (6512.727%), 41 pgs degraded","count":41},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":273,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":86,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":36},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":58},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":40},{"state_name":"peering","count":4},{"state_name":"active+undersized+remapped","count":2},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":303779840,"bytes_avail":289606512640,"bytes_total":289910292480,"inactive_pgs_ratio":0.038095239549875259,"degraded_objects":7164,"degraded_total":110,"degraded_ratio":65.127272727272725,"recovering_objects_per_sec":6,"recovering_bytes_per_sec":24016464,"recovering_keys_per_sec":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:20:37.297 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:20:37.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:37.591 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:37.592 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:37.609 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-04-19T02:20:37.191367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":167,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":296660,"kb_used_data":60184,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282818860,"statfs":{"total":289910292480,"available":289606512640,"internally_reserved":0,"allocated":61628416,"data_stored":205501104,"data_compressed":16754932,"data_compressed_allocated":26832896,"data_compressed_original":171843584,"omap_allocated":10357,"internal_metadata":242079627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7137,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.020011"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179986+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:34.179986+0000","last_peered":"2024-04-19T02:20:34.179986+0000","last_clean":"2024-04-19T02:20:34.179986+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:34.179986+0000","last_undegraded":"2024-04-19T02:20:34.179986+0000","last_fullsized":"2024-04-19T02:20:34.179986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":559,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179348+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:34.179348+0000","last_peered":"2024-04-19T02:20:34.179348+0000","last_clean":"2024-04-19T02:20:34.179348+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:34.179348+0000","last_undegraded":"2024-04-19T02:20:34.179348+0000","last_fullsized":"2024-04-19T02:20:34.179348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":482,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.179596+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:33.179596+0000","last_peered":"2024-04-19T02:20:33.179596+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:33.179596+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":464,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175052+0000","last_change":"2024-04-19T02:20:31.651928+0000","last_active":"2024-04-19T02:20:33.175052+0000","last_peered":"2024-04-19T02:20:33.175052+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.649181+0000","last_became_peered":"2024-04-19T02:20:31.649181+0000","last_unstale":"2024-04-19T02:20:33.175052+0000","last_undegraded":"2024-04-19T02:20:31.509915+0000","last_fullsized":"2024-04-19T02:20:31.496882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:43.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":507,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178379+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:33.178379+0000","last_peered":"2024-04-19T02:20:33.178379+0000","last_clean":"2024-04-19T02:20:33.178379+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:33.178379+0000","last_undegraded":"2024-04-19T02:20:33.178379+0000","last_fullsized":"2024-04-19T02:20:33.178379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":534,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176018+0000","last_change":"2024-04-19T02:20:31.666551+0000","last_active":"2024-04-19T02:20:33.176018+0000","last_peered":"2024-04-19T02:20:33.176018+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:33.176018+0000","last_undegraded":"2024-04-19T02:20:31.515010+0000","last_fullsized":"2024-04-19T02:20:31.499321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.214784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":517,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173778+0000","last_change":"2024-04-19T02:20:31.645598+0000","last_active":"2024-04-19T02:20:33.173778+0000","last_peered":"2024-04-19T02:20:33.173778+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.642919+0000","last_became_peered":"2024-04-19T02:20:31.642919+0000","last_unstale":"2024-04-19T02:20:33.173778+0000","last_undegraded":"2024-04-19T02:20:31.514540+0000","last_fullsized":"2024-04-19T02:20:31.495453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:26.195278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":581,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173804+0000","last_change":"2024-04-19T02:20:31.662166+0000","last_active":"2024-04-19T02:20:33.173804+0000","last_peered":"2024-04-19T02:20:33.173804+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657980+0000","last_became_peered":"2024-04-19T02:20:31.657980+0000","last_unstale":"2024-04-19T02:20:33.173804+0000","last_undegraded":"2024-04-19T02:20:31.505252+0000","last_fullsized":"2024-04-19T02:20:31.495352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:37.286269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":528,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.174771+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:33.174771+0000","last_peered":"2024-04-19T02:20:33.174771+0000","last_clean":"2024-04-19T02:20:33.174771+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:33.174771+0000","last_undegraded":"2024-04-19T02:20:33.174771+0000","last_fullsized":"2024-04-19T02:20:33.174771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":519,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179400+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:33.179400+0000","last_peered":"2024-04-19T02:20:33.179400+0000","last_clean":"2024-04-19T02:20:33.179400+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:33.179400+0000","last_undegraded":"2024-04-19T02:20:33.179400+0000","last_fullsized":"2024-04-19T02:20:33.179400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":456,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175328+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:33.175328+0000","last_peered":"2024-04-19T02:20:33.175328+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:33.175328+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":552,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180212+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:33.180212+0000","last_peered":"2024-04-19T02:20:33.180212+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:33.180212+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":503,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178058+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:33.178058+0000","last_peered":"2024-04-19T02:20:33.178058+0000","last_clean":"2024-04-19T02:20:33.178058+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:33.178058+0000","last_undegraded":"2024-04-19T02:20:33.178058+0000","last_fullsized":"2024-04-19T02:20:33.178058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":506,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176903+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:33.176903+0000","last_peered":"2024-04-19T02:20:33.176903+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:33.176903+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":528,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176487+0000","last_change":"2024-04-19T02:20:31.645793+0000","last_active":"2024-04-19T02:20:33.176487+0000","last_peered":"2024-04-19T02:20:33.176487+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.642921+0000","last_became_peered":"2024-04-19T02:20:31.642921+0000","last_unstale":"2024-04-19T02:20:33.176487+0000","last_undegraded":"2024-04-19T02:20:31.516270+0000","last_fullsized":"2024-04-19T02:20:31.499244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:22.064964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":575,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.173589+0000","last_change":"2024-04-19T02:20:31.664110+0000","last_active":"2024-04-19T02:20:33.173589+0000","last_peered":"2024-04-19T02:20:33.173589+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658002+0000","last_became_peered":"2024-04-19T02:20:31.658002+0000","last_unstale":"2024-04-19T02:20:33.173589+0000","last_undegraded":"2024-04-19T02:20:31.509127+0000","last_fullsized":"2024-04-19T02:20:31.495181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176278+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:33.176278+0000","last_peered":"2024-04-19T02:20:33.176278+0000","last_clean":"2024-04-19T02:20:33.176278+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:33.176278+0000","last_undegraded":"2024-04-19T02:20:33.176278+0000","last_fullsized":"2024-04-19T02:20:33.176278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":503,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179821+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:33.179821+0000","last_peered":"2024-04-19T02:20:33.179821+0000","last_clean":"2024-04-19T02:20:33.179821+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:33.179821+0000","last_undegraded":"2024-04-19T02:20:33.179821+0000","last_fullsized":"2024-04-19T02:20:33.179821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":614,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175541+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:33.175541+0000","last_peered":"2024-04-19T02:20:33.175541+0000","last_clean":"2024-04-19T02:20:33.175541+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:33.175541+0000","last_undegraded":"2024-04-19T02:20:33.175541+0000","last_fullsized":"2024-04-19T02:20:33.175541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":510,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175725+0000","last_change":"2024-04-19T02:20:31.664482+0000","last_active":"2024-04-19T02:20:33.175725+0000","last_peered":"2024-04-19T02:20:33.175725+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658147+0000","last_became_peered":"2024-04-19T02:20:31.658147+0000","last_unstale":"2024-04-19T02:20:33.175725+0000","last_undegraded":"2024-04-19T02:20:31.527172+0000","last_fullsized":"2024-04-19T02:20:31.514881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.179528+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:33.179528+0000","last_peered":"2024-04-19T02:20:33.179528+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:33.179528+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":683,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178418+0000","last_change":"2024-04-19T02:20:31.672278+0000","last_active":"2024-04-19T02:20:33.178418+0000","last_peered":"2024-04-19T02:20:33.178418+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:33.178418+0000","last_undegraded":"2024-04-19T02:20:31.524382+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":509,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174061+0000","last_change":"2024-04-19T02:20:31.648151+0000","last_active":"2024-04-19T02:20:33.174061+0000","last_peered":"2024-04-19T02:20:33.174061+0000","last_clean":"2024-04-19T02:17:07.001190+0000","last_became_active":"2024-04-19T02:20:31.643057+0000","last_became_peered":"2024-04-19T02:20:31.643057+0000","last_unstale":"2024-04-19T02:20:33.174061+0000","last_undegraded":"2024-04-19T02:20:31.508039+0000","last_fullsized":"2024-04-19T02:20:31.495604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:01.698284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":534,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176212+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:33.176212+0000","last_peered":"2024-04-19T02:20:33.176212+0000","last_clean":"2024-04-19T02:20:33.176212+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:33.176212+0000","last_undegraded":"2024-04-19T02:20:33.176212+0000","last_fullsized":"2024-04-19T02:20:33.176212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":521,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.232504+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:34.232504+0000","last_peered":"2024-04-19T02:20:34.232504+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:34.232504+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":701,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176023+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:33.176023+0000","last_peered":"2024-04-19T02:20:33.176023+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:33.176023+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":554,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180813+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:33.180813+0000","last_peered":"2024-04-19T02:20:33.180813+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:33.180813+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":455,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180872+0000","last_change":"2024-04-19T02:20:31.656392+0000","last_active":"2024-04-19T02:20:33.180872+0000","last_peered":"2024-04-19T02:20:33.180872+0000","last_clean":"2024-04-19T02:17:09.445020+0000","last_became_active":"2024-04-19T02:20:31.653744+0000","last_became_peered":"2024-04-19T02:20:31.653744+0000","last_unstale":"2024-04-19T02:20:33.180872+0000","last_undegraded":"2024-04-19T02:20:31.524100+0000","last_fullsized":"2024-04-19T02:20:31.504419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:54.935253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":158,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":505,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.178474+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:34.178474+0000","last_peered":"2024-04-19T02:20:34.178474+0000","last_clean":"2024-04-19T02:20:34.178474+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:34.178474+0000","last_undegraded":"2024-04-19T02:20:34.178474+0000","last_fullsized":"2024-04-19T02:20:34.178474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":619,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.179865+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:34.179865+0000","last_peered":"2024-04-19T02:20:34.179865+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:34.179865+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":582,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.176337+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:34.176337+0000","last_peered":"2024-04-19T02:20:34.176337+0000","last_clean":"2024-04-19T02:20:34.176337+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:34.176337+0000","last_undegraded":"2024-04-19T02:20:34.176337+0000","last_fullsized":"2024-04-19T02:20:34.176337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":523,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174290+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:33.174290+0000","last_peered":"2024-04-19T02:20:33.174290+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:33.174290+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":463,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180918+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:33.180918+0000","last_peered":"2024-04-19T02:20:33.180918+0000","last_clean":"2024-04-19T02:20:33.180918+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:33.180918+0000","last_undegraded":"2024-04-19T02:20:33.180918+0000","last_fullsized":"2024-04-19T02:20:33.180918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":470,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.187866+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:34.187866+0000","last_peered":"2024-04-19T02:20:34.187866+0000","last_clean":"2024-04-19T02:20:34.187866+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:34.187866+0000","last_undegraded":"2024-04-19T02:20:34.187866+0000","last_fullsized":"2024-04-19T02:20:34.187866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":512,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180001+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:33.180001+0000","last_peered":"2024-04-19T02:20:33.180001+0000","last_clean":"2024-04-19T02:20:33.180001+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:33.180001+0000","last_undegraded":"2024-04-19T02:20:33.180001+0000","last_fullsized":"2024-04-19T02:20:33.180001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175440+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:33.175440+0000","last_peered":"2024-04-19T02:20:33.175440+0000","last_clean":"2024-04-19T02:20:33.175440+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:33.175440+0000","last_undegraded":"2024-04-19T02:20:33.175440+0000","last_fullsized":"2024-04-19T02:20:33.175440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":596,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178988+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:33.178988+0000","last_peered":"2024-04-19T02:20:33.178988+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:33.178988+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":159,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177114+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:33.177114+0000","last_peered":"2024-04-19T02:20:33.177114+0000","last_clean":"2024-04-19T02:20:33.177114+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:33.177114+0000","last_undegraded":"2024-04-19T02:20:33.177114+0000","last_fullsized":"2024-04-19T02:20:33.177114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":531,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.184998+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:34.184998+0000","last_peered":"2024-04-19T02:20:34.184998+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:34.184998+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176497+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:33.176497+0000","last_peered":"2024-04-19T02:20:33.176497+0000","last_clean":"2024-04-19T02:20:33.176497+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:33.176497+0000","last_undegraded":"2024-04-19T02:20:33.176497+0000","last_fullsized":"2024-04-19T02:20:33.176497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":256,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.185519+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:33.185519+0000","last_peered":"2024-04-19T02:20:33.185519+0000","last_clean":"2024-04-19T02:20:33.185519+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:33.185519+0000","last_undegraded":"2024-04-19T02:20:33.185519+0000","last_fullsized":"2024-04-19T02:20:33.185519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":502,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176561+0000","last_change":"2024-04-19T02:20:31.662057+0000","last_active":"2024-04-19T02:20:33.176561+0000","last_peered":"2024-04-19T02:20:33.176561+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:20:31.657714+0000","last_became_peered":"2024-04-19T02:20:31.657714+0000","last_unstale":"2024-04-19T02:20:33.176561+0000","last_undegraded":"2024-04-19T02:20:31.509606+0000","last_fullsized":"2024-04-19T02:20:31.499247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:39.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.187216+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:34.187216+0000","last_peered":"2024-04-19T02:20:34.187216+0000","last_clean":"2024-04-19T02:20:34.187216+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:34.187216+0000","last_undegraded":"2024-04-19T02:20:34.187216+0000","last_fullsized":"2024-04-19T02:20:34.187216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":532,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178614+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:33.178614+0000","last_peered":"2024-04-19T02:20:33.178614+0000","last_clean":"2024-04-19T02:20:33.178614+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:33.178614+0000","last_undegraded":"2024-04-19T02:20:33.178614+0000","last_fullsized":"2024-04-19T02:20:33.178614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":678,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.182133+0000","last_change":"2024-04-19T02:20:34.182555+0000","last_active":"2024-04-19T02:20:34.182133+0000","last_peered":"2024-04-19T02:20:33.409500+0000","last_clean":"2024-04-19T02:16:24.498760+0000","last_became_active":"2024-04-19T02:20:31.664145+0000","last_became_peered":"2024-04-19T02:20:31.664145+0000","last_unstale":"2024-04-19T02:20:34.182133+0000","last_undegraded":"2024-04-19T02:20:34.182133+0000","last_fullsized":"2024-04-19T02:20:34.182133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:19.433305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":490,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177517+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:33.177517+0000","last_peered":"2024-04-19T02:20:33.177517+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:33.177517+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176367+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:33.176367+0000","last_peered":"2024-04-19T02:20:33.176367+0000","last_clean":"2024-04-19T02:20:33.176367+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:33.176367+0000","last_undegraded":"2024-04-19T02:20:33.176367+0000","last_fullsized":"2024-04-19T02:20:33.176367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":647,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177228+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:33.177228+0000","last_peered":"2024-04-19T02:20:33.177228+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:33.177228+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":226,"reported_epoch":83,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.512221+0000","last_change":"2024-04-19T02:20:34.232333+0000","last_active":"2024-04-19T02:20:34.512221+0000","last_peered":"2024-04-19T02:20:34.512221+0000","last_clean":"2024-04-19T02:17:07.002985+0000","last_became_active":"2024-04-19T02:20:31.675121+0000","last_became_peered":"2024-04-19T02:20:31.675121+0000","last_unstale":"2024-04-19T02:20:34.512221+0000","last_undegraded":"2024-04-19T02:20:31.539277+0000","last_fullsized":"2024-04-19T02:20:31.536894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:44.980081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":3}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":530,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176825+0000","last_change":"2024-04-19T02:20:31.664858+0000","last_active":"2024-04-19T02:20:33.176825+0000","last_peered":"2024-04-19T02:20:33.176825+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658577+0000","last_became_peered":"2024-04-19T02:20:31.658577+0000","last_unstale":"2024-04-19T02:20:33.176825+0000","last_undegraded":"2024-04-19T02:20:31.520194+0000","last_fullsized":"2024-04-19T02:20:31.497338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:24.362286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":286,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.186437+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:34.186437+0000","last_peered":"2024-04-19T02:20:34.186437+0000","last_clean":"2024-04-19T02:20:34.186437+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:34.186437+0000","last_undegraded":"2024-04-19T02:20:34.186437+0000","last_fullsized":"2024-04-19T02:20:34.186437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":582,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.180311+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:33.180311+0000","last_peered":"2024-04-19T02:20:33.180311+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:33.180311+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177346+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:33.177346+0000","last_peered":"2024-04-19T02:20:33.177346+0000","last_clean":"2024-04-19T02:20:33.177346+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:33.177346+0000","last_undegraded":"2024-04-19T02:20:33.177346+0000","last_fullsized":"2024-04-19T02:20:33.177346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":449,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178715+0000","last_change":"2024-04-19T02:20:31.660785+0000","last_active":"2024-04-19T02:20:33.178715+0000","last_peered":"2024-04-19T02:20:33.178715+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657307+0000","last_became_peered":"2024-04-19T02:20:31.657307+0000","last_unstale":"2024-04-19T02:20:33.178715+0000","last_undegraded":"2024-04-19T02:20:31.516112+0000","last_fullsized":"2024-04-19T02:20:31.501819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:42.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":467,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176771+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:33.176771+0000","last_peered":"2024-04-19T02:20:33.176771+0000","last_clean":"2024-04-19T02:20:33.176771+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:33.176771+0000","last_undegraded":"2024-04-19T02:20:33.176771+0000","last_fullsized":"2024-04-19T02:20:33.176771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175290+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:33.175290+0000","last_peered":"2024-04-19T02:20:33.175290+0000","last_clean":"2024-04-19T02:20:33.175290+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:33.175290+0000","last_undegraded":"2024-04-19T02:20:33.175290+0000","last_fullsized":"2024-04-19T02:20:33.175290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179850+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:33.179850+0000","last_peered":"2024-04-19T02:20:33.179850+0000","last_clean":"2024-04-19T02:20:33.179850+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:33.179850+0000","last_undegraded":"2024-04-19T02:20:33.179850+0000","last_fullsized":"2024-04-19T02:20:33.179850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179851+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:33.179851+0000","last_peered":"2024-04-19T02:20:33.179851+0000","last_clean":"2024-04-19T02:20:33.179851+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:33.179851+0000","last_undegraded":"2024-04-19T02:20:33.179851+0000","last_fullsized":"2024-04-19T02:20:33.179851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":839,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.178347+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:34.178347+0000","last_peered":"2024-04-19T02:20:34.178347+0000","last_clean":"2024-04-19T02:20:34.178347+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:34.178347+0000","last_undegraded":"2024-04-19T02:20:34.178347+0000","last_fullsized":"2024-04-19T02:20:34.178347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":567,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178836+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:33.178836+0000","last_peered":"2024-04-19T02:20:33.178836+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:33.178836+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179280+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:33.179280+0000","last_peered":"2024-04-19T02:20:33.179280+0000","last_clean":"2024-04-19T02:20:33.179280+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:33.179280+0000","last_undegraded":"2024-04-19T02:20:33.179280+0000","last_fullsized":"2024-04-19T02:20:33.179280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":268,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:34.231378+0000","last_change":"2024-04-19T02:20:34.231378+0000","last_active":"2024-04-19T02:20:34.231378+0000","last_peered":"2024-04-19T02:20:34.231378+0000","last_clean":"2024-04-19T02:17:07.001902+0000","last_became_active":"2024-04-19T02:20:31.670290+0000","last_became_peered":"2024-04-19T02:20:31.670290+0000","last_unstale":"2024-04-19T02:20:34.231378+0000","last_undegraded":"2024-04-19T02:20:34.231378+0000","last_fullsized":"2024-04-19T02:20:31.530008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:38.658447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":521,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180077+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:33.180077+0000","last_peered":"2024-04-19T02:20:33.180077+0000","last_clean":"2024-04-19T02:20:33.180077+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:33.180077+0000","last_undegraded":"2024-04-19T02:20:33.180077+0000","last_fullsized":"2024-04-19T02:20:33.180077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176796+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:33.176796+0000","last_peered":"2024-04-19T02:20:33.176796+0000","last_clean":"2024-04-19T02:20:33.176796+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:33.176796+0000","last_undegraded":"2024-04-19T02:20:33.176796+0000","last_fullsized":"2024-04-19T02:20:33.176796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":489,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.186887+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:34.186887+0000","last_peered":"2024-04-19T02:20:34.186887+0000","last_clean":"2024-04-19T02:20:34.186887+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:34.186887+0000","last_undegraded":"2024-04-19T02:20:34.186887+0000","last_fullsized":"2024-04-19T02:20:34.186887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":433,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175598+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:33.175598+0000","last_peered":"2024-04-19T02:20:33.175598+0000","last_clean":"2024-04-19T02:20:33.175598+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:33.175598+0000","last_undegraded":"2024-04-19T02:20:33.175598+0000","last_fullsized":"2024-04-19T02:20:33.175598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179484+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:33.179484+0000","last_peered":"2024-04-19T02:20:33.179484+0000","last_clean":"2024-04-19T02:20:33.179484+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:33.179484+0000","last_undegraded":"2024-04-19T02:20:33.179484+0000","last_fullsized":"2024-04-19T02:20:33.179484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178714+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:33.178714+0000","last_peered":"2024-04-19T02:20:33.178714+0000","last_clean":"2024-04-19T02:20:33.178714+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:33.178714+0000","last_undegraded":"2024-04-19T02:20:33.178714+0000","last_fullsized":"2024-04-19T02:20:33.178714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":535,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.180187+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:34.180187+0000","last_peered":"2024-04-19T02:20:34.180187+0000","last_clean":"2024-04-19T02:20:34.180187+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:34.180187+0000","last_undegraded":"2024-04-19T02:20:34.180187+0000","last_fullsized":"2024-04-19T02:20:34.180187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":532,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.180380+0000","last_change":"2024-04-19T02:20:34.181337+0000","last_active":"2024-04-19T02:20:34.180380+0000","last_peered":"2024-04-19T02:20:33.228520+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:20:31.664433+0000","last_became_peered":"2024-04-19T02:20:31.664433+0000","last_unstale":"2024-04-19T02:20:34.180380+0000","last_undegraded":"2024-04-19T02:20:34.180380+0000","last_fullsized":"2024-04-19T02:20:34.180380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:36.450902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177218+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:33.177218+0000","last_peered":"2024-04-19T02:20:33.177218+0000","last_clean":"2024-04-19T02:20:33.177218+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:33.177218+0000","last_undegraded":"2024-04-19T02:20:33.177218+0000","last_fullsized":"2024-04-19T02:20:33.177218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":491,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.179334+0000","last_change":"2024-04-19T02:20:31.666219+0000","last_active":"2024-04-19T02:20:34.179334+0000","last_peered":"2024-04-19T02:20:34.179334+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:20:31.663303+0000","last_became_peered":"2024-04-19T02:20:31.663303+0000","last_unstale":"2024-04-19T02:20:34.179334+0000","last_undegraded":"2024-04-19T02:20:31.509883+0000","last_fullsized":"2024-04-19T02:20:31.499264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:54.685515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.181085+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:34.181085+0000","last_peered":"2024-04-19T02:20:34.181085+0000","last_clean":"2024-04-19T02:20:34.181085+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:34.181085+0000","last_undegraded":"2024-04-19T02:20:34.181085+0000","last_fullsized":"2024-04-19T02:20:34.181085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.181089+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:33.181089+0000","last_peered":"2024-04-19T02:20:33.181089+0000","last_clean":"2024-04-19T02:20:33.181089+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:33.181089+0000","last_undegraded":"2024-04-19T02:20:33.181089+0000","last_fullsized":"2024-04-19T02:20:33.181089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":576,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.178664+0000","last_change":"2024-04-19T02:20:31.663405+0000","last_active":"2024-04-19T02:20:34.178664+0000","last_peered":"2024-04-19T02:20:34.178664+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:20:31.659420+0000","last_became_peered":"2024-04-19T02:20:31.659420+0000","last_unstale":"2024-04-19T02:20:34.178664+0000","last_undegraded":"2024-04-19T02:20:31.528128+0000","last_fullsized":"2024-04-19T02:20:31.503952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176467+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:33.176467+0000","last_peered":"2024-04-19T02:20:33.176467+0000","last_clean":"2024-04-19T02:20:33.176467+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:33.176467+0000","last_undegraded":"2024-04-19T02:20:33.176467+0000","last_fullsized":"2024-04-19T02:20:33.176467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178731+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:33.178731+0000","last_peered":"2024-04-19T02:20:33.178731+0000","last_clean":"2024-04-19T02:20:33.178731+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:33.178731+0000","last_undegraded":"2024-04-19T02:20:33.178731+0000","last_fullsized":"2024-04-19T02:20:33.178731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.178367+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:33.178367+0000","last_peered":"2024-04-19T02:20:33.178367+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:33.178367+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":169,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178486+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:33.178486+0000","last_peered":"2024-04-19T02:20:33.178486+0000","last_clean":"2024-04-19T02:20:33.178486+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:33.178486+0000","last_undegraded":"2024-04-19T02:20:33.178486+0000","last_fullsized":"2024-04-19T02:20:33.178486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.181600+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:33.181600+0000","last_peered":"2024-04-19T02:20:33.181600+0000","last_clean":"2024-04-19T02:20:33.181600+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:33.181600+0000","last_undegraded":"2024-04-19T02:20:33.181600+0000","last_fullsized":"2024-04-19T02:20:33.181600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":543,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.173682+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:33.173682+0000","last_peered":"2024-04-19T02:20:33.173682+0000","last_clean":"2024-04-19T02:20:33.173682+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:33.173682+0000","last_undegraded":"2024-04-19T02:20:33.173682+0000","last_fullsized":"2024-04-19T02:20:33.173682+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":500,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177217+0000","last_change":"2024-04-19T02:20:31.663417+0000","last_active":"2024-04-19T02:20:33.177217+0000","last_peered":"2024-04-19T02:20:33.177217+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.659358+0000","last_became_peered":"2024-04-19T02:20:31.659358+0000","last_unstale":"2024-04-19T02:20:33.177217+0000","last_undegraded":"2024-04-19T02:20:31.524667+0000","last_fullsized":"2024-04-19T02:20:31.500013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:52.738849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":548,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.184833+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:33.184833+0000","last_peered":"2024-04-19T02:20:33.184833+0000","last_clean":"2024-04-19T02:20:33.184833+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:33.184833+0000","last_undegraded":"2024-04-19T02:20:33.184833+0000","last_fullsized":"2024-04-19T02:20:33.184833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":520,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.173929+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:33.173929+0000","last_peered":"2024-04-19T02:20:33.173929+0000","last_clean":"2024-04-19T02:20:33.173929+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:33.173929+0000","last_undegraded":"2024-04-19T02:20:33.173929+0000","last_fullsized":"2024-04-19T02:20:33.173929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":181,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180900+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:33.180900+0000","last_peered":"2024-04-19T02:20:33.180900+0000","last_clean":"2024-04-19T02:20:33.180900+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:33.180900+0000","last_undegraded":"2024-04-19T02:20:33.180900+0000","last_fullsized":"2024-04-19T02:20:33.180900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":403,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.182792+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:33.182792+0000","last_peered":"2024-04-19T02:20:33.182792+0000","last_clean":"2024-04-19T02:20:33.182792+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:33.182792+0000","last_undegraded":"2024-04-19T02:20:33.182792+0000","last_fullsized":"2024-04-19T02:20:33.182792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":578,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175458+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:33.175458+0000","last_peered":"2024-04-19T02:20:33.175458+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:33.175458+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.176212+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:33.176212+0000","last_peered":"2024-04-19T02:20:33.176212+0000","last_clean":"2024-04-19T02:20:33.176212+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:33.176212+0000","last_undegraded":"2024-04-19T02:20:33.176212+0000","last_fullsized":"2024-04-19T02:20:33.176212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":594,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.174690+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:33.174690+0000","last_peered":"2024-04-19T02:20:33.174690+0000","last_clean":"2024-04-19T02:20:33.174690+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:33.174690+0000","last_undegraded":"2024-04-19T02:20:33.174690+0000","last_fullsized":"2024-04-19T02:20:33.174690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":550,"reported_epoch":83,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:34.180399+0000","last_change":"2024-04-19T02:20:31.661716+0000","last_active":"2024-04-19T02:20:34.180399+0000","last_peered":"2024-04-19T02:20:34.180399+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:20:31.657888+0000","last_became_peered":"2024-04-19T02:20:31.657888+0000","last_unstale":"2024-04-19T02:20:34.180399+0000","last_undegraded":"2024-04-19T02:20:31.528667+0000","last_fullsized":"2024-04-19T02:20:31.510002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:00.802247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":162,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":648,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.175299+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:33.175299+0000","last_peered":"2024-04-19T02:20:33.175299+0000","last_clean":"2024-04-19T02:20:33.175299+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:33.175299+0000","last_undegraded":"2024-04-19T02:20:33.175299+0000","last_fullsized":"2024-04-19T02:20:33.175299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":543,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.176778+0000","last_change":"2024-04-19T02:20:31.663278+0000","last_active":"2024-04-19T02:20:33.176778+0000","last_peered":"2024-04-19T02:20:33.176778+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:20:31.657854+0000","last_became_peered":"2024-04-19T02:20:31.657854+0000","last_unstale":"2024-04-19T02:20:33.176778+0000","last_undegraded":"2024-04-19T02:20:31.511694+0000","last_fullsized":"2024-04-19T02:20:31.499301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:06.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":418,"reported_epoch":83,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:34.181030+0000","last_change":"2024-04-19T02:20:34.181547+0000","last_active":"2024-04-19T02:20:34.181030+0000","last_peered":"2024-04-19T02:20:34.181030+0000","last_clean":"2024-04-19T02:17:07.001688+0000","last_became_active":"2024-04-19T02:20:31.668954+0000","last_became_peered":"2024-04-19T02:20:31.668954+0000","last_unstale":"2024-04-19T02:20:34.181030+0000","last_undegraded":"2024-04-19T02:20:31.529544+0000","last_fullsized":"2024-04-19T02:20:31.517909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:00.949255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":496,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.177946+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:33.177946+0000","last_peered":"2024-04-19T02:20:33.177946+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:33.177946+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":573,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.180649+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:33.180649+0000","last_peered":"2024-04-19T02:20:33.180649+0000","last_clean":"2024-04-19T02:20:33.180649+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:33.180649+0000","last_undegraded":"2024-04-19T02:20:33.180649+0000","last_fullsized":"2024-04-19T02:20:33.180649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":515,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.179879+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:33.179879+0000","last_peered":"2024-04-19T02:20:33.179879+0000","last_clean":"2024-04-19T02:20:33.179879+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:33.179879+0000","last_undegraded":"2024-04-19T02:20:33.179879+0000","last_fullsized":"2024-04-19T02:20:33.179879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.178692+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:33.178692+0000","last_peered":"2024-04-19T02:20:33.178692+0000","last_clean":"2024-04-19T02:20:33.178692+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:33.178692+0000","last_undegraded":"2024-04-19T02:20:33.178692+0000","last_fullsized":"2024-04-19T02:20:33.178692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":465,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.175527+0000","last_change":"2024-04-19T02:20:31.665847+0000","last_active":"2024-04-19T02:20:33.175527+0000","last_peered":"2024-04-19T02:20:33.175527+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:33.175527+0000","last_undegraded":"2024-04-19T02:20:31.510138+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":406,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.182107+0000","last_change":"2024-04-19T02:20:34.182360+0000","last_active":"2024-04-19T02:20:34.182107+0000","last_peered":"2024-04-19T02:20:33.576289+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:20:31.669330+0000","last_became_peered":"2024-04-19T02:20:31.669330+0000","last_unstale":"2024-04-19T02:20:34.182107+0000","last_undegraded":"2024-04-19T02:20:34.182107+0000","last_fullsized":"2024-04-19T02:20:34.182107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:38.881973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":494,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174974+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:33.174974+0000","last_peered":"2024-04-19T02:20:33.174974+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:33.174974+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":466,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-19T02:20:34.181971+0000","last_change":"2024-04-19T02:20:34.182211+0000","last_active":"2024-04-19T02:20:34.181971+0000","last_peered":"2024-04-19T02:20:34.020377+0000","last_clean":"2024-04-19T02:17:09.446016+0000","last_became_active":"2024-04-19T02:20:31.665063+0000","last_became_peered":"2024-04-19T02:20:31.665063+0000","last_unstale":"2024-04-19T02:20:34.181971+0000","last_undegraded":"2024-04-19T02:20:34.181971+0000","last_fullsized":"2024-04-19T02:20:34.181971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:33.904940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":598,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177633+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:33.177633+0000","last_peered":"2024-04-19T02:20:33.177633+0000","last_clean":"2024-04-19T02:20:33.177633+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:33.177633+0000","last_undegraded":"2024-04-19T02:20:33.177633+0000","last_fullsized":"2024-04-19T02:20:33.177633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.177368+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:33.177368+0000","last_peered":"2024-04-19T02:20:33.177368+0000","last_clean":"2024-04-19T02:20:33.177368+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:33.177368+0000","last_undegraded":"2024-04-19T02:20:33.177368+0000","last_fullsized":"2024-04-19T02:20:33.177368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":557,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:33.174157+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:33.174157+0000","last_peered":"2024-04-19T02:20:33.174157+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:33.174157+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.179083+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:34.179083+0000","last_peered":"2024-04-19T02:20:34.179083+0000","last_clean":"2024-04-19T02:20:34.179083+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:34.179083+0000","last_undegraded":"2024-04-19T02:20:34.179083+0000","last_fullsized":"2024-04-19T02:20:34.179083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":88,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62783488,"data_stored":229521765,"data_compressed":19386051,"data_compressed_allocated":30105600,"data_compressed_original":196911104,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":61,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124620,"kb_used_data":27128,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247220,"statfs":{"total":96636764160,"available":96509153280,"internally_reserved":0,"allocated":27779072,"data_stored":81498533,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":78,"seq":335007449090,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":5260,"kb_used_omap":7,"kb_used_meta":27512,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":5386240,"data_stored":37881567,"data_compressed":3459370,"data_compressed_allocated":4624384,"data_compressed_original":37507072,"omap_allocated":7169,"internal_metadata":28173311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139240,"kb_used_data":27796,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232600,"statfs":{"total":96636764160,"available":96494182400,"internally_reserved":0,"allocated":28463104,"data_stored":86121004,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7991296,"data_stored":63171636,"data_compressed":6098522,"data_compressed_allocated":7933952,"data_compressed_original":63148032,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:40.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:40.923 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:40.941 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-04-19T02:20:40.292356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5462,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1655,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":311728,"kb_used_data":67080,"kb_used_omap":10,"kb_used_meta":244597,"kb_avail":282803792,"statfs":{"total":289910292480,"available":289591083008,"internally_reserved":0,"allocated":68689920,"data_stored":259481568,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":250468235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1702,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1629,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001883"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":538,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183155+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:38.183155+0000","last_peered":"2024-04-19T02:20:38.183155+0000","last_clean":"2024-04-19T02:20:38.183155+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:38.183155+0000","last_undegraded":"2024-04-19T02:20:38.183155+0000","last_fullsized":"2024-04-19T02:20:38.183155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":564,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184051+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:38.184051+0000","last_peered":"2024-04-19T02:20:38.184051+0000","last_clean":"2024-04-19T02:20:38.184051+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:38.184051+0000","last_undegraded":"2024-04-19T02:20:38.184051+0000","last_fullsized":"2024-04-19T02:20:38.184051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":487,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182424+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:38.182424+0000","last_peered":"2024-04-19T02:20:38.182424+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:38.182424+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":815,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.191757+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:39.191757+0000","last_peered":"2024-04-19T02:20:39.191757+0000","last_clean":"2024-04-19T02:20:39.191757+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:39.191757+0000","last_undegraded":"2024-04-19T02:20:39.191757+0000","last_fullsized":"2024-04-19T02:20:39.191757+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":512,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181341+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:38.181341+0000","last_peered":"2024-04-19T02:20:38.181341+0000","last_clean":"2024-04-19T02:20:38.181341+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:38.181341+0000","last_undegraded":"2024-04-19T02:20:38.181341+0000","last_fullsized":"2024-04-19T02:20:38.181341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":539,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179927+0000","last_change":"2024-04-19T02:20:31.666551+0000","last_active":"2024-04-19T02:20:38.179927+0000","last_peered":"2024-04-19T02:20:38.179927+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:38.179927+0000","last_undegraded":"2024-04-19T02:20:31.515010+0000","last_fullsized":"2024-04-19T02:20:31.499321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.214784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":898,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175372+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:38.175372+0000","last_peered":"2024-04-19T02:20:38.175372+0000","last_clean":"2024-04-19T02:20:38.175372+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:38.175372+0000","last_undegraded":"2024-04-19T02:20:38.175372+0000","last_fullsized":"2024-04-19T02:20:38.175372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":919,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-19T02:20:39.179309+0000","last_change":"2024-04-19T02:20:39.179808+0000","last_active":"2024-04-19T02:20:39.179309+0000","last_peered":"2024-04-19T02:20:38.672298+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657980+0000","last_became_peered":"2024-04-19T02:20:31.657980+0000","last_unstale":"2024-04-19T02:20:39.179309+0000","last_undegraded":"2024-04-19T02:20:39.179309+0000","last_fullsized":"2024-04-19T02:20:39.179309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:52.956890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":533,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178625+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:38.178625+0000","last_peered":"2024-04-19T02:20:38.178625+0000","last_clean":"2024-04-19T02:20:38.178625+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:38.178625+0000","last_undegraded":"2024-04-19T02:20:38.178625+0000","last_fullsized":"2024-04-19T02:20:38.178625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":524,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184146+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:38.184146+0000","last_peered":"2024-04-19T02:20:38.184146+0000","last_clean":"2024-04-19T02:20:38.184146+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:38.184146+0000","last_undegraded":"2024-04-19T02:20:38.184146+0000","last_fullsized":"2024-04-19T02:20:38.184146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":461,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177101+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:38.177101+0000","last_peered":"2024-04-19T02:20:38.177101+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:38.177101+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":557,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181817+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:38.181817+0000","last_peered":"2024-04-19T02:20:38.181817+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:38.181817+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":508,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180823+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:38.180823+0000","last_peered":"2024-04-19T02:20:38.180823+0000","last_clean":"2024-04-19T02:20:38.180823+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:38.180823+0000","last_undegraded":"2024-04-19T02:20:38.180823+0000","last_fullsized":"2024-04-19T02:20:38.180823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":511,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.180633+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:38.180633+0000","last_peered":"2024-04-19T02:20:38.180633+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:38.180633+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":897,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180198+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:38.180198+0000","last_peered":"2024-04-19T02:20:38.180198+0000","last_clean":"2024-04-19T02:20:38.180198+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:38.180198+0000","last_undegraded":"2024-04-19T02:20:38.180198+0000","last_fullsized":"2024-04-19T02:20:38.180198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":580,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.175509+0000","last_change":"2024-04-19T02:20:31.664110+0000","last_active":"2024-04-19T02:20:38.175509+0000","last_peered":"2024-04-19T02:20:38.175509+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658002+0000","last_became_peered":"2024-04-19T02:20:31.658002+0000","last_unstale":"2024-04-19T02:20:38.175509+0000","last_undegraded":"2024-04-19T02:20:31.509127+0000","last_fullsized":"2024-04-19T02:20:31.495181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":531,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179801+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:38.179801+0000","last_peered":"2024-04-19T02:20:38.179801+0000","last_clean":"2024-04-19T02:20:38.179801+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:38.179801+0000","last_undegraded":"2024-04-19T02:20:38.179801+0000","last_fullsized":"2024-04-19T02:20:38.179801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":508,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184387+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:38.184387+0000","last_peered":"2024-04-19T02:20:38.184387+0000","last_clean":"2024-04-19T02:20:38.184387+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:38.184387+0000","last_undegraded":"2024-04-19T02:20:38.184387+0000","last_fullsized":"2024-04-19T02:20:38.184387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":619,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177409+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:38.177409+0000","last_peered":"2024-04-19T02:20:38.177409+0000","last_clean":"2024-04-19T02:20:38.177409+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:38.177409+0000","last_undegraded":"2024-04-19T02:20:38.177409+0000","last_fullsized":"2024-04-19T02:20:38.177409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":515,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178120+0000","last_change":"2024-04-19T02:20:31.664482+0000","last_active":"2024-04-19T02:20:38.178120+0000","last_peered":"2024-04-19T02:20:38.178120+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658147+0000","last_became_peered":"2024-04-19T02:20:31.658147+0000","last_unstale":"2024-04-19T02:20:38.178120+0000","last_undegraded":"2024-04-19T02:20:31.527172+0000","last_fullsized":"2024-04-19T02:20:31.514881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":548,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178920+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:38.178920+0000","last_peered":"2024-04-19T02:20:38.178920+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:38.178920+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":688,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181112+0000","last_change":"2024-04-19T02:20:31.672278+0000","last_active":"2024-04-19T02:20:38.181112+0000","last_peered":"2024-04-19T02:20:38.181112+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:38.181112+0000","last_undegraded":"2024-04-19T02:20:31.524382+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":870,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184543+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:38.184543+0000","last_peered":"2024-04-19T02:20:38.184543+0000","last_clean":"2024-04-19T02:20:38.184543+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:38.184543+0000","last_undegraded":"2024-04-19T02:20:38.184543+0000","last_fullsized":"2024-04-19T02:20:38.184543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":539,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179912+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:38.179912+0000","last_peered":"2024-04-19T02:20:38.179912+0000","last_clean":"2024-04-19T02:20:38.179912+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:38.179912+0000","last_undegraded":"2024-04-19T02:20:38.179912+0000","last_fullsized":"2024-04-19T02:20:38.179912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":526,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183256+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:38.183256+0000","last_peered":"2024-04-19T02:20:38.183256+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:38.183256+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":706,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178438+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:38.178438+0000","last_peered":"2024-04-19T02:20:38.178438+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:38.178438+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":559,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183573+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:38.183573+0000","last_peered":"2024-04-19T02:20:38.183573+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:38.183573+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":786,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182235+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:38.182235+0000","last_peered":"2024-04-19T02:20:38.182235+0000","last_clean":"2024-04-19T02:20:38.182235+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:38.182235+0000","last_undegraded":"2024-04-19T02:20:38.182235+0000","last_fullsized":"2024-04-19T02:20:38.182235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":510,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178285+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:38.178285+0000","last_peered":"2024-04-19T02:20:38.178285+0000","last_clean":"2024-04-19T02:20:38.178285+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:38.178285+0000","last_undegraded":"2024-04-19T02:20:38.178285+0000","last_fullsized":"2024-04-19T02:20:38.178285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":624,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181759+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:38.181759+0000","last_peered":"2024-04-19T02:20:38.181759+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:38.181759+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":587,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175663+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:38.175663+0000","last_peered":"2024-04-19T02:20:38.175663+0000","last_clean":"2024-04-19T02:20:38.175663+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:38.175663+0000","last_undegraded":"2024-04-19T02:20:38.175663+0000","last_fullsized":"2024-04-19T02:20:38.175663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":528,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176230+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:38.176230+0000","last_peered":"2024-04-19T02:20:38.176230+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:38.176230+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":468,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182060+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:38.182060+0000","last_peered":"2024-04-19T02:20:38.182060+0000","last_clean":"2024-04-19T02:20:38.182060+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:38.182060+0000","last_undegraded":"2024-04-19T02:20:38.182060+0000","last_fullsized":"2024-04-19T02:20:38.182060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":475,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178578+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:38.178578+0000","last_peered":"2024-04-19T02:20:38.178578+0000","last_clean":"2024-04-19T02:20:38.178578+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:38.178578+0000","last_undegraded":"2024-04-19T02:20:38.178578+0000","last_fullsized":"2024-04-19T02:20:38.178578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":517,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183076+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:38.183076+0000","last_peered":"2024-04-19T02:20:38.183076+0000","last_clean":"2024-04-19T02:20:38.183076+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:38.183076+0000","last_undegraded":"2024-04-19T02:20:38.183076+0000","last_fullsized":"2024-04-19T02:20:38.183076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176420+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:38.176420+0000","last_peered":"2024-04-19T02:20:38.176420+0000","last_clean":"2024-04-19T02:20:38.176420+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:38.176420+0000","last_undegraded":"2024-04-19T02:20:38.176420+0000","last_fullsized":"2024-04-19T02:20:38.176420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":601,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179083+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:38.179083+0000","last_peered":"2024-04-19T02:20:38.179083+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:38.179083+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":164,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181815+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:38.181815+0000","last_peered":"2024-04-19T02:20:38.181815+0000","last_clean":"2024-04-19T02:20:38.181815+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:38.181815+0000","last_undegraded":"2024-04-19T02:20:38.181815+0000","last_fullsized":"2024-04-19T02:20:38.181815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":536,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179213+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:38.179213+0000","last_peered":"2024-04-19T02:20:38.179213+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:38.179213+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180195+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:38.180195+0000","last_peered":"2024-04-19T02:20:38.180195+0000","last_clean":"2024-04-19T02:20:38.180195+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:38.180195+0000","last_undegraded":"2024-04-19T02:20:38.180195+0000","last_fullsized":"2024-04-19T02:20:38.180195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":261,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183872+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:38.183872+0000","last_peered":"2024-04-19T02:20:38.183872+0000","last_clean":"2024-04-19T02:20:38.183872+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:38.183872+0000","last_undegraded":"2024-04-19T02:20:38.183872+0000","last_fullsized":"2024-04-19T02:20:38.183872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":857,"reported_epoch":88,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:39.189777+0000","last_change":"2024-04-19T02:20:39.190185+0000","last_active":"2024-04-19T02:20:39.189777+0000","last_peered":"2024-04-19T02:20:39.189777+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:20:31.657714+0000","last_became_peered":"2024-04-19T02:20:31.657714+0000","last_unstale":"2024-04-19T02:20:39.189777+0000","last_undegraded":"2024-04-19T02:20:39.189777+0000","last_fullsized":"2024-04-19T02:20:31.499247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:39.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":400,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184621+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:38.184621+0000","last_peered":"2024-04-19T02:20:38.184621+0000","last_clean":"2024-04-19T02:20:38.184621+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:38.184621+0000","last_undegraded":"2024-04-19T02:20:38.184621+0000","last_fullsized":"2024-04-19T02:20:38.184621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":537,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180376+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:38.180376+0000","last_peered":"2024-04-19T02:20:38.180376+0000","last_clean":"2024-04-19T02:20:38.180376+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:38.180376+0000","last_undegraded":"2024-04-19T02:20:38.180376+0000","last_fullsized":"2024-04-19T02:20:38.180376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":690,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182990+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:38.182990+0000","last_peered":"2024-04-19T02:20:38.182990+0000","last_clean":"2024-04-19T02:20:38.182990+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:38.182990+0000","last_undegraded":"2024-04-19T02:20:38.182990+0000","last_fullsized":"2024-04-19T02:20:38.182990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":495,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176767+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:38.176767+0000","last_peered":"2024-04-19T02:20:38.176767+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:38.176767+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178773+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:38.178773+0000","last_peered":"2024-04-19T02:20:38.178773+0000","last_clean":"2024-04-19T02:20:38.178773+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:38.178773+0000","last_undegraded":"2024-04-19T02:20:38.178773+0000","last_fullsized":"2024-04-19T02:20:38.178773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":652,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177856+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:38.177856+0000","last_peered":"2024-04-19T02:20:38.177856+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:38.177856+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":240,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178919+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:38.178919+0000","last_peered":"2024-04-19T02:20:38.178919+0000","last_clean":"2024-04-19T02:20:38.178919+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:38.178919+0000","last_undegraded":"2024-04-19T02:20:38.178919+0000","last_fullsized":"2024-04-19T02:20:38.178919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":535,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177649+0000","last_change":"2024-04-19T02:20:31.664858+0000","last_active":"2024-04-19T02:20:38.177649+0000","last_peered":"2024-04-19T02:20:38.177649+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658577+0000","last_became_peered":"2024-04-19T02:20:31.658577+0000","last_unstale":"2024-04-19T02:20:38.177649+0000","last_undegraded":"2024-04-19T02:20:31.520194+0000","last_fullsized":"2024-04-19T02:20:31.497338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:24.362286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":291,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176105+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:38.176105+0000","last_peered":"2024-04-19T02:20:38.176105+0000","last_clean":"2024-04-19T02:20:38.176105+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:38.176105+0000","last_undegraded":"2024-04-19T02:20:38.176105+0000","last_fullsized":"2024-04-19T02:20:38.176105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":587,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183314+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:38.183314+0000","last_peered":"2024-04-19T02:20:38.183314+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:38.183314+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180687+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:38.180687+0000","last_peered":"2024-04-19T02:20:38.180687+0000","last_clean":"2024-04-19T02:20:38.180687+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:38.180687+0000","last_undegraded":"2024-04-19T02:20:38.180687+0000","last_fullsized":"2024-04-19T02:20:38.180687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":792,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.191148+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:39.191148+0000","last_peered":"2024-04-19T02:20:39.191148+0000","last_clean":"2024-04-19T02:20:39.191148+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:39.191148+0000","last_undegraded":"2024-04-19T02:20:39.191148+0000","last_fullsized":"2024-04-19T02:20:39.191148+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":472,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180461+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:38.180461+0000","last_peered":"2024-04-19T02:20:38.180461+0000","last_clean":"2024-04-19T02:20:38.180461+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:38.180461+0000","last_undegraded":"2024-04-19T02:20:38.180461+0000","last_fullsized":"2024-04-19T02:20:38.180461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":501,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178939+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:38.178939+0000","last_peered":"2024-04-19T02:20:38.178939+0000","last_clean":"2024-04-19T02:20:38.178939+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:38.178939+0000","last_undegraded":"2024-04-19T02:20:38.178939+0000","last_fullsized":"2024-04-19T02:20:38.178939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180971+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:38.180971+0000","last_peered":"2024-04-19T02:20:38.180971+0000","last_clean":"2024-04-19T02:20:38.180971+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:38.180971+0000","last_undegraded":"2024-04-19T02:20:38.180971+0000","last_fullsized":"2024-04-19T02:20:38.180971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179199+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:38.179199+0000","last_peered":"2024-04-19T02:20:38.179199+0000","last_clean":"2024-04-19T02:20:38.179199+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:38.179199+0000","last_undegraded":"2024-04-19T02:20:38.179199+0000","last_fullsized":"2024-04-19T02:20:38.179199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":844,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176883+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:38.176883+0000","last_peered":"2024-04-19T02:20:38.176883+0000","last_clean":"2024-04-19T02:20:38.176883+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:38.176883+0000","last_undegraded":"2024-04-19T02:20:38.176883+0000","last_fullsized":"2024-04-19T02:20:38.176883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":572,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182803+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:38.182803+0000","last_peered":"2024-04-19T02:20:38.182803+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:38.182803+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180695+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:38.180695+0000","last_peered":"2024-04-19T02:20:38.180695+0000","last_clean":"2024-04-19T02:20:38.180695+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:38.180695+0000","last_undegraded":"2024-04-19T02:20:38.180695+0000","last_fullsized":"2024-04-19T02:20:38.180695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":281,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176858+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:38.176858+0000","last_peered":"2024-04-19T02:20:38.176858+0000","last_clean":"2024-04-19T02:20:38.176858+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:38.176858+0000","last_undegraded":"2024-04-19T02:20:38.176858+0000","last_fullsized":"2024-04-19T02:20:38.176858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":526,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184462+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:38.184462+0000","last_peered":"2024-04-19T02:20:38.184462+0000","last_clean":"2024-04-19T02:20:38.184462+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:38.184462+0000","last_undegraded":"2024-04-19T02:20:38.184462+0000","last_fullsized":"2024-04-19T02:20:38.184462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177114+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:38.177114+0000","last_peered":"2024-04-19T02:20:38.177114+0000","last_clean":"2024-04-19T02:20:38.177114+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:38.177114+0000","last_undegraded":"2024-04-19T02:20:38.177114+0000","last_fullsized":"2024-04-19T02:20:38.177114+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":494,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180647+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:38.180647+0000","last_peered":"2024-04-19T02:20:38.180647+0000","last_clean":"2024-04-19T02:20:38.180647+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:38.180647+0000","last_undegraded":"2024-04-19T02:20:38.180647+0000","last_fullsized":"2024-04-19T02:20:38.180647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":438,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179236+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:38.179236+0000","last_peered":"2024-04-19T02:20:38.179236+0000","last_clean":"2024-04-19T02:20:38.179236+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:38.179236+0000","last_undegraded":"2024-04-19T02:20:38.179236+0000","last_fullsized":"2024-04-19T02:20:38.179236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178334+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:38.178334+0000","last_peered":"2024-04-19T02:20:38.178334+0000","last_clean":"2024-04-19T02:20:38.178334+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:38.178334+0000","last_undegraded":"2024-04-19T02:20:38.178334+0000","last_fullsized":"2024-04-19T02:20:38.178334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178541+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:38.178541+0000","last_peered":"2024-04-19T02:20:38.178541+0000","last_clean":"2024-04-19T02:20:38.178541+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:38.178541+0000","last_undegraded":"2024-04-19T02:20:38.178541+0000","last_fullsized":"2024-04-19T02:20:38.178541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":540,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178505+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:38.178505+0000","last_peered":"2024-04-19T02:20:38.178505+0000","last_clean":"2024-04-19T02:20:38.178505+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:38.178505+0000","last_undegraded":"2024-04-19T02:20:38.178505+0000","last_fullsized":"2024-04-19T02:20:38.178505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":544,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177507+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:38.177507+0000","last_peered":"2024-04-19T02:20:38.177507+0000","last_clean":"2024-04-19T02:20:38.177507+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:38.177507+0000","last_undegraded":"2024-04-19T02:20:38.177507+0000","last_fullsized":"2024-04-19T02:20:38.177507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180804+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:38.180804+0000","last_peered":"2024-04-19T02:20:38.180804+0000","last_clean":"2024-04-19T02:20:38.180804+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:38.180804+0000","last_undegraded":"2024-04-19T02:20:38.180804+0000","last_fullsized":"2024-04-19T02:20:38.180804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":496,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181179+0000","last_change":"2024-04-19T02:20:31.666219+0000","last_active":"2024-04-19T02:20:38.181179+0000","last_peered":"2024-04-19T02:20:38.181179+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:20:31.663303+0000","last_became_peered":"2024-04-19T02:20:31.663303+0000","last_unstale":"2024-04-19T02:20:38.181179+0000","last_undegraded":"2024-04-19T02:20:31.509883+0000","last_fullsized":"2024-04-19T02:20:31.499264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:54.685515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180526+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:38.180526+0000","last_peered":"2024-04-19T02:20:38.180526+0000","last_clean":"2024-04-19T02:20:38.180526+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:38.180526+0000","last_undegraded":"2024-04-19T02:20:38.180526+0000","last_fullsized":"2024-04-19T02:20:38.180526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183708+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:38.183708+0000","last_peered":"2024-04-19T02:20:38.183708+0000","last_clean":"2024-04-19T02:20:38.183708+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:38.183708+0000","last_undegraded":"2024-04-19T02:20:38.183708+0000","last_fullsized":"2024-04-19T02:20:38.183708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":581,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181535+0000","last_change":"2024-04-19T02:20:31.663405+0000","last_active":"2024-04-19T02:20:38.181535+0000","last_peered":"2024-04-19T02:20:38.181535+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:20:31.659420+0000","last_became_peered":"2024-04-19T02:20:31.659420+0000","last_unstale":"2024-04-19T02:20:38.181535+0000","last_undegraded":"2024-04-19T02:20:31.528128+0000","last_fullsized":"2024-04-19T02:20:31.503952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180835+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:38.180835+0000","last_peered":"2024-04-19T02:20:38.180835+0000","last_clean":"2024-04-19T02:20:38.180835+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:38.180835+0000","last_undegraded":"2024-04-19T02:20:38.180835+0000","last_fullsized":"2024-04-19T02:20:38.180835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.181129+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:39.181129+0000","last_peered":"2024-04-19T02:20:39.181129+0000","last_clean":"2024-04-19T02:20:39.181129+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:39.181129+0000","last_undegraded":"2024-04-19T02:20:39.181129+0000","last_fullsized":"2024-04-19T02:20:39.181129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":548,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177512+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:38.177512+0000","last_peered":"2024-04-19T02:20:38.177512+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:38.177512+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179152+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:38.179152+0000","last_peered":"2024-04-19T02:20:38.179152+0000","last_clean":"2024-04-19T02:20:38.179152+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:38.179152+0000","last_undegraded":"2024-04-19T02:20:38.179152+0000","last_fullsized":"2024-04-19T02:20:38.179152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183856+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:38.183856+0000","last_peered":"2024-04-19T02:20:38.183856+0000","last_clean":"2024-04-19T02:20:38.183856+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:38.183856+0000","last_undegraded":"2024-04-19T02:20:38.183856+0000","last_fullsized":"2024-04-19T02:20:38.183856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":548,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175370+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:38.175370+0000","last_peered":"2024-04-19T02:20:38.175370+0000","last_clean":"2024-04-19T02:20:38.175370+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:38.175370+0000","last_undegraded":"2024-04-19T02:20:38.175370+0000","last_fullsized":"2024-04-19T02:20:38.175370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":505,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.180572+0000","last_change":"2024-04-19T02:20:31.663417+0000","last_active":"2024-04-19T02:20:38.180572+0000","last_peered":"2024-04-19T02:20:38.180572+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.659358+0000","last_became_peered":"2024-04-19T02:20:31.659358+0000","last_unstale":"2024-04-19T02:20:38.180572+0000","last_undegraded":"2024-04-19T02:20:31.524667+0000","last_fullsized":"2024-04-19T02:20:31.500013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:52.738849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":553,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181771+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:38.181771+0000","last_peered":"2024-04-19T02:20:38.181771+0000","last_clean":"2024-04-19T02:20:38.181771+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:38.181771+0000","last_undegraded":"2024-04-19T02:20:38.181771+0000","last_fullsized":"2024-04-19T02:20:38.181771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":525,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175836+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:38.175836+0000","last_peered":"2024-04-19T02:20:38.175836+0000","last_clean":"2024-04-19T02:20:38.175836+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:38.175836+0000","last_undegraded":"2024-04-19T02:20:38.175836+0000","last_fullsized":"2024-04-19T02:20:38.175836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":186,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183505+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:38.183505+0000","last_peered":"2024-04-19T02:20:38.183505+0000","last_clean":"2024-04-19T02:20:38.183505+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:38.183505+0000","last_undegraded":"2024-04-19T02:20:38.183505+0000","last_fullsized":"2024-04-19T02:20:38.183505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":408,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178541+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:38.178541+0000","last_peered":"2024-04-19T02:20:38.178541+0000","last_clean":"2024-04-19T02:20:38.178541+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:38.178541+0000","last_undegraded":"2024-04-19T02:20:38.178541+0000","last_fullsized":"2024-04-19T02:20:38.178541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":583,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176009+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:38.176009+0000","last_peered":"2024-04-19T02:20:38.176009+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:38.176009+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179817+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:38.179817+0000","last_peered":"2024-04-19T02:20:38.179817+0000","last_clean":"2024-04-19T02:20:38.179817+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:38.179817+0000","last_undegraded":"2024-04-19T02:20:38.179817+0000","last_fullsized":"2024-04-19T02:20:38.179817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":599,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177077+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:38.177077+0000","last_peered":"2024-04-19T02:20:38.177077+0000","last_clean":"2024-04-19T02:20:38.177077+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:38.177077+0000","last_undegraded":"2024-04-19T02:20:38.177077+0000","last_fullsized":"2024-04-19T02:20:38.177077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":882,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-19T02:20:39.183330+0000","last_change":"2024-04-19T02:20:39.183548+0000","last_active":"2024-04-19T02:20:39.183330+0000","last_peered":"2024-04-19T02:20:38.194400+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:20:31.657888+0000","last_became_peered":"2024-04-19T02:20:31.657888+0000","last_unstale":"2024-04-19T02:20:39.183330+0000","last_undegraded":"2024-04-19T02:20:39.183330+0000","last_fullsized":"2024-04-19T02:20:39.183330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:02.577526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":653,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178038+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:38.178038+0000","last_peered":"2024-04-19T02:20:38.178038+0000","last_clean":"2024-04-19T02:20:38.178038+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:38.178038+0000","last_undegraded":"2024-04-19T02:20:38.178038+0000","last_fullsized":"2024-04-19T02:20:38.178038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":759,"reported_epoch":88,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:39.513815+0000","last_change":"2024-04-19T02:20:39.194284+0000","last_active":"2024-04-19T02:20:39.513815+0000","last_peered":"2024-04-19T02:20:39.513815+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:20:31.657854+0000","last_became_peered":"2024-04-19T02:20:31.657854+0000","last_unstale":"2024-04-19T02:20:39.513815+0000","last_undegraded":"2024-04-19T02:20:39.513815+0000","last_fullsized":"2024-04-19T02:20:31.499301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:06.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":431,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176716+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:38.176716+0000","last_peered":"2024-04-19T02:20:38.176716+0000","last_clean":"2024-04-19T02:20:38.176716+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:38.176716+0000","last_undegraded":"2024-04-19T02:20:38.176716+0000","last_fullsized":"2024-04-19T02:20:38.176716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":501,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182587+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:38.182587+0000","last_peered":"2024-04-19T02:20:38.182587+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:38.182587+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":578,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181700+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:38.181700+0000","last_peered":"2024-04-19T02:20:38.181700+0000","last_clean":"2024-04-19T02:20:38.181700+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:38.181700+0000","last_undegraded":"2024-04-19T02:20:38.181700+0000","last_fullsized":"2024-04-19T02:20:38.181700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":520,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182017+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:38.182017+0000","last_peered":"2024-04-19T02:20:38.182017+0000","last_clean":"2024-04-19T02:20:38.182017+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:38.182017+0000","last_undegraded":"2024-04-19T02:20:38.182017+0000","last_fullsized":"2024-04-19T02:20:38.182017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181616+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:38.181616+0000","last_peered":"2024-04-19T02:20:38.181616+0000","last_clean":"2024-04-19T02:20:38.181616+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:38.181616+0000","last_undegraded":"2024-04-19T02:20:38.181616+0000","last_fullsized":"2024-04-19T02:20:38.181616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":470,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176982+0000","last_change":"2024-04-19T02:20:31.665847+0000","last_active":"2024-04-19T02:20:38.176982+0000","last_peered":"2024-04-19T02:20:38.176982+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:38.176982+0000","last_undegraded":"2024-04-19T02:20:31.510138+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":418,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179685+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:38.179685+0000","last_peered":"2024-04-19T02:20:38.179685+0000","last_clean":"2024-04-19T02:20:38.179685+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:38.179685+0000","last_undegraded":"2024-04-19T02:20:38.179685+0000","last_fullsized":"2024-04-19T02:20:38.179685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":499,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176386+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:38.176386+0000","last_peered":"2024-04-19T02:20:38.176386+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:38.176386+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":478,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183251+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:38.183251+0000","last_peered":"2024-04-19T02:20:38.183251+0000","last_clean":"2024-04-19T02:20:38.183251+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:38.183251+0000","last_undegraded":"2024-04-19T02:20:38.183251+0000","last_fullsized":"2024-04-19T02:20:38.183251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":603,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180945+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:38.180945+0000","last_peered":"2024-04-19T02:20:38.180945+0000","last_clean":"2024-04-19T02:20:38.180945+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:38.180945+0000","last_undegraded":"2024-04-19T02:20:38.180945+0000","last_fullsized":"2024-04-19T02:20:38.180945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178903+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:38.178903+0000","last_peered":"2024-04-19T02:20:38.178903+0000","last_clean":"2024-04-19T02:20:38.178903+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:38.178903+0000","last_undegraded":"2024-04-19T02:20:38.178903+0000","last_fullsized":"2024-04-19T02:20:38.178903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":562,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.175986+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:38.175986+0000","last_peered":"2024-04-19T02:20:38.175986+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:38.175986+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179515+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:38.179515+0000","last_peered":"2024-04-19T02:20:38.179515+0000","last_clean":"2024-04-19T02:20:38.179515+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:38.179515+0000","last_undegraded":"2024-04-19T02:20:38.179515+0000","last_fullsized":"2024-04-19T02:20:38.179515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5462,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1629,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738426,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124688,"kb_used_data":27200,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247152,"statfs":{"total":96636764160,"available":96509083648,"internally_reserved":0,"allocated":27852800,"data_stored":81530185,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":78,"seq":335007449091,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47748,"kb_used_data":12024,"kb_used_omap":7,"kb_used_meta":35704,"kb_avail":94324092,"statfs":{"total":96636764160,"available":96587870208,"internally_reserved":0,"allocated":12312576,"data_stored":91803867,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":36561919},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":27856,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":28524544,"data_stored":86147516,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:40.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:20:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:41.331 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 5462/110 objects degraded (4965.455%), 30 pgs degraded","count":30},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":277,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":90,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":28},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":71},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":30},{"state_name":"peering","count":2},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":319209472,"bytes_avail":289591083008,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":5462,"degraded_total":110,"degraded_ratio":49.654545454545456,"recovering_objects_per_sec":407,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1629,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:20:41.349 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:20:41.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:41.640 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:41.642 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:41.656 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-04-19T02:20:41.185980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5462,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1655,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":311728,"kb_used_data":67080,"kb_used_omap":10,"kb_used_meta":244597,"kb_avail":282803792,"statfs":{"total":289910292480,"available":289591083008,"internally_reserved":0,"allocated":68689920,"data_stored":259481568,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":250468235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1702,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1629,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.994613"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":538,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183155+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:38.183155+0000","last_peered":"2024-04-19T02:20:38.183155+0000","last_clean":"2024-04-19T02:20:38.183155+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:38.183155+0000","last_undegraded":"2024-04-19T02:20:38.183155+0000","last_fullsized":"2024-04-19T02:20:38.183155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":564,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184051+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:38.184051+0000","last_peered":"2024-04-19T02:20:38.184051+0000","last_clean":"2024-04-19T02:20:38.184051+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:38.184051+0000","last_undegraded":"2024-04-19T02:20:38.184051+0000","last_fullsized":"2024-04-19T02:20:38.184051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":487,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182424+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:38.182424+0000","last_peered":"2024-04-19T02:20:38.182424+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:38.182424+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":815,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.191757+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:39.191757+0000","last_peered":"2024-04-19T02:20:39.191757+0000","last_clean":"2024-04-19T02:20:39.191757+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:39.191757+0000","last_undegraded":"2024-04-19T02:20:39.191757+0000","last_fullsized":"2024-04-19T02:20:39.191757+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":512,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181341+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:38.181341+0000","last_peered":"2024-04-19T02:20:38.181341+0000","last_clean":"2024-04-19T02:20:38.181341+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:38.181341+0000","last_undegraded":"2024-04-19T02:20:38.181341+0000","last_fullsized":"2024-04-19T02:20:38.181341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":539,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179927+0000","last_change":"2024-04-19T02:20:31.666551+0000","last_active":"2024-04-19T02:20:38.179927+0000","last_peered":"2024-04-19T02:20:38.179927+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:38.179927+0000","last_undegraded":"2024-04-19T02:20:31.515010+0000","last_fullsized":"2024-04-19T02:20:31.499321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.214784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":898,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175372+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:38.175372+0000","last_peered":"2024-04-19T02:20:38.175372+0000","last_clean":"2024-04-19T02:20:38.175372+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:38.175372+0000","last_undegraded":"2024-04-19T02:20:38.175372+0000","last_fullsized":"2024-04-19T02:20:38.175372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":919,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-19T02:20:39.179309+0000","last_change":"2024-04-19T02:20:39.179808+0000","last_active":"2024-04-19T02:20:39.179309+0000","last_peered":"2024-04-19T02:20:38.672298+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657980+0000","last_became_peered":"2024-04-19T02:20:31.657980+0000","last_unstale":"2024-04-19T02:20:39.179309+0000","last_undegraded":"2024-04-19T02:20:39.179309+0000","last_fullsized":"2024-04-19T02:20:39.179309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:52.956890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":533,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178625+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:38.178625+0000","last_peered":"2024-04-19T02:20:38.178625+0000","last_clean":"2024-04-19T02:20:38.178625+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:38.178625+0000","last_undegraded":"2024-04-19T02:20:38.178625+0000","last_fullsized":"2024-04-19T02:20:38.178625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":524,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184146+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:38.184146+0000","last_peered":"2024-04-19T02:20:38.184146+0000","last_clean":"2024-04-19T02:20:38.184146+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:38.184146+0000","last_undegraded":"2024-04-19T02:20:38.184146+0000","last_fullsized":"2024-04-19T02:20:38.184146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":461,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177101+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:38.177101+0000","last_peered":"2024-04-19T02:20:38.177101+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:38.177101+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":557,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181817+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:38.181817+0000","last_peered":"2024-04-19T02:20:38.181817+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:38.181817+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":508,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180823+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:38.180823+0000","last_peered":"2024-04-19T02:20:38.180823+0000","last_clean":"2024-04-19T02:20:38.180823+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:38.180823+0000","last_undegraded":"2024-04-19T02:20:38.180823+0000","last_fullsized":"2024-04-19T02:20:38.180823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":511,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.180633+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:38.180633+0000","last_peered":"2024-04-19T02:20:38.180633+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:38.180633+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":897,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180198+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:38.180198+0000","last_peered":"2024-04-19T02:20:38.180198+0000","last_clean":"2024-04-19T02:20:38.180198+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:38.180198+0000","last_undegraded":"2024-04-19T02:20:38.180198+0000","last_fullsized":"2024-04-19T02:20:38.180198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":580,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.175509+0000","last_change":"2024-04-19T02:20:31.664110+0000","last_active":"2024-04-19T02:20:38.175509+0000","last_peered":"2024-04-19T02:20:38.175509+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658002+0000","last_became_peered":"2024-04-19T02:20:31.658002+0000","last_unstale":"2024-04-19T02:20:38.175509+0000","last_undegraded":"2024-04-19T02:20:31.509127+0000","last_fullsized":"2024-04-19T02:20:31.495181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":531,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179801+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:38.179801+0000","last_peered":"2024-04-19T02:20:38.179801+0000","last_clean":"2024-04-19T02:20:38.179801+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:38.179801+0000","last_undegraded":"2024-04-19T02:20:38.179801+0000","last_fullsized":"2024-04-19T02:20:38.179801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":508,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184387+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:38.184387+0000","last_peered":"2024-04-19T02:20:38.184387+0000","last_clean":"2024-04-19T02:20:38.184387+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:38.184387+0000","last_undegraded":"2024-04-19T02:20:38.184387+0000","last_fullsized":"2024-04-19T02:20:38.184387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":619,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177409+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:38.177409+0000","last_peered":"2024-04-19T02:20:38.177409+0000","last_clean":"2024-04-19T02:20:38.177409+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:38.177409+0000","last_undegraded":"2024-04-19T02:20:38.177409+0000","last_fullsized":"2024-04-19T02:20:38.177409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":515,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178120+0000","last_change":"2024-04-19T02:20:31.664482+0000","last_active":"2024-04-19T02:20:38.178120+0000","last_peered":"2024-04-19T02:20:38.178120+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658147+0000","last_became_peered":"2024-04-19T02:20:31.658147+0000","last_unstale":"2024-04-19T02:20:38.178120+0000","last_undegraded":"2024-04-19T02:20:31.527172+0000","last_fullsized":"2024-04-19T02:20:31.514881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":548,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178920+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:38.178920+0000","last_peered":"2024-04-19T02:20:38.178920+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:38.178920+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":688,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181112+0000","last_change":"2024-04-19T02:20:31.672278+0000","last_active":"2024-04-19T02:20:38.181112+0000","last_peered":"2024-04-19T02:20:38.181112+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:38.181112+0000","last_undegraded":"2024-04-19T02:20:31.524382+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":870,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184543+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:38.184543+0000","last_peered":"2024-04-19T02:20:38.184543+0000","last_clean":"2024-04-19T02:20:38.184543+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:38.184543+0000","last_undegraded":"2024-04-19T02:20:38.184543+0000","last_fullsized":"2024-04-19T02:20:38.184543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":539,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179912+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:38.179912+0000","last_peered":"2024-04-19T02:20:38.179912+0000","last_clean":"2024-04-19T02:20:38.179912+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:38.179912+0000","last_undegraded":"2024-04-19T02:20:38.179912+0000","last_fullsized":"2024-04-19T02:20:38.179912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":526,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183256+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:38.183256+0000","last_peered":"2024-04-19T02:20:38.183256+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:38.183256+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":706,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178438+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:38.178438+0000","last_peered":"2024-04-19T02:20:38.178438+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:38.178438+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":559,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183573+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:38.183573+0000","last_peered":"2024-04-19T02:20:38.183573+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:38.183573+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":786,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182235+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:38.182235+0000","last_peered":"2024-04-19T02:20:38.182235+0000","last_clean":"2024-04-19T02:20:38.182235+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:38.182235+0000","last_undegraded":"2024-04-19T02:20:38.182235+0000","last_fullsized":"2024-04-19T02:20:38.182235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":510,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178285+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:38.178285+0000","last_peered":"2024-04-19T02:20:38.178285+0000","last_clean":"2024-04-19T02:20:38.178285+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:38.178285+0000","last_undegraded":"2024-04-19T02:20:38.178285+0000","last_fullsized":"2024-04-19T02:20:38.178285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":624,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181759+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:38.181759+0000","last_peered":"2024-04-19T02:20:38.181759+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:38.181759+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":587,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175663+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:38.175663+0000","last_peered":"2024-04-19T02:20:38.175663+0000","last_clean":"2024-04-19T02:20:38.175663+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:38.175663+0000","last_undegraded":"2024-04-19T02:20:38.175663+0000","last_fullsized":"2024-04-19T02:20:38.175663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":528,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176230+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:38.176230+0000","last_peered":"2024-04-19T02:20:38.176230+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:38.176230+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":468,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182060+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:38.182060+0000","last_peered":"2024-04-19T02:20:38.182060+0000","last_clean":"2024-04-19T02:20:38.182060+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:38.182060+0000","last_undegraded":"2024-04-19T02:20:38.182060+0000","last_fullsized":"2024-04-19T02:20:38.182060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":475,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178578+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:38.178578+0000","last_peered":"2024-04-19T02:20:38.178578+0000","last_clean":"2024-04-19T02:20:38.178578+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:38.178578+0000","last_undegraded":"2024-04-19T02:20:38.178578+0000","last_fullsized":"2024-04-19T02:20:38.178578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":517,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183076+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:38.183076+0000","last_peered":"2024-04-19T02:20:38.183076+0000","last_clean":"2024-04-19T02:20:38.183076+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:38.183076+0000","last_undegraded":"2024-04-19T02:20:38.183076+0000","last_fullsized":"2024-04-19T02:20:38.183076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176420+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:38.176420+0000","last_peered":"2024-04-19T02:20:38.176420+0000","last_clean":"2024-04-19T02:20:38.176420+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:38.176420+0000","last_undegraded":"2024-04-19T02:20:38.176420+0000","last_fullsized":"2024-04-19T02:20:38.176420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":601,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179083+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:38.179083+0000","last_peered":"2024-04-19T02:20:38.179083+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:38.179083+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":164,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181815+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:38.181815+0000","last_peered":"2024-04-19T02:20:38.181815+0000","last_clean":"2024-04-19T02:20:38.181815+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:38.181815+0000","last_undegraded":"2024-04-19T02:20:38.181815+0000","last_fullsized":"2024-04-19T02:20:38.181815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":536,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179213+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:38.179213+0000","last_peered":"2024-04-19T02:20:38.179213+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:38.179213+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180195+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:38.180195+0000","last_peered":"2024-04-19T02:20:38.180195+0000","last_clean":"2024-04-19T02:20:38.180195+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:38.180195+0000","last_undegraded":"2024-04-19T02:20:38.180195+0000","last_fullsized":"2024-04-19T02:20:38.180195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":261,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183872+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:38.183872+0000","last_peered":"2024-04-19T02:20:38.183872+0000","last_clean":"2024-04-19T02:20:38.183872+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:38.183872+0000","last_undegraded":"2024-04-19T02:20:38.183872+0000","last_fullsized":"2024-04-19T02:20:38.183872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":857,"reported_epoch":88,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:39.189777+0000","last_change":"2024-04-19T02:20:39.190185+0000","last_active":"2024-04-19T02:20:39.189777+0000","last_peered":"2024-04-19T02:20:39.189777+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:20:31.657714+0000","last_became_peered":"2024-04-19T02:20:31.657714+0000","last_unstale":"2024-04-19T02:20:39.189777+0000","last_undegraded":"2024-04-19T02:20:39.189777+0000","last_fullsized":"2024-04-19T02:20:31.499247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:39.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":400,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184621+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:38.184621+0000","last_peered":"2024-04-19T02:20:38.184621+0000","last_clean":"2024-04-19T02:20:38.184621+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:38.184621+0000","last_undegraded":"2024-04-19T02:20:38.184621+0000","last_fullsized":"2024-04-19T02:20:38.184621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":537,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180376+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:38.180376+0000","last_peered":"2024-04-19T02:20:38.180376+0000","last_clean":"2024-04-19T02:20:38.180376+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:38.180376+0000","last_undegraded":"2024-04-19T02:20:38.180376+0000","last_fullsized":"2024-04-19T02:20:38.180376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":690,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182990+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:38.182990+0000","last_peered":"2024-04-19T02:20:38.182990+0000","last_clean":"2024-04-19T02:20:38.182990+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:38.182990+0000","last_undegraded":"2024-04-19T02:20:38.182990+0000","last_fullsized":"2024-04-19T02:20:38.182990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":495,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176767+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:38.176767+0000","last_peered":"2024-04-19T02:20:38.176767+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:38.176767+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178773+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:38.178773+0000","last_peered":"2024-04-19T02:20:38.178773+0000","last_clean":"2024-04-19T02:20:38.178773+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:38.178773+0000","last_undegraded":"2024-04-19T02:20:38.178773+0000","last_fullsized":"2024-04-19T02:20:38.178773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":652,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177856+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:38.177856+0000","last_peered":"2024-04-19T02:20:38.177856+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:38.177856+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":240,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178919+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:38.178919+0000","last_peered":"2024-04-19T02:20:38.178919+0000","last_clean":"2024-04-19T02:20:38.178919+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:38.178919+0000","last_undegraded":"2024-04-19T02:20:38.178919+0000","last_fullsized":"2024-04-19T02:20:38.178919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":535,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177649+0000","last_change":"2024-04-19T02:20:31.664858+0000","last_active":"2024-04-19T02:20:38.177649+0000","last_peered":"2024-04-19T02:20:38.177649+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658577+0000","last_became_peered":"2024-04-19T02:20:31.658577+0000","last_unstale":"2024-04-19T02:20:38.177649+0000","last_undegraded":"2024-04-19T02:20:31.520194+0000","last_fullsized":"2024-04-19T02:20:31.497338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:24.362286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":291,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176105+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:38.176105+0000","last_peered":"2024-04-19T02:20:38.176105+0000","last_clean":"2024-04-19T02:20:38.176105+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:38.176105+0000","last_undegraded":"2024-04-19T02:20:38.176105+0000","last_fullsized":"2024-04-19T02:20:38.176105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":587,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183314+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:38.183314+0000","last_peered":"2024-04-19T02:20:38.183314+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:38.183314+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180687+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:38.180687+0000","last_peered":"2024-04-19T02:20:38.180687+0000","last_clean":"2024-04-19T02:20:38.180687+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:38.180687+0000","last_undegraded":"2024-04-19T02:20:38.180687+0000","last_fullsized":"2024-04-19T02:20:38.180687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":792,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.191148+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:39.191148+0000","last_peered":"2024-04-19T02:20:39.191148+0000","last_clean":"2024-04-19T02:20:39.191148+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:39.191148+0000","last_undegraded":"2024-04-19T02:20:39.191148+0000","last_fullsized":"2024-04-19T02:20:39.191148+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":472,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180461+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:38.180461+0000","last_peered":"2024-04-19T02:20:38.180461+0000","last_clean":"2024-04-19T02:20:38.180461+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:38.180461+0000","last_undegraded":"2024-04-19T02:20:38.180461+0000","last_fullsized":"2024-04-19T02:20:38.180461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":501,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178939+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:38.178939+0000","last_peered":"2024-04-19T02:20:38.178939+0000","last_clean":"2024-04-19T02:20:38.178939+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:38.178939+0000","last_undegraded":"2024-04-19T02:20:38.178939+0000","last_fullsized":"2024-04-19T02:20:38.178939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180971+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:38.180971+0000","last_peered":"2024-04-19T02:20:38.180971+0000","last_clean":"2024-04-19T02:20:38.180971+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:38.180971+0000","last_undegraded":"2024-04-19T02:20:38.180971+0000","last_fullsized":"2024-04-19T02:20:38.180971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179199+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:38.179199+0000","last_peered":"2024-04-19T02:20:38.179199+0000","last_clean":"2024-04-19T02:20:38.179199+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:38.179199+0000","last_undegraded":"2024-04-19T02:20:38.179199+0000","last_fullsized":"2024-04-19T02:20:38.179199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":844,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176883+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:38.176883+0000","last_peered":"2024-04-19T02:20:38.176883+0000","last_clean":"2024-04-19T02:20:38.176883+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:38.176883+0000","last_undegraded":"2024-04-19T02:20:38.176883+0000","last_fullsized":"2024-04-19T02:20:38.176883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":572,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182803+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:38.182803+0000","last_peered":"2024-04-19T02:20:38.182803+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:38.182803+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180695+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:38.180695+0000","last_peered":"2024-04-19T02:20:38.180695+0000","last_clean":"2024-04-19T02:20:38.180695+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:38.180695+0000","last_undegraded":"2024-04-19T02:20:38.180695+0000","last_fullsized":"2024-04-19T02:20:38.180695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":281,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176858+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:38.176858+0000","last_peered":"2024-04-19T02:20:38.176858+0000","last_clean":"2024-04-19T02:20:38.176858+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:38.176858+0000","last_undegraded":"2024-04-19T02:20:38.176858+0000","last_fullsized":"2024-04-19T02:20:38.176858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":526,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184462+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:38.184462+0000","last_peered":"2024-04-19T02:20:38.184462+0000","last_clean":"2024-04-19T02:20:38.184462+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:38.184462+0000","last_undegraded":"2024-04-19T02:20:38.184462+0000","last_fullsized":"2024-04-19T02:20:38.184462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177114+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:38.177114+0000","last_peered":"2024-04-19T02:20:38.177114+0000","last_clean":"2024-04-19T02:20:38.177114+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:38.177114+0000","last_undegraded":"2024-04-19T02:20:38.177114+0000","last_fullsized":"2024-04-19T02:20:38.177114+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":494,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180647+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:38.180647+0000","last_peered":"2024-04-19T02:20:38.180647+0000","last_clean":"2024-04-19T02:20:38.180647+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:38.180647+0000","last_undegraded":"2024-04-19T02:20:38.180647+0000","last_fullsized":"2024-04-19T02:20:38.180647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":438,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179236+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:38.179236+0000","last_peered":"2024-04-19T02:20:38.179236+0000","last_clean":"2024-04-19T02:20:38.179236+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:38.179236+0000","last_undegraded":"2024-04-19T02:20:38.179236+0000","last_fullsized":"2024-04-19T02:20:38.179236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178334+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:38.178334+0000","last_peered":"2024-04-19T02:20:38.178334+0000","last_clean":"2024-04-19T02:20:38.178334+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:38.178334+0000","last_undegraded":"2024-04-19T02:20:38.178334+0000","last_fullsized":"2024-04-19T02:20:38.178334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178541+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:38.178541+0000","last_peered":"2024-04-19T02:20:38.178541+0000","last_clean":"2024-04-19T02:20:38.178541+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:38.178541+0000","last_undegraded":"2024-04-19T02:20:38.178541+0000","last_fullsized":"2024-04-19T02:20:38.178541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":540,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178505+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:38.178505+0000","last_peered":"2024-04-19T02:20:38.178505+0000","last_clean":"2024-04-19T02:20:38.178505+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:38.178505+0000","last_undegraded":"2024-04-19T02:20:38.178505+0000","last_fullsized":"2024-04-19T02:20:38.178505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":544,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177507+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:38.177507+0000","last_peered":"2024-04-19T02:20:38.177507+0000","last_clean":"2024-04-19T02:20:38.177507+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:38.177507+0000","last_undegraded":"2024-04-19T02:20:38.177507+0000","last_fullsized":"2024-04-19T02:20:38.177507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180804+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:38.180804+0000","last_peered":"2024-04-19T02:20:38.180804+0000","last_clean":"2024-04-19T02:20:38.180804+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:38.180804+0000","last_undegraded":"2024-04-19T02:20:38.180804+0000","last_fullsized":"2024-04-19T02:20:38.180804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":496,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181179+0000","last_change":"2024-04-19T02:20:31.666219+0000","last_active":"2024-04-19T02:20:38.181179+0000","last_peered":"2024-04-19T02:20:38.181179+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:20:31.663303+0000","last_became_peered":"2024-04-19T02:20:31.663303+0000","last_unstale":"2024-04-19T02:20:38.181179+0000","last_undegraded":"2024-04-19T02:20:31.509883+0000","last_fullsized":"2024-04-19T02:20:31.499264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:54.685515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180526+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:38.180526+0000","last_peered":"2024-04-19T02:20:38.180526+0000","last_clean":"2024-04-19T02:20:38.180526+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:38.180526+0000","last_undegraded":"2024-04-19T02:20:38.180526+0000","last_fullsized":"2024-04-19T02:20:38.180526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183708+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:38.183708+0000","last_peered":"2024-04-19T02:20:38.183708+0000","last_clean":"2024-04-19T02:20:38.183708+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:38.183708+0000","last_undegraded":"2024-04-19T02:20:38.183708+0000","last_fullsized":"2024-04-19T02:20:38.183708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":581,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181535+0000","last_change":"2024-04-19T02:20:31.663405+0000","last_active":"2024-04-19T02:20:38.181535+0000","last_peered":"2024-04-19T02:20:38.181535+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:20:31.659420+0000","last_became_peered":"2024-04-19T02:20:31.659420+0000","last_unstale":"2024-04-19T02:20:38.181535+0000","last_undegraded":"2024-04-19T02:20:31.528128+0000","last_fullsized":"2024-04-19T02:20:31.503952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180835+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:38.180835+0000","last_peered":"2024-04-19T02:20:38.180835+0000","last_clean":"2024-04-19T02:20:38.180835+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:38.180835+0000","last_undegraded":"2024-04-19T02:20:38.180835+0000","last_fullsized":"2024-04-19T02:20:38.180835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.181129+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:39.181129+0000","last_peered":"2024-04-19T02:20:39.181129+0000","last_clean":"2024-04-19T02:20:39.181129+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:39.181129+0000","last_undegraded":"2024-04-19T02:20:39.181129+0000","last_fullsized":"2024-04-19T02:20:39.181129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":548,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177512+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:38.177512+0000","last_peered":"2024-04-19T02:20:38.177512+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:38.177512+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179152+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:38.179152+0000","last_peered":"2024-04-19T02:20:38.179152+0000","last_clean":"2024-04-19T02:20:38.179152+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:38.179152+0000","last_undegraded":"2024-04-19T02:20:38.179152+0000","last_fullsized":"2024-04-19T02:20:38.179152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183856+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:38.183856+0000","last_peered":"2024-04-19T02:20:38.183856+0000","last_clean":"2024-04-19T02:20:38.183856+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:38.183856+0000","last_undegraded":"2024-04-19T02:20:38.183856+0000","last_fullsized":"2024-04-19T02:20:38.183856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":548,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175370+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:38.175370+0000","last_peered":"2024-04-19T02:20:38.175370+0000","last_clean":"2024-04-19T02:20:38.175370+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:38.175370+0000","last_undegraded":"2024-04-19T02:20:38.175370+0000","last_fullsized":"2024-04-19T02:20:38.175370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":505,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.180572+0000","last_change":"2024-04-19T02:20:31.663417+0000","last_active":"2024-04-19T02:20:38.180572+0000","last_peered":"2024-04-19T02:20:38.180572+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.659358+0000","last_became_peered":"2024-04-19T02:20:31.659358+0000","last_unstale":"2024-04-19T02:20:38.180572+0000","last_undegraded":"2024-04-19T02:20:31.524667+0000","last_fullsized":"2024-04-19T02:20:31.500013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:52.738849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":553,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181771+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:38.181771+0000","last_peered":"2024-04-19T02:20:38.181771+0000","last_clean":"2024-04-19T02:20:38.181771+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:38.181771+0000","last_undegraded":"2024-04-19T02:20:38.181771+0000","last_fullsized":"2024-04-19T02:20:38.181771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":525,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175836+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:38.175836+0000","last_peered":"2024-04-19T02:20:38.175836+0000","last_clean":"2024-04-19T02:20:38.175836+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:38.175836+0000","last_undegraded":"2024-04-19T02:20:38.175836+0000","last_fullsized":"2024-04-19T02:20:38.175836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":186,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183505+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:38.183505+0000","last_peered":"2024-04-19T02:20:38.183505+0000","last_clean":"2024-04-19T02:20:38.183505+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:38.183505+0000","last_undegraded":"2024-04-19T02:20:38.183505+0000","last_fullsized":"2024-04-19T02:20:38.183505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":408,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178541+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:38.178541+0000","last_peered":"2024-04-19T02:20:38.178541+0000","last_clean":"2024-04-19T02:20:38.178541+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:38.178541+0000","last_undegraded":"2024-04-19T02:20:38.178541+0000","last_fullsized":"2024-04-19T02:20:38.178541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":583,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176009+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:38.176009+0000","last_peered":"2024-04-19T02:20:38.176009+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:38.176009+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179817+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:38.179817+0000","last_peered":"2024-04-19T02:20:38.179817+0000","last_clean":"2024-04-19T02:20:38.179817+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:38.179817+0000","last_undegraded":"2024-04-19T02:20:38.179817+0000","last_fullsized":"2024-04-19T02:20:38.179817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":599,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177077+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:38.177077+0000","last_peered":"2024-04-19T02:20:38.177077+0000","last_clean":"2024-04-19T02:20:38.177077+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:38.177077+0000","last_undegraded":"2024-04-19T02:20:38.177077+0000","last_fullsized":"2024-04-19T02:20:38.177077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":882,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-19T02:20:39.183330+0000","last_change":"2024-04-19T02:20:39.183548+0000","last_active":"2024-04-19T02:20:39.183330+0000","last_peered":"2024-04-19T02:20:38.194400+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:20:31.657888+0000","last_became_peered":"2024-04-19T02:20:31.657888+0000","last_unstale":"2024-04-19T02:20:39.183330+0000","last_undegraded":"2024-04-19T02:20:39.183330+0000","last_fullsized":"2024-04-19T02:20:39.183330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:02.577526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":653,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178038+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:38.178038+0000","last_peered":"2024-04-19T02:20:38.178038+0000","last_clean":"2024-04-19T02:20:38.178038+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:38.178038+0000","last_undegraded":"2024-04-19T02:20:38.178038+0000","last_fullsized":"2024-04-19T02:20:38.178038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":759,"reported_epoch":88,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:39.513815+0000","last_change":"2024-04-19T02:20:39.194284+0000","last_active":"2024-04-19T02:20:39.513815+0000","last_peered":"2024-04-19T02:20:39.513815+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:20:31.657854+0000","last_became_peered":"2024-04-19T02:20:31.657854+0000","last_unstale":"2024-04-19T02:20:39.513815+0000","last_undegraded":"2024-04-19T02:20:39.513815+0000","last_fullsized":"2024-04-19T02:20:31.499301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:06.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":431,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176716+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:38.176716+0000","last_peered":"2024-04-19T02:20:38.176716+0000","last_clean":"2024-04-19T02:20:38.176716+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:38.176716+0000","last_undegraded":"2024-04-19T02:20:38.176716+0000","last_fullsized":"2024-04-19T02:20:38.176716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":501,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182587+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:38.182587+0000","last_peered":"2024-04-19T02:20:38.182587+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:38.182587+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":578,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181700+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:38.181700+0000","last_peered":"2024-04-19T02:20:38.181700+0000","last_clean":"2024-04-19T02:20:38.181700+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:38.181700+0000","last_undegraded":"2024-04-19T02:20:38.181700+0000","last_fullsized":"2024-04-19T02:20:38.181700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":520,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182017+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:38.182017+0000","last_peered":"2024-04-19T02:20:38.182017+0000","last_clean":"2024-04-19T02:20:38.182017+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:38.182017+0000","last_undegraded":"2024-04-19T02:20:38.182017+0000","last_fullsized":"2024-04-19T02:20:38.182017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181616+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:38.181616+0000","last_peered":"2024-04-19T02:20:38.181616+0000","last_clean":"2024-04-19T02:20:38.181616+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:38.181616+0000","last_undegraded":"2024-04-19T02:20:38.181616+0000","last_fullsized":"2024-04-19T02:20:38.181616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":470,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176982+0000","last_change":"2024-04-19T02:20:31.665847+0000","last_active":"2024-04-19T02:20:38.176982+0000","last_peered":"2024-04-19T02:20:38.176982+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:38.176982+0000","last_undegraded":"2024-04-19T02:20:31.510138+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":418,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179685+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:38.179685+0000","last_peered":"2024-04-19T02:20:38.179685+0000","last_clean":"2024-04-19T02:20:38.179685+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:38.179685+0000","last_undegraded":"2024-04-19T02:20:38.179685+0000","last_fullsized":"2024-04-19T02:20:38.179685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":499,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176386+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:38.176386+0000","last_peered":"2024-04-19T02:20:38.176386+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:38.176386+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":478,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183251+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:38.183251+0000","last_peered":"2024-04-19T02:20:38.183251+0000","last_clean":"2024-04-19T02:20:38.183251+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:38.183251+0000","last_undegraded":"2024-04-19T02:20:38.183251+0000","last_fullsized":"2024-04-19T02:20:38.183251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":603,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180945+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:38.180945+0000","last_peered":"2024-04-19T02:20:38.180945+0000","last_clean":"2024-04-19T02:20:38.180945+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:38.180945+0000","last_undegraded":"2024-04-19T02:20:38.180945+0000","last_fullsized":"2024-04-19T02:20:38.180945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178903+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:38.178903+0000","last_peered":"2024-04-19T02:20:38.178903+0000","last_clean":"2024-04-19T02:20:38.178903+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:38.178903+0000","last_undegraded":"2024-04-19T02:20:38.178903+0000","last_fullsized":"2024-04-19T02:20:38.178903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":562,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.175986+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:38.175986+0000","last_peered":"2024-04-19T02:20:38.175986+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:38.175986+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179515+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:38.179515+0000","last_peered":"2024-04-19T02:20:38.179515+0000","last_clean":"2024-04-19T02:20:38.179515+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:38.179515+0000","last_undegraded":"2024-04-19T02:20:38.179515+0000","last_fullsized":"2024-04-19T02:20:38.179515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5462,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1629,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738426,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124688,"kb_used_data":27200,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247152,"statfs":{"total":96636764160,"available":96509083648,"internally_reserved":0,"allocated":27852800,"data_stored":81530185,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":78,"seq":335007449091,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47748,"kb_used_data":12024,"kb_used_omap":7,"kb_used_meta":35704,"kb_avail":94324092,"statfs":{"total":96636764160,"available":96587870208,"internally_reserved":0,"allocated":12312576,"data_stored":91803867,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":36561919},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":27856,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":28524544,"data_stored":86147516,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:44.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:45.002 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-19T02:20:44.294123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5462,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1655,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":307688,"kb_used_data":67140,"kb_used_omap":10,"kb_used_meta":240501,"kb_avail":282807832,"statfs":{"total":289910292480,"available":289595219968,"internally_reserved":0,"allocated":68751360,"data_stored":259507018,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":246273931},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001766"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":538,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183155+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:38.183155+0000","last_peered":"2024-04-19T02:20:38.183155+0000","last_clean":"2024-04-19T02:20:38.183155+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:38.183155+0000","last_undegraded":"2024-04-19T02:20:38.183155+0000","last_fullsized":"2024-04-19T02:20:38.183155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":564,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184051+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:38.184051+0000","last_peered":"2024-04-19T02:20:38.184051+0000","last_clean":"2024-04-19T02:20:38.184051+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:38.184051+0000","last_undegraded":"2024-04-19T02:20:38.184051+0000","last_fullsized":"2024-04-19T02:20:38.184051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":487,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182424+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:38.182424+0000","last_peered":"2024-04-19T02:20:38.182424+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:38.182424+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":815,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.191757+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:39.191757+0000","last_peered":"2024-04-19T02:20:39.191757+0000","last_clean":"2024-04-19T02:20:39.191757+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:39.191757+0000","last_undegraded":"2024-04-19T02:20:39.191757+0000","last_fullsized":"2024-04-19T02:20:39.191757+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":512,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181341+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:38.181341+0000","last_peered":"2024-04-19T02:20:38.181341+0000","last_clean":"2024-04-19T02:20:38.181341+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:38.181341+0000","last_undegraded":"2024-04-19T02:20:38.181341+0000","last_fullsized":"2024-04-19T02:20:38.181341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":539,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179927+0000","last_change":"2024-04-19T02:20:31.666551+0000","last_active":"2024-04-19T02:20:38.179927+0000","last_peered":"2024-04-19T02:20:38.179927+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:38.179927+0000","last_undegraded":"2024-04-19T02:20:31.515010+0000","last_fullsized":"2024-04-19T02:20:31.499321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.214784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":898,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175372+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:38.175372+0000","last_peered":"2024-04-19T02:20:38.175372+0000","last_clean":"2024-04-19T02:20:38.175372+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:38.175372+0000","last_undegraded":"2024-04-19T02:20:38.175372+0000","last_fullsized":"2024-04-19T02:20:38.175372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":919,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-19T02:20:39.179309+0000","last_change":"2024-04-19T02:20:39.179808+0000","last_active":"2024-04-19T02:20:39.179309+0000","last_peered":"2024-04-19T02:20:38.672298+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.657980+0000","last_became_peered":"2024-04-19T02:20:31.657980+0000","last_unstale":"2024-04-19T02:20:39.179309+0000","last_undegraded":"2024-04-19T02:20:39.179309+0000","last_fullsized":"2024-04-19T02:20:39.179309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:52.956890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":533,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178625+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:38.178625+0000","last_peered":"2024-04-19T02:20:38.178625+0000","last_clean":"2024-04-19T02:20:38.178625+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:38.178625+0000","last_undegraded":"2024-04-19T02:20:38.178625+0000","last_fullsized":"2024-04-19T02:20:38.178625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":524,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184146+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:38.184146+0000","last_peered":"2024-04-19T02:20:38.184146+0000","last_clean":"2024-04-19T02:20:38.184146+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:38.184146+0000","last_undegraded":"2024-04-19T02:20:38.184146+0000","last_fullsized":"2024-04-19T02:20:38.184146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":461,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177101+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:38.177101+0000","last_peered":"2024-04-19T02:20:38.177101+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:38.177101+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":557,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181817+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:38.181817+0000","last_peered":"2024-04-19T02:20:38.181817+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:38.181817+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":508,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180823+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:38.180823+0000","last_peered":"2024-04-19T02:20:38.180823+0000","last_clean":"2024-04-19T02:20:38.180823+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:38.180823+0000","last_undegraded":"2024-04-19T02:20:38.180823+0000","last_fullsized":"2024-04-19T02:20:38.180823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":511,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.180633+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:38.180633+0000","last_peered":"2024-04-19T02:20:38.180633+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:38.180633+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":897,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180198+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:38.180198+0000","last_peered":"2024-04-19T02:20:38.180198+0000","last_clean":"2024-04-19T02:20:38.180198+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:38.180198+0000","last_undegraded":"2024-04-19T02:20:38.180198+0000","last_fullsized":"2024-04-19T02:20:38.180198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":580,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.175509+0000","last_change":"2024-04-19T02:20:31.664110+0000","last_active":"2024-04-19T02:20:38.175509+0000","last_peered":"2024-04-19T02:20:38.175509+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658002+0000","last_became_peered":"2024-04-19T02:20:31.658002+0000","last_unstale":"2024-04-19T02:20:38.175509+0000","last_undegraded":"2024-04-19T02:20:31.509127+0000","last_fullsized":"2024-04-19T02:20:31.495181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":531,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179801+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:38.179801+0000","last_peered":"2024-04-19T02:20:38.179801+0000","last_clean":"2024-04-19T02:20:38.179801+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:38.179801+0000","last_undegraded":"2024-04-19T02:20:38.179801+0000","last_fullsized":"2024-04-19T02:20:38.179801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":508,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184387+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:38.184387+0000","last_peered":"2024-04-19T02:20:38.184387+0000","last_clean":"2024-04-19T02:20:38.184387+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:38.184387+0000","last_undegraded":"2024-04-19T02:20:38.184387+0000","last_fullsized":"2024-04-19T02:20:38.184387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":619,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177409+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:38.177409+0000","last_peered":"2024-04-19T02:20:38.177409+0000","last_clean":"2024-04-19T02:20:38.177409+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:38.177409+0000","last_undegraded":"2024-04-19T02:20:38.177409+0000","last_fullsized":"2024-04-19T02:20:38.177409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":515,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178120+0000","last_change":"2024-04-19T02:20:31.664482+0000","last_active":"2024-04-19T02:20:38.178120+0000","last_peered":"2024-04-19T02:20:38.178120+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658147+0000","last_became_peered":"2024-04-19T02:20:31.658147+0000","last_unstale":"2024-04-19T02:20:38.178120+0000","last_undegraded":"2024-04-19T02:20:31.527172+0000","last_fullsized":"2024-04-19T02:20:31.514881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":548,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178920+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:38.178920+0000","last_peered":"2024-04-19T02:20:38.178920+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:38.178920+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":688,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181112+0000","last_change":"2024-04-19T02:20:31.672278+0000","last_active":"2024-04-19T02:20:38.181112+0000","last_peered":"2024-04-19T02:20:38.181112+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:38.181112+0000","last_undegraded":"2024-04-19T02:20:31.524382+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":870,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184543+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:38.184543+0000","last_peered":"2024-04-19T02:20:38.184543+0000","last_clean":"2024-04-19T02:20:38.184543+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:38.184543+0000","last_undegraded":"2024-04-19T02:20:38.184543+0000","last_fullsized":"2024-04-19T02:20:38.184543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":539,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179912+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:38.179912+0000","last_peered":"2024-04-19T02:20:38.179912+0000","last_clean":"2024-04-19T02:20:38.179912+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:38.179912+0000","last_undegraded":"2024-04-19T02:20:38.179912+0000","last_fullsized":"2024-04-19T02:20:38.179912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":526,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183256+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:38.183256+0000","last_peered":"2024-04-19T02:20:38.183256+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:38.183256+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":706,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.178438+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:38.178438+0000","last_peered":"2024-04-19T02:20:38.178438+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:38.178438+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":559,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183573+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:38.183573+0000","last_peered":"2024-04-19T02:20:38.183573+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:38.183573+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":786,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182235+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:38.182235+0000","last_peered":"2024-04-19T02:20:38.182235+0000","last_clean":"2024-04-19T02:20:38.182235+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:38.182235+0000","last_undegraded":"2024-04-19T02:20:38.182235+0000","last_fullsized":"2024-04-19T02:20:38.182235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":510,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178285+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:38.178285+0000","last_peered":"2024-04-19T02:20:38.178285+0000","last_clean":"2024-04-19T02:20:38.178285+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:38.178285+0000","last_undegraded":"2024-04-19T02:20:38.178285+0000","last_fullsized":"2024-04-19T02:20:38.178285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":624,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181759+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:38.181759+0000","last_peered":"2024-04-19T02:20:38.181759+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:38.181759+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":587,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175663+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:38.175663+0000","last_peered":"2024-04-19T02:20:38.175663+0000","last_clean":"2024-04-19T02:20:38.175663+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:38.175663+0000","last_undegraded":"2024-04-19T02:20:38.175663+0000","last_fullsized":"2024-04-19T02:20:38.175663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":528,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176230+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:38.176230+0000","last_peered":"2024-04-19T02:20:38.176230+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:38.176230+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":468,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182060+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:38.182060+0000","last_peered":"2024-04-19T02:20:38.182060+0000","last_clean":"2024-04-19T02:20:38.182060+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:38.182060+0000","last_undegraded":"2024-04-19T02:20:38.182060+0000","last_fullsized":"2024-04-19T02:20:38.182060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":475,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178578+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:38.178578+0000","last_peered":"2024-04-19T02:20:38.178578+0000","last_clean":"2024-04-19T02:20:38.178578+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:38.178578+0000","last_undegraded":"2024-04-19T02:20:38.178578+0000","last_fullsized":"2024-04-19T02:20:38.178578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":517,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183076+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:38.183076+0000","last_peered":"2024-04-19T02:20:38.183076+0000","last_clean":"2024-04-19T02:20:38.183076+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:38.183076+0000","last_undegraded":"2024-04-19T02:20:38.183076+0000","last_fullsized":"2024-04-19T02:20:38.183076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176420+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:38.176420+0000","last_peered":"2024-04-19T02:20:38.176420+0000","last_clean":"2024-04-19T02:20:38.176420+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:38.176420+0000","last_undegraded":"2024-04-19T02:20:38.176420+0000","last_fullsized":"2024-04-19T02:20:38.176420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":601,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179083+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:38.179083+0000","last_peered":"2024-04-19T02:20:38.179083+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:38.179083+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":164,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181815+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:38.181815+0000","last_peered":"2024-04-19T02:20:38.181815+0000","last_clean":"2024-04-19T02:20:38.181815+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:38.181815+0000","last_undegraded":"2024-04-19T02:20:38.181815+0000","last_fullsized":"2024-04-19T02:20:38.181815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":536,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.179213+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:38.179213+0000","last_peered":"2024-04-19T02:20:38.179213+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:38.179213+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180195+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:38.180195+0000","last_peered":"2024-04-19T02:20:38.180195+0000","last_clean":"2024-04-19T02:20:38.180195+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:38.180195+0000","last_undegraded":"2024-04-19T02:20:38.180195+0000","last_fullsized":"2024-04-19T02:20:38.180195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":261,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183872+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:38.183872+0000","last_peered":"2024-04-19T02:20:38.183872+0000","last_clean":"2024-04-19T02:20:38.183872+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:38.183872+0000","last_undegraded":"2024-04-19T02:20:38.183872+0000","last_fullsized":"2024-04-19T02:20:38.183872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":857,"reported_epoch":88,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:39.189777+0000","last_change":"2024-04-19T02:20:39.190185+0000","last_active":"2024-04-19T02:20:39.189777+0000","last_peered":"2024-04-19T02:20:39.189777+0000","last_clean":"2024-04-19T02:17:09.443797+0000","last_became_active":"2024-04-19T02:20:31.657714+0000","last_became_peered":"2024-04-19T02:20:31.657714+0000","last_unstale":"2024-04-19T02:20:39.189777+0000","last_undegraded":"2024-04-19T02:20:39.189777+0000","last_fullsized":"2024-04-19T02:20:31.499247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:39.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":400,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184621+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:38.184621+0000","last_peered":"2024-04-19T02:20:38.184621+0000","last_clean":"2024-04-19T02:20:38.184621+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:38.184621+0000","last_undegraded":"2024-04-19T02:20:38.184621+0000","last_fullsized":"2024-04-19T02:20:38.184621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":537,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180376+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:38.180376+0000","last_peered":"2024-04-19T02:20:38.180376+0000","last_clean":"2024-04-19T02:20:38.180376+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:38.180376+0000","last_undegraded":"2024-04-19T02:20:38.180376+0000","last_fullsized":"2024-04-19T02:20:38.180376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":690,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182990+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:38.182990+0000","last_peered":"2024-04-19T02:20:38.182990+0000","last_clean":"2024-04-19T02:20:38.182990+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:38.182990+0000","last_undegraded":"2024-04-19T02:20:38.182990+0000","last_fullsized":"2024-04-19T02:20:38.182990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":495,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176767+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:38.176767+0000","last_peered":"2024-04-19T02:20:38.176767+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:38.176767+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178773+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:38.178773+0000","last_peered":"2024-04-19T02:20:38.178773+0000","last_clean":"2024-04-19T02:20:38.178773+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:38.178773+0000","last_undegraded":"2024-04-19T02:20:38.178773+0000","last_fullsized":"2024-04-19T02:20:38.178773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":652,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177856+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:38.177856+0000","last_peered":"2024-04-19T02:20:38.177856+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:38.177856+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":240,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178919+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:38.178919+0000","last_peered":"2024-04-19T02:20:38.178919+0000","last_clean":"2024-04-19T02:20:38.178919+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:38.178919+0000","last_undegraded":"2024-04-19T02:20:38.178919+0000","last_fullsized":"2024-04-19T02:20:38.178919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":535,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177649+0000","last_change":"2024-04-19T02:20:31.664858+0000","last_active":"2024-04-19T02:20:38.177649+0000","last_peered":"2024-04-19T02:20:38.177649+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.658577+0000","last_became_peered":"2024-04-19T02:20:31.658577+0000","last_unstale":"2024-04-19T02:20:38.177649+0000","last_undegraded":"2024-04-19T02:20:31.520194+0000","last_fullsized":"2024-04-19T02:20:31.497338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:24.362286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":291,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176105+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:38.176105+0000","last_peered":"2024-04-19T02:20:38.176105+0000","last_clean":"2024-04-19T02:20:38.176105+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:38.176105+0000","last_undegraded":"2024-04-19T02:20:38.176105+0000","last_fullsized":"2024-04-19T02:20:38.176105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":587,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.183314+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:38.183314+0000","last_peered":"2024-04-19T02:20:38.183314+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:38.183314+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180687+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:38.180687+0000","last_peered":"2024-04-19T02:20:38.180687+0000","last_clean":"2024-04-19T02:20:38.180687+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:38.180687+0000","last_undegraded":"2024-04-19T02:20:38.180687+0000","last_fullsized":"2024-04-19T02:20:38.180687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":792,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.191148+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:39.191148+0000","last_peered":"2024-04-19T02:20:39.191148+0000","last_clean":"2024-04-19T02:20:39.191148+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:39.191148+0000","last_undegraded":"2024-04-19T02:20:39.191148+0000","last_fullsized":"2024-04-19T02:20:39.191148+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":472,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180461+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:38.180461+0000","last_peered":"2024-04-19T02:20:38.180461+0000","last_clean":"2024-04-19T02:20:38.180461+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:38.180461+0000","last_undegraded":"2024-04-19T02:20:38.180461+0000","last_fullsized":"2024-04-19T02:20:38.180461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":501,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178939+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:38.178939+0000","last_peered":"2024-04-19T02:20:38.178939+0000","last_clean":"2024-04-19T02:20:38.178939+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:38.178939+0000","last_undegraded":"2024-04-19T02:20:38.178939+0000","last_fullsized":"2024-04-19T02:20:38.178939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":276,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180971+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:38.180971+0000","last_peered":"2024-04-19T02:20:38.180971+0000","last_clean":"2024-04-19T02:20:38.180971+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:38.180971+0000","last_undegraded":"2024-04-19T02:20:38.180971+0000","last_fullsized":"2024-04-19T02:20:38.180971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179199+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:38.179199+0000","last_peered":"2024-04-19T02:20:38.179199+0000","last_clean":"2024-04-19T02:20:38.179199+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:38.179199+0000","last_undegraded":"2024-04-19T02:20:38.179199+0000","last_fullsized":"2024-04-19T02:20:38.179199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":844,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176883+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:38.176883+0000","last_peered":"2024-04-19T02:20:38.176883+0000","last_clean":"2024-04-19T02:20:38.176883+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:38.176883+0000","last_undegraded":"2024-04-19T02:20:38.176883+0000","last_fullsized":"2024-04-19T02:20:38.176883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":572,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182803+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:38.182803+0000","last_peered":"2024-04-19T02:20:38.182803+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:38.182803+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180695+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:38.180695+0000","last_peered":"2024-04-19T02:20:38.180695+0000","last_clean":"2024-04-19T02:20:38.180695+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:38.180695+0000","last_undegraded":"2024-04-19T02:20:38.180695+0000","last_fullsized":"2024-04-19T02:20:38.180695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":281,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176858+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:38.176858+0000","last_peered":"2024-04-19T02:20:38.176858+0000","last_clean":"2024-04-19T02:20:38.176858+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:38.176858+0000","last_undegraded":"2024-04-19T02:20:38.176858+0000","last_fullsized":"2024-04-19T02:20:38.176858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":526,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.184462+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:38.184462+0000","last_peered":"2024-04-19T02:20:38.184462+0000","last_clean":"2024-04-19T02:20:38.184462+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:38.184462+0000","last_undegraded":"2024-04-19T02:20:38.184462+0000","last_fullsized":"2024-04-19T02:20:38.184462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177114+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:38.177114+0000","last_peered":"2024-04-19T02:20:38.177114+0000","last_clean":"2024-04-19T02:20:38.177114+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:38.177114+0000","last_undegraded":"2024-04-19T02:20:38.177114+0000","last_fullsized":"2024-04-19T02:20:38.177114+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":494,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180647+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:38.180647+0000","last_peered":"2024-04-19T02:20:38.180647+0000","last_clean":"2024-04-19T02:20:38.180647+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:38.180647+0000","last_undegraded":"2024-04-19T02:20:38.180647+0000","last_fullsized":"2024-04-19T02:20:38.180647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":438,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179236+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:38.179236+0000","last_peered":"2024-04-19T02:20:38.179236+0000","last_clean":"2024-04-19T02:20:38.179236+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:38.179236+0000","last_undegraded":"2024-04-19T02:20:38.179236+0000","last_fullsized":"2024-04-19T02:20:38.179236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178334+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:38.178334+0000","last_peered":"2024-04-19T02:20:38.178334+0000","last_clean":"2024-04-19T02:20:38.178334+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:38.178334+0000","last_undegraded":"2024-04-19T02:20:38.178334+0000","last_fullsized":"2024-04-19T02:20:38.178334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178541+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:38.178541+0000","last_peered":"2024-04-19T02:20:38.178541+0000","last_clean":"2024-04-19T02:20:38.178541+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:38.178541+0000","last_undegraded":"2024-04-19T02:20:38.178541+0000","last_fullsized":"2024-04-19T02:20:38.178541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":540,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178505+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:38.178505+0000","last_peered":"2024-04-19T02:20:38.178505+0000","last_clean":"2024-04-19T02:20:38.178505+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:38.178505+0000","last_undegraded":"2024-04-19T02:20:38.178505+0000","last_fullsized":"2024-04-19T02:20:38.178505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":544,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177507+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:38.177507+0000","last_peered":"2024-04-19T02:20:38.177507+0000","last_clean":"2024-04-19T02:20:38.177507+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:38.177507+0000","last_undegraded":"2024-04-19T02:20:38.177507+0000","last_fullsized":"2024-04-19T02:20:38.177507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180804+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:38.180804+0000","last_peered":"2024-04-19T02:20:38.180804+0000","last_clean":"2024-04-19T02:20:38.180804+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:38.180804+0000","last_undegraded":"2024-04-19T02:20:38.180804+0000","last_fullsized":"2024-04-19T02:20:38.180804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":496,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181179+0000","last_change":"2024-04-19T02:20:31.666219+0000","last_active":"2024-04-19T02:20:38.181179+0000","last_peered":"2024-04-19T02:20:38.181179+0000","last_clean":"2024-04-19T02:17:09.444505+0000","last_became_active":"2024-04-19T02:20:31.663303+0000","last_became_peered":"2024-04-19T02:20:31.663303+0000","last_unstale":"2024-04-19T02:20:38.181179+0000","last_undegraded":"2024-04-19T02:20:31.509883+0000","last_fullsized":"2024-04-19T02:20:31.499264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:54.685515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180526+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:38.180526+0000","last_peered":"2024-04-19T02:20:38.180526+0000","last_clean":"2024-04-19T02:20:38.180526+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:38.180526+0000","last_undegraded":"2024-04-19T02:20:38.180526+0000","last_fullsized":"2024-04-19T02:20:38.180526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183708+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:38.183708+0000","last_peered":"2024-04-19T02:20:38.183708+0000","last_clean":"2024-04-19T02:20:38.183708+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:38.183708+0000","last_undegraded":"2024-04-19T02:20:38.183708+0000","last_fullsized":"2024-04-19T02:20:38.183708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":581,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.181535+0000","last_change":"2024-04-19T02:20:31.663405+0000","last_active":"2024-04-19T02:20:38.181535+0000","last_peered":"2024-04-19T02:20:38.181535+0000","last_clean":"2024-04-19T02:17:09.444817+0000","last_became_active":"2024-04-19T02:20:31.659420+0000","last_became_peered":"2024-04-19T02:20:31.659420+0000","last_unstale":"2024-04-19T02:20:38.181535+0000","last_undegraded":"2024-04-19T02:20:31.528128+0000","last_fullsized":"2024-04-19T02:20:31.503952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180835+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:38.180835+0000","last_peered":"2024-04-19T02:20:38.180835+0000","last_clean":"2024-04-19T02:20:38.180835+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:38.180835+0000","last_undegraded":"2024-04-19T02:20:38.180835+0000","last_fullsized":"2024-04-19T02:20:38.180835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.181129+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:39.181129+0000","last_peered":"2024-04-19T02:20:39.181129+0000","last_clean":"2024-04-19T02:20:39.181129+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:39.181129+0000","last_undegraded":"2024-04-19T02:20:39.181129+0000","last_fullsized":"2024-04-19T02:20:39.181129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":548,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.177512+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:38.177512+0000","last_peered":"2024-04-19T02:20:38.177512+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:38.177512+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179152+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:38.179152+0000","last_peered":"2024-04-19T02:20:38.179152+0000","last_clean":"2024-04-19T02:20:38.179152+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:38.179152+0000","last_undegraded":"2024-04-19T02:20:38.179152+0000","last_fullsized":"2024-04-19T02:20:38.179152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183856+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:38.183856+0000","last_peered":"2024-04-19T02:20:38.183856+0000","last_clean":"2024-04-19T02:20:38.183856+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:38.183856+0000","last_undegraded":"2024-04-19T02:20:38.183856+0000","last_fullsized":"2024-04-19T02:20:38.183856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":548,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175370+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:38.175370+0000","last_peered":"2024-04-19T02:20:38.175370+0000","last_clean":"2024-04-19T02:20:38.175370+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:38.175370+0000","last_undegraded":"2024-04-19T02:20:38.175370+0000","last_fullsized":"2024-04-19T02:20:38.175370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":505,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.180572+0000","last_change":"2024-04-19T02:20:31.663417+0000","last_active":"2024-04-19T02:20:38.180572+0000","last_peered":"2024-04-19T02:20:38.180572+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.659358+0000","last_became_peered":"2024-04-19T02:20:31.659358+0000","last_unstale":"2024-04-19T02:20:38.180572+0000","last_undegraded":"2024-04-19T02:20:31.524667+0000","last_fullsized":"2024-04-19T02:20:31.500013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:52.738849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":553,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181771+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:38.181771+0000","last_peered":"2024-04-19T02:20:38.181771+0000","last_clean":"2024-04-19T02:20:38.181771+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:38.181771+0000","last_undegraded":"2024-04-19T02:20:38.181771+0000","last_fullsized":"2024-04-19T02:20:38.181771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":525,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.175836+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:38.175836+0000","last_peered":"2024-04-19T02:20:38.175836+0000","last_clean":"2024-04-19T02:20:38.175836+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:38.175836+0000","last_undegraded":"2024-04-19T02:20:38.175836+0000","last_fullsized":"2024-04-19T02:20:38.175836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":186,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183505+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:38.183505+0000","last_peered":"2024-04-19T02:20:38.183505+0000","last_clean":"2024-04-19T02:20:38.183505+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:38.183505+0000","last_undegraded":"2024-04-19T02:20:38.183505+0000","last_fullsized":"2024-04-19T02:20:38.183505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":408,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178541+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:38.178541+0000","last_peered":"2024-04-19T02:20:38.178541+0000","last_clean":"2024-04-19T02:20:38.178541+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:38.178541+0000","last_undegraded":"2024-04-19T02:20:38.178541+0000","last_fullsized":"2024-04-19T02:20:38.178541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":583,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176009+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:38.176009+0000","last_peered":"2024-04-19T02:20:38.176009+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:38.176009+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179817+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:38.179817+0000","last_peered":"2024-04-19T02:20:38.179817+0000","last_clean":"2024-04-19T02:20:38.179817+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:38.179817+0000","last_undegraded":"2024-04-19T02:20:38.179817+0000","last_fullsized":"2024-04-19T02:20:38.179817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":599,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.177077+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:38.177077+0000","last_peered":"2024-04-19T02:20:38.177077+0000","last_clean":"2024-04-19T02:20:38.177077+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:38.177077+0000","last_undegraded":"2024-04-19T02:20:38.177077+0000","last_fullsized":"2024-04-19T02:20:38.177077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":882,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-19T02:20:39.183330+0000","last_change":"2024-04-19T02:20:39.183548+0000","last_active":"2024-04-19T02:20:39.183330+0000","last_peered":"2024-04-19T02:20:38.194400+0000","last_clean":"2024-04-19T02:17:09.445515+0000","last_became_active":"2024-04-19T02:20:31.657888+0000","last_became_peered":"2024-04-19T02:20:31.657888+0000","last_unstale":"2024-04-19T02:20:39.183330+0000","last_undegraded":"2024-04-19T02:20:39.183330+0000","last_fullsized":"2024-04-19T02:20:39.183330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:02.577526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":653,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178038+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:38.178038+0000","last_peered":"2024-04-19T02:20:38.178038+0000","last_clean":"2024-04-19T02:20:38.178038+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:38.178038+0000","last_undegraded":"2024-04-19T02:20:38.178038+0000","last_fullsized":"2024-04-19T02:20:38.178038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":759,"reported_epoch":88,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:39.513815+0000","last_change":"2024-04-19T02:20:39.194284+0000","last_active":"2024-04-19T02:20:39.513815+0000","last_peered":"2024-04-19T02:20:39.513815+0000","last_clean":"2024-04-19T02:17:07.002821+0000","last_became_active":"2024-04-19T02:20:31.657854+0000","last_became_peered":"2024-04-19T02:20:31.657854+0000","last_unstale":"2024-04-19T02:20:39.513815+0000","last_undegraded":"2024-04-19T02:20:39.513815+0000","last_fullsized":"2024-04-19T02:20:31.499301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:06.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":431,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.176716+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:38.176716+0000","last_peered":"2024-04-19T02:20:38.176716+0000","last_clean":"2024-04-19T02:20:38.176716+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:38.176716+0000","last_undegraded":"2024-04-19T02:20:38.176716+0000","last_fullsized":"2024-04-19T02:20:38.176716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":501,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.182587+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:38.182587+0000","last_peered":"2024-04-19T02:20:38.182587+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:38.182587+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":578,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181700+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:38.181700+0000","last_peered":"2024-04-19T02:20:38.181700+0000","last_clean":"2024-04-19T02:20:38.181700+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:38.181700+0000","last_undegraded":"2024-04-19T02:20:38.181700+0000","last_fullsized":"2024-04-19T02:20:38.181700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":520,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.182017+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:38.182017+0000","last_peered":"2024-04-19T02:20:38.182017+0000","last_clean":"2024-04-19T02:20:38.182017+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:38.182017+0000","last_undegraded":"2024-04-19T02:20:38.182017+0000","last_fullsized":"2024-04-19T02:20:38.182017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.181616+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:38.181616+0000","last_peered":"2024-04-19T02:20:38.181616+0000","last_clean":"2024-04-19T02:20:38.181616+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:38.181616+0000","last_undegraded":"2024-04-19T02:20:38.181616+0000","last_fullsized":"2024-04-19T02:20:38.181616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":470,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176982+0000","last_change":"2024-04-19T02:20:31.665847+0000","last_active":"2024-04-19T02:20:38.176982+0000","last_peered":"2024-04-19T02:20:38.176982+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:38.176982+0000","last_undegraded":"2024-04-19T02:20:31.510138+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":418,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179685+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:38.179685+0000","last_peered":"2024-04-19T02:20:38.179685+0000","last_clean":"2024-04-19T02:20:38.179685+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:38.179685+0000","last_undegraded":"2024-04-19T02:20:38.179685+0000","last_fullsized":"2024-04-19T02:20:38.179685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":499,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.176386+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:38.176386+0000","last_peered":"2024-04-19T02:20:38.176386+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:38.176386+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":478,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.183251+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:38.183251+0000","last_peered":"2024-04-19T02:20:38.183251+0000","last_clean":"2024-04-19T02:20:38.183251+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:38.183251+0000","last_undegraded":"2024-04-19T02:20:38.183251+0000","last_fullsized":"2024-04-19T02:20:38.183251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":603,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.180945+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:38.180945+0000","last_peered":"2024-04-19T02:20:38.180945+0000","last_clean":"2024-04-19T02:20:38.180945+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:38.180945+0000","last_undegraded":"2024-04-19T02:20:38.180945+0000","last_fullsized":"2024-04-19T02:20:38.180945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.178903+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:38.178903+0000","last_peered":"2024-04-19T02:20:38.178903+0000","last_clean":"2024-04-19T02:20:38.178903+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:38.178903+0000","last_undegraded":"2024-04-19T02:20:38.178903+0000","last_fullsized":"2024-04-19T02:20:38.178903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":562,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:38.175986+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:38.175986+0000","last_peered":"2024-04-19T02:20:38.175986+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:38.175986+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T02:20:38.179515+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:38.179515+0000","last_peered":"2024-04-19T02:20:38.179515+0000","last_clean":"2024-04-19T02:20:38.179515+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:38.179515+0000","last_undegraded":"2024-04-19T02:20:38.179515+0000","last_fullsized":"2024-04-19T02:20:38.179515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5462,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1629,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738426,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124688,"kb_used_data":27200,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247152,"statfs":{"total":96636764160,"available":96509083648,"internally_reserved":0,"allocated":27852800,"data_stored":81530185,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":78,"seq":335007449092,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43708,"kb_used_data":12084,"kb_used_omap":7,"kb_used_meta":31608,"kb_avail":94328132,"statfs":{"total":96636764160,"available":96592007168,"internally_reserved":0,"allocated":12374016,"data_stored":91829317,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":32367615},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":27856,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":28524544,"data_stored":86147516,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:45.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:20:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:45.393 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 5462/110 objects degraded (4965.455%), 30 pgs degraded","count":30},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":282,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":94,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":21},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":71},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":30},{"state_name":"peering","count":2},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":315072512,"bytes_avail":289595219968,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":5462,"degraded_total":110,"degraded_ratio":49.654545454545456},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:20:45.410 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-19T02:20:45.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:45.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:45.720 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:45.736 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-04-19T02:20:45.189356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3205,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":187,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":307812,"kb_used_data":67260,"kb_used_omap":10,"kb_used_meta":240501,"kb_avail":282807708,"statfs":{"total":289910292480,"available":289595092992,"internally_reserved":0,"allocated":68874240,"data_stored":259557172,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":246273931},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1631,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1550,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003375"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":543,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186569+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:43.186569+0000","last_peered":"2024-04-19T02:20:43.186569+0000","last_clean":"2024-04-19T02:20:43.186569+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:43.186569+0000","last_undegraded":"2024-04-19T02:20:43.186569+0000","last_fullsized":"2024-04-19T02:20:43.186569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":569,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185924+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:43.185924+0000","last_peered":"2024-04-19T02:20:43.185924+0000","last_clean":"2024-04-19T02:20:43.185924+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:43.185924+0000","last_undegraded":"2024-04-19T02:20:43.185924+0000","last_fullsized":"2024-04-19T02:20:43.185924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":492,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184503+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:43.184503+0000","last_peered":"2024-04-19T02:20:43.184503+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:43.184503+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":820,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184888+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:43.184888+0000","last_peered":"2024-04-19T02:20:43.184888+0000","last_clean":"2024-04-19T02:20:43.184888+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:43.184888+0000","last_undegraded":"2024-04-19T02:20:43.184888+0000","last_fullsized":"2024-04-19T02:20:43.184888+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":517,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184194+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:43.184194+0000","last_peered":"2024-04-19T02:20:43.184194+0000","last_clean":"2024-04-19T02:20:43.184194+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:43.184194+0000","last_undegraded":"2024-04-19T02:20:43.184194+0000","last_fullsized":"2024-04-19T02:20:43.184194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":907,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-19T02:20:44.186686+0000","last_change":"2024-04-19T02:20:44.187055+0000","last_active":"2024-04-19T02:20:44.186686+0000","last_peered":"2024-04-19T02:20:43.668135+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:44.186686+0000","last_undegraded":"2024-04-19T02:20:44.186686+0000","last_fullsized":"2024-04-19T02:20:44.186686+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:58:38.325301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":903,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182472+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:43.182472+0000","last_peered":"2024-04-19T02:20:43.182472+0000","last_clean":"2024-04-19T02:20:43.182472+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:43.182472+0000","last_undegraded":"2024-04-19T02:20:43.182472+0000","last_fullsized":"2024-04-19T02:20:43.182472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":931,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182597+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:43.182597+0000","last_peered":"2024-04-19T02:20:43.182597+0000","last_clean":"2024-04-19T02:20:43.182597+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:43.182597+0000","last_undegraded":"2024-04-19T02:20:43.182597+0000","last_fullsized":"2024-04-19T02:20:43.182597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":538,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184972+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:43.184972+0000","last_peered":"2024-04-19T02:20:43.184972+0000","last_clean":"2024-04-19T02:20:43.184972+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:43.184972+0000","last_undegraded":"2024-04-19T02:20:43.184972+0000","last_fullsized":"2024-04-19T02:20:43.184972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":529,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186188+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:43.186188+0000","last_peered":"2024-04-19T02:20:43.186188+0000","last_clean":"2024-04-19T02:20:43.186188+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:43.186188+0000","last_undegraded":"2024-04-19T02:20:43.186188+0000","last_fullsized":"2024-04-19T02:20:43.186188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":466,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184080+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:43.184080+0000","last_peered":"2024-04-19T02:20:43.184080+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:43.184080+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":562,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184288+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:43.184288+0000","last_peered":"2024-04-19T02:20:43.184288+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:43.184288+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":513,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183623+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:43.183623+0000","last_peered":"2024-04-19T02:20:43.183623+0000","last_clean":"2024-04-19T02:20:43.183623+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:43.183623+0000","last_undegraded":"2024-04-19T02:20:43.183623+0000","last_fullsized":"2024-04-19T02:20:43.183623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":516,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184149+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:43.184149+0000","last_peered":"2024-04-19T02:20:43.184149+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:43.184149+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":902,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183004+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:43.183004+0000","last_peered":"2024-04-19T02:20:43.183004+0000","last_clean":"2024-04-19T02:20:43.183004+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:43.183004+0000","last_undegraded":"2024-04-19T02:20:43.183004+0000","last_fullsized":"2024-04-19T02:20:43.183004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":985,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182356+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:43.182356+0000","last_peered":"2024-04-19T02:20:43.182356+0000","last_clean":"2024-04-19T02:20:43.182356+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:43.182356+0000","last_undegraded":"2024-04-19T02:20:43.182356+0000","last_fullsized":"2024-04-19T02:20:43.182356+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":536,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186001+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:43.186001+0000","last_peered":"2024-04-19T02:20:43.186001+0000","last_clean":"2024-04-19T02:20:43.186001+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:43.186001+0000","last_undegraded":"2024-04-19T02:20:43.186001+0000","last_fullsized":"2024-04-19T02:20:43.186001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":513,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186651+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:43.186651+0000","last_peered":"2024-04-19T02:20:43.186651+0000","last_clean":"2024-04-19T02:20:43.186651+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:43.186651+0000","last_undegraded":"2024-04-19T02:20:43.186651+0000","last_fullsized":"2024-04-19T02:20:43.186651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":624,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184181+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:43.184181+0000","last_peered":"2024-04-19T02:20:43.184181+0000","last_clean":"2024-04-19T02:20:43.184181+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:43.184181+0000","last_undegraded":"2024-04-19T02:20:43.184181+0000","last_fullsized":"2024-04-19T02:20:43.184181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":914,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.200907+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:43.200907+0000","last_peered":"2024-04-19T02:20:43.200907+0000","last_clean":"2024-04-19T02:20:43.200907+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:43.200907+0000","last_undegraded":"2024-04-19T02:20:43.200907+0000","last_fullsized":"2024-04-19T02:20:43.200907+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":553,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185401+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:43.185401+0000","last_peered":"2024-04-19T02:20:43.185401+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:43.185401+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":780,"reported_epoch":93,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:44.430218+0000","last_change":"2024-04-19T02:20:44.278125+0000","last_active":"2024-04-19T02:20:44.430218+0000","last_peered":"2024-04-19T02:20:44.430218+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:44.430218+0000","last_undegraded":"2024-04-19T02:20:44.430218+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":875,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182751+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:43.182751+0000","last_peered":"2024-04-19T02:20:43.182751+0000","last_clean":"2024-04-19T02:20:43.182751+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:43.182751+0000","last_undegraded":"2024-04-19T02:20:43.182751+0000","last_fullsized":"2024-04-19T02:20:43.182751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":545,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.185637+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:44.185637+0000","last_peered":"2024-04-19T02:20:44.185637+0000","last_clean":"2024-04-19T02:20:44.185637+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:44.185637+0000","last_undegraded":"2024-04-19T02:20:44.185637+0000","last_fullsized":"2024-04-19T02:20:44.185637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":532,"reported_epoch":93,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:44.189552+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:44.189552+0000","last_peered":"2024-04-19T02:20:44.189552+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:44.189552+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":712,"reported_epoch":93,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:44.182351+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:44.182351+0000","last_peered":"2024-04-19T02:20:44.182351+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:44.182351+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":564,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.186692+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:43.186692+0000","last_peered":"2024-04-19T02:20:43.186692+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:43.186692+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":792,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.188045+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:44.188045+0000","last_peered":"2024-04-19T02:20:44.188045+0000","last_clean":"2024-04-19T02:20:44.188045+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:44.188045+0000","last_undegraded":"2024-04-19T02:20:44.188045+0000","last_fullsized":"2024-04-19T02:20:44.188045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":515,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185239+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:43.185239+0000","last_peered":"2024-04-19T02:20:43.185239+0000","last_clean":"2024-04-19T02:20:43.185239+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:43.185239+0000","last_undegraded":"2024-04-19T02:20:43.185239+0000","last_fullsized":"2024-04-19T02:20:43.185239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":629,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185434+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:43.185434+0000","last_peered":"2024-04-19T02:20:43.185434+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:43.185434+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":592,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182755+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:43.182755+0000","last_peered":"2024-04-19T02:20:43.182755+0000","last_clean":"2024-04-19T02:20:43.182755+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:43.182755+0000","last_undegraded":"2024-04-19T02:20:43.182755+0000","last_fullsized":"2024-04-19T02:20:43.182755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":533,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.182936+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:43.182936+0000","last_peered":"2024-04-19T02:20:43.182936+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:43.182936+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":473,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184763+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:43.184763+0000","last_peered":"2024-04-19T02:20:43.184763+0000","last_clean":"2024-04-19T02:20:43.184763+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:43.184763+0000","last_undegraded":"2024-04-19T02:20:43.184763+0000","last_fullsized":"2024-04-19T02:20:43.184763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":480,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184666+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:43.184666+0000","last_peered":"2024-04-19T02:20:43.184666+0000","last_clean":"2024-04-19T02:20:43.184666+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:43.184666+0000","last_undegraded":"2024-04-19T02:20:43.184666+0000","last_fullsized":"2024-04-19T02:20:43.184666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":522,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186029+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:43.186029+0000","last_peered":"2024-04-19T02:20:43.186029+0000","last_clean":"2024-04-19T02:20:43.186029+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:43.186029+0000","last_undegraded":"2024-04-19T02:20:43.186029+0000","last_fullsized":"2024-04-19T02:20:43.186029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183698+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:43.183698+0000","last_peered":"2024-04-19T02:20:43.183698+0000","last_clean":"2024-04-19T02:20:43.183698+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:43.183698+0000","last_undegraded":"2024-04-19T02:20:43.183698+0000","last_fullsized":"2024-04-19T02:20:43.183698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":606,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185607+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:43.185607+0000","last_peered":"2024-04-19T02:20:43.185607+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:43.185607+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183493+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:43.183493+0000","last_peered":"2024-04-19T02:20:43.183493+0000","last_clean":"2024-04-19T02:20:43.183493+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:43.183493+0000","last_undegraded":"2024-04-19T02:20:43.183493+0000","last_fullsized":"2024-04-19T02:20:43.183493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":541,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185127+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:43.185127+0000","last_peered":"2024-04-19T02:20:43.185127+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:43.185127+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":142,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183024+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:43.183024+0000","last_peered":"2024-04-19T02:20:43.183024+0000","last_clean":"2024-04-19T02:20:43.183024+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:43.183024+0000","last_undegraded":"2024-04-19T02:20:43.183024+0000","last_fullsized":"2024-04-19T02:20:43.183024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":266,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187827+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:43.187827+0000","last_peered":"2024-04-19T02:20:43.187827+0000","last_clean":"2024-04-19T02:20:43.187827+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:43.187827+0000","last_undegraded":"2024-04-19T02:20:43.187827+0000","last_fullsized":"2024-04-19T02:20:43.187827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":871,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.185808+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:44.185808+0000","last_peered":"2024-04-19T02:20:44.185808+0000","last_clean":"2024-04-19T02:20:44.185808+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:44.185808+0000","last_undegraded":"2024-04-19T02:20:44.185808+0000","last_fullsized":"2024-04-19T02:20:44.185808+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":405,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187198+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:43.187198+0000","last_peered":"2024-04-19T02:20:43.187198+0000","last_clean":"2024-04-19T02:20:43.187198+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:43.187198+0000","last_undegraded":"2024-04-19T02:20:43.187198+0000","last_fullsized":"2024-04-19T02:20:43.187198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":543,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186022+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:44.186022+0000","last_peered":"2024-04-19T02:20:44.186022+0000","last_clean":"2024-04-19T02:20:44.186022+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:44.186022+0000","last_undegraded":"2024-04-19T02:20:44.186022+0000","last_fullsized":"2024-04-19T02:20:44.186022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185770+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:43.185770+0000","last_peered":"2024-04-19T02:20:43.185770+0000","last_clean":"2024-04-19T02:20:43.185770+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:43.185770+0000","last_undegraded":"2024-04-19T02:20:43.185770+0000","last_fullsized":"2024-04-19T02:20:43.185770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":500,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184002+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:43.184002+0000","last_peered":"2024-04-19T02:20:43.184002+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:43.184002+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":133,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186449+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:43.186449+0000","last_peered":"2024-04-19T02:20:43.186449+0000","last_clean":"2024-04-19T02:20:43.186449+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:43.186449+0000","last_undegraded":"2024-04-19T02:20:43.186449+0000","last_fullsized":"2024-04-19T02:20:43.186449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":657,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183481+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:43.183481+0000","last_peered":"2024-04-19T02:20:43.183481+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:43.183481+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185504+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:43.185504+0000","last_peered":"2024-04-19T02:20:43.185504+0000","last_clean":"2024-04-19T02:20:43.185504+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:43.185504+0000","last_undegraded":"2024-04-19T02:20:43.185504+0000","last_fullsized":"2024-04-19T02:20:43.185504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":944,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.190361+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:44.190361+0000","last_peered":"2024-04-19T02:20:44.190361+0000","last_clean":"2024-04-19T02:20:44.190361+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:44.190361+0000","last_undegraded":"2024-04-19T02:20:44.190361+0000","last_fullsized":"2024-04-19T02:20:44.190361+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":296,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183647+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:43.183647+0000","last_peered":"2024-04-19T02:20:43.183647+0000","last_clean":"2024-04-19T02:20:43.183647+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:43.183647+0000","last_undegraded":"2024-04-19T02:20:43.183647+0000","last_fullsized":"2024-04-19T02:20:43.183647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":592,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.186350+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:43.186350+0000","last_peered":"2024-04-19T02:20:43.186350+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:43.186350+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":154,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186463+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:44.186463+0000","last_peered":"2024-04-19T02:20:44.186463+0000","last_clean":"2024-04-19T02:20:44.186463+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:44.186463+0000","last_undegraded":"2024-04-19T02:20:44.186463+0000","last_fullsized":"2024-04-19T02:20:44.186463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":797,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185936+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:43.185936+0000","last_peered":"2024-04-19T02:20:43.185936+0000","last_clean":"2024-04-19T02:20:43.185936+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:43.185936+0000","last_undegraded":"2024-04-19T02:20:43.185936+0000","last_fullsized":"2024-04-19T02:20:43.185936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":478,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186083+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:44.186083+0000","last_peered":"2024-04-19T02:20:44.186083+0000","last_clean":"2024-04-19T02:20:44.186083+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:44.186083+0000","last_undegraded":"2024-04-19T02:20:44.186083+0000","last_fullsized":"2024-04-19T02:20:44.186083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":506,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185249+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:43.185249+0000","last_peered":"2024-04-19T02:20:43.185249+0000","last_clean":"2024-04-19T02:20:43.185249+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:43.185249+0000","last_undegraded":"2024-04-19T02:20:43.185249+0000","last_fullsized":"2024-04-19T02:20:43.185249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183994+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:43.183994+0000","last_peered":"2024-04-19T02:20:43.183994+0000","last_clean":"2024-04-19T02:20:43.183994+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:43.183994+0000","last_undegraded":"2024-04-19T02:20:43.183994+0000","last_fullsized":"2024-04-19T02:20:43.183994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185785+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:43.185785+0000","last_peered":"2024-04-19T02:20:43.185785+0000","last_clean":"2024-04-19T02:20:43.185785+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:43.185785+0000","last_undegraded":"2024-04-19T02:20:43.185785+0000","last_fullsized":"2024-04-19T02:20:43.185785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":849,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184416+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:43.184416+0000","last_peered":"2024-04-19T02:20:43.184416+0000","last_clean":"2024-04-19T02:20:43.184416+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:43.184416+0000","last_undegraded":"2024-04-19T02:20:43.184416+0000","last_fullsized":"2024-04-19T02:20:43.184416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":577,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185774+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:43.185774+0000","last_peered":"2024-04-19T02:20:43.185774+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:43.185774+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183495+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:43.183495+0000","last_peered":"2024-04-19T02:20:43.183495+0000","last_clean":"2024-04-19T02:20:43.183495+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:43.183495+0000","last_undegraded":"2024-04-19T02:20:43.183495+0000","last_fullsized":"2024-04-19T02:20:43.183495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":286,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183471+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:43.183471+0000","last_peered":"2024-04-19T02:20:43.183471+0000","last_clean":"2024-04-19T02:20:43.183471+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:43.183471+0000","last_undegraded":"2024-04-19T02:20:43.183471+0000","last_fullsized":"2024-04-19T02:20:43.183471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":532,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.188710+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:44.188710+0000","last_peered":"2024-04-19T02:20:44.188710+0000","last_clean":"2024-04-19T02:20:44.188710+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:44.188710+0000","last_undegraded":"2024-04-19T02:20:44.188710+0000","last_fullsized":"2024-04-19T02:20:44.188710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183926+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:43.183926+0000","last_peered":"2024-04-19T02:20:43.183926+0000","last_clean":"2024-04-19T02:20:43.183926+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:43.183926+0000","last_undegraded":"2024-04-19T02:20:43.183926+0000","last_fullsized":"2024-04-19T02:20:43.183926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":499,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183358+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:43.183358+0000","last_peered":"2024-04-19T02:20:43.183358+0000","last_clean":"2024-04-19T02:20:43.183358+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:43.183358+0000","last_undegraded":"2024-04-19T02:20:43.183358+0000","last_fullsized":"2024-04-19T02:20:43.183358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":444,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.183761+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:44.183761+0000","last_peered":"2024-04-19T02:20:44.183761+0000","last_clean":"2024-04-19T02:20:44.183761+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:44.183761+0000","last_undegraded":"2024-04-19T02:20:44.183761+0000","last_fullsized":"2024-04-19T02:20:44.183761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184882+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:43.184882+0000","last_peered":"2024-04-19T02:20:43.184882+0000","last_clean":"2024-04-19T02:20:43.184882+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:43.184882+0000","last_undegraded":"2024-04-19T02:20:43.184882+0000","last_fullsized":"2024-04-19T02:20:43.184882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":147,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185016+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:43.185016+0000","last_peered":"2024-04-19T02:20:43.185016+0000","last_clean":"2024-04-19T02:20:43.185016+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:43.185016+0000","last_undegraded":"2024-04-19T02:20:43.185016+0000","last_fullsized":"2024-04-19T02:20:43.185016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":545,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186195+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:43.186195+0000","last_peered":"2024-04-19T02:20:43.186195+0000","last_clean":"2024-04-19T02:20:43.186195+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:43.186195+0000","last_undegraded":"2024-04-19T02:20:43.186195+0000","last_fullsized":"2024-04-19T02:20:43.186195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":549,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184465+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:43.184465+0000","last_peered":"2024-04-19T02:20:43.184465+0000","last_clean":"2024-04-19T02:20:43.184465+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:43.184465+0000","last_undegraded":"2024-04-19T02:20:43.184465+0000","last_fullsized":"2024-04-19T02:20:43.184465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187135+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:43.187135+0000","last_peered":"2024-04-19T02:20:43.187135+0000","last_clean":"2024-04-19T02:20:43.187135+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:43.187135+0000","last_undegraded":"2024-04-19T02:20:43.187135+0000","last_fullsized":"2024-04-19T02:20:43.187135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":833,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.195104+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:44.195104+0000","last_peered":"2024-04-19T02:20:44.195104+0000","last_clean":"2024-04-19T02:20:44.195104+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:44.195104+0000","last_undegraded":"2024-04-19T02:20:44.195104+0000","last_fullsized":"2024-04-19T02:20:44.195104+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":143,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186917+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:43.186917+0000","last_peered":"2024-04-19T02:20:43.186917+0000","last_clean":"2024-04-19T02:20:43.186917+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:43.186917+0000","last_undegraded":"2024-04-19T02:20:43.186917+0000","last_fullsized":"2024-04-19T02:20:43.186917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186744+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:43.186744+0000","last_peered":"2024-04-19T02:20:43.186744+0000","last_clean":"2024-04-19T02:20:43.186744+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:43.186744+0000","last_undegraded":"2024-04-19T02:20:43.186744+0000","last_fullsized":"2024-04-19T02:20:43.186744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":950,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183926+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:43.183926+0000","last_peered":"2024-04-19T02:20:43.183926+0000","last_clean":"2024-04-19T02:20:43.183926+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:43.183926+0000","last_undegraded":"2024-04-19T02:20:43.183926+0000","last_fullsized":"2024-04-19T02:20:43.183926+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":153,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.184314+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:44.184314+0000","last_peered":"2024-04-19T02:20:44.184314+0000","last_clean":"2024-04-19T02:20:44.184314+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:44.184314+0000","last_undegraded":"2024-04-19T02:20:44.184314+0000","last_fullsized":"2024-04-19T02:20:44.184314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185769+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:43.185769+0000","last_peered":"2024-04-19T02:20:43.185769+0000","last_clean":"2024-04-19T02:20:43.185769+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:43.185769+0000","last_undegraded":"2024-04-19T02:20:43.185769+0000","last_fullsized":"2024-04-19T02:20:43.185769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":553,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183923+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:43.183923+0000","last_peered":"2024-04-19T02:20:43.183923+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:43.183923+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":180,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.183459+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:44.183459+0000","last_peered":"2024-04-19T02:20:44.183459+0000","last_clean":"2024-04-19T02:20:44.183459+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:44.183459+0000","last_undegraded":"2024-04-19T02:20:44.183459+0000","last_fullsized":"2024-04-19T02:20:44.183459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187940+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:43.187940+0000","last_peered":"2024-04-19T02:20:43.187940+0000","last_clean":"2024-04-19T02:20:43.187940+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:43.187940+0000","last_undegraded":"2024-04-19T02:20:43.187940+0000","last_fullsized":"2024-04-19T02:20:43.187940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":553,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182493+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:43.182493+0000","last_peered":"2024-04-19T02:20:43.182493+0000","last_clean":"2024-04-19T02:20:43.182493+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:43.182493+0000","last_undegraded":"2024-04-19T02:20:43.182493+0000","last_fullsized":"2024-04-19T02:20:43.182493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":856,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.197685+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:43.197685+0000","last_peered":"2024-04-19T02:20:43.197685+0000","last_clean":"2024-04-19T02:20:43.197685+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:43.197685+0000","last_undegraded":"2024-04-19T02:20:43.197685+0000","last_fullsized":"2024-04-19T02:20:43.197685+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":558,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184297+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:43.184297+0000","last_peered":"2024-04-19T02:20:43.184297+0000","last_clean":"2024-04-19T02:20:43.184297+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:43.184297+0000","last_undegraded":"2024-04-19T02:20:43.184297+0000","last_fullsized":"2024-04-19T02:20:43.184297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":530,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182809+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:43.182809+0000","last_peered":"2024-04-19T02:20:43.182809+0000","last_clean":"2024-04-19T02:20:43.182809+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:43.182809+0000","last_undegraded":"2024-04-19T02:20:43.182809+0000","last_fullsized":"2024-04-19T02:20:43.182809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":191,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186447+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:43.186447+0000","last_peered":"2024-04-19T02:20:43.186447+0000","last_clean":"2024-04-19T02:20:43.186447+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:43.186447+0000","last_undegraded":"2024-04-19T02:20:43.186447+0000","last_fullsized":"2024-04-19T02:20:43.186447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":413,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184578+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:43.184578+0000","last_peered":"2024-04-19T02:20:43.184578+0000","last_clean":"2024-04-19T02:20:43.184578+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:43.184578+0000","last_undegraded":"2024-04-19T02:20:43.184578+0000","last_fullsized":"2024-04-19T02:20:43.184578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":588,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183237+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:43.183237+0000","last_peered":"2024-04-19T02:20:43.183237+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:43.183237+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":153,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185804+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:43.185804+0000","last_peered":"2024-04-19T02:20:43.185804+0000","last_clean":"2024-04-19T02:20:43.185804+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:43.185804+0000","last_undegraded":"2024-04-19T02:20:43.185804+0000","last_fullsized":"2024-04-19T02:20:43.185804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":604,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183555+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:43.183555+0000","last_peered":"2024-04-19T02:20:43.183555+0000","last_clean":"2024-04-19T02:20:43.183555+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:43.183555+0000","last_undegraded":"2024-04-19T02:20:43.183555+0000","last_fullsized":"2024-04-19T02:20:43.183555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":894,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187699+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:43.187699+0000","last_peered":"2024-04-19T02:20:43.187699+0000","last_clean":"2024-04-19T02:20:43.187699+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:43.187699+0000","last_undegraded":"2024-04-19T02:20:43.187699+0000","last_fullsized":"2024-04-19T02:20:43.187699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":658,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184298+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:43.184298+0000","last_peered":"2024-04-19T02:20:43.184298+0000","last_clean":"2024-04-19T02:20:43.184298+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:43.184298+0000","last_undegraded":"2024-04-19T02:20:43.184298+0000","last_fullsized":"2024-04-19T02:20:43.184298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":919,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184335+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:43.184335+0000","last_peered":"2024-04-19T02:20:43.184335+0000","last_clean":"2024-04-19T02:20:43.184335+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:43.184335+0000","last_undegraded":"2024-04-19T02:20:43.184335+0000","last_fullsized":"2024-04-19T02:20:43.184335+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":436,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183209+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:43.183209+0000","last_peered":"2024-04-19T02:20:43.183209+0000","last_clean":"2024-04-19T02:20:43.183209+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:43.183209+0000","last_undegraded":"2024-04-19T02:20:43.183209+0000","last_fullsized":"2024-04-19T02:20:43.183209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":506,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185240+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:43.185240+0000","last_peered":"2024-04-19T02:20:43.185240+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:43.185240+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":583,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185862+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:43.185862+0000","last_peered":"2024-04-19T02:20:43.185862+0000","last_clean":"2024-04-19T02:20:43.185862+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:43.185862+0000","last_undegraded":"2024-04-19T02:20:43.185862+0000","last_fullsized":"2024-04-19T02:20:43.185862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":525,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184597+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:43.184597+0000","last_peered":"2024-04-19T02:20:43.184597+0000","last_clean":"2024-04-19T02:20:43.184597+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:43.184597+0000","last_undegraded":"2024-04-19T02:20:43.184597+0000","last_fullsized":"2024-04-19T02:20:43.184597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184707+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:43.184707+0000","last_peered":"2024-04-19T02:20:43.184707+0000","last_clean":"2024-04-19T02:20:43.184707+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:43.184707+0000","last_undegraded":"2024-04-19T02:20:43.184707+0000","last_fullsized":"2024-04-19T02:20:43.184707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":805,"reported_epoch":93,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:44.271796+0000","last_change":"2024-04-19T02:20:44.272189+0000","last_active":"2024-04-19T02:20:44.271796+0000","last_peered":"2024-04-19T02:20:44.271796+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:44.271796+0000","last_undegraded":"2024-04-19T02:20:44.271796+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":423,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186693+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:43.186693+0000","last_peered":"2024-04-19T02:20:43.186693+0000","last_clean":"2024-04-19T02:20:43.186693+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:43.186693+0000","last_undegraded":"2024-04-19T02:20:43.186693+0000","last_fullsized":"2024-04-19T02:20:43.186693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":504,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183258+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:43.183258+0000","last_peered":"2024-04-19T02:20:43.183258+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:43.183258+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":483,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186189+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:43.186189+0000","last_peered":"2024-04-19T02:20:43.186189+0000","last_clean":"2024-04-19T02:20:43.186189+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:43.186189+0000","last_undegraded":"2024-04-19T02:20:43.186189+0000","last_fullsized":"2024-04-19T02:20:43.186189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":608,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183760+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:43.183760+0000","last_peered":"2024-04-19T02:20:43.183760+0000","last_clean":"2024-04-19T02:20:43.183760+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:43.183760+0000","last_undegraded":"2024-04-19T02:20:43.183760+0000","last_fullsized":"2024-04-19T02:20:43.183760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185196+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:43.185196+0000","last_peered":"2024-04-19T02:20:43.185196+0000","last_clean":"2024-04-19T02:20:43.185196+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:43.185196+0000","last_undegraded":"2024-04-19T02:20:43.185196+0000","last_fullsized":"2024-04-19T02:20:43.185196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":567,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.182684+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:43.182684+0000","last_peered":"2024-04-19T02:20:43.182684+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:43.182684+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":157,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185558+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:43.185558+0000","last_peered":"2024-04-19T02:20:43.185558+0000","last_clean":"2024-04-19T02:20:43.185558+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:43.185558+0000","last_undegraded":"2024-04-19T02:20:43.185558+0000","last_fullsized":"2024-04-19T02:20:43.185558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":105,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124744,"kb_used_data":27260,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247096,"statfs":{"total":96636764160,"available":96509026304,"internally_reserved":0,"allocated":27914240,"data_stored":81555139,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":1,"up_from":78,"seq":335007449092,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43708,"kb_used_data":12084,"kb_used_omap":7,"kb_used_meta":31608,"kb_avail":94328132,"statfs":{"total":96636764160,"available":96592007168,"internally_reserved":0,"allocated":12374016,"data_stored":91829317,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":32367615},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139360,"kb_used_data":27916,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232480,"statfs":{"total":96636764160,"available":96494059520,"internally_reserved":0,"allocated":28585984,"data_stored":86172716,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:48.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:49.052 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:49.065 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-04-19T02:20:48.295921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3205,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":187,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":307812,"kb_used_data":67260,"kb_used_omap":10,"kb_used_meta":240501,"kb_avail":282807708,"statfs":{"total":289910292480,"available":289595092992,"internally_reserved":0,"allocated":68874240,"data_stored":259557172,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":246273931},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1631,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1550,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001798"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":543,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186569+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:43.186569+0000","last_peered":"2024-04-19T02:20:43.186569+0000","last_clean":"2024-04-19T02:20:43.186569+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:43.186569+0000","last_undegraded":"2024-04-19T02:20:43.186569+0000","last_fullsized":"2024-04-19T02:20:43.186569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":569,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185924+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:43.185924+0000","last_peered":"2024-04-19T02:20:43.185924+0000","last_clean":"2024-04-19T02:20:43.185924+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:43.185924+0000","last_undegraded":"2024-04-19T02:20:43.185924+0000","last_fullsized":"2024-04-19T02:20:43.185924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":492,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184503+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:43.184503+0000","last_peered":"2024-04-19T02:20:43.184503+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:43.184503+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":820,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184888+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:43.184888+0000","last_peered":"2024-04-19T02:20:43.184888+0000","last_clean":"2024-04-19T02:20:43.184888+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:43.184888+0000","last_undegraded":"2024-04-19T02:20:43.184888+0000","last_fullsized":"2024-04-19T02:20:43.184888+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":517,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184194+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:43.184194+0000","last_peered":"2024-04-19T02:20:43.184194+0000","last_clean":"2024-04-19T02:20:43.184194+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:43.184194+0000","last_undegraded":"2024-04-19T02:20:43.184194+0000","last_fullsized":"2024-04-19T02:20:43.184194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":907,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-19T02:20:44.186686+0000","last_change":"2024-04-19T02:20:44.187055+0000","last_active":"2024-04-19T02:20:44.186686+0000","last_peered":"2024-04-19T02:20:43.668135+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:44.186686+0000","last_undegraded":"2024-04-19T02:20:44.186686+0000","last_fullsized":"2024-04-19T02:20:44.186686+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:58:38.325301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":903,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182472+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:43.182472+0000","last_peered":"2024-04-19T02:20:43.182472+0000","last_clean":"2024-04-19T02:20:43.182472+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:43.182472+0000","last_undegraded":"2024-04-19T02:20:43.182472+0000","last_fullsized":"2024-04-19T02:20:43.182472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":931,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182597+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:43.182597+0000","last_peered":"2024-04-19T02:20:43.182597+0000","last_clean":"2024-04-19T02:20:43.182597+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:43.182597+0000","last_undegraded":"2024-04-19T02:20:43.182597+0000","last_fullsized":"2024-04-19T02:20:43.182597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":538,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184972+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:43.184972+0000","last_peered":"2024-04-19T02:20:43.184972+0000","last_clean":"2024-04-19T02:20:43.184972+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:43.184972+0000","last_undegraded":"2024-04-19T02:20:43.184972+0000","last_fullsized":"2024-04-19T02:20:43.184972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":529,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186188+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:43.186188+0000","last_peered":"2024-04-19T02:20:43.186188+0000","last_clean":"2024-04-19T02:20:43.186188+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:43.186188+0000","last_undegraded":"2024-04-19T02:20:43.186188+0000","last_fullsized":"2024-04-19T02:20:43.186188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":466,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184080+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:43.184080+0000","last_peered":"2024-04-19T02:20:43.184080+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:43.184080+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":562,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184288+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:43.184288+0000","last_peered":"2024-04-19T02:20:43.184288+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:43.184288+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":513,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183623+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:43.183623+0000","last_peered":"2024-04-19T02:20:43.183623+0000","last_clean":"2024-04-19T02:20:43.183623+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:43.183623+0000","last_undegraded":"2024-04-19T02:20:43.183623+0000","last_fullsized":"2024-04-19T02:20:43.183623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":516,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184149+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:43.184149+0000","last_peered":"2024-04-19T02:20:43.184149+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:43.184149+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":902,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183004+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:43.183004+0000","last_peered":"2024-04-19T02:20:43.183004+0000","last_clean":"2024-04-19T02:20:43.183004+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:43.183004+0000","last_undegraded":"2024-04-19T02:20:43.183004+0000","last_fullsized":"2024-04-19T02:20:43.183004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":985,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182356+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:43.182356+0000","last_peered":"2024-04-19T02:20:43.182356+0000","last_clean":"2024-04-19T02:20:43.182356+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:43.182356+0000","last_undegraded":"2024-04-19T02:20:43.182356+0000","last_fullsized":"2024-04-19T02:20:43.182356+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":536,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186001+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:43.186001+0000","last_peered":"2024-04-19T02:20:43.186001+0000","last_clean":"2024-04-19T02:20:43.186001+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:43.186001+0000","last_undegraded":"2024-04-19T02:20:43.186001+0000","last_fullsized":"2024-04-19T02:20:43.186001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":513,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186651+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:43.186651+0000","last_peered":"2024-04-19T02:20:43.186651+0000","last_clean":"2024-04-19T02:20:43.186651+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:43.186651+0000","last_undegraded":"2024-04-19T02:20:43.186651+0000","last_fullsized":"2024-04-19T02:20:43.186651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":624,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184181+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:43.184181+0000","last_peered":"2024-04-19T02:20:43.184181+0000","last_clean":"2024-04-19T02:20:43.184181+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:43.184181+0000","last_undegraded":"2024-04-19T02:20:43.184181+0000","last_fullsized":"2024-04-19T02:20:43.184181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":914,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.200907+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:43.200907+0000","last_peered":"2024-04-19T02:20:43.200907+0000","last_clean":"2024-04-19T02:20:43.200907+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:43.200907+0000","last_undegraded":"2024-04-19T02:20:43.200907+0000","last_fullsized":"2024-04-19T02:20:43.200907+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":553,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185401+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:43.185401+0000","last_peered":"2024-04-19T02:20:43.185401+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:43.185401+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":780,"reported_epoch":93,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:44.430218+0000","last_change":"2024-04-19T02:20:44.278125+0000","last_active":"2024-04-19T02:20:44.430218+0000","last_peered":"2024-04-19T02:20:44.430218+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:44.430218+0000","last_undegraded":"2024-04-19T02:20:44.430218+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":875,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182751+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:43.182751+0000","last_peered":"2024-04-19T02:20:43.182751+0000","last_clean":"2024-04-19T02:20:43.182751+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:43.182751+0000","last_undegraded":"2024-04-19T02:20:43.182751+0000","last_fullsized":"2024-04-19T02:20:43.182751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":545,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.185637+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:44.185637+0000","last_peered":"2024-04-19T02:20:44.185637+0000","last_clean":"2024-04-19T02:20:44.185637+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:44.185637+0000","last_undegraded":"2024-04-19T02:20:44.185637+0000","last_fullsized":"2024-04-19T02:20:44.185637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":532,"reported_epoch":93,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:44.189552+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:44.189552+0000","last_peered":"2024-04-19T02:20:44.189552+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:44.189552+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":712,"reported_epoch":93,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:44.182351+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:44.182351+0000","last_peered":"2024-04-19T02:20:44.182351+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:44.182351+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":564,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.186692+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:43.186692+0000","last_peered":"2024-04-19T02:20:43.186692+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:43.186692+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":792,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.188045+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:44.188045+0000","last_peered":"2024-04-19T02:20:44.188045+0000","last_clean":"2024-04-19T02:20:44.188045+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:44.188045+0000","last_undegraded":"2024-04-19T02:20:44.188045+0000","last_fullsized":"2024-04-19T02:20:44.188045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":515,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185239+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:43.185239+0000","last_peered":"2024-04-19T02:20:43.185239+0000","last_clean":"2024-04-19T02:20:43.185239+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:43.185239+0000","last_undegraded":"2024-04-19T02:20:43.185239+0000","last_fullsized":"2024-04-19T02:20:43.185239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":629,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185434+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:43.185434+0000","last_peered":"2024-04-19T02:20:43.185434+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:43.185434+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":592,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182755+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:43.182755+0000","last_peered":"2024-04-19T02:20:43.182755+0000","last_clean":"2024-04-19T02:20:43.182755+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:43.182755+0000","last_undegraded":"2024-04-19T02:20:43.182755+0000","last_fullsized":"2024-04-19T02:20:43.182755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":533,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.182936+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:43.182936+0000","last_peered":"2024-04-19T02:20:43.182936+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:43.182936+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":473,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184763+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:43.184763+0000","last_peered":"2024-04-19T02:20:43.184763+0000","last_clean":"2024-04-19T02:20:43.184763+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:43.184763+0000","last_undegraded":"2024-04-19T02:20:43.184763+0000","last_fullsized":"2024-04-19T02:20:43.184763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":480,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184666+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:43.184666+0000","last_peered":"2024-04-19T02:20:43.184666+0000","last_clean":"2024-04-19T02:20:43.184666+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:43.184666+0000","last_undegraded":"2024-04-19T02:20:43.184666+0000","last_fullsized":"2024-04-19T02:20:43.184666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":522,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186029+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:43.186029+0000","last_peered":"2024-04-19T02:20:43.186029+0000","last_clean":"2024-04-19T02:20:43.186029+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:43.186029+0000","last_undegraded":"2024-04-19T02:20:43.186029+0000","last_fullsized":"2024-04-19T02:20:43.186029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183698+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:43.183698+0000","last_peered":"2024-04-19T02:20:43.183698+0000","last_clean":"2024-04-19T02:20:43.183698+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:43.183698+0000","last_undegraded":"2024-04-19T02:20:43.183698+0000","last_fullsized":"2024-04-19T02:20:43.183698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":606,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185607+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:43.185607+0000","last_peered":"2024-04-19T02:20:43.185607+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:43.185607+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183493+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:43.183493+0000","last_peered":"2024-04-19T02:20:43.183493+0000","last_clean":"2024-04-19T02:20:43.183493+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:43.183493+0000","last_undegraded":"2024-04-19T02:20:43.183493+0000","last_fullsized":"2024-04-19T02:20:43.183493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":541,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185127+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:43.185127+0000","last_peered":"2024-04-19T02:20:43.185127+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:43.185127+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":142,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183024+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:43.183024+0000","last_peered":"2024-04-19T02:20:43.183024+0000","last_clean":"2024-04-19T02:20:43.183024+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:43.183024+0000","last_undegraded":"2024-04-19T02:20:43.183024+0000","last_fullsized":"2024-04-19T02:20:43.183024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":266,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187827+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:43.187827+0000","last_peered":"2024-04-19T02:20:43.187827+0000","last_clean":"2024-04-19T02:20:43.187827+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:43.187827+0000","last_undegraded":"2024-04-19T02:20:43.187827+0000","last_fullsized":"2024-04-19T02:20:43.187827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":871,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.185808+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:44.185808+0000","last_peered":"2024-04-19T02:20:44.185808+0000","last_clean":"2024-04-19T02:20:44.185808+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:44.185808+0000","last_undegraded":"2024-04-19T02:20:44.185808+0000","last_fullsized":"2024-04-19T02:20:44.185808+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":405,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187198+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:43.187198+0000","last_peered":"2024-04-19T02:20:43.187198+0000","last_clean":"2024-04-19T02:20:43.187198+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:43.187198+0000","last_undegraded":"2024-04-19T02:20:43.187198+0000","last_fullsized":"2024-04-19T02:20:43.187198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":543,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186022+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:44.186022+0000","last_peered":"2024-04-19T02:20:44.186022+0000","last_clean":"2024-04-19T02:20:44.186022+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:44.186022+0000","last_undegraded":"2024-04-19T02:20:44.186022+0000","last_fullsized":"2024-04-19T02:20:44.186022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185770+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:43.185770+0000","last_peered":"2024-04-19T02:20:43.185770+0000","last_clean":"2024-04-19T02:20:43.185770+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:43.185770+0000","last_undegraded":"2024-04-19T02:20:43.185770+0000","last_fullsized":"2024-04-19T02:20:43.185770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":500,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184002+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:43.184002+0000","last_peered":"2024-04-19T02:20:43.184002+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:43.184002+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":133,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186449+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:43.186449+0000","last_peered":"2024-04-19T02:20:43.186449+0000","last_clean":"2024-04-19T02:20:43.186449+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:43.186449+0000","last_undegraded":"2024-04-19T02:20:43.186449+0000","last_fullsized":"2024-04-19T02:20:43.186449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":657,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183481+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:43.183481+0000","last_peered":"2024-04-19T02:20:43.183481+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:43.183481+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185504+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:43.185504+0000","last_peered":"2024-04-19T02:20:43.185504+0000","last_clean":"2024-04-19T02:20:43.185504+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:43.185504+0000","last_undegraded":"2024-04-19T02:20:43.185504+0000","last_fullsized":"2024-04-19T02:20:43.185504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":944,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.190361+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:44.190361+0000","last_peered":"2024-04-19T02:20:44.190361+0000","last_clean":"2024-04-19T02:20:44.190361+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:44.190361+0000","last_undegraded":"2024-04-19T02:20:44.190361+0000","last_fullsized":"2024-04-19T02:20:44.190361+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":296,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183647+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:43.183647+0000","last_peered":"2024-04-19T02:20:43.183647+0000","last_clean":"2024-04-19T02:20:43.183647+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:43.183647+0000","last_undegraded":"2024-04-19T02:20:43.183647+0000","last_fullsized":"2024-04-19T02:20:43.183647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":592,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.186350+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:43.186350+0000","last_peered":"2024-04-19T02:20:43.186350+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:43.186350+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":154,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186463+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:44.186463+0000","last_peered":"2024-04-19T02:20:44.186463+0000","last_clean":"2024-04-19T02:20:44.186463+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:44.186463+0000","last_undegraded":"2024-04-19T02:20:44.186463+0000","last_fullsized":"2024-04-19T02:20:44.186463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":797,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185936+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:43.185936+0000","last_peered":"2024-04-19T02:20:43.185936+0000","last_clean":"2024-04-19T02:20:43.185936+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:43.185936+0000","last_undegraded":"2024-04-19T02:20:43.185936+0000","last_fullsized":"2024-04-19T02:20:43.185936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":478,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186083+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:44.186083+0000","last_peered":"2024-04-19T02:20:44.186083+0000","last_clean":"2024-04-19T02:20:44.186083+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:44.186083+0000","last_undegraded":"2024-04-19T02:20:44.186083+0000","last_fullsized":"2024-04-19T02:20:44.186083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":506,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185249+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:43.185249+0000","last_peered":"2024-04-19T02:20:43.185249+0000","last_clean":"2024-04-19T02:20:43.185249+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:43.185249+0000","last_undegraded":"2024-04-19T02:20:43.185249+0000","last_fullsized":"2024-04-19T02:20:43.185249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183994+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:43.183994+0000","last_peered":"2024-04-19T02:20:43.183994+0000","last_clean":"2024-04-19T02:20:43.183994+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:43.183994+0000","last_undegraded":"2024-04-19T02:20:43.183994+0000","last_fullsized":"2024-04-19T02:20:43.183994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185785+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:43.185785+0000","last_peered":"2024-04-19T02:20:43.185785+0000","last_clean":"2024-04-19T02:20:43.185785+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:43.185785+0000","last_undegraded":"2024-04-19T02:20:43.185785+0000","last_fullsized":"2024-04-19T02:20:43.185785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":849,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184416+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:43.184416+0000","last_peered":"2024-04-19T02:20:43.184416+0000","last_clean":"2024-04-19T02:20:43.184416+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:43.184416+0000","last_undegraded":"2024-04-19T02:20:43.184416+0000","last_fullsized":"2024-04-19T02:20:43.184416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":577,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185774+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:43.185774+0000","last_peered":"2024-04-19T02:20:43.185774+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:43.185774+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183495+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:43.183495+0000","last_peered":"2024-04-19T02:20:43.183495+0000","last_clean":"2024-04-19T02:20:43.183495+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:43.183495+0000","last_undegraded":"2024-04-19T02:20:43.183495+0000","last_fullsized":"2024-04-19T02:20:43.183495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":286,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183471+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:43.183471+0000","last_peered":"2024-04-19T02:20:43.183471+0000","last_clean":"2024-04-19T02:20:43.183471+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:43.183471+0000","last_undegraded":"2024-04-19T02:20:43.183471+0000","last_fullsized":"2024-04-19T02:20:43.183471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":532,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.188710+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:44.188710+0000","last_peered":"2024-04-19T02:20:44.188710+0000","last_clean":"2024-04-19T02:20:44.188710+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:44.188710+0000","last_undegraded":"2024-04-19T02:20:44.188710+0000","last_fullsized":"2024-04-19T02:20:44.188710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183926+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:43.183926+0000","last_peered":"2024-04-19T02:20:43.183926+0000","last_clean":"2024-04-19T02:20:43.183926+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:43.183926+0000","last_undegraded":"2024-04-19T02:20:43.183926+0000","last_fullsized":"2024-04-19T02:20:43.183926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":499,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183358+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:43.183358+0000","last_peered":"2024-04-19T02:20:43.183358+0000","last_clean":"2024-04-19T02:20:43.183358+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:43.183358+0000","last_undegraded":"2024-04-19T02:20:43.183358+0000","last_fullsized":"2024-04-19T02:20:43.183358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":444,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.183761+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:44.183761+0000","last_peered":"2024-04-19T02:20:44.183761+0000","last_clean":"2024-04-19T02:20:44.183761+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:44.183761+0000","last_undegraded":"2024-04-19T02:20:44.183761+0000","last_fullsized":"2024-04-19T02:20:44.183761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184882+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:43.184882+0000","last_peered":"2024-04-19T02:20:43.184882+0000","last_clean":"2024-04-19T02:20:43.184882+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:43.184882+0000","last_undegraded":"2024-04-19T02:20:43.184882+0000","last_fullsized":"2024-04-19T02:20:43.184882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":147,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185016+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:43.185016+0000","last_peered":"2024-04-19T02:20:43.185016+0000","last_clean":"2024-04-19T02:20:43.185016+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:43.185016+0000","last_undegraded":"2024-04-19T02:20:43.185016+0000","last_fullsized":"2024-04-19T02:20:43.185016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":545,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186195+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:43.186195+0000","last_peered":"2024-04-19T02:20:43.186195+0000","last_clean":"2024-04-19T02:20:43.186195+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:43.186195+0000","last_undegraded":"2024-04-19T02:20:43.186195+0000","last_fullsized":"2024-04-19T02:20:43.186195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":549,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184465+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:43.184465+0000","last_peered":"2024-04-19T02:20:43.184465+0000","last_clean":"2024-04-19T02:20:43.184465+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:43.184465+0000","last_undegraded":"2024-04-19T02:20:43.184465+0000","last_fullsized":"2024-04-19T02:20:43.184465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187135+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:43.187135+0000","last_peered":"2024-04-19T02:20:43.187135+0000","last_clean":"2024-04-19T02:20:43.187135+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:43.187135+0000","last_undegraded":"2024-04-19T02:20:43.187135+0000","last_fullsized":"2024-04-19T02:20:43.187135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":833,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.195104+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:44.195104+0000","last_peered":"2024-04-19T02:20:44.195104+0000","last_clean":"2024-04-19T02:20:44.195104+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:44.195104+0000","last_undegraded":"2024-04-19T02:20:44.195104+0000","last_fullsized":"2024-04-19T02:20:44.195104+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":143,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186917+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:43.186917+0000","last_peered":"2024-04-19T02:20:43.186917+0000","last_clean":"2024-04-19T02:20:43.186917+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:43.186917+0000","last_undegraded":"2024-04-19T02:20:43.186917+0000","last_fullsized":"2024-04-19T02:20:43.186917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186744+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:43.186744+0000","last_peered":"2024-04-19T02:20:43.186744+0000","last_clean":"2024-04-19T02:20:43.186744+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:43.186744+0000","last_undegraded":"2024-04-19T02:20:43.186744+0000","last_fullsized":"2024-04-19T02:20:43.186744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":950,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183926+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:43.183926+0000","last_peered":"2024-04-19T02:20:43.183926+0000","last_clean":"2024-04-19T02:20:43.183926+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:43.183926+0000","last_undegraded":"2024-04-19T02:20:43.183926+0000","last_fullsized":"2024-04-19T02:20:43.183926+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":153,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.184314+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:44.184314+0000","last_peered":"2024-04-19T02:20:44.184314+0000","last_clean":"2024-04-19T02:20:44.184314+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:44.184314+0000","last_undegraded":"2024-04-19T02:20:44.184314+0000","last_fullsized":"2024-04-19T02:20:44.184314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185769+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:43.185769+0000","last_peered":"2024-04-19T02:20:43.185769+0000","last_clean":"2024-04-19T02:20:43.185769+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:43.185769+0000","last_undegraded":"2024-04-19T02:20:43.185769+0000","last_fullsized":"2024-04-19T02:20:43.185769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":553,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183923+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:43.183923+0000","last_peered":"2024-04-19T02:20:43.183923+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:43.183923+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":180,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.183459+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:44.183459+0000","last_peered":"2024-04-19T02:20:44.183459+0000","last_clean":"2024-04-19T02:20:44.183459+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:44.183459+0000","last_undegraded":"2024-04-19T02:20:44.183459+0000","last_fullsized":"2024-04-19T02:20:44.183459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187940+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:43.187940+0000","last_peered":"2024-04-19T02:20:43.187940+0000","last_clean":"2024-04-19T02:20:43.187940+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:43.187940+0000","last_undegraded":"2024-04-19T02:20:43.187940+0000","last_fullsized":"2024-04-19T02:20:43.187940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":553,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182493+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:43.182493+0000","last_peered":"2024-04-19T02:20:43.182493+0000","last_clean":"2024-04-19T02:20:43.182493+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:43.182493+0000","last_undegraded":"2024-04-19T02:20:43.182493+0000","last_fullsized":"2024-04-19T02:20:43.182493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":856,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.197685+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:43.197685+0000","last_peered":"2024-04-19T02:20:43.197685+0000","last_clean":"2024-04-19T02:20:43.197685+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:43.197685+0000","last_undegraded":"2024-04-19T02:20:43.197685+0000","last_fullsized":"2024-04-19T02:20:43.197685+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":558,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184297+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:43.184297+0000","last_peered":"2024-04-19T02:20:43.184297+0000","last_clean":"2024-04-19T02:20:43.184297+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:43.184297+0000","last_undegraded":"2024-04-19T02:20:43.184297+0000","last_fullsized":"2024-04-19T02:20:43.184297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":530,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182809+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:43.182809+0000","last_peered":"2024-04-19T02:20:43.182809+0000","last_clean":"2024-04-19T02:20:43.182809+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:43.182809+0000","last_undegraded":"2024-04-19T02:20:43.182809+0000","last_fullsized":"2024-04-19T02:20:43.182809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":191,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186447+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:43.186447+0000","last_peered":"2024-04-19T02:20:43.186447+0000","last_clean":"2024-04-19T02:20:43.186447+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:43.186447+0000","last_undegraded":"2024-04-19T02:20:43.186447+0000","last_fullsized":"2024-04-19T02:20:43.186447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":413,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184578+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:43.184578+0000","last_peered":"2024-04-19T02:20:43.184578+0000","last_clean":"2024-04-19T02:20:43.184578+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:43.184578+0000","last_undegraded":"2024-04-19T02:20:43.184578+0000","last_fullsized":"2024-04-19T02:20:43.184578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":588,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183237+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:43.183237+0000","last_peered":"2024-04-19T02:20:43.183237+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:43.183237+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":153,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185804+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:43.185804+0000","last_peered":"2024-04-19T02:20:43.185804+0000","last_clean":"2024-04-19T02:20:43.185804+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:43.185804+0000","last_undegraded":"2024-04-19T02:20:43.185804+0000","last_fullsized":"2024-04-19T02:20:43.185804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":604,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183555+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:43.183555+0000","last_peered":"2024-04-19T02:20:43.183555+0000","last_clean":"2024-04-19T02:20:43.183555+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:43.183555+0000","last_undegraded":"2024-04-19T02:20:43.183555+0000","last_fullsized":"2024-04-19T02:20:43.183555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":894,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187699+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:43.187699+0000","last_peered":"2024-04-19T02:20:43.187699+0000","last_clean":"2024-04-19T02:20:43.187699+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:43.187699+0000","last_undegraded":"2024-04-19T02:20:43.187699+0000","last_fullsized":"2024-04-19T02:20:43.187699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":658,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184298+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:43.184298+0000","last_peered":"2024-04-19T02:20:43.184298+0000","last_clean":"2024-04-19T02:20:43.184298+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:43.184298+0000","last_undegraded":"2024-04-19T02:20:43.184298+0000","last_fullsized":"2024-04-19T02:20:43.184298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":919,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184335+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:43.184335+0000","last_peered":"2024-04-19T02:20:43.184335+0000","last_clean":"2024-04-19T02:20:43.184335+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:43.184335+0000","last_undegraded":"2024-04-19T02:20:43.184335+0000","last_fullsized":"2024-04-19T02:20:43.184335+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":436,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183209+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:43.183209+0000","last_peered":"2024-04-19T02:20:43.183209+0000","last_clean":"2024-04-19T02:20:43.183209+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:43.183209+0000","last_undegraded":"2024-04-19T02:20:43.183209+0000","last_fullsized":"2024-04-19T02:20:43.183209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":506,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185240+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:43.185240+0000","last_peered":"2024-04-19T02:20:43.185240+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:43.185240+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":583,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185862+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:43.185862+0000","last_peered":"2024-04-19T02:20:43.185862+0000","last_clean":"2024-04-19T02:20:43.185862+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:43.185862+0000","last_undegraded":"2024-04-19T02:20:43.185862+0000","last_fullsized":"2024-04-19T02:20:43.185862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":525,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184597+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:43.184597+0000","last_peered":"2024-04-19T02:20:43.184597+0000","last_clean":"2024-04-19T02:20:43.184597+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:43.184597+0000","last_undegraded":"2024-04-19T02:20:43.184597+0000","last_fullsized":"2024-04-19T02:20:43.184597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184707+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:43.184707+0000","last_peered":"2024-04-19T02:20:43.184707+0000","last_clean":"2024-04-19T02:20:43.184707+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:43.184707+0000","last_undegraded":"2024-04-19T02:20:43.184707+0000","last_fullsized":"2024-04-19T02:20:43.184707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":805,"reported_epoch":93,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:44.271796+0000","last_change":"2024-04-19T02:20:44.272189+0000","last_active":"2024-04-19T02:20:44.271796+0000","last_peered":"2024-04-19T02:20:44.271796+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:44.271796+0000","last_undegraded":"2024-04-19T02:20:44.271796+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":423,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186693+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:43.186693+0000","last_peered":"2024-04-19T02:20:43.186693+0000","last_clean":"2024-04-19T02:20:43.186693+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:43.186693+0000","last_undegraded":"2024-04-19T02:20:43.186693+0000","last_fullsized":"2024-04-19T02:20:43.186693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":504,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183258+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:43.183258+0000","last_peered":"2024-04-19T02:20:43.183258+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:43.183258+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":483,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186189+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:43.186189+0000","last_peered":"2024-04-19T02:20:43.186189+0000","last_clean":"2024-04-19T02:20:43.186189+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:43.186189+0000","last_undegraded":"2024-04-19T02:20:43.186189+0000","last_fullsized":"2024-04-19T02:20:43.186189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":608,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183760+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:43.183760+0000","last_peered":"2024-04-19T02:20:43.183760+0000","last_clean":"2024-04-19T02:20:43.183760+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:43.183760+0000","last_undegraded":"2024-04-19T02:20:43.183760+0000","last_fullsized":"2024-04-19T02:20:43.183760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185196+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:43.185196+0000","last_peered":"2024-04-19T02:20:43.185196+0000","last_clean":"2024-04-19T02:20:43.185196+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:43.185196+0000","last_undegraded":"2024-04-19T02:20:43.185196+0000","last_fullsized":"2024-04-19T02:20:43.185196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":567,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.182684+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:43.182684+0000","last_peered":"2024-04-19T02:20:43.182684+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:43.182684+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":157,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185558+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:43.185558+0000","last_peered":"2024-04-19T02:20:43.185558+0000","last_clean":"2024-04-19T02:20:43.185558+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:43.185558+0000","last_undegraded":"2024-04-19T02:20:43.185558+0000","last_fullsized":"2024-04-19T02:20:43.185558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":105,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124744,"kb_used_data":27260,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247096,"statfs":{"total":96636764160,"available":96509026304,"internally_reserved":0,"allocated":27914240,"data_stored":81555139,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":1,"up_from":78,"seq":335007449092,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43708,"kb_used_data":12084,"kb_used_omap":7,"kb_used_meta":31608,"kb_avail":94328132,"statfs":{"total":96636764160,"available":96592007168,"internally_reserved":0,"allocated":12374016,"data_stored":91829317,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":32367615},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139360,"kb_used_data":27916,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232480,"statfs":{"total":96636764160,"available":96494059520,"internally_reserved":0,"allocated":28585984,"data_stored":86172716,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:49.073 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:20:49.462 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:49.462 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3831/110 objects degraded (3482.727%), 21 pgs degraded","count":21},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":286,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":98,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":15},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":21},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":315199488,"bytes_avail":289595092992,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":3831,"degraded_total":110,"degraded_ratio":34.827272727272728,"recovering_objects_per_sec":387,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1550,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:20:49.478 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:20:49.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:49.788 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:49.790 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:49.808 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-04-19T02:20:49.178130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3205,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":187,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":303784,"kb_used_data":67320,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282811736,"statfs":{"total":289910292480,"available":289599217664,"internally_reserved":0,"allocated":68935680,"data_stored":259581455,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":242079627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.988773"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":543,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186569+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:43.186569+0000","last_peered":"2024-04-19T02:20:43.186569+0000","last_clean":"2024-04-19T02:20:43.186569+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:43.186569+0000","last_undegraded":"2024-04-19T02:20:43.186569+0000","last_fullsized":"2024-04-19T02:20:43.186569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":569,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185924+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:43.185924+0000","last_peered":"2024-04-19T02:20:43.185924+0000","last_clean":"2024-04-19T02:20:43.185924+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:43.185924+0000","last_undegraded":"2024-04-19T02:20:43.185924+0000","last_fullsized":"2024-04-19T02:20:43.185924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":492,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184503+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:43.184503+0000","last_peered":"2024-04-19T02:20:43.184503+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:43.184503+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":820,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184888+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:43.184888+0000","last_peered":"2024-04-19T02:20:43.184888+0000","last_clean":"2024-04-19T02:20:43.184888+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:43.184888+0000","last_undegraded":"2024-04-19T02:20:43.184888+0000","last_fullsized":"2024-04-19T02:20:43.184888+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":517,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184194+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:43.184194+0000","last_peered":"2024-04-19T02:20:43.184194+0000","last_clean":"2024-04-19T02:20:43.184194+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:43.184194+0000","last_undegraded":"2024-04-19T02:20:43.184194+0000","last_fullsized":"2024-04-19T02:20:43.184194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":907,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-19T02:20:44.186686+0000","last_change":"2024-04-19T02:20:44.187055+0000","last_active":"2024-04-19T02:20:44.186686+0000","last_peered":"2024-04-19T02:20:43.668135+0000","last_clean":"2024-04-19T02:20:28.469924+0000","last_became_active":"2024-04-19T02:20:31.663510+0000","last_became_peered":"2024-04-19T02:20:31.663510+0000","last_unstale":"2024-04-19T02:20:44.186686+0000","last_undegraded":"2024-04-19T02:20:44.186686+0000","last_fullsized":"2024-04-19T02:20:44.186686+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:58:38.325301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":903,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182472+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:43.182472+0000","last_peered":"2024-04-19T02:20:43.182472+0000","last_clean":"2024-04-19T02:20:43.182472+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:43.182472+0000","last_undegraded":"2024-04-19T02:20:43.182472+0000","last_fullsized":"2024-04-19T02:20:43.182472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":931,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182597+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:43.182597+0000","last_peered":"2024-04-19T02:20:43.182597+0000","last_clean":"2024-04-19T02:20:43.182597+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:43.182597+0000","last_undegraded":"2024-04-19T02:20:43.182597+0000","last_fullsized":"2024-04-19T02:20:43.182597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":538,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184972+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:43.184972+0000","last_peered":"2024-04-19T02:20:43.184972+0000","last_clean":"2024-04-19T02:20:43.184972+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:43.184972+0000","last_undegraded":"2024-04-19T02:20:43.184972+0000","last_fullsized":"2024-04-19T02:20:43.184972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":529,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186188+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:43.186188+0000","last_peered":"2024-04-19T02:20:43.186188+0000","last_clean":"2024-04-19T02:20:43.186188+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:43.186188+0000","last_undegraded":"2024-04-19T02:20:43.186188+0000","last_fullsized":"2024-04-19T02:20:43.186188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":466,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184080+0000","last_change":"2024-04-19T02:20:31.669439+0000","last_active":"2024-04-19T02:20:43.184080+0000","last_peered":"2024-04-19T02:20:43.184080+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.664396+0000","last_became_peered":"2024-04-19T02:20:31.664396+0000","last_unstale":"2024-04-19T02:20:43.184080+0000","last_undegraded":"2024-04-19T02:20:31.508874+0000","last_fullsized":"2024-04-19T02:20:31.496956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:43:35.751795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":562,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184288+0000","last_change":"2024-04-19T02:20:31.674038+0000","last_active":"2024-04-19T02:20:43.184288+0000","last_peered":"2024-04-19T02:20:43.184288+0000","last_clean":"2024-04-19T02:17:09.444520+0000","last_became_active":"2024-04-19T02:20:31.669294+0000","last_became_peered":"2024-04-19T02:20:31.669294+0000","last_unstale":"2024-04-19T02:20:43.184288+0000","last_undegraded":"2024-04-19T02:20:31.524361+0000","last_fullsized":"2024-04-19T02:20:31.515341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:52.802850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":513,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183623+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:43.183623+0000","last_peered":"2024-04-19T02:20:43.183623+0000","last_clean":"2024-04-19T02:20:43.183623+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:43.183623+0000","last_undegraded":"2024-04-19T02:20:43.183623+0000","last_fullsized":"2024-04-19T02:20:43.183623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":516,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184149+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:43.184149+0000","last_peered":"2024-04-19T02:20:43.184149+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:43.184149+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":902,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183004+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:43.183004+0000","last_peered":"2024-04-19T02:20:43.183004+0000","last_clean":"2024-04-19T02:20:43.183004+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:43.183004+0000","last_undegraded":"2024-04-19T02:20:43.183004+0000","last_fullsized":"2024-04-19T02:20:43.183004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":985,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182356+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:43.182356+0000","last_peered":"2024-04-19T02:20:43.182356+0000","last_clean":"2024-04-19T02:20:43.182356+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:43.182356+0000","last_undegraded":"2024-04-19T02:20:43.182356+0000","last_fullsized":"2024-04-19T02:20:43.182356+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":536,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186001+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:43.186001+0000","last_peered":"2024-04-19T02:20:43.186001+0000","last_clean":"2024-04-19T02:20:43.186001+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:43.186001+0000","last_undegraded":"2024-04-19T02:20:43.186001+0000","last_fullsized":"2024-04-19T02:20:43.186001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":513,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186651+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:43.186651+0000","last_peered":"2024-04-19T02:20:43.186651+0000","last_clean":"2024-04-19T02:20:43.186651+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:43.186651+0000","last_undegraded":"2024-04-19T02:20:43.186651+0000","last_fullsized":"2024-04-19T02:20:43.186651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":624,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184181+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:43.184181+0000","last_peered":"2024-04-19T02:20:43.184181+0000","last_clean":"2024-04-19T02:20:43.184181+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:43.184181+0000","last_undegraded":"2024-04-19T02:20:43.184181+0000","last_fullsized":"2024-04-19T02:20:43.184181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":914,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.200907+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:43.200907+0000","last_peered":"2024-04-19T02:20:43.200907+0000","last_clean":"2024-04-19T02:20:43.200907+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:43.200907+0000","last_undegraded":"2024-04-19T02:20:43.200907+0000","last_fullsized":"2024-04-19T02:20:43.200907+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":553,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185401+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:43.185401+0000","last_peered":"2024-04-19T02:20:43.185401+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:43.185401+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":780,"reported_epoch":93,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:44.430218+0000","last_change":"2024-04-19T02:20:44.278125+0000","last_active":"2024-04-19T02:20:44.430218+0000","last_peered":"2024-04-19T02:20:44.430218+0000","last_clean":"2024-04-19T02:17:09.444212+0000","last_became_active":"2024-04-19T02:20:31.668940+0000","last_became_peered":"2024-04-19T02:20:31.668940+0000","last_unstale":"2024-04-19T02:20:44.430218+0000","last_undegraded":"2024-04-19T02:20:44.430218+0000","last_fullsized":"2024-04-19T02:20:31.512453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:20.187960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":875,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182751+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:43.182751+0000","last_peered":"2024-04-19T02:20:43.182751+0000","last_clean":"2024-04-19T02:20:43.182751+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:43.182751+0000","last_undegraded":"2024-04-19T02:20:43.182751+0000","last_fullsized":"2024-04-19T02:20:43.182751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":545,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.185637+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:44.185637+0000","last_peered":"2024-04-19T02:20:44.185637+0000","last_clean":"2024-04-19T02:20:44.185637+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:44.185637+0000","last_undegraded":"2024-04-19T02:20:44.185637+0000","last_fullsized":"2024-04-19T02:20:44.185637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":532,"reported_epoch":93,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:44.189552+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:44.189552+0000","last_peered":"2024-04-19T02:20:44.189552+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:44.189552+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":712,"reported_epoch":93,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:44.182351+0000","last_change":"2024-04-19T02:20:31.677115+0000","last_active":"2024-04-19T02:20:44.182351+0000","last_peered":"2024-04-19T02:20:44.182351+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:44.182351+0000","last_undegraded":"2024-04-19T02:20:31.524944+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":214,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":564,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.186692+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:43.186692+0000","last_peered":"2024-04-19T02:20:43.186692+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:43.186692+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":792,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.188045+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:44.188045+0000","last_peered":"2024-04-19T02:20:44.188045+0000","last_clean":"2024-04-19T02:20:44.188045+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:44.188045+0000","last_undegraded":"2024-04-19T02:20:44.188045+0000","last_fullsized":"2024-04-19T02:20:44.188045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":515,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185239+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:43.185239+0000","last_peered":"2024-04-19T02:20:43.185239+0000","last_clean":"2024-04-19T02:20:43.185239+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:43.185239+0000","last_undegraded":"2024-04-19T02:20:43.185239+0000","last_fullsized":"2024-04-19T02:20:43.185239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":629,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185434+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:43.185434+0000","last_peered":"2024-04-19T02:20:43.185434+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:43.185434+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":592,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182755+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:43.182755+0000","last_peered":"2024-04-19T02:20:43.182755+0000","last_clean":"2024-04-19T02:20:43.182755+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:43.182755+0000","last_undegraded":"2024-04-19T02:20:43.182755+0000","last_fullsized":"2024-04-19T02:20:43.182755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":533,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.182936+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:43.182936+0000","last_peered":"2024-04-19T02:20:43.182936+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:43.182936+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":473,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184763+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:43.184763+0000","last_peered":"2024-04-19T02:20:43.184763+0000","last_clean":"2024-04-19T02:20:43.184763+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:43.184763+0000","last_undegraded":"2024-04-19T02:20:43.184763+0000","last_fullsized":"2024-04-19T02:20:43.184763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":480,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184666+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:43.184666+0000","last_peered":"2024-04-19T02:20:43.184666+0000","last_clean":"2024-04-19T02:20:43.184666+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:43.184666+0000","last_undegraded":"2024-04-19T02:20:43.184666+0000","last_fullsized":"2024-04-19T02:20:43.184666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":522,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186029+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:43.186029+0000","last_peered":"2024-04-19T02:20:43.186029+0000","last_clean":"2024-04-19T02:20:43.186029+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:43.186029+0000","last_undegraded":"2024-04-19T02:20:43.186029+0000","last_fullsized":"2024-04-19T02:20:43.186029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183698+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:43.183698+0000","last_peered":"2024-04-19T02:20:43.183698+0000","last_clean":"2024-04-19T02:20:43.183698+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:43.183698+0000","last_undegraded":"2024-04-19T02:20:43.183698+0000","last_fullsized":"2024-04-19T02:20:43.183698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":606,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185607+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:43.185607+0000","last_peered":"2024-04-19T02:20:43.185607+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:43.185607+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183493+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:43.183493+0000","last_peered":"2024-04-19T02:20:43.183493+0000","last_clean":"2024-04-19T02:20:43.183493+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:43.183493+0000","last_undegraded":"2024-04-19T02:20:43.183493+0000","last_fullsized":"2024-04-19T02:20:43.183493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":541,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185127+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:43.185127+0000","last_peered":"2024-04-19T02:20:43.185127+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:43.185127+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":142,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183024+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:43.183024+0000","last_peered":"2024-04-19T02:20:43.183024+0000","last_clean":"2024-04-19T02:20:43.183024+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:43.183024+0000","last_undegraded":"2024-04-19T02:20:43.183024+0000","last_fullsized":"2024-04-19T02:20:43.183024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":266,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187827+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:43.187827+0000","last_peered":"2024-04-19T02:20:43.187827+0000","last_clean":"2024-04-19T02:20:43.187827+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:43.187827+0000","last_undegraded":"2024-04-19T02:20:43.187827+0000","last_fullsized":"2024-04-19T02:20:43.187827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":871,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.185808+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:44.185808+0000","last_peered":"2024-04-19T02:20:44.185808+0000","last_clean":"2024-04-19T02:20:44.185808+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:44.185808+0000","last_undegraded":"2024-04-19T02:20:44.185808+0000","last_fullsized":"2024-04-19T02:20:44.185808+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":405,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187198+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:43.187198+0000","last_peered":"2024-04-19T02:20:43.187198+0000","last_clean":"2024-04-19T02:20:43.187198+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:43.187198+0000","last_undegraded":"2024-04-19T02:20:43.187198+0000","last_fullsized":"2024-04-19T02:20:43.187198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":543,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186022+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:44.186022+0000","last_peered":"2024-04-19T02:20:44.186022+0000","last_clean":"2024-04-19T02:20:44.186022+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:44.186022+0000","last_undegraded":"2024-04-19T02:20:44.186022+0000","last_fullsized":"2024-04-19T02:20:44.186022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185770+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:43.185770+0000","last_peered":"2024-04-19T02:20:43.185770+0000","last_clean":"2024-04-19T02:20:43.185770+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:43.185770+0000","last_undegraded":"2024-04-19T02:20:43.185770+0000","last_fullsized":"2024-04-19T02:20:43.185770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":500,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.184002+0000","last_change":"2024-04-19T02:20:31.676062+0000","last_active":"2024-04-19T02:20:43.184002+0000","last_peered":"2024-04-19T02:20:43.184002+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669637+0000","last_became_peered":"2024-04-19T02:20:31.669637+0000","last_unstale":"2024-04-19T02:20:43.184002+0000","last_undegraded":"2024-04-19T02:20:31.536542+0000","last_fullsized":"2024-04-19T02:20:31.520133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:56.925638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":133,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186449+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:43.186449+0000","last_peered":"2024-04-19T02:20:43.186449+0000","last_clean":"2024-04-19T02:20:43.186449+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:43.186449+0000","last_undegraded":"2024-04-19T02:20:43.186449+0000","last_fullsized":"2024-04-19T02:20:43.186449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":657,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183481+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:43.183481+0000","last_peered":"2024-04-19T02:20:43.183481+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:43.183481+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185504+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:43.185504+0000","last_peered":"2024-04-19T02:20:43.185504+0000","last_clean":"2024-04-19T02:20:43.185504+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:43.185504+0000","last_undegraded":"2024-04-19T02:20:43.185504+0000","last_fullsized":"2024-04-19T02:20:43.185504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":944,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.190361+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:44.190361+0000","last_peered":"2024-04-19T02:20:44.190361+0000","last_clean":"2024-04-19T02:20:44.190361+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:44.190361+0000","last_undegraded":"2024-04-19T02:20:44.190361+0000","last_fullsized":"2024-04-19T02:20:44.190361+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":296,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183647+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:43.183647+0000","last_peered":"2024-04-19T02:20:43.183647+0000","last_clean":"2024-04-19T02:20:43.183647+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:43.183647+0000","last_undegraded":"2024-04-19T02:20:43.183647+0000","last_fullsized":"2024-04-19T02:20:43.183647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":592,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.186350+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:43.186350+0000","last_peered":"2024-04-19T02:20:43.186350+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:43.186350+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":154,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186463+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:44.186463+0000","last_peered":"2024-04-19T02:20:44.186463+0000","last_clean":"2024-04-19T02:20:44.186463+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:44.186463+0000","last_undegraded":"2024-04-19T02:20:44.186463+0000","last_fullsized":"2024-04-19T02:20:44.186463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":797,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185936+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:43.185936+0000","last_peered":"2024-04-19T02:20:43.185936+0000","last_clean":"2024-04-19T02:20:43.185936+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:43.185936+0000","last_undegraded":"2024-04-19T02:20:43.185936+0000","last_fullsized":"2024-04-19T02:20:43.185936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":478,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.186083+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:44.186083+0000","last_peered":"2024-04-19T02:20:44.186083+0000","last_clean":"2024-04-19T02:20:44.186083+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:44.186083+0000","last_undegraded":"2024-04-19T02:20:44.186083+0000","last_fullsized":"2024-04-19T02:20:44.186083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":506,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185249+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:43.185249+0000","last_peered":"2024-04-19T02:20:43.185249+0000","last_clean":"2024-04-19T02:20:43.185249+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:43.185249+0000","last_undegraded":"2024-04-19T02:20:43.185249+0000","last_fullsized":"2024-04-19T02:20:43.185249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183994+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:43.183994+0000","last_peered":"2024-04-19T02:20:43.183994+0000","last_clean":"2024-04-19T02:20:43.183994+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:43.183994+0000","last_undegraded":"2024-04-19T02:20:43.183994+0000","last_fullsized":"2024-04-19T02:20:43.183994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185785+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:43.185785+0000","last_peered":"2024-04-19T02:20:43.185785+0000","last_clean":"2024-04-19T02:20:43.185785+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:43.185785+0000","last_undegraded":"2024-04-19T02:20:43.185785+0000","last_fullsized":"2024-04-19T02:20:43.185785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":849,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184416+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:43.184416+0000","last_peered":"2024-04-19T02:20:43.184416+0000","last_clean":"2024-04-19T02:20:43.184416+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:43.184416+0000","last_undegraded":"2024-04-19T02:20:43.184416+0000","last_fullsized":"2024-04-19T02:20:43.184416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":577,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185774+0000","last_change":"2024-04-19T02:20:31.677207+0000","last_active":"2024-04-19T02:20:43.185774+0000","last_peered":"2024-04-19T02:20:43.185774+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:43.185774+0000","last_undegraded":"2024-04-19T02:20:31.532106+0000","last_fullsized":"2024-04-19T02:20:31.522324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:13.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183495+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:43.183495+0000","last_peered":"2024-04-19T02:20:43.183495+0000","last_clean":"2024-04-19T02:20:43.183495+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:43.183495+0000","last_undegraded":"2024-04-19T02:20:43.183495+0000","last_fullsized":"2024-04-19T02:20:43.183495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":286,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183471+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:43.183471+0000","last_peered":"2024-04-19T02:20:43.183471+0000","last_clean":"2024-04-19T02:20:43.183471+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:43.183471+0000","last_undegraded":"2024-04-19T02:20:43.183471+0000","last_fullsized":"2024-04-19T02:20:43.183471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":532,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.188710+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:44.188710+0000","last_peered":"2024-04-19T02:20:44.188710+0000","last_clean":"2024-04-19T02:20:44.188710+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:44.188710+0000","last_undegraded":"2024-04-19T02:20:44.188710+0000","last_fullsized":"2024-04-19T02:20:44.188710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183926+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:43.183926+0000","last_peered":"2024-04-19T02:20:43.183926+0000","last_clean":"2024-04-19T02:20:43.183926+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:43.183926+0000","last_undegraded":"2024-04-19T02:20:43.183926+0000","last_fullsized":"2024-04-19T02:20:43.183926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":499,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183358+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:43.183358+0000","last_peered":"2024-04-19T02:20:43.183358+0000","last_clean":"2024-04-19T02:20:43.183358+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:43.183358+0000","last_undegraded":"2024-04-19T02:20:43.183358+0000","last_fullsized":"2024-04-19T02:20:43.183358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":444,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.183761+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:44.183761+0000","last_peered":"2024-04-19T02:20:44.183761+0000","last_clean":"2024-04-19T02:20:44.183761+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:44.183761+0000","last_undegraded":"2024-04-19T02:20:44.183761+0000","last_fullsized":"2024-04-19T02:20:44.183761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184882+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:43.184882+0000","last_peered":"2024-04-19T02:20:43.184882+0000","last_clean":"2024-04-19T02:20:43.184882+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:43.184882+0000","last_undegraded":"2024-04-19T02:20:43.184882+0000","last_fullsized":"2024-04-19T02:20:43.184882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":147,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185016+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:43.185016+0000","last_peered":"2024-04-19T02:20:43.185016+0000","last_clean":"2024-04-19T02:20:43.185016+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:43.185016+0000","last_undegraded":"2024-04-19T02:20:43.185016+0000","last_fullsized":"2024-04-19T02:20:43.185016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":545,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186195+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:43.186195+0000","last_peered":"2024-04-19T02:20:43.186195+0000","last_clean":"2024-04-19T02:20:43.186195+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:43.186195+0000","last_undegraded":"2024-04-19T02:20:43.186195+0000","last_fullsized":"2024-04-19T02:20:43.186195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":549,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184465+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:43.184465+0000","last_peered":"2024-04-19T02:20:43.184465+0000","last_clean":"2024-04-19T02:20:43.184465+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:43.184465+0000","last_undegraded":"2024-04-19T02:20:43.184465+0000","last_fullsized":"2024-04-19T02:20:43.184465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187135+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:43.187135+0000","last_peered":"2024-04-19T02:20:43.187135+0000","last_clean":"2024-04-19T02:20:43.187135+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:43.187135+0000","last_undegraded":"2024-04-19T02:20:43.187135+0000","last_fullsized":"2024-04-19T02:20:43.187135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":833,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.195104+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:44.195104+0000","last_peered":"2024-04-19T02:20:44.195104+0000","last_clean":"2024-04-19T02:20:44.195104+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:44.195104+0000","last_undegraded":"2024-04-19T02:20:44.195104+0000","last_fullsized":"2024-04-19T02:20:44.195104+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":143,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186917+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:43.186917+0000","last_peered":"2024-04-19T02:20:43.186917+0000","last_clean":"2024-04-19T02:20:43.186917+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:43.186917+0000","last_undegraded":"2024-04-19T02:20:43.186917+0000","last_fullsized":"2024-04-19T02:20:43.186917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186744+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:43.186744+0000","last_peered":"2024-04-19T02:20:43.186744+0000","last_clean":"2024-04-19T02:20:43.186744+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:43.186744+0000","last_undegraded":"2024-04-19T02:20:43.186744+0000","last_fullsized":"2024-04-19T02:20:43.186744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":950,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183926+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:43.183926+0000","last_peered":"2024-04-19T02:20:43.183926+0000","last_clean":"2024-04-19T02:20:43.183926+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:43.183926+0000","last_undegraded":"2024-04-19T02:20:43.183926+0000","last_fullsized":"2024-04-19T02:20:43.183926+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":153,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.184314+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:44.184314+0000","last_peered":"2024-04-19T02:20:44.184314+0000","last_clean":"2024-04-19T02:20:44.184314+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:44.184314+0000","last_undegraded":"2024-04-19T02:20:44.184314+0000","last_fullsized":"2024-04-19T02:20:44.184314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185769+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:43.185769+0000","last_peered":"2024-04-19T02:20:43.185769+0000","last_clean":"2024-04-19T02:20:43.185769+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:43.185769+0000","last_undegraded":"2024-04-19T02:20:43.185769+0000","last_fullsized":"2024-04-19T02:20:43.185769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":553,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183923+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:43.183923+0000","last_peered":"2024-04-19T02:20:43.183923+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:43.183923+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":180,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.183459+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:44.183459+0000","last_peered":"2024-04-19T02:20:44.183459+0000","last_clean":"2024-04-19T02:20:44.183459+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:44.183459+0000","last_undegraded":"2024-04-19T02:20:44.183459+0000","last_fullsized":"2024-04-19T02:20:44.183459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187940+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:43.187940+0000","last_peered":"2024-04-19T02:20:43.187940+0000","last_clean":"2024-04-19T02:20:43.187940+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:43.187940+0000","last_undegraded":"2024-04-19T02:20:43.187940+0000","last_fullsized":"2024-04-19T02:20:43.187940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":553,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182493+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:43.182493+0000","last_peered":"2024-04-19T02:20:43.182493+0000","last_clean":"2024-04-19T02:20:43.182493+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:43.182493+0000","last_undegraded":"2024-04-19T02:20:43.182493+0000","last_fullsized":"2024-04-19T02:20:43.182493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":856,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.197685+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:43.197685+0000","last_peered":"2024-04-19T02:20:43.197685+0000","last_clean":"2024-04-19T02:20:43.197685+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:43.197685+0000","last_undegraded":"2024-04-19T02:20:43.197685+0000","last_fullsized":"2024-04-19T02:20:43.197685+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":558,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184297+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:43.184297+0000","last_peered":"2024-04-19T02:20:43.184297+0000","last_clean":"2024-04-19T02:20:43.184297+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:43.184297+0000","last_undegraded":"2024-04-19T02:20:43.184297+0000","last_fullsized":"2024-04-19T02:20:43.184297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":530,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.182809+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:43.182809+0000","last_peered":"2024-04-19T02:20:43.182809+0000","last_clean":"2024-04-19T02:20:43.182809+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:43.182809+0000","last_undegraded":"2024-04-19T02:20:43.182809+0000","last_fullsized":"2024-04-19T02:20:43.182809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":191,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186447+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:43.186447+0000","last_peered":"2024-04-19T02:20:43.186447+0000","last_clean":"2024-04-19T02:20:43.186447+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:43.186447+0000","last_undegraded":"2024-04-19T02:20:43.186447+0000","last_fullsized":"2024-04-19T02:20:43.186447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":413,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184578+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:43.184578+0000","last_peered":"2024-04-19T02:20:43.184578+0000","last_clean":"2024-04-19T02:20:43.184578+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:43.184578+0000","last_undegraded":"2024-04-19T02:20:43.184578+0000","last_fullsized":"2024-04-19T02:20:43.184578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":588,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183237+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:43.183237+0000","last_peered":"2024-04-19T02:20:43.183237+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:43.183237+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":153,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185804+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:43.185804+0000","last_peered":"2024-04-19T02:20:43.185804+0000","last_clean":"2024-04-19T02:20:43.185804+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:43.185804+0000","last_undegraded":"2024-04-19T02:20:43.185804+0000","last_fullsized":"2024-04-19T02:20:43.185804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":604,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183555+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:43.183555+0000","last_peered":"2024-04-19T02:20:43.183555+0000","last_clean":"2024-04-19T02:20:43.183555+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:43.183555+0000","last_undegraded":"2024-04-19T02:20:43.183555+0000","last_fullsized":"2024-04-19T02:20:43.183555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":894,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.187699+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:43.187699+0000","last_peered":"2024-04-19T02:20:43.187699+0000","last_clean":"2024-04-19T02:20:43.187699+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:43.187699+0000","last_undegraded":"2024-04-19T02:20:43.187699+0000","last_fullsized":"2024-04-19T02:20:43.187699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":658,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184298+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:43.184298+0000","last_peered":"2024-04-19T02:20:43.184298+0000","last_clean":"2024-04-19T02:20:43.184298+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:43.184298+0000","last_undegraded":"2024-04-19T02:20:43.184298+0000","last_fullsized":"2024-04-19T02:20:43.184298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":919,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184335+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:43.184335+0000","last_peered":"2024-04-19T02:20:43.184335+0000","last_clean":"2024-04-19T02:20:43.184335+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:43.184335+0000","last_undegraded":"2024-04-19T02:20:43.184335+0000","last_fullsized":"2024-04-19T02:20:43.184335+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":436,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183209+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:43.183209+0000","last_peered":"2024-04-19T02:20:43.183209+0000","last_clean":"2024-04-19T02:20:43.183209+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:43.183209+0000","last_undegraded":"2024-04-19T02:20:43.183209+0000","last_fullsized":"2024-04-19T02:20:43.183209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":506,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.185240+0000","last_change":"2024-04-19T02:20:31.672390+0000","last_active":"2024-04-19T02:20:43.185240+0000","last_peered":"2024-04-19T02:20:43.185240+0000","last_clean":"2024-04-19T02:17:09.445694+0000","last_became_active":"2024-04-19T02:20:31.668953+0000","last_became_peered":"2024-04-19T02:20:31.668953+0000","last_unstale":"2024-04-19T02:20:43.185240+0000","last_undegraded":"2024-04-19T02:20:31.534139+0000","last_fullsized":"2024-04-19T02:20:31.528174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:39.812795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":583,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185862+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:43.185862+0000","last_peered":"2024-04-19T02:20:43.185862+0000","last_clean":"2024-04-19T02:20:43.185862+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:43.185862+0000","last_undegraded":"2024-04-19T02:20:43.185862+0000","last_fullsized":"2024-04-19T02:20:43.185862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":525,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184597+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:43.184597+0000","last_peered":"2024-04-19T02:20:43.184597+0000","last_clean":"2024-04-19T02:20:43.184597+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:43.184597+0000","last_undegraded":"2024-04-19T02:20:43.184597+0000","last_fullsized":"2024-04-19T02:20:43.184597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.184707+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:43.184707+0000","last_peered":"2024-04-19T02:20:43.184707+0000","last_clean":"2024-04-19T02:20:43.184707+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:43.184707+0000","last_undegraded":"2024-04-19T02:20:43.184707+0000","last_fullsized":"2024-04-19T02:20:43.184707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":805,"reported_epoch":93,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:44.271796+0000","last_change":"2024-04-19T02:20:44.272189+0000","last_active":"2024-04-19T02:20:44.271796+0000","last_peered":"2024-04-19T02:20:44.271796+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.660752+0000","last_became_peered":"2024-04-19T02:20:31.660752+0000","last_unstale":"2024-04-19T02:20:44.271796+0000","last_undegraded":"2024-04-19T02:20:44.271796+0000","last_fullsized":"2024-04-19T02:20:31.496759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:40.591777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":423,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186693+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:43.186693+0000","last_peered":"2024-04-19T02:20:43.186693+0000","last_clean":"2024-04-19T02:20:43.186693+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:43.186693+0000","last_undegraded":"2024-04-19T02:20:43.186693+0000","last_fullsized":"2024-04-19T02:20:43.186693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":504,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.183258+0000","last_change":"2024-04-19T02:20:31.668276+0000","last_active":"2024-04-19T02:20:43.183258+0000","last_peered":"2024-04-19T02:20:43.183258+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.665035+0000","last_became_peered":"2024-04-19T02:20:31.665035+0000","last_unstale":"2024-04-19T02:20:43.183258+0000","last_undegraded":"2024-04-19T02:20:31.524380+0000","last_fullsized":"2024-04-19T02:20:31.496472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:34.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":483,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.186189+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:43.186189+0000","last_peered":"2024-04-19T02:20:43.186189+0000","last_clean":"2024-04-19T02:20:43.186189+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:43.186189+0000","last_undegraded":"2024-04-19T02:20:43.186189+0000","last_fullsized":"2024-04-19T02:20:43.186189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":608,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.183760+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:43.183760+0000","last_peered":"2024-04-19T02:20:43.183760+0000","last_clean":"2024-04-19T02:20:43.183760+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:43.183760+0000","last_undegraded":"2024-04-19T02:20:43.183760+0000","last_fullsized":"2024-04-19T02:20:43.183760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185196+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:43.185196+0000","last_peered":"2024-04-19T02:20:43.185196+0000","last_clean":"2024-04-19T02:20:43.185196+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:43.185196+0000","last_undegraded":"2024-04-19T02:20:43.185196+0000","last_fullsized":"2024-04-19T02:20:43.185196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":567,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:43.182684+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:43.182684+0000","last_peered":"2024-04-19T02:20:43.182684+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:43.182684+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":157,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T02:20:43.185558+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:43.185558+0000","last_peered":"2024-04-19T02:20:43.185558+0000","last_clean":"2024-04-19T02:20:43.185558+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:43.185558+0000","last_undegraded":"2024-04-19T02:20:43.185558+0000","last_fullsized":"2024-04-19T02:20:43.185558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":105,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124744,"kb_used_data":27260,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247096,"statfs":{"total":96636764160,"available":96509026304,"internally_reserved":0,"allocated":27914240,"data_stored":81555139,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":1,"up_from":78,"seq":335007449093,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39680,"kb_used_data":12144,"kb_used_omap":7,"kb_used_meta":27512,"kb_avail":94332160,"statfs":{"total":96636764160,"available":96596131840,"internally_reserved":0,"allocated":12435456,"data_stored":91853600,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":28173311},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139360,"kb_used_data":27916,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232480,"statfs":{"total":96636764160,"available":96494059520,"internally_reserved":0,"allocated":28585984,"data_stored":86172716,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:52.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:53.132 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:53.148 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-04-19T02:20:52.297682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2592,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4598,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":195,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":303908,"kb_used_data":67440,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282811612,"statfs":{"total":289910292480,"available":289599090688,"internally_reserved":0,"allocated":69058560,"data_stored":259629421,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":242079627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1239,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1393,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001760"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":548,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184923+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:48.184923+0000","last_peered":"2024-04-19T02:20:48.184923+0000","last_clean":"2024-04-19T02:20:48.184923+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:48.184923+0000","last_undegraded":"2024-04-19T02:20:48.184923+0000","last_fullsized":"2024-04-19T02:20:48.184923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":574,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184934+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:48.184934+0000","last_peered":"2024-04-19T02:20:48.184934+0000","last_clean":"2024-04-19T02:20:48.184934+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:48.184934+0000","last_undegraded":"2024-04-19T02:20:48.184934+0000","last_fullsized":"2024-04-19T02:20:48.184934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":497,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.183424+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:48.183424+0000","last_peered":"2024-04-19T02:20:48.183424+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:48.183424+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":825,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183161+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:48.183161+0000","last_peered":"2024-04-19T02:20:48.183161+0000","last_clean":"2024-04-19T02:20:48.183161+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:48.183161+0000","last_undegraded":"2024-04-19T02:20:48.183161+0000","last_fullsized":"2024-04-19T02:20:48.183161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":522,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184376+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:48.184376+0000","last_peered":"2024-04-19T02:20:48.184376+0000","last_clean":"2024-04-19T02:20:48.184376+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:48.184376+0000","last_undegraded":"2024-04-19T02:20:48.184376+0000","last_fullsized":"2024-04-19T02:20:48.184376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":919,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182839+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:48.182839+0000","last_peered":"2024-04-19T02:20:48.182839+0000","last_clean":"2024-04-19T02:20:48.182839+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:48.182839+0000","last_undegraded":"2024-04-19T02:20:48.182839+0000","last_fullsized":"2024-04-19T02:20:48.182839+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":908,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181449+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:48.181449+0000","last_peered":"2024-04-19T02:20:48.181449+0000","last_clean":"2024-04-19T02:20:48.181449+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:48.181449+0000","last_undegraded":"2024-04-19T02:20:48.181449+0000","last_fullsized":"2024-04-19T02:20:48.181449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":936,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181669+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:48.181669+0000","last_peered":"2024-04-19T02:20:48.181669+0000","last_clean":"2024-04-19T02:20:48.181669+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:48.181669+0000","last_undegraded":"2024-04-19T02:20:48.181669+0000","last_fullsized":"2024-04-19T02:20:48.181669+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184215+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:48.184215+0000","last_peered":"2024-04-19T02:20:48.184215+0000","last_clean":"2024-04-19T02:20:48.184215+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:48.184215+0000","last_undegraded":"2024-04-19T02:20:48.184215+0000","last_fullsized":"2024-04-19T02:20:48.184215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":534,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184082+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:48.184082+0000","last_peered":"2024-04-19T02:20:48.184082+0000","last_clean":"2024-04-19T02:20:48.184082+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:48.184082+0000","last_undegraded":"2024-04-19T02:20:48.184082+0000","last_fullsized":"2024-04-19T02:20:48.184082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":823,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.198732+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:48.198732+0000","last_peered":"2024-04-19T02:20:48.198732+0000","last_clean":"2024-04-19T02:20:48.198732+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:48.198732+0000","last_undegraded":"2024-04-19T02:20:48.198732+0000","last_fullsized":"2024-04-19T02:20:48.198732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":891,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.198847+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:49.198847+0000","last_peered":"2024-04-19T02:20:49.198847+0000","last_clean":"2024-04-19T02:20:49.198847+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:49.198847+0000","last_undegraded":"2024-04-19T02:20:49.198847+0000","last_fullsized":"2024-04-19T02:20:49.198847+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":518,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184089+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:48.184089+0000","last_peered":"2024-04-19T02:20:48.184089+0000","last_clean":"2024-04-19T02:20:48.184089+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:48.184089+0000","last_undegraded":"2024-04-19T02:20:48.184089+0000","last_fullsized":"2024-04-19T02:20:48.184089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":521,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182921+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:48.182921+0000","last_peered":"2024-04-19T02:20:48.182921+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:48.182921+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":907,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182514+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:48.182514+0000","last_peered":"2024-04-19T02:20:48.182514+0000","last_clean":"2024-04-19T02:20:48.182514+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:48.182514+0000","last_undegraded":"2024-04-19T02:20:48.182514+0000","last_fullsized":"2024-04-19T02:20:48.182514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":990,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181468+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:48.181468+0000","last_peered":"2024-04-19T02:20:48.181468+0000","last_clean":"2024-04-19T02:20:48.181468+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:48.181468+0000","last_undegraded":"2024-04-19T02:20:48.181468+0000","last_fullsized":"2024-04-19T02:20:48.181468+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185498+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:48.185498+0000","last_peered":"2024-04-19T02:20:48.185498+0000","last_clean":"2024-04-19T02:20:48.185498+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:48.185498+0000","last_undegraded":"2024-04-19T02:20:48.185498+0000","last_fullsized":"2024-04-19T02:20:48.185498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":518,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184509+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:48.184509+0000","last_peered":"2024-04-19T02:20:48.184509+0000","last_clean":"2024-04-19T02:20:48.184509+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:48.184509+0000","last_undegraded":"2024-04-19T02:20:48.184509+0000","last_fullsized":"2024-04-19T02:20:48.184509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183650+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:48.183650+0000","last_peered":"2024-04-19T02:20:48.183650+0000","last_clean":"2024-04-19T02:20:48.183650+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:48.183650+0000","last_undegraded":"2024-04-19T02:20:48.183650+0000","last_fullsized":"2024-04-19T02:20:48.183650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":919,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183395+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:48.183395+0000","last_peered":"2024-04-19T02:20:48.183395+0000","last_clean":"2024-04-19T02:20:48.183395+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:48.183395+0000","last_undegraded":"2024-04-19T02:20:48.183395+0000","last_fullsized":"2024-04-19T02:20:48.183395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":558,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.183520+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:48.183520+0000","last_peered":"2024-04-19T02:20:48.183520+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:48.183520+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1102,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183518+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:48.183518+0000","last_peered":"2024-04-19T02:20:48.183518+0000","last_clean":"2024-04-19T02:20:48.183518+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:48.183518+0000","last_undegraded":"2024-04-19T02:20:48.183518+0000","last_fullsized":"2024-04-19T02:20:48.183518+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":880,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181718+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:48.181718+0000","last_peered":"2024-04-19T02:20:48.181718+0000","last_clean":"2024-04-19T02:20:48.181718+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:48.181718+0000","last_undegraded":"2024-04-19T02:20:48.181718+0000","last_fullsized":"2024-04-19T02:20:48.181718+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":550,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182398+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:48.182398+0000","last_peered":"2024-04-19T02:20:48.182398+0000","last_clean":"2024-04-19T02:20:48.182398+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:48.182398+0000","last_undegraded":"2024-04-19T02:20:48.182398+0000","last_fullsized":"2024-04-19T02:20:48.182398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":537,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.185125+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:48.185125+0000","last_peered":"2024-04-19T02:20:48.185125+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:48.185125+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1147,"reported_epoch":98,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:49.472631+0000","last_change":"2024-04-19T02:20:49.473041+0000","last_active":"2024-04-19T02:20:49.472631+0000","last_peered":"2024-04-19T02:20:49.472631+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:49.472631+0000","last_undegraded":"2024-04-19T02:20:49.472631+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":569,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.185166+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:48.185166+0000","last_peered":"2024-04-19T02:20:48.185166+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:48.185166+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":797,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185549+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:48.185549+0000","last_peered":"2024-04-19T02:20:48.185549+0000","last_clean":"2024-04-19T02:20:48.185549+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:48.185549+0000","last_undegraded":"2024-04-19T02:20:48.185549+0000","last_fullsized":"2024-04-19T02:20:48.185549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":520,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183121+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:48.183121+0000","last_peered":"2024-04-19T02:20:48.183121+0000","last_clean":"2024-04-19T02:20:48.183121+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:48.183121+0000","last_undegraded":"2024-04-19T02:20:48.183121+0000","last_fullsized":"2024-04-19T02:20:48.183121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":634,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.183955+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:48.183955+0000","last_peered":"2024-04-19T02:20:48.183955+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:48.183955+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":597,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181747+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:48.181747+0000","last_peered":"2024-04-19T02:20:48.181747+0000","last_clean":"2024-04-19T02:20:48.181747+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:48.181747+0000","last_undegraded":"2024-04-19T02:20:48.181747+0000","last_fullsized":"2024-04-19T02:20:48.181747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":538,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182045+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:48.182045+0000","last_peered":"2024-04-19T02:20:48.182045+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:48.182045+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":478,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185262+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:48.185262+0000","last_peered":"2024-04-19T02:20:48.185262+0000","last_clean":"2024-04-19T02:20:48.185262+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:48.185262+0000","last_undegraded":"2024-04-19T02:20:48.185262+0000","last_fullsized":"2024-04-19T02:20:48.185262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":485,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183110+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:48.183110+0000","last_peered":"2024-04-19T02:20:48.183110+0000","last_clean":"2024-04-19T02:20:48.183110+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:48.183110+0000","last_undegraded":"2024-04-19T02:20:48.183110+0000","last_fullsized":"2024-04-19T02:20:48.183110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":527,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184373+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:48.184373+0000","last_peered":"2024-04-19T02:20:48.184373+0000","last_clean":"2024-04-19T02:20:48.184373+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:48.184373+0000","last_undegraded":"2024-04-19T02:20:48.184373+0000","last_fullsized":"2024-04-19T02:20:48.184373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":168,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182119+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:48.182119+0000","last_peered":"2024-04-19T02:20:48.182119+0000","last_clean":"2024-04-19T02:20:48.182119+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:48.182119+0000","last_undegraded":"2024-04-19T02:20:48.182119+0000","last_fullsized":"2024-04-19T02:20:48.182119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":611,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.185454+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:48.185454+0000","last_peered":"2024-04-19T02:20:48.185454+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:48.185454+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":174,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182992+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:48.182992+0000","last_peered":"2024-04-19T02:20:48.182992+0000","last_clean":"2024-04-19T02:20:48.182992+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:48.182992+0000","last_undegraded":"2024-04-19T02:20:48.182992+0000","last_fullsized":"2024-04-19T02:20:48.182992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":546,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.184931+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:48.184931+0000","last_peered":"2024-04-19T02:20:48.184931+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:48.184931+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182742+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:48.182742+0000","last_peered":"2024-04-19T02:20:48.182742+0000","last_clean":"2024-04-19T02:20:48.182742+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:48.182742+0000","last_undegraded":"2024-04-19T02:20:48.182742+0000","last_fullsized":"2024-04-19T02:20:48.182742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":271,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185521+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:48.185521+0000","last_peered":"2024-04-19T02:20:48.185521+0000","last_clean":"2024-04-19T02:20:48.185521+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:48.185521+0000","last_undegraded":"2024-04-19T02:20:48.185521+0000","last_fullsized":"2024-04-19T02:20:48.185521+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":876,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182559+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:48.182559+0000","last_peered":"2024-04-19T02:20:48.182559+0000","last_clean":"2024-04-19T02:20:48.182559+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:48.182559+0000","last_undegraded":"2024-04-19T02:20:48.182559+0000","last_fullsized":"2024-04-19T02:20:48.182559+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":410,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185185+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:48.185185+0000","last_peered":"2024-04-19T02:20:48.185185+0000","last_clean":"2024-04-19T02:20:48.185185+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:48.185185+0000","last_undegraded":"2024-04-19T02:20:48.185185+0000","last_fullsized":"2024-04-19T02:20:48.185185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":548,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182748+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:48.182748+0000","last_peered":"2024-04-19T02:20:48.182748+0000","last_clean":"2024-04-19T02:20:48.182748+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:48.182748+0000","last_undegraded":"2024-04-19T02:20:48.182748+0000","last_fullsized":"2024-04-19T02:20:48.182748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":700,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184120+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:48.184120+0000","last_peered":"2024-04-19T02:20:48.184120+0000","last_clean":"2024-04-19T02:20:48.184120+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:48.184120+0000","last_undegraded":"2024-04-19T02:20:48.184120+0000","last_fullsized":"2024-04-19T02:20:48.184120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":879,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.201498+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:49.201498+0000","last_peered":"2024-04-19T02:20:49.201498+0000","last_clean":"2024-04-19T02:20:49.201498+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:49.201498+0000","last_undegraded":"2024-04-19T02:20:49.201498+0000","last_fullsized":"2024-04-19T02:20:49.201498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183887+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:48.183887+0000","last_peered":"2024-04-19T02:20:48.183887+0000","last_clean":"2024-04-19T02:20:48.183887+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:48.183887+0000","last_undegraded":"2024-04-19T02:20:48.183887+0000","last_fullsized":"2024-04-19T02:20:48.183887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":662,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182476+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:48.182476+0000","last_peered":"2024-04-19T02:20:48.182476+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:48.182476+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":250,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183718+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:48.183718+0000","last_peered":"2024-04-19T02:20:48.183718+0000","last_clean":"2024-04-19T02:20:48.183718+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:48.183718+0000","last_undegraded":"2024-04-19T02:20:48.183718+0000","last_fullsized":"2024-04-19T02:20:48.183718+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":949,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183050+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:48.183050+0000","last_peered":"2024-04-19T02:20:48.183050+0000","last_clean":"2024-04-19T02:20:48.183050+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:48.183050+0000","last_undegraded":"2024-04-19T02:20:48.183050+0000","last_fullsized":"2024-04-19T02:20:48.183050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":301,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181864+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:48.181864+0000","last_peered":"2024-04-19T02:20:48.181864+0000","last_clean":"2024-04-19T02:20:48.181864+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:48.181864+0000","last_undegraded":"2024-04-19T02:20:48.181864+0000","last_fullsized":"2024-04-19T02:20:48.181864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":597,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.184660+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:48.184660+0000","last_peered":"2024-04-19T02:20:48.184660+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:48.184660+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":159,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183137+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:48.183137+0000","last_peered":"2024-04-19T02:20:48.183137+0000","last_clean":"2024-04-19T02:20:48.183137+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:48.183137+0000","last_undegraded":"2024-04-19T02:20:48.183137+0000","last_fullsized":"2024-04-19T02:20:48.183137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":802,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183792+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:48.183792+0000","last_peered":"2024-04-19T02:20:48.183792+0000","last_clean":"2024-04-19T02:20:48.183792+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:48.183792+0000","last_undegraded":"2024-04-19T02:20:48.183792+0000","last_fullsized":"2024-04-19T02:20:48.183792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":483,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182806+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:48.182806+0000","last_peered":"2024-04-19T02:20:48.182806+0000","last_clean":"2024-04-19T02:20:48.182806+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:48.182806+0000","last_undegraded":"2024-04-19T02:20:48.182806+0000","last_fullsized":"2024-04-19T02:20:48.182806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":511,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184600+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:48.184600+0000","last_peered":"2024-04-19T02:20:48.184600+0000","last_clean":"2024-04-19T02:20:48.184600+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:48.184600+0000","last_undegraded":"2024-04-19T02:20:48.184600+0000","last_fullsized":"2024-04-19T02:20:48.184600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":286,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183478+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:48.183478+0000","last_peered":"2024-04-19T02:20:48.183478+0000","last_clean":"2024-04-19T02:20:48.183478+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:48.183478+0000","last_undegraded":"2024-04-19T02:20:48.183478+0000","last_fullsized":"2024-04-19T02:20:48.183478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184698+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:48.184698+0000","last_peered":"2024-04-19T02:20:48.184698+0000","last_clean":"2024-04-19T02:20:48.184698+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:48.184698+0000","last_undegraded":"2024-04-19T02:20:48.184698+0000","last_fullsized":"2024-04-19T02:20:48.184698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":854,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183792+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:48.183792+0000","last_peered":"2024-04-19T02:20:48.183792+0000","last_clean":"2024-04-19T02:20:48.183792+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:48.183792+0000","last_undegraded":"2024-04-19T02:20:48.183792+0000","last_fullsized":"2024-04-19T02:20:48.183792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":943,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-19T02:20:49.184629+0000","last_change":"2024-04-19T02:20:49.184859+0000","last_active":"2024-04-19T02:20:49.184629+0000","last_peered":"2024-04-19T02:20:48.730329+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:49.184629+0000","last_undegraded":"2024-04-19T02:20:49.184629+0000","last_fullsized":"2024-04-19T02:20:49.184629+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183032+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:48.183032+0000","last_peered":"2024-04-19T02:20:48.183032+0000","last_clean":"2024-04-19T02:20:48.183032+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:48.183032+0000","last_undegraded":"2024-04-19T02:20:48.183032+0000","last_fullsized":"2024-04-19T02:20:48.183032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":291,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182525+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:48.182525+0000","last_peered":"2024-04-19T02:20:48.182525+0000","last_clean":"2024-04-19T02:20:48.182525+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:48.182525+0000","last_undegraded":"2024-04-19T02:20:48.182525+0000","last_fullsized":"2024-04-19T02:20:48.182525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":537,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184746+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:48.184746+0000","last_peered":"2024-04-19T02:20:48.184746+0000","last_clean":"2024-04-19T02:20:48.184746+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:48.184746+0000","last_undegraded":"2024-04-19T02:20:48.184746+0000","last_fullsized":"2024-04-19T02:20:48.184746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182747+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:48.182747+0000","last_peered":"2024-04-19T02:20:48.182747+0000","last_clean":"2024-04-19T02:20:48.182747+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:48.182747+0000","last_undegraded":"2024-04-19T02:20:48.182747+0000","last_fullsized":"2024-04-19T02:20:48.182747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":504,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183041+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:48.183041+0000","last_peered":"2024-04-19T02:20:48.183041+0000","last_clean":"2024-04-19T02:20:48.183041+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:48.183041+0000","last_undegraded":"2024-04-19T02:20:48.183041+0000","last_fullsized":"2024-04-19T02:20:48.183041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":449,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184878+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:48.184878+0000","last_peered":"2024-04-19T02:20:48.184878+0000","last_clean":"2024-04-19T02:20:48.184878+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:48.184878+0000","last_undegraded":"2024-04-19T02:20:48.184878+0000","last_fullsized":"2024-04-19T02:20:48.184878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184222+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:48.184222+0000","last_peered":"2024-04-19T02:20:48.184222+0000","last_clean":"2024-04-19T02:20:48.184222+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:48.184222+0000","last_undegraded":"2024-04-19T02:20:48.184222+0000","last_fullsized":"2024-04-19T02:20:48.184222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":152,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183395+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:48.183395+0000","last_peered":"2024-04-19T02:20:48.183395+0000","last_clean":"2024-04-19T02:20:48.183395+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:48.183395+0000","last_undegraded":"2024-04-19T02:20:48.183395+0000","last_fullsized":"2024-04-19T02:20:48.183395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":550,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183499+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:48.183499+0000","last_peered":"2024-04-19T02:20:48.183499+0000","last_clean":"2024-04-19T02:20:48.183499+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:48.183499+0000","last_undegraded":"2024-04-19T02:20:48.183499+0000","last_fullsized":"2024-04-19T02:20:48.183499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":554,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184462+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:48.184462+0000","last_peered":"2024-04-19T02:20:48.184462+0000","last_clean":"2024-04-19T02:20:48.184462+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:48.184462+0000","last_undegraded":"2024-04-19T02:20:48.184462+0000","last_fullsized":"2024-04-19T02:20:48.184462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184101+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:48.184101+0000","last_peered":"2024-04-19T02:20:48.184101+0000","last_clean":"2024-04-19T02:20:48.184101+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:48.184101+0000","last_undegraded":"2024-04-19T02:20:48.184101+0000","last_fullsized":"2024-04-19T02:20:48.184101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":838,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183520+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:48.183520+0000","last_peered":"2024-04-19T02:20:48.183520+0000","last_clean":"2024-04-19T02:20:48.183520+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:48.183520+0000","last_undegraded":"2024-04-19T02:20:48.183520+0000","last_fullsized":"2024-04-19T02:20:48.183520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":148,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184582+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:48.184582+0000","last_peered":"2024-04-19T02:20:48.184582+0000","last_clean":"2024-04-19T02:20:48.184582+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:48.184582+0000","last_undegraded":"2024-04-19T02:20:48.184582+0000","last_fullsized":"2024-04-19T02:20:48.184582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185001+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:48.185001+0000","last_peered":"2024-04-19T02:20:48.185001+0000","last_clean":"2024-04-19T02:20:48.185001+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:48.185001+0000","last_undegraded":"2024-04-19T02:20:48.185001+0000","last_fullsized":"2024-04-19T02:20:48.185001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":955,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184110+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:48.184110+0000","last_peered":"2024-04-19T02:20:48.184110+0000","last_clean":"2024-04-19T02:20:48.184110+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:48.184110+0000","last_undegraded":"2024-04-19T02:20:48.184110+0000","last_fullsized":"2024-04-19T02:20:48.184110+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":158,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185600+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:48.185600+0000","last_peered":"2024-04-19T02:20:48.185600+0000","last_clean":"2024-04-19T02:20:48.185600+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:48.185600+0000","last_undegraded":"2024-04-19T02:20:48.185600+0000","last_fullsized":"2024-04-19T02:20:48.185600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185589+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:48.185589+0000","last_peered":"2024-04-19T02:20:48.185589+0000","last_clean":"2024-04-19T02:20:48.185589+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:48.185589+0000","last_undegraded":"2024-04-19T02:20:48.185589+0000","last_fullsized":"2024-04-19T02:20:48.185589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":558,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182715+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:48.182715+0000","last_peered":"2024-04-19T02:20:48.182715+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:48.182715+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":185,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185451+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:48.185451+0000","last_peered":"2024-04-19T02:20:48.185451+0000","last_clean":"2024-04-19T02:20:48.185451+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:48.185451+0000","last_undegraded":"2024-04-19T02:20:48.185451+0000","last_fullsized":"2024-04-19T02:20:48.185451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185579+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:48.185579+0000","last_peered":"2024-04-19T02:20:48.185579+0000","last_clean":"2024-04-19T02:20:48.185579+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:48.185579+0000","last_undegraded":"2024-04-19T02:20:48.185579+0000","last_fullsized":"2024-04-19T02:20:48.185579+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":558,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181468+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:48.181468+0000","last_peered":"2024-04-19T02:20:48.181468+0000","last_clean":"2024-04-19T02:20:48.181468+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:48.181468+0000","last_undegraded":"2024-04-19T02:20:48.181468+0000","last_fullsized":"2024-04-19T02:20:48.181468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":861,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183565+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:48.183565+0000","last_peered":"2024-04-19T02:20:48.183565+0000","last_clean":"2024-04-19T02:20:48.183565+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:48.183565+0000","last_undegraded":"2024-04-19T02:20:48.183565+0000","last_fullsized":"2024-04-19T02:20:48.183565+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":563,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184661+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:48.184661+0000","last_peered":"2024-04-19T02:20:48.184661+0000","last_clean":"2024-04-19T02:20:48.184661+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:48.184661+0000","last_undegraded":"2024-04-19T02:20:48.184661+0000","last_fullsized":"2024-04-19T02:20:48.184661+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":535,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181693+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:48.181693+0000","last_peered":"2024-04-19T02:20:48.181693+0000","last_clean":"2024-04-19T02:20:48.181693+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:48.181693+0000","last_undegraded":"2024-04-19T02:20:48.181693+0000","last_fullsized":"2024-04-19T02:20:48.181693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":196,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184684+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:48.184684+0000","last_peered":"2024-04-19T02:20:48.184684+0000","last_clean":"2024-04-19T02:20:48.184684+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:48.184684+0000","last_undegraded":"2024-04-19T02:20:48.184684+0000","last_fullsized":"2024-04-19T02:20:48.184684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":418,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184921+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:48.184921+0000","last_peered":"2024-04-19T02:20:48.184921+0000","last_clean":"2024-04-19T02:20:48.184921+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:48.184921+0000","last_undegraded":"2024-04-19T02:20:48.184921+0000","last_fullsized":"2024-04-19T02:20:48.184921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":593,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182110+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:48.182110+0000","last_peered":"2024-04-19T02:20:48.182110+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:48.182110+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":158,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185273+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:48.185273+0000","last_peered":"2024-04-19T02:20:48.185273+0000","last_clean":"2024-04-19T02:20:48.185273+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:48.185273+0000","last_undegraded":"2024-04-19T02:20:48.185273+0000","last_fullsized":"2024-04-19T02:20:48.185273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":609,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182388+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:48.182388+0000","last_peered":"2024-04-19T02:20:48.182388+0000","last_clean":"2024-04-19T02:20:48.182388+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:48.182388+0000","last_undegraded":"2024-04-19T02:20:48.182388+0000","last_fullsized":"2024-04-19T02:20:48.182388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":899,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185185+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:48.185185+0000","last_peered":"2024-04-19T02:20:48.185185+0000","last_clean":"2024-04-19T02:20:48.185185+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:48.185185+0000","last_undegraded":"2024-04-19T02:20:48.185185+0000","last_fullsized":"2024-04-19T02:20:48.185185+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":663,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182910+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:48.182910+0000","last_peered":"2024-04-19T02:20:48.182910+0000","last_clean":"2024-04-19T02:20:48.182910+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:48.182910+0000","last_undegraded":"2024-04-19T02:20:48.182910+0000","last_fullsized":"2024-04-19T02:20:48.182910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":924,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184394+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:48.184394+0000","last_peered":"2024-04-19T02:20:48.184394+0000","last_clean":"2024-04-19T02:20:48.184394+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:48.184394+0000","last_undegraded":"2024-04-19T02:20:48.184394+0000","last_fullsized":"2024-04-19T02:20:48.184394+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":441,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182218+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:48.182218+0000","last_peered":"2024-04-19T02:20:48.182218+0000","last_clean":"2024-04-19T02:20:48.182218+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:48.182218+0000","last_undegraded":"2024-04-19T02:20:48.182218+0000","last_fullsized":"2024-04-19T02:20:48.182218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":841,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183835+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:48.183835+0000","last_peered":"2024-04-19T02:20:48.183835+0000","last_clean":"2024-04-19T02:20:48.183835+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:48.183835+0000","last_undegraded":"2024-04-19T02:20:48.183835+0000","last_fullsized":"2024-04-19T02:20:48.183835+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":588,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183848+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:48.183848+0000","last_peered":"2024-04-19T02:20:48.183848+0000","last_clean":"2024-04-19T02:20:48.183848+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:48.183848+0000","last_undegraded":"2024-04-19T02:20:48.183848+0000","last_fullsized":"2024-04-19T02:20:48.183848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":530,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184997+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:48.184997+0000","last_peered":"2024-04-19T02:20:48.184997+0000","last_clean":"2024-04-19T02:20:48.184997+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:48.184997+0000","last_undegraded":"2024-04-19T02:20:48.184997+0000","last_fullsized":"2024-04-19T02:20:48.184997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":168,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184386+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:48.184386+0000","last_peered":"2024-04-19T02:20:48.184386+0000","last_clean":"2024-04-19T02:20:48.184386+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:48.184386+0000","last_undegraded":"2024-04-19T02:20:48.184386+0000","last_fullsized":"2024-04-19T02:20:48.184386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":818,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182144+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:48.182144+0000","last_peered":"2024-04-19T02:20:48.182144+0000","last_clean":"2024-04-19T02:20:48.182144+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:48.182144+0000","last_undegraded":"2024-04-19T02:20:48.182144+0000","last_fullsized":"2024-04-19T02:20:48.182144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":428,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183861+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:48.183861+0000","last_peered":"2024-04-19T02:20:48.183861+0000","last_clean":"2024-04-19T02:20:48.183861+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:48.183861+0000","last_undegraded":"2024-04-19T02:20:48.183861+0000","last_fullsized":"2024-04-19T02:20:48.183861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":871,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181985+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:48.181985+0000","last_peered":"2024-04-19T02:20:48.181985+0000","last_clean":"2024-04-19T02:20:48.181985+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:48.181985+0000","last_undegraded":"2024-04-19T02:20:48.181985+0000","last_fullsized":"2024-04-19T02:20:48.181985+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":488,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184430+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:48.184430+0000","last_peered":"2024-04-19T02:20:48.184430+0000","last_clean":"2024-04-19T02:20:48.184430+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:48.184430+0000","last_undegraded":"2024-04-19T02:20:48.184430+0000","last_fullsized":"2024-04-19T02:20:48.184430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":613,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183277+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:48.183277+0000","last_peered":"2024-04-19T02:20:48.183277+0000","last_clean":"2024-04-19T02:20:48.183277+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:48.183277+0000","last_undegraded":"2024-04-19T02:20:48.183277+0000","last_fullsized":"2024-04-19T02:20:48.183277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185216+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:48.185216+0000","last_peered":"2024-04-19T02:20:48.185216+0000","last_clean":"2024-04-19T02:20:48.185216+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:48.185216+0000","last_undegraded":"2024-04-19T02:20:48.185216+0000","last_fullsized":"2024-04-19T02:20:48.185216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":572,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.181816+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:48.181816+0000","last_peered":"2024-04-19T02:20:48.181816+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:48.181816+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185132+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:48.185132+0000","last_peered":"2024-04-19T02:20:48.185132+0000","last_clean":"2024-04-19T02:20:48.185132+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:48.185132+0000","last_undegraded":"2024-04-19T02:20:48.185132+0000","last_fullsized":"2024-04-19T02:20:48.185132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2592,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4572,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":113,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124812,"kb_used_data":27320,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247028,"statfs":{"total":96636764160,"available":96508956672,"internally_reserved":0,"allocated":27975680,"data_stored":81579022,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":1,"up_from":78,"seq":335007449093,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39680,"kb_used_data":12144,"kb_used_omap":7,"kb_used_meta":27512,"kb_avail":94332160,"statfs":{"total":96636764160,"available":96596131840,"internally_reserved":0,"allocated":12435456,"data_stored":91853600,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":28173311},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139416,"kb_used_data":27976,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232424,"statfs":{"total":96636764160,"available":96494002176,"internally_reserved":0,"allocated":28647424,"data_stored":86196799,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:53.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:20:53.527 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:53.527 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2592/110 objects degraded (2356.364%), 14 pgs degraded","count":14},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":290,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":102,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":9},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":89},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":14},{"state_name":"peering","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":311201792,"bytes_avail":289599090688,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":2592,"degraded_total":110,"degraded_ratio":23.563636363636359,"recovering_objects_per_sec":348,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1393,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:20:53.545 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:20:53.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:53.825 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:53.827 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:53.842 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-04-19T02:20:53.177028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2592,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4598,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":195,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":303908,"kb_used_data":67440,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282811612,"statfs":{"total":289910292480,"available":289599090688,"internally_reserved":0,"allocated":69058560,"data_stored":259629421,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":242079627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1239,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1393,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.998898"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":548,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184923+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:48.184923+0000","last_peered":"2024-04-19T02:20:48.184923+0000","last_clean":"2024-04-19T02:20:48.184923+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:48.184923+0000","last_undegraded":"2024-04-19T02:20:48.184923+0000","last_fullsized":"2024-04-19T02:20:48.184923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":574,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184934+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:48.184934+0000","last_peered":"2024-04-19T02:20:48.184934+0000","last_clean":"2024-04-19T02:20:48.184934+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:48.184934+0000","last_undegraded":"2024-04-19T02:20:48.184934+0000","last_fullsized":"2024-04-19T02:20:48.184934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":497,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.183424+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:48.183424+0000","last_peered":"2024-04-19T02:20:48.183424+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:48.183424+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":825,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183161+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:48.183161+0000","last_peered":"2024-04-19T02:20:48.183161+0000","last_clean":"2024-04-19T02:20:48.183161+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:48.183161+0000","last_undegraded":"2024-04-19T02:20:48.183161+0000","last_fullsized":"2024-04-19T02:20:48.183161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":522,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184376+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:48.184376+0000","last_peered":"2024-04-19T02:20:48.184376+0000","last_clean":"2024-04-19T02:20:48.184376+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:48.184376+0000","last_undegraded":"2024-04-19T02:20:48.184376+0000","last_fullsized":"2024-04-19T02:20:48.184376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":919,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182839+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:48.182839+0000","last_peered":"2024-04-19T02:20:48.182839+0000","last_clean":"2024-04-19T02:20:48.182839+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:48.182839+0000","last_undegraded":"2024-04-19T02:20:48.182839+0000","last_fullsized":"2024-04-19T02:20:48.182839+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":908,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181449+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:48.181449+0000","last_peered":"2024-04-19T02:20:48.181449+0000","last_clean":"2024-04-19T02:20:48.181449+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:48.181449+0000","last_undegraded":"2024-04-19T02:20:48.181449+0000","last_fullsized":"2024-04-19T02:20:48.181449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":936,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181669+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:48.181669+0000","last_peered":"2024-04-19T02:20:48.181669+0000","last_clean":"2024-04-19T02:20:48.181669+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:48.181669+0000","last_undegraded":"2024-04-19T02:20:48.181669+0000","last_fullsized":"2024-04-19T02:20:48.181669+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184215+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:48.184215+0000","last_peered":"2024-04-19T02:20:48.184215+0000","last_clean":"2024-04-19T02:20:48.184215+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:48.184215+0000","last_undegraded":"2024-04-19T02:20:48.184215+0000","last_fullsized":"2024-04-19T02:20:48.184215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":534,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184082+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:48.184082+0000","last_peered":"2024-04-19T02:20:48.184082+0000","last_clean":"2024-04-19T02:20:48.184082+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:48.184082+0000","last_undegraded":"2024-04-19T02:20:48.184082+0000","last_fullsized":"2024-04-19T02:20:48.184082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":823,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.198732+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:48.198732+0000","last_peered":"2024-04-19T02:20:48.198732+0000","last_clean":"2024-04-19T02:20:48.198732+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:48.198732+0000","last_undegraded":"2024-04-19T02:20:48.198732+0000","last_fullsized":"2024-04-19T02:20:48.198732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":891,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.198847+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:49.198847+0000","last_peered":"2024-04-19T02:20:49.198847+0000","last_clean":"2024-04-19T02:20:49.198847+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:49.198847+0000","last_undegraded":"2024-04-19T02:20:49.198847+0000","last_fullsized":"2024-04-19T02:20:49.198847+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":518,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184089+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:48.184089+0000","last_peered":"2024-04-19T02:20:48.184089+0000","last_clean":"2024-04-19T02:20:48.184089+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:48.184089+0000","last_undegraded":"2024-04-19T02:20:48.184089+0000","last_fullsized":"2024-04-19T02:20:48.184089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":521,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182921+0000","last_change":"2024-04-19T02:20:31.679166+0000","last_active":"2024-04-19T02:20:48.182921+0000","last_peered":"2024-04-19T02:20:48.182921+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674177+0000","last_became_peered":"2024-04-19T02:20:31.674177+0000","last_unstale":"2024-04-19T02:20:48.182921+0000","last_undegraded":"2024-04-19T02:20:31.533394+0000","last_fullsized":"2024-04-19T02:20:31.525536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:09.705192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":907,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182514+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:48.182514+0000","last_peered":"2024-04-19T02:20:48.182514+0000","last_clean":"2024-04-19T02:20:48.182514+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:48.182514+0000","last_undegraded":"2024-04-19T02:20:48.182514+0000","last_fullsized":"2024-04-19T02:20:48.182514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":990,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181468+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:48.181468+0000","last_peered":"2024-04-19T02:20:48.181468+0000","last_clean":"2024-04-19T02:20:48.181468+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:48.181468+0000","last_undegraded":"2024-04-19T02:20:48.181468+0000","last_fullsized":"2024-04-19T02:20:48.181468+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185498+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:48.185498+0000","last_peered":"2024-04-19T02:20:48.185498+0000","last_clean":"2024-04-19T02:20:48.185498+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:48.185498+0000","last_undegraded":"2024-04-19T02:20:48.185498+0000","last_fullsized":"2024-04-19T02:20:48.185498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":518,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184509+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:48.184509+0000","last_peered":"2024-04-19T02:20:48.184509+0000","last_clean":"2024-04-19T02:20:48.184509+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:48.184509+0000","last_undegraded":"2024-04-19T02:20:48.184509+0000","last_fullsized":"2024-04-19T02:20:48.184509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183650+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:48.183650+0000","last_peered":"2024-04-19T02:20:48.183650+0000","last_clean":"2024-04-19T02:20:48.183650+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:48.183650+0000","last_undegraded":"2024-04-19T02:20:48.183650+0000","last_fullsized":"2024-04-19T02:20:48.183650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":919,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183395+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:48.183395+0000","last_peered":"2024-04-19T02:20:48.183395+0000","last_clean":"2024-04-19T02:20:48.183395+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:48.183395+0000","last_undegraded":"2024-04-19T02:20:48.183395+0000","last_fullsized":"2024-04-19T02:20:48.183395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":558,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.183520+0000","last_change":"2024-04-19T02:20:31.677463+0000","last_active":"2024-04-19T02:20:48.183520+0000","last_peered":"2024-04-19T02:20:48.183520+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669355+0000","last_became_peered":"2024-04-19T02:20:31.669355+0000","last_unstale":"2024-04-19T02:20:48.183520+0000","last_undegraded":"2024-04-19T02:20:31.539628+0000","last_fullsized":"2024-04-19T02:20:31.530420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.534054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1102,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183518+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:48.183518+0000","last_peered":"2024-04-19T02:20:48.183518+0000","last_clean":"2024-04-19T02:20:48.183518+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:48.183518+0000","last_undegraded":"2024-04-19T02:20:48.183518+0000","last_fullsized":"2024-04-19T02:20:48.183518+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":880,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181718+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:48.181718+0000","last_peered":"2024-04-19T02:20:48.181718+0000","last_clean":"2024-04-19T02:20:48.181718+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:48.181718+0000","last_undegraded":"2024-04-19T02:20:48.181718+0000","last_fullsized":"2024-04-19T02:20:48.181718+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":550,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182398+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:48.182398+0000","last_peered":"2024-04-19T02:20:48.182398+0000","last_clean":"2024-04-19T02:20:48.182398+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:48.182398+0000","last_undegraded":"2024-04-19T02:20:48.182398+0000","last_fullsized":"2024-04-19T02:20:48.182398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":537,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.185125+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:48.185125+0000","last_peered":"2024-04-19T02:20:48.185125+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:48.185125+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1147,"reported_epoch":98,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:49.472631+0000","last_change":"2024-04-19T02:20:49.473041+0000","last_active":"2024-04-19T02:20:49.472631+0000","last_peered":"2024-04-19T02:20:49.472631+0000","last_clean":"2024-04-19T02:17:07.002898+0000","last_became_active":"2024-04-19T02:20:31.669688+0000","last_became_peered":"2024-04-19T02:20:31.669688+0000","last_unstale":"2024-04-19T02:20:49.472631+0000","last_undegraded":"2024-04-19T02:20:49.472631+0000","last_fullsized":"2024-04-19T02:20:31.500329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:24.157279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":569,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.185166+0000","last_change":"2024-04-19T02:20:31.677524+0000","last_active":"2024-04-19T02:20:48.185166+0000","last_peered":"2024-04-19T02:20:48.185166+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.674315+0000","last_became_peered":"2024-04-19T02:20:31.674315+0000","last_unstale":"2024-04-19T02:20:48.185166+0000","last_undegraded":"2024-04-19T02:20:31.538086+0000","last_fullsized":"2024-04-19T02:20:31.535263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:00.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":797,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185549+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:48.185549+0000","last_peered":"2024-04-19T02:20:48.185549+0000","last_clean":"2024-04-19T02:20:48.185549+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:48.185549+0000","last_undegraded":"2024-04-19T02:20:48.185549+0000","last_fullsized":"2024-04-19T02:20:48.185549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":520,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183121+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:48.183121+0000","last_peered":"2024-04-19T02:20:48.183121+0000","last_clean":"2024-04-19T02:20:48.183121+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:48.183121+0000","last_undegraded":"2024-04-19T02:20:48.183121+0000","last_fullsized":"2024-04-19T02:20:48.183121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":634,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.183955+0000","last_change":"2024-04-19T02:20:31.679671+0000","last_active":"2024-04-19T02:20:48.183955+0000","last_peered":"2024-04-19T02:20:48.183955+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:48.183955+0000","last_undegraded":"2024-04-19T02:20:31.528848+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":597,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181747+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:48.181747+0000","last_peered":"2024-04-19T02:20:48.181747+0000","last_clean":"2024-04-19T02:20:48.181747+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:48.181747+0000","last_undegraded":"2024-04-19T02:20:48.181747+0000","last_fullsized":"2024-04-19T02:20:48.181747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":538,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182045+0000","last_change":"2024-04-19T02:20:31.678075+0000","last_active":"2024-04-19T02:20:48.182045+0000","last_peered":"2024-04-19T02:20:48.182045+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.670956+0000","last_became_peered":"2024-04-19T02:20:31.670956+0000","last_unstale":"2024-04-19T02:20:48.182045+0000","last_undegraded":"2024-04-19T02:20:31.525375+0000","last_fullsized":"2024-04-19T02:20:31.512162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:04.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":478,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185262+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:48.185262+0000","last_peered":"2024-04-19T02:20:48.185262+0000","last_clean":"2024-04-19T02:20:48.185262+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:48.185262+0000","last_undegraded":"2024-04-19T02:20:48.185262+0000","last_fullsized":"2024-04-19T02:20:48.185262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":485,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183110+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:48.183110+0000","last_peered":"2024-04-19T02:20:48.183110+0000","last_clean":"2024-04-19T02:20:48.183110+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:48.183110+0000","last_undegraded":"2024-04-19T02:20:48.183110+0000","last_fullsized":"2024-04-19T02:20:48.183110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":527,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184373+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:48.184373+0000","last_peered":"2024-04-19T02:20:48.184373+0000","last_clean":"2024-04-19T02:20:48.184373+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:48.184373+0000","last_undegraded":"2024-04-19T02:20:48.184373+0000","last_fullsized":"2024-04-19T02:20:48.184373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":168,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182119+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:48.182119+0000","last_peered":"2024-04-19T02:20:48.182119+0000","last_clean":"2024-04-19T02:20:48.182119+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:48.182119+0000","last_undegraded":"2024-04-19T02:20:48.182119+0000","last_fullsized":"2024-04-19T02:20:48.182119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":611,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.185454+0000","last_change":"2024-04-19T02:20:31.678680+0000","last_active":"2024-04-19T02:20:48.185454+0000","last_peered":"2024-04-19T02:20:48.185454+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:48.185454+0000","last_undegraded":"2024-04-19T02:20:31.539575+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":174,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182992+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:48.182992+0000","last_peered":"2024-04-19T02:20:48.182992+0000","last_clean":"2024-04-19T02:20:48.182992+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:48.182992+0000","last_undegraded":"2024-04-19T02:20:48.182992+0000","last_fullsized":"2024-04-19T02:20:48.182992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":546,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.184931+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:48.184931+0000","last_peered":"2024-04-19T02:20:48.184931+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:48.184931+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182742+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:48.182742+0000","last_peered":"2024-04-19T02:20:48.182742+0000","last_clean":"2024-04-19T02:20:48.182742+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:48.182742+0000","last_undegraded":"2024-04-19T02:20:48.182742+0000","last_fullsized":"2024-04-19T02:20:48.182742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":271,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185521+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:48.185521+0000","last_peered":"2024-04-19T02:20:48.185521+0000","last_clean":"2024-04-19T02:20:48.185521+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:48.185521+0000","last_undegraded":"2024-04-19T02:20:48.185521+0000","last_fullsized":"2024-04-19T02:20:48.185521+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":876,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182559+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:48.182559+0000","last_peered":"2024-04-19T02:20:48.182559+0000","last_clean":"2024-04-19T02:20:48.182559+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:48.182559+0000","last_undegraded":"2024-04-19T02:20:48.182559+0000","last_fullsized":"2024-04-19T02:20:48.182559+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":410,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185185+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:48.185185+0000","last_peered":"2024-04-19T02:20:48.185185+0000","last_clean":"2024-04-19T02:20:48.185185+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:48.185185+0000","last_undegraded":"2024-04-19T02:20:48.185185+0000","last_fullsized":"2024-04-19T02:20:48.185185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":548,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182748+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:48.182748+0000","last_peered":"2024-04-19T02:20:48.182748+0000","last_clean":"2024-04-19T02:20:48.182748+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:48.182748+0000","last_undegraded":"2024-04-19T02:20:48.182748+0000","last_fullsized":"2024-04-19T02:20:48.182748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":700,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184120+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:48.184120+0000","last_peered":"2024-04-19T02:20:48.184120+0000","last_clean":"2024-04-19T02:20:48.184120+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:48.184120+0000","last_undegraded":"2024-04-19T02:20:48.184120+0000","last_fullsized":"2024-04-19T02:20:48.184120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":879,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.201498+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:49.201498+0000","last_peered":"2024-04-19T02:20:49.201498+0000","last_clean":"2024-04-19T02:20:49.201498+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:49.201498+0000","last_undegraded":"2024-04-19T02:20:49.201498+0000","last_fullsized":"2024-04-19T02:20:49.201498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183887+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:48.183887+0000","last_peered":"2024-04-19T02:20:48.183887+0000","last_clean":"2024-04-19T02:20:48.183887+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:48.183887+0000","last_undegraded":"2024-04-19T02:20:48.183887+0000","last_fullsized":"2024-04-19T02:20:48.183887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":662,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182476+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:48.182476+0000","last_peered":"2024-04-19T02:20:48.182476+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:48.182476+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":250,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183718+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:48.183718+0000","last_peered":"2024-04-19T02:20:48.183718+0000","last_clean":"2024-04-19T02:20:48.183718+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:48.183718+0000","last_undegraded":"2024-04-19T02:20:48.183718+0000","last_fullsized":"2024-04-19T02:20:48.183718+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":949,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183050+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:48.183050+0000","last_peered":"2024-04-19T02:20:48.183050+0000","last_clean":"2024-04-19T02:20:48.183050+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:48.183050+0000","last_undegraded":"2024-04-19T02:20:48.183050+0000","last_fullsized":"2024-04-19T02:20:48.183050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":301,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181864+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:48.181864+0000","last_peered":"2024-04-19T02:20:48.181864+0000","last_clean":"2024-04-19T02:20:48.181864+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:48.181864+0000","last_undegraded":"2024-04-19T02:20:48.181864+0000","last_fullsized":"2024-04-19T02:20:48.181864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":597,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.184660+0000","last_change":"2024-04-19T02:20:31.679082+0000","last_active":"2024-04-19T02:20:48.184660+0000","last_peered":"2024-04-19T02:20:48.184660+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.673897+0000","last_became_peered":"2024-04-19T02:20:31.673897+0000","last_unstale":"2024-04-19T02:20:48.184660+0000","last_undegraded":"2024-04-19T02:20:31.536723+0000","last_fullsized":"2024-04-19T02:20:31.533980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:32.482221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":159,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183137+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:48.183137+0000","last_peered":"2024-04-19T02:20:48.183137+0000","last_clean":"2024-04-19T02:20:48.183137+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:48.183137+0000","last_undegraded":"2024-04-19T02:20:48.183137+0000","last_fullsized":"2024-04-19T02:20:48.183137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":802,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183792+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:48.183792+0000","last_peered":"2024-04-19T02:20:48.183792+0000","last_clean":"2024-04-19T02:20:48.183792+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:48.183792+0000","last_undegraded":"2024-04-19T02:20:48.183792+0000","last_fullsized":"2024-04-19T02:20:48.183792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":483,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182806+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:48.182806+0000","last_peered":"2024-04-19T02:20:48.182806+0000","last_clean":"2024-04-19T02:20:48.182806+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:48.182806+0000","last_undegraded":"2024-04-19T02:20:48.182806+0000","last_fullsized":"2024-04-19T02:20:48.182806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":511,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184600+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:48.184600+0000","last_peered":"2024-04-19T02:20:48.184600+0000","last_clean":"2024-04-19T02:20:48.184600+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:48.184600+0000","last_undegraded":"2024-04-19T02:20:48.184600+0000","last_fullsized":"2024-04-19T02:20:48.184600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":286,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183478+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:48.183478+0000","last_peered":"2024-04-19T02:20:48.183478+0000","last_clean":"2024-04-19T02:20:48.183478+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:48.183478+0000","last_undegraded":"2024-04-19T02:20:48.183478+0000","last_fullsized":"2024-04-19T02:20:48.183478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184698+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:48.184698+0000","last_peered":"2024-04-19T02:20:48.184698+0000","last_clean":"2024-04-19T02:20:48.184698+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:48.184698+0000","last_undegraded":"2024-04-19T02:20:48.184698+0000","last_fullsized":"2024-04-19T02:20:48.184698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":854,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183792+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:48.183792+0000","last_peered":"2024-04-19T02:20:48.183792+0000","last_clean":"2024-04-19T02:20:48.183792+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:48.183792+0000","last_undegraded":"2024-04-19T02:20:48.183792+0000","last_fullsized":"2024-04-19T02:20:48.183792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":943,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-19T02:20:49.184629+0000","last_change":"2024-04-19T02:20:49.184859+0000","last_active":"2024-04-19T02:20:49.184629+0000","last_peered":"2024-04-19T02:20:48.730329+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.669108+0000","last_became_peered":"2024-04-19T02:20:31.669108+0000","last_unstale":"2024-04-19T02:20:49.184629+0000","last_undegraded":"2024-04-19T02:20:49.184629+0000","last_fullsized":"2024-04-19T02:20:49.184629+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183032+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:48.183032+0000","last_peered":"2024-04-19T02:20:48.183032+0000","last_clean":"2024-04-19T02:20:48.183032+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:48.183032+0000","last_undegraded":"2024-04-19T02:20:48.183032+0000","last_fullsized":"2024-04-19T02:20:48.183032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":291,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182525+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:48.182525+0000","last_peered":"2024-04-19T02:20:48.182525+0000","last_clean":"2024-04-19T02:20:48.182525+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:48.182525+0000","last_undegraded":"2024-04-19T02:20:48.182525+0000","last_fullsized":"2024-04-19T02:20:48.182525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":537,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184746+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:48.184746+0000","last_peered":"2024-04-19T02:20:48.184746+0000","last_clean":"2024-04-19T02:20:48.184746+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:48.184746+0000","last_undegraded":"2024-04-19T02:20:48.184746+0000","last_fullsized":"2024-04-19T02:20:48.184746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182747+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:48.182747+0000","last_peered":"2024-04-19T02:20:48.182747+0000","last_clean":"2024-04-19T02:20:48.182747+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:48.182747+0000","last_undegraded":"2024-04-19T02:20:48.182747+0000","last_fullsized":"2024-04-19T02:20:48.182747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":504,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183041+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:48.183041+0000","last_peered":"2024-04-19T02:20:48.183041+0000","last_clean":"2024-04-19T02:20:48.183041+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:48.183041+0000","last_undegraded":"2024-04-19T02:20:48.183041+0000","last_fullsized":"2024-04-19T02:20:48.183041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":449,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184878+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:48.184878+0000","last_peered":"2024-04-19T02:20:48.184878+0000","last_clean":"2024-04-19T02:20:48.184878+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:48.184878+0000","last_undegraded":"2024-04-19T02:20:48.184878+0000","last_fullsized":"2024-04-19T02:20:48.184878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184222+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:48.184222+0000","last_peered":"2024-04-19T02:20:48.184222+0000","last_clean":"2024-04-19T02:20:48.184222+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:48.184222+0000","last_undegraded":"2024-04-19T02:20:48.184222+0000","last_fullsized":"2024-04-19T02:20:48.184222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":152,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183395+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:48.183395+0000","last_peered":"2024-04-19T02:20:48.183395+0000","last_clean":"2024-04-19T02:20:48.183395+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:48.183395+0000","last_undegraded":"2024-04-19T02:20:48.183395+0000","last_fullsized":"2024-04-19T02:20:48.183395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":550,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183499+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:48.183499+0000","last_peered":"2024-04-19T02:20:48.183499+0000","last_clean":"2024-04-19T02:20:48.183499+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:48.183499+0000","last_undegraded":"2024-04-19T02:20:48.183499+0000","last_fullsized":"2024-04-19T02:20:48.183499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":554,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184462+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:48.184462+0000","last_peered":"2024-04-19T02:20:48.184462+0000","last_clean":"2024-04-19T02:20:48.184462+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:48.184462+0000","last_undegraded":"2024-04-19T02:20:48.184462+0000","last_fullsized":"2024-04-19T02:20:48.184462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184101+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:48.184101+0000","last_peered":"2024-04-19T02:20:48.184101+0000","last_clean":"2024-04-19T02:20:48.184101+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:48.184101+0000","last_undegraded":"2024-04-19T02:20:48.184101+0000","last_fullsized":"2024-04-19T02:20:48.184101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":838,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183520+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:48.183520+0000","last_peered":"2024-04-19T02:20:48.183520+0000","last_clean":"2024-04-19T02:20:48.183520+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:48.183520+0000","last_undegraded":"2024-04-19T02:20:48.183520+0000","last_fullsized":"2024-04-19T02:20:48.183520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":148,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184582+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:48.184582+0000","last_peered":"2024-04-19T02:20:48.184582+0000","last_clean":"2024-04-19T02:20:48.184582+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:48.184582+0000","last_undegraded":"2024-04-19T02:20:48.184582+0000","last_fullsized":"2024-04-19T02:20:48.184582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185001+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:48.185001+0000","last_peered":"2024-04-19T02:20:48.185001+0000","last_clean":"2024-04-19T02:20:48.185001+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:48.185001+0000","last_undegraded":"2024-04-19T02:20:48.185001+0000","last_fullsized":"2024-04-19T02:20:48.185001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":955,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184110+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:48.184110+0000","last_peered":"2024-04-19T02:20:48.184110+0000","last_clean":"2024-04-19T02:20:48.184110+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:48.184110+0000","last_undegraded":"2024-04-19T02:20:48.184110+0000","last_fullsized":"2024-04-19T02:20:48.184110+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":158,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185600+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:48.185600+0000","last_peered":"2024-04-19T02:20:48.185600+0000","last_clean":"2024-04-19T02:20:48.185600+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:48.185600+0000","last_undegraded":"2024-04-19T02:20:48.185600+0000","last_fullsized":"2024-04-19T02:20:48.185600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185589+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:48.185589+0000","last_peered":"2024-04-19T02:20:48.185589+0000","last_clean":"2024-04-19T02:20:48.185589+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:48.185589+0000","last_undegraded":"2024-04-19T02:20:48.185589+0000","last_fullsized":"2024-04-19T02:20:48.185589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":558,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182715+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:48.182715+0000","last_peered":"2024-04-19T02:20:48.182715+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:48.182715+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":185,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185451+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:48.185451+0000","last_peered":"2024-04-19T02:20:48.185451+0000","last_clean":"2024-04-19T02:20:48.185451+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:48.185451+0000","last_undegraded":"2024-04-19T02:20:48.185451+0000","last_fullsized":"2024-04-19T02:20:48.185451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185579+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:48.185579+0000","last_peered":"2024-04-19T02:20:48.185579+0000","last_clean":"2024-04-19T02:20:48.185579+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:48.185579+0000","last_undegraded":"2024-04-19T02:20:48.185579+0000","last_fullsized":"2024-04-19T02:20:48.185579+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":558,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181468+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:48.181468+0000","last_peered":"2024-04-19T02:20:48.181468+0000","last_clean":"2024-04-19T02:20:48.181468+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:48.181468+0000","last_undegraded":"2024-04-19T02:20:48.181468+0000","last_fullsized":"2024-04-19T02:20:48.181468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":861,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183565+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:48.183565+0000","last_peered":"2024-04-19T02:20:48.183565+0000","last_clean":"2024-04-19T02:20:48.183565+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:48.183565+0000","last_undegraded":"2024-04-19T02:20:48.183565+0000","last_fullsized":"2024-04-19T02:20:48.183565+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":563,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184661+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:48.184661+0000","last_peered":"2024-04-19T02:20:48.184661+0000","last_clean":"2024-04-19T02:20:48.184661+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:48.184661+0000","last_undegraded":"2024-04-19T02:20:48.184661+0000","last_fullsized":"2024-04-19T02:20:48.184661+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":535,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181693+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:48.181693+0000","last_peered":"2024-04-19T02:20:48.181693+0000","last_clean":"2024-04-19T02:20:48.181693+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:48.181693+0000","last_undegraded":"2024-04-19T02:20:48.181693+0000","last_fullsized":"2024-04-19T02:20:48.181693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":196,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184684+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:48.184684+0000","last_peered":"2024-04-19T02:20:48.184684+0000","last_clean":"2024-04-19T02:20:48.184684+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:48.184684+0000","last_undegraded":"2024-04-19T02:20:48.184684+0000","last_fullsized":"2024-04-19T02:20:48.184684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":418,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184921+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:48.184921+0000","last_peered":"2024-04-19T02:20:48.184921+0000","last_clean":"2024-04-19T02:20:48.184921+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:48.184921+0000","last_undegraded":"2024-04-19T02:20:48.184921+0000","last_fullsized":"2024-04-19T02:20:48.184921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":593,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.182110+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:48.182110+0000","last_peered":"2024-04-19T02:20:48.182110+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:48.182110+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":158,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185273+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:48.185273+0000","last_peered":"2024-04-19T02:20:48.185273+0000","last_clean":"2024-04-19T02:20:48.185273+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:48.185273+0000","last_undegraded":"2024-04-19T02:20:48.185273+0000","last_fullsized":"2024-04-19T02:20:48.185273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":609,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182388+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:48.182388+0000","last_peered":"2024-04-19T02:20:48.182388+0000","last_clean":"2024-04-19T02:20:48.182388+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:48.182388+0000","last_undegraded":"2024-04-19T02:20:48.182388+0000","last_fullsized":"2024-04-19T02:20:48.182388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":899,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185185+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:48.185185+0000","last_peered":"2024-04-19T02:20:48.185185+0000","last_clean":"2024-04-19T02:20:48.185185+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:48.185185+0000","last_undegraded":"2024-04-19T02:20:48.185185+0000","last_fullsized":"2024-04-19T02:20:48.185185+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":663,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182910+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:48.182910+0000","last_peered":"2024-04-19T02:20:48.182910+0000","last_clean":"2024-04-19T02:20:48.182910+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:48.182910+0000","last_undegraded":"2024-04-19T02:20:48.182910+0000","last_fullsized":"2024-04-19T02:20:48.182910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":924,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184394+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:48.184394+0000","last_peered":"2024-04-19T02:20:48.184394+0000","last_clean":"2024-04-19T02:20:48.184394+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:48.184394+0000","last_undegraded":"2024-04-19T02:20:48.184394+0000","last_fullsized":"2024-04-19T02:20:48.184394+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":441,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182218+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:48.182218+0000","last_peered":"2024-04-19T02:20:48.182218+0000","last_clean":"2024-04-19T02:20:48.182218+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:48.182218+0000","last_undegraded":"2024-04-19T02:20:48.182218+0000","last_fullsized":"2024-04-19T02:20:48.182218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":841,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183835+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:48.183835+0000","last_peered":"2024-04-19T02:20:48.183835+0000","last_clean":"2024-04-19T02:20:48.183835+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:48.183835+0000","last_undegraded":"2024-04-19T02:20:48.183835+0000","last_fullsized":"2024-04-19T02:20:48.183835+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":588,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183848+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:48.183848+0000","last_peered":"2024-04-19T02:20:48.183848+0000","last_clean":"2024-04-19T02:20:48.183848+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:48.183848+0000","last_undegraded":"2024-04-19T02:20:48.183848+0000","last_fullsized":"2024-04-19T02:20:48.183848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":530,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184997+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:48.184997+0000","last_peered":"2024-04-19T02:20:48.184997+0000","last_clean":"2024-04-19T02:20:48.184997+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:48.184997+0000","last_undegraded":"2024-04-19T02:20:48.184997+0000","last_fullsized":"2024-04-19T02:20:48.184997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":168,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184386+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:48.184386+0000","last_peered":"2024-04-19T02:20:48.184386+0000","last_clean":"2024-04-19T02:20:48.184386+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:48.184386+0000","last_undegraded":"2024-04-19T02:20:48.184386+0000","last_fullsized":"2024-04-19T02:20:48.184386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":818,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.182144+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:48.182144+0000","last_peered":"2024-04-19T02:20:48.182144+0000","last_clean":"2024-04-19T02:20:48.182144+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:48.182144+0000","last_undegraded":"2024-04-19T02:20:48.182144+0000","last_fullsized":"2024-04-19T02:20:48.182144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":428,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183861+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:48.183861+0000","last_peered":"2024-04-19T02:20:48.183861+0000","last_clean":"2024-04-19T02:20:48.183861+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:48.183861+0000","last_undegraded":"2024-04-19T02:20:48.183861+0000","last_fullsized":"2024-04-19T02:20:48.183861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":871,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.181985+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:48.181985+0000","last_peered":"2024-04-19T02:20:48.181985+0000","last_clean":"2024-04-19T02:20:48.181985+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:48.181985+0000","last_undegraded":"2024-04-19T02:20:48.181985+0000","last_fullsized":"2024-04-19T02:20:48.181985+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":488,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.184430+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:48.184430+0000","last_peered":"2024-04-19T02:20:48.184430+0000","last_clean":"2024-04-19T02:20:48.184430+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:48.184430+0000","last_undegraded":"2024-04-19T02:20:48.184430+0000","last_fullsized":"2024-04-19T02:20:48.184430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":613,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.183277+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:48.183277+0000","last_peered":"2024-04-19T02:20:48.183277+0000","last_clean":"2024-04-19T02:20:48.183277+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:48.183277+0000","last_undegraded":"2024-04-19T02:20:48.183277+0000","last_fullsized":"2024-04-19T02:20:48.183277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185216+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:48.185216+0000","last_peered":"2024-04-19T02:20:48.185216+0000","last_clean":"2024-04-19T02:20:48.185216+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:48.185216+0000","last_undegraded":"2024-04-19T02:20:48.185216+0000","last_fullsized":"2024-04-19T02:20:48.185216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":572,"reported_epoch":97,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:48.181816+0000","last_change":"2024-04-19T02:20:31.678253+0000","last_active":"2024-04-19T02:20:48.181816+0000","last_peered":"2024-04-19T02:20:48.181816+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:48.181816+0000","last_undegraded":"2024-04-19T02:20:31.533022+0000","last_fullsized":"2024-04-19T02:20:31.510282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:10.045240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.185132+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:48.185132+0000","last_peered":"2024-04-19T02:20:48.185132+0000","last_clean":"2024-04-19T02:20:48.185132+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:48.185132+0000","last_undegraded":"2024-04-19T02:20:48.185132+0000","last_fullsized":"2024-04-19T02:20:48.185132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2592,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4572,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":113,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124812,"kb_used_data":27320,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94247028,"statfs":{"total":96636764160,"available":96508956672,"internally_reserved":0,"allocated":27975680,"data_stored":81579022,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":1,"up_from":78,"seq":335007449093,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39680,"kb_used_data":12144,"kb_used_omap":7,"kb_used_meta":27512,"kb_avail":94332160,"statfs":{"total":96636764160,"available":96596131840,"internally_reserved":0,"allocated":12435456,"data_stored":91853600,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":28173311},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139416,"kb_used_data":27976,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232424,"statfs":{"total":96636764160,"available":96494002176,"internally_reserved":0,"allocated":28647424,"data_stored":86196799,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:56.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:57.159 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:57.161 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:57.179 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-04-19T02:20:56.299210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5941,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":316364,"kb_used_data":67620,"kb_used_omap":10,"kb_used_meta":248693,"kb_avail":282799156,"statfs":{"total":289910292480,"available":289586335744,"internally_reserved":0,"allocated":69242880,"data_stored":259698778,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":254662539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1486,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001528"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":553,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182608+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:53.182608+0000","last_peered":"2024-04-19T02:20:53.182608+0000","last_clean":"2024-04-19T02:20:53.182608+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:53.182608+0000","last_undegraded":"2024-04-19T02:20:53.182608+0000","last_fullsized":"2024-04-19T02:20:53.182608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":579,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181495+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:53.181495+0000","last_peered":"2024-04-19T02:20:53.181495+0000","last_clean":"2024-04-19T02:20:53.181495+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:53.181495+0000","last_undegraded":"2024-04-19T02:20:53.181495+0000","last_fullsized":"2024-04-19T02:20:53.181495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":502,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.181404+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:53.181404+0000","last_peered":"2024-04-19T02:20:53.181404+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:53.181404+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":830,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181937+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:53.181937+0000","last_peered":"2024-04-19T02:20:53.181937+0000","last_clean":"2024-04-19T02:20:53.181937+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:53.181937+0000","last_undegraded":"2024-04-19T02:20:53.181937+0000","last_fullsized":"2024-04-19T02:20:53.181937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":527,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181097+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:53.181097+0000","last_peered":"2024-04-19T02:20:53.181097+0000","last_clean":"2024-04-19T02:20:53.181097+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:53.181097+0000","last_undegraded":"2024-04-19T02:20:53.181097+0000","last_fullsized":"2024-04-19T02:20:53.181097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":924,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180394+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:53.180394+0000","last_peered":"2024-04-19T02:20:53.180394+0000","last_clean":"2024-04-19T02:20:53.180394+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:53.180394+0000","last_undegraded":"2024-04-19T02:20:53.180394+0000","last_fullsized":"2024-04-19T02:20:53.180394+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":913,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180179+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:53.180179+0000","last_peered":"2024-04-19T02:20:53.180179+0000","last_clean":"2024-04-19T02:20:53.180179+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:53.180179+0000","last_undegraded":"2024-04-19T02:20:53.180179+0000","last_fullsized":"2024-04-19T02:20:53.180179+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":941,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180341+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:53.180341+0000","last_peered":"2024-04-19T02:20:53.180341+0000","last_clean":"2024-04-19T02:20:53.180341+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:53.180341+0000","last_undegraded":"2024-04-19T02:20:53.180341+0000","last_fullsized":"2024-04-19T02:20:53.180341+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":548,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182962+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:53.182962+0000","last_peered":"2024-04-19T02:20:53.182962+0000","last_clean":"2024-04-19T02:20:53.182962+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:53.182962+0000","last_undegraded":"2024-04-19T02:20:53.182962+0000","last_fullsized":"2024-04-19T02:20:53.182962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":539,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181666+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:53.181666+0000","last_peered":"2024-04-19T02:20:53.181666+0000","last_clean":"2024-04-19T02:20:53.181666+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:53.181666+0000","last_undegraded":"2024-04-19T02:20:53.181666+0000","last_fullsized":"2024-04-19T02:20:53.181666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":828,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181990+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:53.181990+0000","last_peered":"2024-04-19T02:20:53.181990+0000","last_clean":"2024-04-19T02:20:53.181990+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:53.181990+0000","last_undegraded":"2024-04-19T02:20:53.181990+0000","last_fullsized":"2024-04-19T02:20:53.181990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":896,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181798+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:53.181798+0000","last_peered":"2024-04-19T02:20:53.181798+0000","last_clean":"2024-04-19T02:20:53.181798+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:53.181798+0000","last_undegraded":"2024-04-19T02:20:53.181798+0000","last_fullsized":"2024-04-19T02:20:53.181798+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":523,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180830+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:53.180830+0000","last_peered":"2024-04-19T02:20:53.180830+0000","last_clean":"2024-04-19T02:20:53.180830+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:53.180830+0000","last_undegraded":"2024-04-19T02:20:53.180830+0000","last_fullsized":"2024-04-19T02:20:53.180830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":892,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.208376+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:20:54.208376+0000","last_peered":"2024-04-19T02:20:54.208376+0000","last_clean":"2024-04-19T02:20:54.208376+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:20:54.208376+0000","last_undegraded":"2024-04-19T02:20:54.208376+0000","last_fullsized":"2024-04-19T02:20:54.208376+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":912,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180187+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:53.180187+0000","last_peered":"2024-04-19T02:20:53.180187+0000","last_clean":"2024-04-19T02:20:53.180187+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:53.180187+0000","last_undegraded":"2024-04-19T02:20:53.180187+0000","last_fullsized":"2024-04-19T02:20:53.180187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":995,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180068+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:53.180068+0000","last_peered":"2024-04-19T02:20:53.180068+0000","last_clean":"2024-04-19T02:20:53.180068+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:53.180068+0000","last_undegraded":"2024-04-19T02:20:53.180068+0000","last_fullsized":"2024-04-19T02:20:53.180068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":546,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183640+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:53.183640+0000","last_peered":"2024-04-19T02:20:53.183640+0000","last_clean":"2024-04-19T02:20:53.183640+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:53.183640+0000","last_undegraded":"2024-04-19T02:20:53.183640+0000","last_fullsized":"2024-04-19T02:20:53.183640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":523,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181897+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:53.181897+0000","last_peered":"2024-04-19T02:20:53.181897+0000","last_clean":"2024-04-19T02:20:53.181897+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:53.181897+0000","last_undegraded":"2024-04-19T02:20:53.181897+0000","last_fullsized":"2024-04-19T02:20:53.181897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":635,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.193998+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:54.193998+0000","last_peered":"2024-04-19T02:20:54.193998+0000","last_clean":"2024-04-19T02:20:54.193998+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:54.193998+0000","last_undegraded":"2024-04-19T02:20:54.193998+0000","last_fullsized":"2024-04-19T02:20:54.193998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":924,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182340+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:53.182340+0000","last_peered":"2024-04-19T02:20:53.182340+0000","last_clean":"2024-04-19T02:20:53.182340+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:53.182340+0000","last_undegraded":"2024-04-19T02:20:53.182340+0000","last_fullsized":"2024-04-19T02:20:53.182340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":925,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181611+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:20:53.181611+0000","last_peered":"2024-04-19T02:20:53.181611+0000","last_clean":"2024-04-19T02:20:53.181611+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:20:53.181611+0000","last_undegraded":"2024-04-19T02:20:53.181611+0000","last_fullsized":"2024-04-19T02:20:53.181611+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1108,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.194103+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:54.194103+0000","last_peered":"2024-04-19T02:20:54.194103+0000","last_clean":"2024-04-19T02:20:54.194103+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:54.194103+0000","last_undegraded":"2024-04-19T02:20:54.194103+0000","last_fullsized":"2024-04-19T02:20:54.194103+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":886,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.191852+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:54.191852+0000","last_peered":"2024-04-19T02:20:54.191852+0000","last_clean":"2024-04-19T02:20:54.191852+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:54.191852+0000","last_undegraded":"2024-04-19T02:20:54.191852+0000","last_fullsized":"2024-04-19T02:20:54.191852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":555,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180228+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:53.180228+0000","last_peered":"2024-04-19T02:20:53.180228+0000","last_clean":"2024-04-19T02:20:53.180228+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:53.180228+0000","last_undegraded":"2024-04-19T02:20:53.180228+0000","last_fullsized":"2024-04-19T02:20:53.180228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":542,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.182840+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:53.182840+0000","last_peered":"2024-04-19T02:20:53.182840+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:53.182840+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182711+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:20:53.182711+0000","last_peered":"2024-04-19T02:20:53.182711+0000","last_clean":"2024-04-19T02:20:53.182711+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:20:53.182711+0000","last_undegraded":"2024-04-19T02:20:53.182711+0000","last_fullsized":"2024-04-19T02:20:53.182711+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":932,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182748+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:20:53.182748+0000","last_peered":"2024-04-19T02:20:53.182748+0000","last_clean":"2024-04-19T02:20:53.182748+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:20:53.182748+0000","last_undegraded":"2024-04-19T02:20:53.182748+0000","last_fullsized":"2024-04-19T02:20:53.182748+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":802,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182346+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:53.182346+0000","last_peered":"2024-04-19T02:20:53.182346+0000","last_clean":"2024-04-19T02:20:53.182346+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:53.182346+0000","last_undegraded":"2024-04-19T02:20:53.182346+0000","last_fullsized":"2024-04-19T02:20:53.182346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":525,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181251+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:53.181251+0000","last_peered":"2024-04-19T02:20:53.181251+0000","last_clean":"2024-04-19T02:20:53.181251+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:53.181251+0000","last_undegraded":"2024-04-19T02:20:53.181251+0000","last_fullsized":"2024-04-19T02:20:53.181251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1055,"reported_epoch":103,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:54.322538+0000","last_change":"2024-04-19T02:20:54.323056+0000","last_active":"2024-04-19T02:20:54.322538+0000","last_peered":"2024-04-19T02:20:54.322538+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:54.322538+0000","last_undegraded":"2024-04-19T02:20:54.322538+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":602,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180527+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:53.180527+0000","last_peered":"2024-04-19T02:20:53.180527+0000","last_clean":"2024-04-19T02:20:53.180527+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:53.180527+0000","last_undegraded":"2024-04-19T02:20:53.180527+0000","last_fullsized":"2024-04-19T02:20:53.180527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":919,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.192636+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:20:53.192636+0000","last_peered":"2024-04-19T02:20:53.192636+0000","last_clean":"2024-04-19T02:20:53.192636+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:20:53.192636+0000","last_undegraded":"2024-04-19T02:20:53.192636+0000","last_fullsized":"2024-04-19T02:20:53.192636+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":483,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182586+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:53.182586+0000","last_peered":"2024-04-19T02:20:53.182586+0000","last_clean":"2024-04-19T02:20:53.182586+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:53.182586+0000","last_undegraded":"2024-04-19T02:20:53.182586+0000","last_fullsized":"2024-04-19T02:20:53.182586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":490,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180993+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:53.180993+0000","last_peered":"2024-04-19T02:20:53.180993+0000","last_clean":"2024-04-19T02:20:53.180993+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:53.180993+0000","last_undegraded":"2024-04-19T02:20:53.180993+0000","last_fullsized":"2024-04-19T02:20:53.180993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":532,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182076+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:53.182076+0000","last_peered":"2024-04-19T02:20:53.182076+0000","last_clean":"2024-04-19T02:20:53.182076+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:53.182076+0000","last_undegraded":"2024-04-19T02:20:53.182076+0000","last_fullsized":"2024-04-19T02:20:53.182076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181728+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:53.181728+0000","last_peered":"2024-04-19T02:20:53.181728+0000","last_clean":"2024-04-19T02:20:53.181728+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:53.181728+0000","last_undegraded":"2024-04-19T02:20:53.181728+0000","last_fullsized":"2024-04-19T02:20:53.181728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":711,"reported_epoch":103,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:54.516384+0000","last_change":"2024-04-19T02:20:54.327790+0000","last_active":"2024-04-19T02:20:54.516384+0000","last_peered":"2024-04-19T02:20:54.516384+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:54.516384+0000","last_undegraded":"2024-04-19T02:20:54.516384+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180725+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:53.180725+0000","last_peered":"2024-04-19T02:20:53.180725+0000","last_clean":"2024-04-19T02:20:53.180725+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:53.180725+0000","last_undegraded":"2024-04-19T02:20:53.180725+0000","last_fullsized":"2024-04-19T02:20:53.180725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":551,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.182713+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:53.182713+0000","last_peered":"2024-04-19T02:20:53.182713+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:53.182713+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":152,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180506+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:53.180506+0000","last_peered":"2024-04-19T02:20:53.180506+0000","last_clean":"2024-04-19T02:20:53.180506+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:53.180506+0000","last_undegraded":"2024-04-19T02:20:53.180506+0000","last_fullsized":"2024-04-19T02:20:53.180506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":276,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182992+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:53.182992+0000","last_peered":"2024-04-19T02:20:53.182992+0000","last_clean":"2024-04-19T02:20:53.182992+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:53.182992+0000","last_undegraded":"2024-04-19T02:20:53.182992+0000","last_fullsized":"2024-04-19T02:20:53.182992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":881,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180374+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:53.180374+0000","last_peered":"2024-04-19T02:20:53.180374+0000","last_clean":"2024-04-19T02:20:53.180374+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:53.180374+0000","last_undegraded":"2024-04-19T02:20:53.180374+0000","last_fullsized":"2024-04-19T02:20:53.180374+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":416,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.195530+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:54.195530+0000","last_peered":"2024-04-19T02:20:54.195530+0000","last_clean":"2024-04-19T02:20:54.195530+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:54.195530+0000","last_undegraded":"2024-04-19T02:20:54.195530+0000","last_fullsized":"2024-04-19T02:20:54.195530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":553,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180441+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:53.180441+0000","last_peered":"2024-04-19T02:20:53.180441+0000","last_clean":"2024-04-19T02:20:53.180441+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:53.180441+0000","last_undegraded":"2024-04-19T02:20:53.180441+0000","last_fullsized":"2024-04-19T02:20:53.180441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":705,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181995+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:53.181995+0000","last_peered":"2024-04-19T02:20:53.181995+0000","last_clean":"2024-04-19T02:20:53.181995+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:53.181995+0000","last_undegraded":"2024-04-19T02:20:53.181995+0000","last_fullsized":"2024-04-19T02:20:53.181995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":884,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180823+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:53.180823+0000","last_peered":"2024-04-19T02:20:53.180823+0000","last_clean":"2024-04-19T02:20:53.180823+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:53.180823+0000","last_undegraded":"2024-04-19T02:20:53.180823+0000","last_fullsized":"2024-04-19T02:20:53.180823+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182597+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:53.182597+0000","last_peered":"2024-04-19T02:20:53.182597+0000","last_clean":"2024-04-19T02:20:53.182597+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:53.182597+0000","last_undegraded":"2024-04-19T02:20:53.182597+0000","last_fullsized":"2024-04-19T02:20:53.182597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":668,"reported_epoch":103,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:54.192470+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:54.192470+0000","last_peered":"2024-04-19T02:20:54.192470+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:54.192470+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":256,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.193651+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:54.193651+0000","last_peered":"2024-04-19T02:20:54.193651+0000","last_clean":"2024-04-19T02:20:54.193651+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:54.193651+0000","last_undegraded":"2024-04-19T02:20:54.193651+0000","last_fullsized":"2024-04-19T02:20:54.193651+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":954,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182243+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:53.182243+0000","last_peered":"2024-04-19T02:20:53.182243+0000","last_clean":"2024-04-19T02:20:53.182243+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:53.182243+0000","last_undegraded":"2024-04-19T02:20:53.182243+0000","last_fullsized":"2024-04-19T02:20:53.182243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":306,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180525+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:53.180525+0000","last_peered":"2024-04-19T02:20:53.180525+0000","last_clean":"2024-04-19T02:20:53.180525+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:53.180525+0000","last_undegraded":"2024-04-19T02:20:53.180525+0000","last_fullsized":"2024-04-19T02:20:53.180525+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":976,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.191981+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:20:53.191981+0000","last_peered":"2024-04-19T02:20:53.191981+0000","last_clean":"2024-04-19T02:20:53.191981+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:20:53.191981+0000","last_undegraded":"2024-04-19T02:20:53.191981+0000","last_fullsized":"2024-04-19T02:20:53.191981+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":164,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180738+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:53.180738+0000","last_peered":"2024-04-19T02:20:53.180738+0000","last_clean":"2024-04-19T02:20:53.180738+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:53.180738+0000","last_undegraded":"2024-04-19T02:20:53.180738+0000","last_fullsized":"2024-04-19T02:20:53.180738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":807,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181337+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:53.181337+0000","last_peered":"2024-04-19T02:20:53.181337+0000","last_clean":"2024-04-19T02:20:53.181337+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:53.181337+0000","last_undegraded":"2024-04-19T02:20:53.181337+0000","last_fullsized":"2024-04-19T02:20:53.181337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":488,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180633+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:53.180633+0000","last_peered":"2024-04-19T02:20:53.180633+0000","last_clean":"2024-04-19T02:20:53.180633+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:53.180633+0000","last_undegraded":"2024-04-19T02:20:53.180633+0000","last_fullsized":"2024-04-19T02:20:53.180633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":517,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.194287+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:54.194287+0000","last_peered":"2024-04-19T02:20:54.194287+0000","last_clean":"2024-04-19T02:20:54.194287+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:54.194287+0000","last_undegraded":"2024-04-19T02:20:54.194287+0000","last_fullsized":"2024-04-19T02:20:54.194287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":291,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181104+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:53.181104+0000","last_peered":"2024-04-19T02:20:53.181104+0000","last_clean":"2024-04-19T02:20:53.181104+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:53.181104+0000","last_undegraded":"2024-04-19T02:20:53.181104+0000","last_fullsized":"2024-04-19T02:20:53.181104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182981+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:53.182981+0000","last_peered":"2024-04-19T02:20:53.182981+0000","last_clean":"2024-04-19T02:20:53.182981+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:53.182981+0000","last_undegraded":"2024-04-19T02:20:53.182981+0000","last_fullsized":"2024-04-19T02:20:53.182981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":859,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181150+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:53.181150+0000","last_peered":"2024-04-19T02:20:53.181150+0000","last_clean":"2024-04-19T02:20:53.181150+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:53.181150+0000","last_undegraded":"2024-04-19T02:20:53.181150+0000","last_fullsized":"2024-04-19T02:20:53.181150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":955,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181823+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:20:53.181823+0000","last_peered":"2024-04-19T02:20:53.181823+0000","last_clean":"2024-04-19T02:20:53.181823+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:20:53.181823+0000","last_undegraded":"2024-04-19T02:20:53.181823+0000","last_fullsized":"2024-04-19T02:20:53.181823+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180863+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:53.180863+0000","last_peered":"2024-04-19T02:20:53.180863+0000","last_clean":"2024-04-19T02:20:53.180863+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:53.180863+0000","last_undegraded":"2024-04-19T02:20:53.180863+0000","last_fullsized":"2024-04-19T02:20:53.180863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":296,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181615+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:53.181615+0000","last_peered":"2024-04-19T02:20:53.181615+0000","last_clean":"2024-04-19T02:20:53.181615+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:53.181615+0000","last_undegraded":"2024-04-19T02:20:53.181615+0000","last_fullsized":"2024-04-19T02:20:53.181615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":542,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181964+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:53.181964+0000","last_peered":"2024-04-19T02:20:53.181964+0000","last_clean":"2024-04-19T02:20:53.181964+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:53.181964+0000","last_undegraded":"2024-04-19T02:20:53.181964+0000","last_fullsized":"2024-04-19T02:20:53.181964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182236+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:53.182236+0000","last_peered":"2024-04-19T02:20:53.182236+0000","last_clean":"2024-04-19T02:20:53.182236+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:53.182236+0000","last_undegraded":"2024-04-19T02:20:53.182236+0000","last_fullsized":"2024-04-19T02:20:53.182236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":509,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180745+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:53.180745+0000","last_peered":"2024-04-19T02:20:53.180745+0000","last_clean":"2024-04-19T02:20:53.180745+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:53.180745+0000","last_undegraded":"2024-04-19T02:20:53.180745+0000","last_fullsized":"2024-04-19T02:20:53.180745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":454,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183218+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:53.183218+0000","last_peered":"2024-04-19T02:20:53.183218+0000","last_clean":"2024-04-19T02:20:53.183218+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:53.183218+0000","last_undegraded":"2024-04-19T02:20:53.183218+0000","last_fullsized":"2024-04-19T02:20:53.183218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181961+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:53.181961+0000","last_peered":"2024-04-19T02:20:53.181961+0000","last_clean":"2024-04-19T02:20:53.181961+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:53.181961+0000","last_undegraded":"2024-04-19T02:20:53.181961+0000","last_fullsized":"2024-04-19T02:20:53.181961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181365+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:53.181365+0000","last_peered":"2024-04-19T02:20:53.181365+0000","last_clean":"2024-04-19T02:20:53.181365+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:53.181365+0000","last_undegraded":"2024-04-19T02:20:53.181365+0000","last_fullsized":"2024-04-19T02:20:53.181365+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":555,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182520+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:53.182520+0000","last_peered":"2024-04-19T02:20:53.182520+0000","last_clean":"2024-04-19T02:20:53.182520+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:53.182520+0000","last_undegraded":"2024-04-19T02:20:53.182520+0000","last_fullsized":"2024-04-19T02:20:53.182520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":559,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182525+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:53.182525+0000","last_peered":"2024-04-19T02:20:53.182525+0000","last_clean":"2024-04-19T02:20:53.182525+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:53.182525+0000","last_undegraded":"2024-04-19T02:20:53.182525+0000","last_fullsized":"2024-04-19T02:20:53.182525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183042+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:53.183042+0000","last_peered":"2024-04-19T02:20:53.183042+0000","last_clean":"2024-04-19T02:20:53.183042+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:53.183042+0000","last_undegraded":"2024-04-19T02:20:53.183042+0000","last_fullsized":"2024-04-19T02:20:53.183042+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":843,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181616+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:53.181616+0000","last_peered":"2024-04-19T02:20:53.181616+0000","last_clean":"2024-04-19T02:20:53.181616+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:53.181616+0000","last_undegraded":"2024-04-19T02:20:53.181616+0000","last_fullsized":"2024-04-19T02:20:53.181616+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182825+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:53.182825+0000","last_peered":"2024-04-19T02:20:53.182825+0000","last_clean":"2024-04-19T02:20:53.182825+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:53.182825+0000","last_undegraded":"2024-04-19T02:20:53.182825+0000","last_fullsized":"2024-04-19T02:20:53.182825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182960+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:53.182960+0000","last_peered":"2024-04-19T02:20:53.182960+0000","last_clean":"2024-04-19T02:20:53.182960+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:53.182960+0000","last_undegraded":"2024-04-19T02:20:53.182960+0000","last_fullsized":"2024-04-19T02:20:53.182960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":960,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180920+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:53.180920+0000","last_peered":"2024-04-19T02:20:53.180920+0000","last_clean":"2024-04-19T02:20:53.180920+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:53.180920+0000","last_undegraded":"2024-04-19T02:20:53.180920+0000","last_fullsized":"2024-04-19T02:20:53.180920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183718+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:53.183718+0000","last_peered":"2024-04-19T02:20:53.183718+0000","last_clean":"2024-04-19T02:20:53.183718+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:53.183718+0000","last_undegraded":"2024-04-19T02:20:53.183718+0000","last_fullsized":"2024-04-19T02:20:53.183718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183858+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:53.183858+0000","last_peered":"2024-04-19T02:20:53.183858+0000","last_clean":"2024-04-19T02:20:53.183858+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:53.183858+0000","last_undegraded":"2024-04-19T02:20:53.183858+0000","last_fullsized":"2024-04-19T02:20:53.183858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":563,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.181263+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:53.181263+0000","last_peered":"2024-04-19T02:20:53.181263+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:53.181263+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":190,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183651+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:53.183651+0000","last_peered":"2024-04-19T02:20:53.183651+0000","last_clean":"2024-04-19T02:20:53.183651+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:53.183651+0000","last_undegraded":"2024-04-19T02:20:53.183651+0000","last_fullsized":"2024-04-19T02:20:53.183651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183145+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:53.183145+0000","last_peered":"2024-04-19T02:20:53.183145+0000","last_clean":"2024-04-19T02:20:53.183145+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:53.183145+0000","last_undegraded":"2024-04-19T02:20:53.183145+0000","last_fullsized":"2024-04-19T02:20:53.183145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":563,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180182+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:53.180182+0000","last_peered":"2024-04-19T02:20:53.180182+0000","last_clean":"2024-04-19T02:20:53.180182+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:53.180182+0000","last_undegraded":"2024-04-19T02:20:53.180182+0000","last_fullsized":"2024-04-19T02:20:53.180182+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":866,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180629+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:53.180629+0000","last_peered":"2024-04-19T02:20:53.180629+0000","last_clean":"2024-04-19T02:20:53.180629+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:53.180629+0000","last_undegraded":"2024-04-19T02:20:53.180629+0000","last_fullsized":"2024-04-19T02:20:53.180629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":568,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182209+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:53.182209+0000","last_peered":"2024-04-19T02:20:53.182209+0000","last_clean":"2024-04-19T02:20:53.182209+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:53.182209+0000","last_undegraded":"2024-04-19T02:20:53.182209+0000","last_fullsized":"2024-04-19T02:20:53.182209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":540,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180235+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:53.180235+0000","last_peered":"2024-04-19T02:20:53.180235+0000","last_clean":"2024-04-19T02:20:53.180235+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:53.180235+0000","last_undegraded":"2024-04-19T02:20:53.180235+0000","last_fullsized":"2024-04-19T02:20:53.180235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182484+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:53.182484+0000","last_peered":"2024-04-19T02:20:53.182484+0000","last_clean":"2024-04-19T02:20:53.182484+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:53.182484+0000","last_undegraded":"2024-04-19T02:20:53.182484+0000","last_fullsized":"2024-04-19T02:20:53.182484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":423,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182870+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:53.182870+0000","last_peered":"2024-04-19T02:20:53.182870+0000","last_clean":"2024-04-19T02:20:53.182870+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:53.182870+0000","last_undegraded":"2024-04-19T02:20:53.182870+0000","last_fullsized":"2024-04-19T02:20:53.182870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":598,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.180870+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:53.180870+0000","last_peered":"2024-04-19T02:20:53.180870+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:53.180870+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183479+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:53.183479+0000","last_peered":"2024-04-19T02:20:53.183479+0000","last_clean":"2024-04-19T02:20:53.183479+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:53.183479+0000","last_undegraded":"2024-04-19T02:20:53.183479+0000","last_fullsized":"2024-04-19T02:20:53.183479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":614,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180933+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:53.180933+0000","last_peered":"2024-04-19T02:20:53.180933+0000","last_clean":"2024-04-19T02:20:53.180933+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:53.180933+0000","last_undegraded":"2024-04-19T02:20:53.180933+0000","last_fullsized":"2024-04-19T02:20:53.180933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":904,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182768+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:53.182768+0000","last_peered":"2024-04-19T02:20:53.182768+0000","last_clean":"2024-04-19T02:20:53.182768+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:53.182768+0000","last_undegraded":"2024-04-19T02:20:53.182768+0000","last_fullsized":"2024-04-19T02:20:53.182768+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":668,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181743+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:53.181743+0000","last_peered":"2024-04-19T02:20:53.181743+0000","last_clean":"2024-04-19T02:20:53.181743+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:53.181743+0000","last_undegraded":"2024-04-19T02:20:53.181743+0000","last_fullsized":"2024-04-19T02:20:53.181743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":929,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182434+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:53.182434+0000","last_peered":"2024-04-19T02:20:53.182434+0000","last_clean":"2024-04-19T02:20:53.182434+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:53.182434+0000","last_undegraded":"2024-04-19T02:20:53.182434+0000","last_fullsized":"2024-04-19T02:20:53.182434+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":446,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181247+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:53.181247+0000","last_peered":"2024-04-19T02:20:53.181247+0000","last_clean":"2024-04-19T02:20:53.181247+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:53.181247+0000","last_undegraded":"2024-04-19T02:20:53.181247+0000","last_fullsized":"2024-04-19T02:20:53.181247+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":846,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181760+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:53.181760+0000","last_peered":"2024-04-19T02:20:53.181760+0000","last_clean":"2024-04-19T02:20:53.181760+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:53.181760+0000","last_undegraded":"2024-04-19T02:20:53.181760+0000","last_fullsized":"2024-04-19T02:20:53.181760+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":593,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182384+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:53.182384+0000","last_peered":"2024-04-19T02:20:53.182384+0000","last_clean":"2024-04-19T02:20:53.182384+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:53.182384+0000","last_undegraded":"2024-04-19T02:20:53.182384+0000","last_fullsized":"2024-04-19T02:20:53.182384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":535,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182042+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:53.182042+0000","last_peered":"2024-04-19T02:20:53.182042+0000","last_clean":"2024-04-19T02:20:53.182042+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:53.182042+0000","last_undegraded":"2024-04-19T02:20:53.182042+0000","last_fullsized":"2024-04-19T02:20:53.182042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181223+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:53.181223+0000","last_peered":"2024-04-19T02:20:53.181223+0000","last_clean":"2024-04-19T02:20:53.181223+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:53.181223+0000","last_undegraded":"2024-04-19T02:20:53.181223+0000","last_fullsized":"2024-04-19T02:20:53.181223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":823,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180522+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:53.180522+0000","last_peered":"2024-04-19T02:20:53.180522+0000","last_clean":"2024-04-19T02:20:53.180522+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:53.180522+0000","last_undegraded":"2024-04-19T02:20:53.180522+0000","last_fullsized":"2024-04-19T02:20:53.180522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":433,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182785+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:53.182785+0000","last_peered":"2024-04-19T02:20:53.182785+0000","last_clean":"2024-04-19T02:20:53.182785+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:53.182785+0000","last_undegraded":"2024-04-19T02:20:53.182785+0000","last_fullsized":"2024-04-19T02:20:53.182785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":876,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180560+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:53.180560+0000","last_peered":"2024-04-19T02:20:53.180560+0000","last_clean":"2024-04-19T02:20:53.180560+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:53.180560+0000","last_undegraded":"2024-04-19T02:20:53.180560+0000","last_fullsized":"2024-04-19T02:20:53.180560+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":493,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182243+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:53.182243+0000","last_peered":"2024-04-19T02:20:53.182243+0000","last_clean":"2024-04-19T02:20:53.182243+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:53.182243+0000","last_undegraded":"2024-04-19T02:20:53.182243+0000","last_fullsized":"2024-04-19T02:20:53.182243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":618,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181019+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:53.181019+0000","last_peered":"2024-04-19T02:20:53.181019+0000","last_clean":"2024-04-19T02:20:53.181019+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:53.181019+0000","last_undegraded":"2024-04-19T02:20:53.181019+0000","last_fullsized":"2024-04-19T02:20:53.181019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":165,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183130+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:53.183130+0000","last_peered":"2024-04-19T02:20:53.183130+0000","last_clean":"2024-04-19T02:20:53.183130+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:53.183130+0000","last_undegraded":"2024-04-19T02:20:53.183130+0000","last_fullsized":"2024-04-19T02:20:53.183130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":972,"reported_epoch":103,"state":"peering","last_fresh":"2024-04-19T02:20:54.192988+0000","last_change":"2024-04-19T02:20:54.194182+0000","last_active":"2024-04-19T02:20:54.192988+0000","last_peered":"2024-04-19T02:20:53.506462+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:54.192988+0000","last_undegraded":"2024-04-19T02:20:54.192988+0000","last_fullsized":"2024-04-19T02:20:54.192988+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:19.862737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183310+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:53.183310+0000","last_peered":"2024-04-19T02:20:53.183310+0000","last_clean":"2024-04-19T02:20:53.183310+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:53.183310+0000","last_undegraded":"2024-04-19T02:20:53.183310+0000","last_fullsized":"2024-04-19T02:20:53.183310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5915,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124868,"kb_used_data":27380,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94246972,"statfs":{"total":96636764160,"available":96508899328,"internally_reserved":0,"allocated":28037120,"data_stored":81601959,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":78,"seq":335007449094,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52024,"kb_used_data":12204,"kb_used_omap":7,"kb_used_meta":39800,"kb_avail":94319816,"statfs":{"total":96636764160,"available":96583491584,"internally_reserved":0,"allocated":12496896,"data_stored":91876908,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":40756223},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139472,"kb_used_data":28036,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232368,"statfs":{"total":96636764160,"available":96493944832,"internally_reserved":0,"allocated":28708864,"data_stored":86219911,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:57.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:20:57.558 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:57.559 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1106/110 objects degraded (1005.455%), 6 pgs degraded","count":6},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":294,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":106,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":4},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":6},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":323956736,"bytes_avail":289586335744,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":1106,"degraded_total":110,"degraded_ratio":10.054545454545455,"recovering_objects_per_sec":335,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1343,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:20:57.578 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:20:57.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:57.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:20:57.874 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:20:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-19T02:20:57.222515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5941,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":316364,"kb_used_data":67620,"kb_used_omap":10,"kb_used_meta":248693,"kb_avail":282799156,"statfs":{"total":289910292480,"available":289586335744,"internally_reserved":0,"allocated":69242880,"data_stored":259698778,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":254662539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1486,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.045486"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":553,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182608+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:53.182608+0000","last_peered":"2024-04-19T02:20:53.182608+0000","last_clean":"2024-04-19T02:20:53.182608+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:53.182608+0000","last_undegraded":"2024-04-19T02:20:53.182608+0000","last_fullsized":"2024-04-19T02:20:53.182608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":579,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181495+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:53.181495+0000","last_peered":"2024-04-19T02:20:53.181495+0000","last_clean":"2024-04-19T02:20:53.181495+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:53.181495+0000","last_undegraded":"2024-04-19T02:20:53.181495+0000","last_fullsized":"2024-04-19T02:20:53.181495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":502,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.181404+0000","last_change":"2024-04-19T02:20:31.681755+0000","last_active":"2024-04-19T02:20:53.181404+0000","last_peered":"2024-04-19T02:20:53.181404+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.678098+0000","last_became_peered":"2024-04-19T02:20:31.678098+0000","last_unstale":"2024-04-19T02:20:53.181404+0000","last_undegraded":"2024-04-19T02:20:31.539712+0000","last_fullsized":"2024-04-19T02:20:31.537365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:54.915717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":830,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181937+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:53.181937+0000","last_peered":"2024-04-19T02:20:53.181937+0000","last_clean":"2024-04-19T02:20:53.181937+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:53.181937+0000","last_undegraded":"2024-04-19T02:20:53.181937+0000","last_fullsized":"2024-04-19T02:20:53.181937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":527,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181097+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:53.181097+0000","last_peered":"2024-04-19T02:20:53.181097+0000","last_clean":"2024-04-19T02:20:53.181097+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:53.181097+0000","last_undegraded":"2024-04-19T02:20:53.181097+0000","last_fullsized":"2024-04-19T02:20:53.181097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":924,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180394+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:53.180394+0000","last_peered":"2024-04-19T02:20:53.180394+0000","last_clean":"2024-04-19T02:20:53.180394+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:53.180394+0000","last_undegraded":"2024-04-19T02:20:53.180394+0000","last_fullsized":"2024-04-19T02:20:53.180394+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":913,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180179+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:53.180179+0000","last_peered":"2024-04-19T02:20:53.180179+0000","last_clean":"2024-04-19T02:20:53.180179+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:53.180179+0000","last_undegraded":"2024-04-19T02:20:53.180179+0000","last_fullsized":"2024-04-19T02:20:53.180179+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":941,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180341+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:53.180341+0000","last_peered":"2024-04-19T02:20:53.180341+0000","last_clean":"2024-04-19T02:20:53.180341+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:53.180341+0000","last_undegraded":"2024-04-19T02:20:53.180341+0000","last_fullsized":"2024-04-19T02:20:53.180341+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":548,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182962+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:53.182962+0000","last_peered":"2024-04-19T02:20:53.182962+0000","last_clean":"2024-04-19T02:20:53.182962+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:53.182962+0000","last_undegraded":"2024-04-19T02:20:53.182962+0000","last_fullsized":"2024-04-19T02:20:53.182962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":539,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181666+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:53.181666+0000","last_peered":"2024-04-19T02:20:53.181666+0000","last_clean":"2024-04-19T02:20:53.181666+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:53.181666+0000","last_undegraded":"2024-04-19T02:20:53.181666+0000","last_fullsized":"2024-04-19T02:20:53.181666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":828,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181990+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:53.181990+0000","last_peered":"2024-04-19T02:20:53.181990+0000","last_clean":"2024-04-19T02:20:53.181990+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:53.181990+0000","last_undegraded":"2024-04-19T02:20:53.181990+0000","last_fullsized":"2024-04-19T02:20:53.181990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":896,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181798+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:53.181798+0000","last_peered":"2024-04-19T02:20:53.181798+0000","last_clean":"2024-04-19T02:20:53.181798+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:53.181798+0000","last_undegraded":"2024-04-19T02:20:53.181798+0000","last_fullsized":"2024-04-19T02:20:53.181798+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":523,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180830+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:53.180830+0000","last_peered":"2024-04-19T02:20:53.180830+0000","last_clean":"2024-04-19T02:20:53.180830+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:53.180830+0000","last_undegraded":"2024-04-19T02:20:53.180830+0000","last_fullsized":"2024-04-19T02:20:53.180830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":892,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.208376+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:20:54.208376+0000","last_peered":"2024-04-19T02:20:54.208376+0000","last_clean":"2024-04-19T02:20:54.208376+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:20:54.208376+0000","last_undegraded":"2024-04-19T02:20:54.208376+0000","last_fullsized":"2024-04-19T02:20:54.208376+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":912,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180187+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:53.180187+0000","last_peered":"2024-04-19T02:20:53.180187+0000","last_clean":"2024-04-19T02:20:53.180187+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:53.180187+0000","last_undegraded":"2024-04-19T02:20:53.180187+0000","last_fullsized":"2024-04-19T02:20:53.180187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":995,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180068+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:53.180068+0000","last_peered":"2024-04-19T02:20:53.180068+0000","last_clean":"2024-04-19T02:20:53.180068+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:53.180068+0000","last_undegraded":"2024-04-19T02:20:53.180068+0000","last_fullsized":"2024-04-19T02:20:53.180068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":546,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183640+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:53.183640+0000","last_peered":"2024-04-19T02:20:53.183640+0000","last_clean":"2024-04-19T02:20:53.183640+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:53.183640+0000","last_undegraded":"2024-04-19T02:20:53.183640+0000","last_fullsized":"2024-04-19T02:20:53.183640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":523,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181897+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:53.181897+0000","last_peered":"2024-04-19T02:20:53.181897+0000","last_clean":"2024-04-19T02:20:53.181897+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:53.181897+0000","last_undegraded":"2024-04-19T02:20:53.181897+0000","last_fullsized":"2024-04-19T02:20:53.181897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":635,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.193998+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:54.193998+0000","last_peered":"2024-04-19T02:20:54.193998+0000","last_clean":"2024-04-19T02:20:54.193998+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:54.193998+0000","last_undegraded":"2024-04-19T02:20:54.193998+0000","last_fullsized":"2024-04-19T02:20:54.193998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":924,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182340+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:53.182340+0000","last_peered":"2024-04-19T02:20:53.182340+0000","last_clean":"2024-04-19T02:20:53.182340+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:53.182340+0000","last_undegraded":"2024-04-19T02:20:53.182340+0000","last_fullsized":"2024-04-19T02:20:53.182340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":925,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181611+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:20:53.181611+0000","last_peered":"2024-04-19T02:20:53.181611+0000","last_clean":"2024-04-19T02:20:53.181611+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:20:53.181611+0000","last_undegraded":"2024-04-19T02:20:53.181611+0000","last_fullsized":"2024-04-19T02:20:53.181611+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1108,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.194103+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:54.194103+0000","last_peered":"2024-04-19T02:20:54.194103+0000","last_clean":"2024-04-19T02:20:54.194103+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:54.194103+0000","last_undegraded":"2024-04-19T02:20:54.194103+0000","last_fullsized":"2024-04-19T02:20:54.194103+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":886,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.191852+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:54.191852+0000","last_peered":"2024-04-19T02:20:54.191852+0000","last_clean":"2024-04-19T02:20:54.191852+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:54.191852+0000","last_undegraded":"2024-04-19T02:20:54.191852+0000","last_fullsized":"2024-04-19T02:20:54.191852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":555,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180228+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:53.180228+0000","last_peered":"2024-04-19T02:20:53.180228+0000","last_clean":"2024-04-19T02:20:53.180228+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:53.180228+0000","last_undegraded":"2024-04-19T02:20:53.180228+0000","last_fullsized":"2024-04-19T02:20:53.180228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":542,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.182840+0000","last_change":"2024-04-19T02:20:34.232800+0000","last_active":"2024-04-19T02:20:53.182840+0000","last_peered":"2024-04-19T02:20:53.182840+0000","last_clean":"2024-04-19T02:17:09.445414+0000","last_became_active":"2024-04-19T02:20:31.635519+0000","last_became_peered":"2024-04-19T02:20:31.635519+0000","last_unstale":"2024-04-19T02:20:53.182840+0000","last_undegraded":"2024-04-19T02:20:34.232504+0000","last_fullsized":"2024-04-19T02:20:31.499924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:15:58.004292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182711+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:20:53.182711+0000","last_peered":"2024-04-19T02:20:53.182711+0000","last_clean":"2024-04-19T02:20:53.182711+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:20:53.182711+0000","last_undegraded":"2024-04-19T02:20:53.182711+0000","last_fullsized":"2024-04-19T02:20:53.182711+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":932,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182748+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:20:53.182748+0000","last_peered":"2024-04-19T02:20:53.182748+0000","last_clean":"2024-04-19T02:20:53.182748+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:20:53.182748+0000","last_undegraded":"2024-04-19T02:20:53.182748+0000","last_fullsized":"2024-04-19T02:20:53.182748+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":802,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182346+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:53.182346+0000","last_peered":"2024-04-19T02:20:53.182346+0000","last_clean":"2024-04-19T02:20:53.182346+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:53.182346+0000","last_undegraded":"2024-04-19T02:20:53.182346+0000","last_fullsized":"2024-04-19T02:20:53.182346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":525,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181251+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:53.181251+0000","last_peered":"2024-04-19T02:20:53.181251+0000","last_clean":"2024-04-19T02:20:53.181251+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:53.181251+0000","last_undegraded":"2024-04-19T02:20:53.181251+0000","last_fullsized":"2024-04-19T02:20:53.181251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1055,"reported_epoch":103,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:54.322538+0000","last_change":"2024-04-19T02:20:54.323056+0000","last_active":"2024-04-19T02:20:54.322538+0000","last_peered":"2024-04-19T02:20:54.322538+0000","last_clean":"2024-04-19T02:17:09.444800+0000","last_became_active":"2024-04-19T02:20:31.673997+0000","last_became_peered":"2024-04-19T02:20:31.673997+0000","last_unstale":"2024-04-19T02:20:54.322538+0000","last_undegraded":"2024-04-19T02:20:54.322538+0000","last_fullsized":"2024-04-19T02:20:31.519302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:42.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":602,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180527+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:53.180527+0000","last_peered":"2024-04-19T02:20:53.180527+0000","last_clean":"2024-04-19T02:20:53.180527+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:53.180527+0000","last_undegraded":"2024-04-19T02:20:53.180527+0000","last_fullsized":"2024-04-19T02:20:53.180527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":919,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.192636+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:20:53.192636+0000","last_peered":"2024-04-19T02:20:53.192636+0000","last_clean":"2024-04-19T02:20:53.192636+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:20:53.192636+0000","last_undegraded":"2024-04-19T02:20:53.192636+0000","last_fullsized":"2024-04-19T02:20:53.192636+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":483,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182586+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:53.182586+0000","last_peered":"2024-04-19T02:20:53.182586+0000","last_clean":"2024-04-19T02:20:53.182586+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:53.182586+0000","last_undegraded":"2024-04-19T02:20:53.182586+0000","last_fullsized":"2024-04-19T02:20:53.182586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":490,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180993+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:53.180993+0000","last_peered":"2024-04-19T02:20:53.180993+0000","last_clean":"2024-04-19T02:20:53.180993+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:53.180993+0000","last_undegraded":"2024-04-19T02:20:53.180993+0000","last_fullsized":"2024-04-19T02:20:53.180993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":532,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182076+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:53.182076+0000","last_peered":"2024-04-19T02:20:53.182076+0000","last_clean":"2024-04-19T02:20:53.182076+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:53.182076+0000","last_undegraded":"2024-04-19T02:20:53.182076+0000","last_fullsized":"2024-04-19T02:20:53.182076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181728+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:53.181728+0000","last_peered":"2024-04-19T02:20:53.181728+0000","last_clean":"2024-04-19T02:20:53.181728+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:53.181728+0000","last_undegraded":"2024-04-19T02:20:53.181728+0000","last_fullsized":"2024-04-19T02:20:53.181728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":711,"reported_epoch":103,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-19T02:20:54.516384+0000","last_change":"2024-04-19T02:20:54.327790+0000","last_active":"2024-04-19T02:20:54.516384+0000","last_peered":"2024-04-19T02:20:54.516384+0000","last_clean":"2024-04-19T02:17:07.003331+0000","last_became_active":"2024-04-19T02:20:31.669859+0000","last_became_peered":"2024-04-19T02:20:31.669859+0000","last_unstale":"2024-04-19T02:20:54.516384+0000","last_undegraded":"2024-04-19T02:20:54.516384+0000","last_fullsized":"2024-04-19T02:20:31.527260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:01.415546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180725+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:53.180725+0000","last_peered":"2024-04-19T02:20:53.180725+0000","last_clean":"2024-04-19T02:20:53.180725+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:53.180725+0000","last_undegraded":"2024-04-19T02:20:53.180725+0000","last_fullsized":"2024-04-19T02:20:53.180725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":551,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.182713+0000","last_change":"2024-04-19T02:20:34.185514+0000","last_active":"2024-04-19T02:20:53.182713+0000","last_peered":"2024-04-19T02:20:53.182713+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:53.182713+0000","last_undegraded":"2024-04-19T02:20:34.184998+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":152,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180506+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:53.180506+0000","last_peered":"2024-04-19T02:20:53.180506+0000","last_clean":"2024-04-19T02:20:53.180506+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:53.180506+0000","last_undegraded":"2024-04-19T02:20:53.180506+0000","last_fullsized":"2024-04-19T02:20:53.180506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":276,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182992+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:53.182992+0000","last_peered":"2024-04-19T02:20:53.182992+0000","last_clean":"2024-04-19T02:20:53.182992+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:53.182992+0000","last_undegraded":"2024-04-19T02:20:53.182992+0000","last_fullsized":"2024-04-19T02:20:53.182992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":881,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180374+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:53.180374+0000","last_peered":"2024-04-19T02:20:53.180374+0000","last_clean":"2024-04-19T02:20:53.180374+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:53.180374+0000","last_undegraded":"2024-04-19T02:20:53.180374+0000","last_fullsized":"2024-04-19T02:20:53.180374+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":416,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.195530+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:54.195530+0000","last_peered":"2024-04-19T02:20:54.195530+0000","last_clean":"2024-04-19T02:20:54.195530+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:54.195530+0000","last_undegraded":"2024-04-19T02:20:54.195530+0000","last_fullsized":"2024-04-19T02:20:54.195530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":553,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180441+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:53.180441+0000","last_peered":"2024-04-19T02:20:53.180441+0000","last_clean":"2024-04-19T02:20:53.180441+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:53.180441+0000","last_undegraded":"2024-04-19T02:20:53.180441+0000","last_fullsized":"2024-04-19T02:20:53.180441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":705,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181995+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:53.181995+0000","last_peered":"2024-04-19T02:20:53.181995+0000","last_clean":"2024-04-19T02:20:53.181995+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:53.181995+0000","last_undegraded":"2024-04-19T02:20:53.181995+0000","last_fullsized":"2024-04-19T02:20:53.181995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":884,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180823+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:53.180823+0000","last_peered":"2024-04-19T02:20:53.180823+0000","last_clean":"2024-04-19T02:20:53.180823+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:53.180823+0000","last_undegraded":"2024-04-19T02:20:53.180823+0000","last_fullsized":"2024-04-19T02:20:53.180823+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182597+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:53.182597+0000","last_peered":"2024-04-19T02:20:53.182597+0000","last_clean":"2024-04-19T02:20:53.182597+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:53.182597+0000","last_undegraded":"2024-04-19T02:20:53.182597+0000","last_fullsized":"2024-04-19T02:20:53.182597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":668,"reported_epoch":103,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:54.192470+0000","last_change":"2024-04-19T02:20:31.682294+0000","last_active":"2024-04-19T02:20:54.192470+0000","last_peered":"2024-04-19T02:20:54.192470+0000","last_clean":"2024-04-19T02:17:07.002016+0000","last_became_active":"2024-04-19T02:20:31.676496+0000","last_became_peered":"2024-04-19T02:20:31.676496+0000","last_unstale":"2024-04-19T02:20:54.192470+0000","last_undegraded":"2024-04-19T02:20:31.535621+0000","last_fullsized":"2024-04-19T02:20:31.497851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:21.259193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":256,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.193651+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:54.193651+0000","last_peered":"2024-04-19T02:20:54.193651+0000","last_clean":"2024-04-19T02:20:54.193651+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:54.193651+0000","last_undegraded":"2024-04-19T02:20:54.193651+0000","last_fullsized":"2024-04-19T02:20:54.193651+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":954,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182243+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:53.182243+0000","last_peered":"2024-04-19T02:20:53.182243+0000","last_clean":"2024-04-19T02:20:53.182243+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:53.182243+0000","last_undegraded":"2024-04-19T02:20:53.182243+0000","last_fullsized":"2024-04-19T02:20:53.182243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":306,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180525+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:53.180525+0000","last_peered":"2024-04-19T02:20:53.180525+0000","last_clean":"2024-04-19T02:20:53.180525+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:53.180525+0000","last_undegraded":"2024-04-19T02:20:53.180525+0000","last_fullsized":"2024-04-19T02:20:53.180525+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":976,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.191981+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:20:53.191981+0000","last_peered":"2024-04-19T02:20:53.191981+0000","last_clean":"2024-04-19T02:20:53.191981+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:20:53.191981+0000","last_undegraded":"2024-04-19T02:20:53.191981+0000","last_fullsized":"2024-04-19T02:20:53.191981+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":164,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180738+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:53.180738+0000","last_peered":"2024-04-19T02:20:53.180738+0000","last_clean":"2024-04-19T02:20:53.180738+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:53.180738+0000","last_undegraded":"2024-04-19T02:20:53.180738+0000","last_fullsized":"2024-04-19T02:20:53.180738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":807,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181337+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:53.181337+0000","last_peered":"2024-04-19T02:20:53.181337+0000","last_clean":"2024-04-19T02:20:53.181337+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:53.181337+0000","last_undegraded":"2024-04-19T02:20:53.181337+0000","last_fullsized":"2024-04-19T02:20:53.181337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":488,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180633+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:53.180633+0000","last_peered":"2024-04-19T02:20:53.180633+0000","last_clean":"2024-04-19T02:20:53.180633+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:53.180633+0000","last_undegraded":"2024-04-19T02:20:53.180633+0000","last_fullsized":"2024-04-19T02:20:53.180633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":517,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.194287+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:54.194287+0000","last_peered":"2024-04-19T02:20:54.194287+0000","last_clean":"2024-04-19T02:20:54.194287+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:54.194287+0000","last_undegraded":"2024-04-19T02:20:54.194287+0000","last_fullsized":"2024-04-19T02:20:54.194287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":291,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181104+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:53.181104+0000","last_peered":"2024-04-19T02:20:53.181104+0000","last_clean":"2024-04-19T02:20:53.181104+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:53.181104+0000","last_undegraded":"2024-04-19T02:20:53.181104+0000","last_fullsized":"2024-04-19T02:20:53.181104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182981+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:53.182981+0000","last_peered":"2024-04-19T02:20:53.182981+0000","last_clean":"2024-04-19T02:20:53.182981+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:53.182981+0000","last_undegraded":"2024-04-19T02:20:53.182981+0000","last_fullsized":"2024-04-19T02:20:53.182981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":859,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181150+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:53.181150+0000","last_peered":"2024-04-19T02:20:53.181150+0000","last_clean":"2024-04-19T02:20:53.181150+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:53.181150+0000","last_undegraded":"2024-04-19T02:20:53.181150+0000","last_fullsized":"2024-04-19T02:20:53.181150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":955,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181823+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:20:53.181823+0000","last_peered":"2024-04-19T02:20:53.181823+0000","last_clean":"2024-04-19T02:20:53.181823+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:20:53.181823+0000","last_undegraded":"2024-04-19T02:20:53.181823+0000","last_fullsized":"2024-04-19T02:20:53.181823+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180863+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:53.180863+0000","last_peered":"2024-04-19T02:20:53.180863+0000","last_clean":"2024-04-19T02:20:53.180863+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:53.180863+0000","last_undegraded":"2024-04-19T02:20:53.180863+0000","last_fullsized":"2024-04-19T02:20:53.180863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":296,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181615+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:53.181615+0000","last_peered":"2024-04-19T02:20:53.181615+0000","last_clean":"2024-04-19T02:20:53.181615+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:53.181615+0000","last_undegraded":"2024-04-19T02:20:53.181615+0000","last_fullsized":"2024-04-19T02:20:53.181615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":542,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181964+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:53.181964+0000","last_peered":"2024-04-19T02:20:53.181964+0000","last_clean":"2024-04-19T02:20:53.181964+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:53.181964+0000","last_undegraded":"2024-04-19T02:20:53.181964+0000","last_fullsized":"2024-04-19T02:20:53.181964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182236+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:53.182236+0000","last_peered":"2024-04-19T02:20:53.182236+0000","last_clean":"2024-04-19T02:20:53.182236+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:53.182236+0000","last_undegraded":"2024-04-19T02:20:53.182236+0000","last_fullsized":"2024-04-19T02:20:53.182236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":509,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180745+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:53.180745+0000","last_peered":"2024-04-19T02:20:53.180745+0000","last_clean":"2024-04-19T02:20:53.180745+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:53.180745+0000","last_undegraded":"2024-04-19T02:20:53.180745+0000","last_fullsized":"2024-04-19T02:20:53.180745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":454,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183218+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:53.183218+0000","last_peered":"2024-04-19T02:20:53.183218+0000","last_clean":"2024-04-19T02:20:53.183218+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:53.183218+0000","last_undegraded":"2024-04-19T02:20:53.183218+0000","last_fullsized":"2024-04-19T02:20:53.183218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181961+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:53.181961+0000","last_peered":"2024-04-19T02:20:53.181961+0000","last_clean":"2024-04-19T02:20:53.181961+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:53.181961+0000","last_undegraded":"2024-04-19T02:20:53.181961+0000","last_fullsized":"2024-04-19T02:20:53.181961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181365+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:53.181365+0000","last_peered":"2024-04-19T02:20:53.181365+0000","last_clean":"2024-04-19T02:20:53.181365+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:53.181365+0000","last_undegraded":"2024-04-19T02:20:53.181365+0000","last_fullsized":"2024-04-19T02:20:53.181365+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":555,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182520+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:53.182520+0000","last_peered":"2024-04-19T02:20:53.182520+0000","last_clean":"2024-04-19T02:20:53.182520+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:53.182520+0000","last_undegraded":"2024-04-19T02:20:53.182520+0000","last_fullsized":"2024-04-19T02:20:53.182520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":559,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182525+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:53.182525+0000","last_peered":"2024-04-19T02:20:53.182525+0000","last_clean":"2024-04-19T02:20:53.182525+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:53.182525+0000","last_undegraded":"2024-04-19T02:20:53.182525+0000","last_fullsized":"2024-04-19T02:20:53.182525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183042+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:53.183042+0000","last_peered":"2024-04-19T02:20:53.183042+0000","last_clean":"2024-04-19T02:20:53.183042+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:53.183042+0000","last_undegraded":"2024-04-19T02:20:53.183042+0000","last_fullsized":"2024-04-19T02:20:53.183042+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":843,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181616+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:53.181616+0000","last_peered":"2024-04-19T02:20:53.181616+0000","last_clean":"2024-04-19T02:20:53.181616+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:53.181616+0000","last_undegraded":"2024-04-19T02:20:53.181616+0000","last_fullsized":"2024-04-19T02:20:53.181616+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182825+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:53.182825+0000","last_peered":"2024-04-19T02:20:53.182825+0000","last_clean":"2024-04-19T02:20:53.182825+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:53.182825+0000","last_undegraded":"2024-04-19T02:20:53.182825+0000","last_fullsized":"2024-04-19T02:20:53.182825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182960+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:53.182960+0000","last_peered":"2024-04-19T02:20:53.182960+0000","last_clean":"2024-04-19T02:20:53.182960+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:53.182960+0000","last_undegraded":"2024-04-19T02:20:53.182960+0000","last_fullsized":"2024-04-19T02:20:53.182960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":960,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180920+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:53.180920+0000","last_peered":"2024-04-19T02:20:53.180920+0000","last_clean":"2024-04-19T02:20:53.180920+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:53.180920+0000","last_undegraded":"2024-04-19T02:20:53.180920+0000","last_fullsized":"2024-04-19T02:20:53.180920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183718+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:53.183718+0000","last_peered":"2024-04-19T02:20:53.183718+0000","last_clean":"2024-04-19T02:20:53.183718+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:53.183718+0000","last_undegraded":"2024-04-19T02:20:53.183718+0000","last_fullsized":"2024-04-19T02:20:53.183718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183858+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:53.183858+0000","last_peered":"2024-04-19T02:20:53.183858+0000","last_clean":"2024-04-19T02:20:53.183858+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:53.183858+0000","last_undegraded":"2024-04-19T02:20:53.183858+0000","last_fullsized":"2024-04-19T02:20:53.183858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":563,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.181263+0000","last_change":"2024-04-19T02:20:31.683156+0000","last_active":"2024-04-19T02:20:53.181263+0000","last_peered":"2024-04-19T02:20:53.181263+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:53.181263+0000","last_undegraded":"2024-04-19T02:20:31.539406+0000","last_fullsized":"2024-04-19T02:20:31.530172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:24.445528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":190,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183651+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:53.183651+0000","last_peered":"2024-04-19T02:20:53.183651+0000","last_clean":"2024-04-19T02:20:53.183651+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:53.183651+0000","last_undegraded":"2024-04-19T02:20:53.183651+0000","last_fullsized":"2024-04-19T02:20:53.183651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183145+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:53.183145+0000","last_peered":"2024-04-19T02:20:53.183145+0000","last_clean":"2024-04-19T02:20:53.183145+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:53.183145+0000","last_undegraded":"2024-04-19T02:20:53.183145+0000","last_fullsized":"2024-04-19T02:20:53.183145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":563,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180182+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:53.180182+0000","last_peered":"2024-04-19T02:20:53.180182+0000","last_clean":"2024-04-19T02:20:53.180182+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:53.180182+0000","last_undegraded":"2024-04-19T02:20:53.180182+0000","last_fullsized":"2024-04-19T02:20:53.180182+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":866,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180629+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:53.180629+0000","last_peered":"2024-04-19T02:20:53.180629+0000","last_clean":"2024-04-19T02:20:53.180629+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:53.180629+0000","last_undegraded":"2024-04-19T02:20:53.180629+0000","last_fullsized":"2024-04-19T02:20:53.180629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":568,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182209+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:53.182209+0000","last_peered":"2024-04-19T02:20:53.182209+0000","last_clean":"2024-04-19T02:20:53.182209+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:53.182209+0000","last_undegraded":"2024-04-19T02:20:53.182209+0000","last_fullsized":"2024-04-19T02:20:53.182209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":540,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180235+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:53.180235+0000","last_peered":"2024-04-19T02:20:53.180235+0000","last_clean":"2024-04-19T02:20:53.180235+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:53.180235+0000","last_undegraded":"2024-04-19T02:20:53.180235+0000","last_fullsized":"2024-04-19T02:20:53.180235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182484+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:53.182484+0000","last_peered":"2024-04-19T02:20:53.182484+0000","last_clean":"2024-04-19T02:20:53.182484+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:53.182484+0000","last_undegraded":"2024-04-19T02:20:53.182484+0000","last_fullsized":"2024-04-19T02:20:53.182484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":423,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182870+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:53.182870+0000","last_peered":"2024-04-19T02:20:53.182870+0000","last_clean":"2024-04-19T02:20:53.182870+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:53.182870+0000","last_undegraded":"2024-04-19T02:20:53.182870+0000","last_fullsized":"2024-04-19T02:20:53.182870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":598,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-19T02:20:53.180870+0000","last_change":"2024-04-19T02:20:31.679844+0000","last_active":"2024-04-19T02:20:53.180870+0000","last_peered":"2024-04-19T02:20:53.180870+0000","last_clean":"2024-04-19T02:17:07.001419+0000","last_became_active":"2024-04-19T02:20:31.669014+0000","last_became_peered":"2024-04-19T02:20:31.669014+0000","last_unstale":"2024-04-19T02:20:53.180870+0000","last_undegraded":"2024-04-19T02:20:31.527774+0000","last_fullsized":"2024-04-19T02:20:31.509375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:49.791729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183479+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:53.183479+0000","last_peered":"2024-04-19T02:20:53.183479+0000","last_clean":"2024-04-19T02:20:53.183479+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:53.183479+0000","last_undegraded":"2024-04-19T02:20:53.183479+0000","last_fullsized":"2024-04-19T02:20:53.183479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":614,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180933+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:53.180933+0000","last_peered":"2024-04-19T02:20:53.180933+0000","last_clean":"2024-04-19T02:20:53.180933+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:53.180933+0000","last_undegraded":"2024-04-19T02:20:53.180933+0000","last_fullsized":"2024-04-19T02:20:53.180933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":904,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182768+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:53.182768+0000","last_peered":"2024-04-19T02:20:53.182768+0000","last_clean":"2024-04-19T02:20:53.182768+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:53.182768+0000","last_undegraded":"2024-04-19T02:20:53.182768+0000","last_fullsized":"2024-04-19T02:20:53.182768+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":668,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181743+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:53.181743+0000","last_peered":"2024-04-19T02:20:53.181743+0000","last_clean":"2024-04-19T02:20:53.181743+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:53.181743+0000","last_undegraded":"2024-04-19T02:20:53.181743+0000","last_fullsized":"2024-04-19T02:20:53.181743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":929,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182434+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:53.182434+0000","last_peered":"2024-04-19T02:20:53.182434+0000","last_clean":"2024-04-19T02:20:53.182434+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:53.182434+0000","last_undegraded":"2024-04-19T02:20:53.182434+0000","last_fullsized":"2024-04-19T02:20:53.182434+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":446,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181247+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:53.181247+0000","last_peered":"2024-04-19T02:20:53.181247+0000","last_clean":"2024-04-19T02:20:53.181247+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:53.181247+0000","last_undegraded":"2024-04-19T02:20:53.181247+0000","last_fullsized":"2024-04-19T02:20:53.181247+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":846,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181760+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:53.181760+0000","last_peered":"2024-04-19T02:20:53.181760+0000","last_clean":"2024-04-19T02:20:53.181760+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:53.181760+0000","last_undegraded":"2024-04-19T02:20:53.181760+0000","last_fullsized":"2024-04-19T02:20:53.181760+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":593,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182384+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:53.182384+0000","last_peered":"2024-04-19T02:20:53.182384+0000","last_clean":"2024-04-19T02:20:53.182384+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:53.182384+0000","last_undegraded":"2024-04-19T02:20:53.182384+0000","last_fullsized":"2024-04-19T02:20:53.182384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":535,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182042+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:53.182042+0000","last_peered":"2024-04-19T02:20:53.182042+0000","last_clean":"2024-04-19T02:20:53.182042+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:53.182042+0000","last_undegraded":"2024-04-19T02:20:53.182042+0000","last_fullsized":"2024-04-19T02:20:53.182042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181223+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:53.181223+0000","last_peered":"2024-04-19T02:20:53.181223+0000","last_clean":"2024-04-19T02:20:53.181223+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:53.181223+0000","last_undegraded":"2024-04-19T02:20:53.181223+0000","last_fullsized":"2024-04-19T02:20:53.181223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":823,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180522+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:53.180522+0000","last_peered":"2024-04-19T02:20:53.180522+0000","last_clean":"2024-04-19T02:20:53.180522+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:53.180522+0000","last_undegraded":"2024-04-19T02:20:53.180522+0000","last_fullsized":"2024-04-19T02:20:53.180522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":433,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182785+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:53.182785+0000","last_peered":"2024-04-19T02:20:53.182785+0000","last_clean":"2024-04-19T02:20:53.182785+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:53.182785+0000","last_undegraded":"2024-04-19T02:20:53.182785+0000","last_fullsized":"2024-04-19T02:20:53.182785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":876,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.180560+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:53.180560+0000","last_peered":"2024-04-19T02:20:53.180560+0000","last_clean":"2024-04-19T02:20:53.180560+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:53.180560+0000","last_undegraded":"2024-04-19T02:20:53.180560+0000","last_fullsized":"2024-04-19T02:20:53.180560+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":493,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.182243+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:53.182243+0000","last_peered":"2024-04-19T02:20:53.182243+0000","last_clean":"2024-04-19T02:20:53.182243+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:53.182243+0000","last_undegraded":"2024-04-19T02:20:53.182243+0000","last_fullsized":"2024-04-19T02:20:53.182243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":618,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.181019+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:53.181019+0000","last_peered":"2024-04-19T02:20:53.181019+0000","last_clean":"2024-04-19T02:20:53.181019+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:53.181019+0000","last_undegraded":"2024-04-19T02:20:53.181019+0000","last_fullsized":"2024-04-19T02:20:53.181019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":165,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183130+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:53.183130+0000","last_peered":"2024-04-19T02:20:53.183130+0000","last_clean":"2024-04-19T02:20:53.183130+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:53.183130+0000","last_undegraded":"2024-04-19T02:20:53.183130+0000","last_fullsized":"2024-04-19T02:20:53.183130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":972,"reported_epoch":103,"state":"peering","last_fresh":"2024-04-19T02:20:54.192988+0000","last_change":"2024-04-19T02:20:54.194182+0000","last_active":"2024-04-19T02:20:54.192988+0000","last_peered":"2024-04-19T02:20:53.506462+0000","last_clean":"2024-04-19T02:16:24.102963+0000","last_became_active":"2024-04-19T02:20:31.671520+0000","last_became_peered":"2024-04-19T02:20:31.671520+0000","last_unstale":"2024-04-19T02:20:54.192988+0000","last_undegraded":"2024-04-19T02:20:54.192988+0000","last_fullsized":"2024-04-19T02:20:54.192988+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:19.862737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-19T02:20:53.183310+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:53.183310+0000","last_peered":"2024-04-19T02:20:53.183310+0000","last_clean":"2024-04-19T02:20:53.183310+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:53.183310+0000","last_undegraded":"2024-04-19T02:20:53.183310+0000","last_fullsized":"2024-04-19T02:20:53.183310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5915,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124868,"kb_used_data":27380,"kb_used_omap":1,"kb_used_meta":97470,"kb_avail":94246972,"statfs":{"total":96636764160,"available":96508899328,"internally_reserved":0,"allocated":28037120,"data_stored":81601959,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":99809734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":78,"seq":335007449094,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52024,"kb_used_data":12204,"kb_used_omap":7,"kb_used_meta":39800,"kb_avail":94319816,"statfs":{"total":96636764160,"available":96583491584,"internally_reserved":0,"allocated":12496896,"data_stored":91876908,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":40756223},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139472,"kb_used_data":28036,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232368,"statfs":{"total":96636764160,"available":96493944832,"internally_reserved":0,"allocated":28708864,"data_stored":86219911,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:00.896 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:01.238 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-04-19T02:21:01.194358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7190,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":209,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348532,"kb_used_data":67788,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766988,"statfs":{"total":289910292480,"available":289553395712,"internally_reserved":0,"allocated":69414912,"data_stored":259765543,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1249,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.971843"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189611+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:58.189611+0000","last_peered":"2024-04-19T02:20:58.189611+0000","last_clean":"2024-04-19T02:20:58.189611+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:58.189611+0000","last_undegraded":"2024-04-19T02:20:58.189611+0000","last_fullsized":"2024-04-19T02:20:58.189611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":584,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187906+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:58.187906+0000","last_peered":"2024-04-19T02:20:58.187906+0000","last_clean":"2024-04-19T02:20:58.187906+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:58.187906+0000","last_undegraded":"2024-04-19T02:20:58.187906+0000","last_fullsized":"2024-04-19T02:20:58.187906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":861,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187272+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:20:58.187272+0000","last_peered":"2024-04-19T02:20:58.187272+0000","last_clean":"2024-04-19T02:20:58.187272+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:20:58.187272+0000","last_undegraded":"2024-04-19T02:20:58.187272+0000","last_fullsized":"2024-04-19T02:20:58.187272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":835,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183265+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:58.183265+0000","last_peered":"2024-04-19T02:20:58.183265+0000","last_clean":"2024-04-19T02:20:58.183265+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:58.183265+0000","last_undegraded":"2024-04-19T02:20:58.183265+0000","last_fullsized":"2024-04-19T02:20:58.183265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":532,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:58.188108+0000","last_peered":"2024-04-19T02:20:58.188108+0000","last_clean":"2024-04-19T02:20:58.188108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:58.188108+0000","last_undegraded":"2024-04-19T02:20:58.188108+0000","last_fullsized":"2024-04-19T02:20:58.188108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186929+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:58.186929+0000","last_peered":"2024-04-19T02:20:58.186929+0000","last_clean":"2024-04-19T02:20:58.186929+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:58.186929+0000","last_undegraded":"2024-04-19T02:20:58.186929+0000","last_fullsized":"2024-04-19T02:20:58.186929+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":918,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":946,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182437+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:58.182437+0000","last_peered":"2024-04-19T02:20:58.182437+0000","last_clean":"2024-04-19T02:20:58.182437+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:58.182437+0000","last_undegraded":"2024-04-19T02:20:58.182437+0000","last_fullsized":"2024-04-19T02:20:58.182437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":553,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184099+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:58.184099+0000","last_peered":"2024-04-19T02:20:58.184099+0000","last_clean":"2024-04-19T02:20:58.184099+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:58.184099+0000","last_undegraded":"2024-04-19T02:20:58.184099+0000","last_fullsized":"2024-04-19T02:20:58.184099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":544,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188531+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:58.188531+0000","last_peered":"2024-04-19T02:20:58.188531+0000","last_clean":"2024-04-19T02:20:58.188531+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:58.188531+0000","last_undegraded":"2024-04-19T02:20:58.188531+0000","last_fullsized":"2024-04-19T02:20:58.188531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":833,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185427+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:58.185427+0000","last_peered":"2024-04-19T02:20:58.185427+0000","last_clean":"2024-04-19T02:20:58.185427+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:58.185427+0000","last_undegraded":"2024-04-19T02:20:58.185427+0000","last_fullsized":"2024-04-19T02:20:58.185427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":901,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187669+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:58.187669+0000","last_peered":"2024-04-19T02:20:58.187669+0000","last_clean":"2024-04-19T02:20:58.187669+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:58.187669+0000","last_undegraded":"2024-04-19T02:20:58.187669+0000","last_fullsized":"2024-04-19T02:20:58.187669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187872+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:58.187872+0000","last_peered":"2024-04-19T02:20:58.187872+0000","last_clean":"2024-04-19T02:20:58.187872+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:58.187872+0000","last_undegraded":"2024-04-19T02:20:58.187872+0000","last_fullsized":"2024-04-19T02:20:58.187872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":897,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187235+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:20:58.187235+0000","last_peered":"2024-04-19T02:20:58.187235+0000","last_clean":"2024-04-19T02:20:58.187235+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:20:58.187235+0000","last_undegraded":"2024-04-19T02:20:58.187235+0000","last_fullsized":"2024-04-19T02:20:58.187235+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":917,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186716+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:58.186716+0000","last_peered":"2024-04-19T02:20:58.186716+0000","last_clean":"2024-04-19T02:20:58.186716+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:58.186716+0000","last_undegraded":"2024-04-19T02:20:58.186716+0000","last_fullsized":"2024-04-19T02:20:58.186716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1000,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":551,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185085+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:58.185085+0000","last_peered":"2024-04-19T02:20:58.185085+0000","last_clean":"2024-04-19T02:20:58.185085+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:58.185085+0000","last_undegraded":"2024-04-19T02:20:58.185085+0000","last_fullsized":"2024-04-19T02:20:58.185085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188798+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:58.188798+0000","last_peered":"2024-04-19T02:20:58.188798+0000","last_clean":"2024-04-19T02:20:58.188798+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:58.188798+0000","last_undegraded":"2024-04-19T02:20:58.188798+0000","last_fullsized":"2024-04-19T02:20:58.188798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":640,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185254+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:58.185254+0000","last_peered":"2024-04-19T02:20:58.185254+0000","last_clean":"2024-04-19T02:20:58.185254+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:58.185254+0000","last_undegraded":"2024-04-19T02:20:58.185254+0000","last_fullsized":"2024-04-19T02:20:58.185254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183559+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:58.183559+0000","last_peered":"2024-04-19T02:20:58.183559+0000","last_clean":"2024-04-19T02:20:58.183559+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:58.183559+0000","last_undegraded":"2024-04-19T02:20:58.183559+0000","last_fullsized":"2024-04-19T02:20:58.183559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":930,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184453+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:20:58.184453+0000","last_peered":"2024-04-19T02:20:58.184453+0000","last_clean":"2024-04-19T02:20:58.184453+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:20:58.184453+0000","last_undegraded":"2024-04-19T02:20:58.184453+0000","last_fullsized":"2024-04-19T02:20:58.184453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1113,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188435+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:58.188435+0000","last_peered":"2024-04-19T02:20:58.188435+0000","last_clean":"2024-04-19T02:20:58.188435+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:58.188435+0000","last_undegraded":"2024-04-19T02:20:58.188435+0000","last_fullsized":"2024-04-19T02:20:58.188435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":891,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182523+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:58.182523+0000","last_peered":"2024-04-19T02:20:58.182523+0000","last_clean":"2024-04-19T02:20:58.182523+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:58.182523+0000","last_undegraded":"2024-04-19T02:20:58.182523+0000","last_fullsized":"2024-04-19T02:20:58.182523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186542+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:58.186542+0000","last_peered":"2024-04-19T02:20:58.186542+0000","last_clean":"2024-04-19T02:20:58.186542+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:58.186542+0000","last_undegraded":"2024-04-19T02:20:58.186542+0000","last_fullsized":"2024-04-19T02:20:58.186542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":941,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197999+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:20:59.197999+0000","last_peered":"2024-04-19T02:20:59.197999+0000","last_clean":"2024-04-19T02:20:59.197999+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:20:59.197999+0000","last_undegraded":"2024-04-19T02:20:59.197999+0000","last_fullsized":"2024-04-19T02:20:59.197999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1165,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184976+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:20:58.184976+0000","last_peered":"2024-04-19T02:20:58.184976+0000","last_clean":"2024-04-19T02:20:58.184976+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:20:58.184976+0000","last_undegraded":"2024-04-19T02:20:58.184976+0000","last_fullsized":"2024-04-19T02:20:58.184976+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":937,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189199+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:20:58.189199+0000","last_peered":"2024-04-19T02:20:58.189199+0000","last_clean":"2024-04-19T02:20:58.189199+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:20:58.189199+0000","last_undegraded":"2024-04-19T02:20:58.189199+0000","last_fullsized":"2024-04-19T02:20:58.189199+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":807,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189123+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:58.189123+0000","last_peered":"2024-04-19T02:20:58.189123+0000","last_clean":"2024-04-19T02:20:58.189123+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:58.189123+0000","last_undegraded":"2024-04-19T02:20:58.189123+0000","last_fullsized":"2024-04-19T02:20:58.189123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":530,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183900+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:58.183900+0000","last_peered":"2024-04-19T02:20:58.183900+0000","last_clean":"2024-04-19T02:20:58.183900+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:58.183900+0000","last_undegraded":"2024-04-19T02:20:58.183900+0000","last_fullsized":"2024-04-19T02:20:58.183900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1068,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188849+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:20:58.188849+0000","last_peered":"2024-04-19T02:20:58.188849+0000","last_clean":"2024-04-19T02:20:58.188849+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:20:58.188849+0000","last_undegraded":"2024-04-19T02:20:58.188849+0000","last_fullsized":"2024-04-19T02:20:58.188849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":607,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183261+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:58.183261+0000","last_peered":"2024-04-19T02:20:58.183261+0000","last_clean":"2024-04-19T02:20:58.183261+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:58.183261+0000","last_undegraded":"2024-04-19T02:20:58.183261+0000","last_fullsized":"2024-04-19T02:20:58.183261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":924,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182736+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:20:58.182736+0000","last_peered":"2024-04-19T02:20:58.182736+0000","last_clean":"2024-04-19T02:20:58.182736+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:20:58.182736+0000","last_undegraded":"2024-04-19T02:20:58.182736+0000","last_fullsized":"2024-04-19T02:20:58.182736+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":488,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188256+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:58.188256+0000","last_peered":"2024-04-19T02:20:58.188256+0000","last_clean":"2024-04-19T02:20:58.188256+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:58.188256+0000","last_undegraded":"2024-04-19T02:20:58.188256+0000","last_fullsized":"2024-04-19T02:20:58.188256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":495,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183579+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:58.183579+0000","last_peered":"2024-04-19T02:20:58.183579+0000","last_clean":"2024-04-19T02:20:58.183579+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:58.183579+0000","last_undegraded":"2024-04-19T02:20:58.183579+0000","last_fullsized":"2024-04-19T02:20:58.183579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":537,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188626+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:58.188626+0000","last_peered":"2024-04-19T02:20:58.188626+0000","last_clean":"2024-04-19T02:20:58.188626+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:58.188626+0000","last_undegraded":"2024-04-19T02:20:58.188626+0000","last_fullsized":"2024-04-19T02:20:58.188626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183606+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:58.183606+0000","last_peered":"2024-04-19T02:20:58.183606+0000","last_clean":"2024-04-19T02:20:58.183606+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:58.183606+0000","last_undegraded":"2024-04-19T02:20:58.183606+0000","last_fullsized":"2024-04-19T02:20:58.183606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1011,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185435+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:20:58.185435+0000","last_peered":"2024-04-19T02:20:58.185435+0000","last_clean":"2024-04-19T02:20:58.185435+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:20:58.185435+0000","last_undegraded":"2024-04-19T02:20:58.185435+0000","last_fullsized":"2024-04-19T02:20:58.185435+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":184,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187169+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:58.187169+0000","last_peered":"2024-04-19T02:20:58.187169+0000","last_clean":"2024-04-19T02:20:58.187169+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:58.187169+0000","last_undegraded":"2024-04-19T02:20:58.187169+0000","last_fullsized":"2024-04-19T02:20:58.187169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":892,"reported_epoch":108,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:59.274114+0000","last_change":"2024-04-19T02:20:59.274607+0000","last_active":"2024-04-19T02:20:59.274114+0000","last_peered":"2024-04-19T02:20:59.274114+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:59.274114+0000","last_undegraded":"2024-04-19T02:20:59.274114+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":157,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186821+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:58.186821+0000","last_peered":"2024-04-19T02:20:58.186821+0000","last_clean":"2024-04-19T02:20:58.186821+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:58.186821+0000","last_undegraded":"2024-04-19T02:20:58.186821+0000","last_fullsized":"2024-04-19T02:20:58.186821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":281,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190716+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:58.190716+0000","last_peered":"2024-04-19T02:20:58.190716+0000","last_clean":"2024-04-19T02:20:58.190716+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:58.190716+0000","last_undegraded":"2024-04-19T02:20:58.190716+0000","last_fullsized":"2024-04-19T02:20:58.190716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":886,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186562+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:58.186562+0000","last_peered":"2024-04-19T02:20:58.186562+0000","last_clean":"2024-04-19T02:20:58.186562+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:58.186562+0000","last_undegraded":"2024-04-19T02:20:58.186562+0000","last_fullsized":"2024-04-19T02:20:58.186562+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":421,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187704+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:58.187704+0000","last_peered":"2024-04-19T02:20:58.187704+0000","last_clean":"2024-04-19T02:20:58.187704+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:58.187704+0000","last_undegraded":"2024-04-19T02:20:58.187704+0000","last_fullsized":"2024-04-19T02:20:58.187704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186946+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:58.186946+0000","last_peered":"2024-04-19T02:20:58.186946+0000","last_clean":"2024-04-19T02:20:58.186946+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:58.186946+0000","last_undegraded":"2024-04-19T02:20:58.186946+0000","last_fullsized":"2024-04-19T02:20:58.186946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":710,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188498+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:58.188498+0000","last_peered":"2024-04-19T02:20:58.188498+0000","last_clean":"2024-04-19T02:20:58.188498+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:58.188498+0000","last_undegraded":"2024-04-19T02:20:58.188498+0000","last_fullsized":"2024-04-19T02:20:58.188498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":889,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183389+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:58.183389+0000","last_peered":"2024-04-19T02:20:58.183389+0000","last_clean":"2024-04-19T02:20:58.183389+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:58.183389+0000","last_undegraded":"2024-04-19T02:20:58.183389+0000","last_fullsized":"2024-04-19T02:20:58.183389+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":148,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186108+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:58.186108+0000","last_peered":"2024-04-19T02:20:58.186108+0000","last_clean":"2024-04-19T02:20:58.186108+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:58.186108+0000","last_undegraded":"2024-04-19T02:20:58.186108+0000","last_fullsized":"2024-04-19T02:20:58.186108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1073,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197928+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:20:59.197928+0000","last_peered":"2024-04-19T02:20:59.197928+0000","last_clean":"2024-04-19T02:20:59.197928+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:20:59.197928+0000","last_undegraded":"2024-04-19T02:20:59.197928+0000","last_fullsized":"2024-04-19T02:20:59.197928+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":261,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184702+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:58.184702+0000","last_peered":"2024-04-19T02:20:58.184702+0000","last_clean":"2024-04-19T02:20:58.184702+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:58.184702+0000","last_undegraded":"2024-04-19T02:20:58.184702+0000","last_fullsized":"2024-04-19T02:20:58.184702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":959,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183337+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:58.183337+0000","last_peered":"2024-04-19T02:20:58.183337+0000","last_clean":"2024-04-19T02:20:58.183337+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:58.183337+0000","last_undegraded":"2024-04-19T02:20:58.183337+0000","last_fullsized":"2024-04-19T02:20:58.183337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":311,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182928+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:58.182928+0000","last_peered":"2024-04-19T02:20:58.182928+0000","last_clean":"2024-04-19T02:20:58.182928+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:58.182928+0000","last_undegraded":"2024-04-19T02:20:58.182928+0000","last_fullsized":"2024-04-19T02:20:58.182928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":981,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188951+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:20:58.188951+0000","last_peered":"2024-04-19T02:20:58.188951+0000","last_clean":"2024-04-19T02:20:58.188951+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:20:58.188951+0000","last_undegraded":"2024-04-19T02:20:58.188951+0000","last_fullsized":"2024-04-19T02:20:58.188951+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":169,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187255+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:58.187255+0000","last_peered":"2024-04-19T02:20:58.187255+0000","last_clean":"2024-04-19T02:20:58.187255+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:58.187255+0000","last_undegraded":"2024-04-19T02:20:58.187255+0000","last_fullsized":"2024-04-19T02:20:58.187255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":812,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187556+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:58.187556+0000","last_peered":"2024-04-19T02:20:58.187556+0000","last_clean":"2024-04-19T02:20:58.187556+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:58.187556+0000","last_undegraded":"2024-04-19T02:20:58.187556+0000","last_fullsized":"2024-04-19T02:20:58.187556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":493,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186923+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:58.186923+0000","last_peered":"2024-04-19T02:20:58.186923+0000","last_clean":"2024-04-19T02:20:58.186923+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:58.186923+0000","last_undegraded":"2024-04-19T02:20:58.186923+0000","last_fullsized":"2024-04-19T02:20:58.186923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":522,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184350+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:58.184350+0000","last_peered":"2024-04-19T02:20:58.184350+0000","last_clean":"2024-04-19T02:20:58.184350+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:58.184350+0000","last_undegraded":"2024-04-19T02:20:58.184350+0000","last_fullsized":"2024-04-19T02:20:58.184350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":296,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187952+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:58.187952+0000","last_peered":"2024-04-19T02:20:58.187952+0000","last_clean":"2024-04-19T02:20:58.187952+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:58.187952+0000","last_undegraded":"2024-04-19T02:20:58.187952+0000","last_fullsized":"2024-04-19T02:20:58.187952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184943+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:58.184943+0000","last_peered":"2024-04-19T02:20:58.184943+0000","last_clean":"2024-04-19T02:20:58.184943+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:58.184943+0000","last_undegraded":"2024-04-19T02:20:58.184943+0000","last_fullsized":"2024-04-19T02:20:58.184943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":864,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183855+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:58.183855+0000","last_peered":"2024-04-19T02:20:58.183855+0000","last_clean":"2024-04-19T02:20:58.183855+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:58.183855+0000","last_undegraded":"2024-04-19T02:20:58.183855+0000","last_fullsized":"2024-04-19T02:20:58.183855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":960,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188320+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:20:58.188320+0000","last_peered":"2024-04-19T02:20:58.188320+0000","last_clean":"2024-04-19T02:20:58.188320+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:20:58.188320+0000","last_undegraded":"2024-04-19T02:20:58.188320+0000","last_fullsized":"2024-04-19T02:20:58.188320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187173+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:58.187173+0000","last_peered":"2024-04-19T02:20:58.187173+0000","last_clean":"2024-04-19T02:20:58.187173+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:58.187173+0000","last_undegraded":"2024-04-19T02:20:58.187173+0000","last_fullsized":"2024-04-19T02:20:58.187173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":301,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184037+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:58.184037+0000","last_peered":"2024-04-19T02:20:58.184037+0000","last_clean":"2024-04-19T02:20:58.184037+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:58.184037+0000","last_undegraded":"2024-04-19T02:20:58.184037+0000","last_fullsized":"2024-04-19T02:20:58.184037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":547,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188897+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:58.188897+0000","last_peered":"2024-04-19T02:20:58.188897+0000","last_clean":"2024-04-19T02:20:58.188897+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:58.188897+0000","last_undegraded":"2024-04-19T02:20:58.188897+0000","last_fullsized":"2024-04-19T02:20:58.188897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184454+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:58.184454+0000","last_peered":"2024-04-19T02:20:58.184454+0000","last_clean":"2024-04-19T02:20:58.184454+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:58.184454+0000","last_undegraded":"2024-04-19T02:20:58.184454+0000","last_fullsized":"2024-04-19T02:20:58.184454+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":514,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187090+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:58.187090+0000","last_peered":"2024-04-19T02:20:58.187090+0000","last_clean":"2024-04-19T02:20:58.187090+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:58.187090+0000","last_undegraded":"2024-04-19T02:20:58.187090+0000","last_fullsized":"2024-04-19T02:20:58.187090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":459,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184597+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:58.184597+0000","last_peered":"2024-04-19T02:20:58.184597+0000","last_clean":"2024-04-19T02:20:58.184597+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:58.184597+0000","last_undegraded":"2024-04-19T02:20:58.184597+0000","last_fullsized":"2024-04-19T02:20:58.184597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184094+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:58.184094+0000","last_peered":"2024-04-19T02:20:58.184094+0000","last_clean":"2024-04-19T02:20:58.184094+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:58.184094+0000","last_undegraded":"2024-04-19T02:20:58.184094+0000","last_fullsized":"2024-04-19T02:20:58.184094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184203+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:58.184203+0000","last_peered":"2024-04-19T02:20:58.184203+0000","last_clean":"2024-04-19T02:20:58.184203+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:58.184203+0000","last_undegraded":"2024-04-19T02:20:58.184203+0000","last_fullsized":"2024-04-19T02:20:58.184203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":564,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186156+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:58.186156+0000","last_peered":"2024-04-19T02:20:58.186156+0000","last_clean":"2024-04-19T02:20:58.186156+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:58.186156+0000","last_undegraded":"2024-04-19T02:20:58.186156+0000","last_fullsized":"2024-04-19T02:20:58.186156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":848,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188727+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:58.188727+0000","last_peered":"2024-04-19T02:20:58.188727+0000","last_clean":"2024-04-19T02:20:58.188727+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:58.188727+0000","last_undegraded":"2024-04-19T02:20:58.188727+0000","last_fullsized":"2024-04-19T02:20:58.188727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":158,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185942+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:58.185942+0000","last_peered":"2024-04-19T02:20:58.185942+0000","last_clean":"2024-04-19T02:20:58.185942+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:58.185942+0000","last_undegraded":"2024-04-19T02:20:58.185942+0000","last_fullsized":"2024-04-19T02:20:58.185942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189368+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:58.189368+0000","last_peered":"2024-04-19T02:20:58.189368+0000","last_clean":"2024-04-19T02:20:58.189368+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:58.189368+0000","last_undegraded":"2024-04-19T02:20:58.189368+0000","last_fullsized":"2024-04-19T02:20:58.189368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":965,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187927+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:58.187927+0000","last_peered":"2024-04-19T02:20:58.187927+0000","last_clean":"2024-04-19T02:20:58.187927+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:58.187927+0000","last_undegraded":"2024-04-19T02:20:58.187927+0000","last_fullsized":"2024-04-19T02:20:58.187927+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185300+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:58.185300+0000","last_peered":"2024-04-19T02:20:58.185300+0000","last_clean":"2024-04-19T02:20:58.185300+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:58.185300+0000","last_undegraded":"2024-04-19T02:20:58.185300+0000","last_fullsized":"2024-04-19T02:20:58.185300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185705+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:58.185705+0000","last_peered":"2024-04-19T02:20:58.185705+0000","last_clean":"2024-04-19T02:20:58.185705+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:58.185705+0000","last_undegraded":"2024-04-19T02:20:58.185705+0000","last_fullsized":"2024-04-19T02:20:58.185705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":935,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-19T02:20:59.188187+0000","last_change":"2024-04-19T02:20:59.188612+0000","last_active":"2024-04-19T02:20:59.188187+0000","last_peered":"2024-04-19T02:20:58.677847+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:59.188187+0000","last_undegraded":"2024-04-19T02:20:59.188187+0000","last_fullsized":"2024-04-19T02:20:59.188187+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:19.653804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":195,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185569+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:58.185569+0000","last_peered":"2024-04-19T02:20:58.185569+0000","last_clean":"2024-04-19T02:20:58.185569+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:58.185569+0000","last_undegraded":"2024-04-19T02:20:58.185569+0000","last_fullsized":"2024-04-19T02:20:58.185569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190807+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:58.190807+0000","last_peered":"2024-04-19T02:20:58.190807+0000","last_clean":"2024-04-19T02:20:58.190807+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:58.190807+0000","last_undegraded":"2024-04-19T02:20:58.190807+0000","last_fullsized":"2024-04-19T02:20:58.190807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":568,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182220+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:58.182220+0000","last_peered":"2024-04-19T02:20:58.182220+0000","last_clean":"2024-04-19T02:20:58.182220+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:58.182220+0000","last_undegraded":"2024-04-19T02:20:58.182220+0000","last_fullsized":"2024-04-19T02:20:58.182220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":871,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187693+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:58.187693+0000","last_peered":"2024-04-19T02:20:58.187693+0000","last_clean":"2024-04-19T02:20:58.187693+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:58.187693+0000","last_undegraded":"2024-04-19T02:20:58.187693+0000","last_fullsized":"2024-04-19T02:20:58.187693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":573,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187907+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:58.187907+0000","last_peered":"2024-04-19T02:20:58.187907+0000","last_clean":"2024-04-19T02:20:58.187907+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:58.187907+0000","last_undegraded":"2024-04-19T02:20:58.187907+0000","last_fullsized":"2024-04-19T02:20:58.187907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":545,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182531+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:58.182531+0000","last_peered":"2024-04-19T02:20:58.182531+0000","last_clean":"2024-04-19T02:20:58.182531+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:58.182531+0000","last_undegraded":"2024-04-19T02:20:58.182531+0000","last_fullsized":"2024-04-19T02:20:58.182531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":206,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189192+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:58.189192+0000","last_peered":"2024-04-19T02:20:58.189192+0000","last_clean":"2024-04-19T02:20:58.189192+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:58.189192+0000","last_undegraded":"2024-04-19T02:20:58.189192+0000","last_fullsized":"2024-04-19T02:20:58.189192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":428,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185082+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:58.185082+0000","last_peered":"2024-04-19T02:20:58.185082+0000","last_clean":"2024-04-19T02:20:58.185082+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:58.185082+0000","last_undegraded":"2024-04-19T02:20:58.185082+0000","last_fullsized":"2024-04-19T02:20:58.185082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1009,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.191099+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:20:58.191099+0000","last_peered":"2024-04-19T02:20:58.191099+0000","last_clean":"2024-04-19T02:20:58.191099+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:20:58.191099+0000","last_undegraded":"2024-04-19T02:20:58.191099+0000","last_fullsized":"2024-04-19T02:20:58.191099+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184996+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:58.184996+0000","last_peered":"2024-04-19T02:20:58.184996+0000","last_clean":"2024-04-19T02:20:58.184996+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:58.184996+0000","last_undegraded":"2024-04-19T02:20:58.184996+0000","last_fullsized":"2024-04-19T02:20:58.184996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":619,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182945+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:58.182945+0000","last_peered":"2024-04-19T02:20:58.182945+0000","last_clean":"2024-04-19T02:20:58.182945+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:58.182945+0000","last_undegraded":"2024-04-19T02:20:58.182945+0000","last_fullsized":"2024-04-19T02:20:58.182945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":909,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190489+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:58.190489+0000","last_peered":"2024-04-19T02:20:58.190489+0000","last_clean":"2024-04-19T02:20:58.190489+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:58.190489+0000","last_undegraded":"2024-04-19T02:20:58.190489+0000","last_fullsized":"2024-04-19T02:20:58.190489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":673,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183238+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:58.183238+0000","last_peered":"2024-04-19T02:20:58.183238+0000","last_clean":"2024-04-19T02:20:58.183238+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:58.183238+0000","last_undegraded":"2024-04-19T02:20:58.183238+0000","last_fullsized":"2024-04-19T02:20:58.183238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":934,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184606+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:58.184606+0000","last_peered":"2024-04-19T02:20:58.184606+0000","last_clean":"2024-04-19T02:20:58.184606+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:58.184606+0000","last_undegraded":"2024-04-19T02:20:58.184606+0000","last_fullsized":"2024-04-19T02:20:58.184606+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":451,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183734+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:58.183734+0000","last_peered":"2024-04-19T02:20:58.183734+0000","last_clean":"2024-04-19T02:20:58.183734+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:58.183734+0000","last_undegraded":"2024-04-19T02:20:58.183734+0000","last_fullsized":"2024-04-19T02:20:58.183734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":851,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187699+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:58.187699+0000","last_peered":"2024-04-19T02:20:58.187699+0000","last_clean":"2024-04-19T02:20:58.187699+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:58.187699+0000","last_undegraded":"2024-04-19T02:20:58.187699+0000","last_fullsized":"2024-04-19T02:20:58.187699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":598,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188970+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:58.188970+0000","last_peered":"2024-04-19T02:20:58.188970+0000","last_clean":"2024-04-19T02:20:58.188970+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:58.188970+0000","last_undegraded":"2024-04-19T02:20:58.188970+0000","last_fullsized":"2024-04-19T02:20:58.188970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":540,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188374+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:58.188374+0000","last_peered":"2024-04-19T02:20:58.188374+0000","last_clean":"2024-04-19T02:20:58.188374+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:58.188374+0000","last_undegraded":"2024-04-19T02:20:58.188374+0000","last_fullsized":"2024-04-19T02:20:58.188374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188183+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:58.188183+0000","last_peered":"2024-04-19T02:20:58.188183+0000","last_clean":"2024-04-19T02:20:58.188183+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:58.188183+0000","last_undegraded":"2024-04-19T02:20:58.188183+0000","last_fullsized":"2024-04-19T02:20:58.188183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":828,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182835+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:58.182835+0000","last_peered":"2024-04-19T02:20:58.182835+0000","last_clean":"2024-04-19T02:20:58.182835+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:58.182835+0000","last_undegraded":"2024-04-19T02:20:58.182835+0000","last_fullsized":"2024-04-19T02:20:58.182835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":438,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185768+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:58.185768+0000","last_peered":"2024-04-19T02:20:58.185768+0000","last_clean":"2024-04-19T02:20:58.185768+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:58.185768+0000","last_undegraded":"2024-04-19T02:20:58.185768+0000","last_fullsized":"2024-04-19T02:20:58.185768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":881,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182801+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:58.182801+0000","last_peered":"2024-04-19T02:20:58.182801+0000","last_clean":"2024-04-19T02:20:58.182801+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:58.182801+0000","last_undegraded":"2024-04-19T02:20:58.182801+0000","last_fullsized":"2024-04-19T02:20:58.182801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":498,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188888+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:58.188888+0000","last_peered":"2024-04-19T02:20:58.188888+0000","last_clean":"2024-04-19T02:20:58.188888+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:58.188888+0000","last_undegraded":"2024-04-19T02:20:58.188888+0000","last_fullsized":"2024-04-19T02:20:58.188888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":623,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187425+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:58.187425+0000","last_peered":"2024-04-19T02:20:58.187425+0000","last_clean":"2024-04-19T02:20:58.187425+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:58.187425+0000","last_undegraded":"2024-04-19T02:20:58.187425+0000","last_fullsized":"2024-04-19T02:20:58.187425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185343+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:58.185343+0000","last_peered":"2024-04-19T02:20:58.185343+0000","last_clean":"2024-04-19T02:20:58.185343+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:58.185343+0000","last_undegraded":"2024-04-19T02:20:58.185343+0000","last_fullsized":"2024-04-19T02:20:58.185343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":984,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182511+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:20:58.182511+0000","last_peered":"2024-04-19T02:20:58.182511+0000","last_clean":"2024-04-19T02:20:58.182511+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:20:58.182511+0000","last_undegraded":"2024-04-19T02:20:58.182511+0000","last_fullsized":"2024-04-19T02:20:58.182511+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":172,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184740+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:58.184740+0000","last_peered":"2024-04-19T02:20:58.184740+0000","last_clean":"2024-04-19T02:20:58.184740+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:58.184740+0000","last_undegraded":"2024-04-19T02:20:58.184740+0000","last_fullsized":"2024-04-19T02:20:58.184740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":127,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142964,"kb_used_data":27432,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228876,"statfs":{"total":96636764160,"available":96490369024,"internally_reserved":0,"allocated":28090368,"data_stored":81624046,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":78,"seq":335007449095,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66032,"kb_used_data":12264,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305808,"statfs":{"total":96636764160,"available":96569147392,"internally_reserved":0,"allocated":12558336,"data_stored":91899324,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139536,"kb_used_data":28092,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232304,"statfs":{"total":96636764160,"available":96493879296,"internally_reserved":0,"allocated":28766208,"data_stored":86242173,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:01.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:21:01.604 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:01.604 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":298,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":110,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":103},{"state_name":"active+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":356896768,"bytes_avail":289553395712,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"recovering_objects_per_sec":312,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1249,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:21:01.622 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:21:01.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:01.929 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:01.947 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-04-19T02:21:01.194358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7190,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":209,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348532,"kb_used_data":67788,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766988,"statfs":{"total":289910292480,"available":289553395712,"internally_reserved":0,"allocated":69414912,"data_stored":259765543,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1249,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.971843"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189611+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:58.189611+0000","last_peered":"2024-04-19T02:20:58.189611+0000","last_clean":"2024-04-19T02:20:58.189611+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:58.189611+0000","last_undegraded":"2024-04-19T02:20:58.189611+0000","last_fullsized":"2024-04-19T02:20:58.189611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":584,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187906+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:58.187906+0000","last_peered":"2024-04-19T02:20:58.187906+0000","last_clean":"2024-04-19T02:20:58.187906+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:58.187906+0000","last_undegraded":"2024-04-19T02:20:58.187906+0000","last_fullsized":"2024-04-19T02:20:58.187906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":861,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187272+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:20:58.187272+0000","last_peered":"2024-04-19T02:20:58.187272+0000","last_clean":"2024-04-19T02:20:58.187272+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:20:58.187272+0000","last_undegraded":"2024-04-19T02:20:58.187272+0000","last_fullsized":"2024-04-19T02:20:58.187272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":835,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183265+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:58.183265+0000","last_peered":"2024-04-19T02:20:58.183265+0000","last_clean":"2024-04-19T02:20:58.183265+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:58.183265+0000","last_undegraded":"2024-04-19T02:20:58.183265+0000","last_fullsized":"2024-04-19T02:20:58.183265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":532,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:58.188108+0000","last_peered":"2024-04-19T02:20:58.188108+0000","last_clean":"2024-04-19T02:20:58.188108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:58.188108+0000","last_undegraded":"2024-04-19T02:20:58.188108+0000","last_fullsized":"2024-04-19T02:20:58.188108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186929+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:58.186929+0000","last_peered":"2024-04-19T02:20:58.186929+0000","last_clean":"2024-04-19T02:20:58.186929+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:58.186929+0000","last_undegraded":"2024-04-19T02:20:58.186929+0000","last_fullsized":"2024-04-19T02:20:58.186929+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":918,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":946,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182437+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:58.182437+0000","last_peered":"2024-04-19T02:20:58.182437+0000","last_clean":"2024-04-19T02:20:58.182437+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:58.182437+0000","last_undegraded":"2024-04-19T02:20:58.182437+0000","last_fullsized":"2024-04-19T02:20:58.182437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":553,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184099+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:58.184099+0000","last_peered":"2024-04-19T02:20:58.184099+0000","last_clean":"2024-04-19T02:20:58.184099+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:58.184099+0000","last_undegraded":"2024-04-19T02:20:58.184099+0000","last_fullsized":"2024-04-19T02:20:58.184099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":544,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188531+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:58.188531+0000","last_peered":"2024-04-19T02:20:58.188531+0000","last_clean":"2024-04-19T02:20:58.188531+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:58.188531+0000","last_undegraded":"2024-04-19T02:20:58.188531+0000","last_fullsized":"2024-04-19T02:20:58.188531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":833,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185427+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:58.185427+0000","last_peered":"2024-04-19T02:20:58.185427+0000","last_clean":"2024-04-19T02:20:58.185427+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:58.185427+0000","last_undegraded":"2024-04-19T02:20:58.185427+0000","last_fullsized":"2024-04-19T02:20:58.185427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":901,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187669+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:58.187669+0000","last_peered":"2024-04-19T02:20:58.187669+0000","last_clean":"2024-04-19T02:20:58.187669+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:58.187669+0000","last_undegraded":"2024-04-19T02:20:58.187669+0000","last_fullsized":"2024-04-19T02:20:58.187669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187872+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:58.187872+0000","last_peered":"2024-04-19T02:20:58.187872+0000","last_clean":"2024-04-19T02:20:58.187872+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:58.187872+0000","last_undegraded":"2024-04-19T02:20:58.187872+0000","last_fullsized":"2024-04-19T02:20:58.187872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":897,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187235+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:20:58.187235+0000","last_peered":"2024-04-19T02:20:58.187235+0000","last_clean":"2024-04-19T02:20:58.187235+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:20:58.187235+0000","last_undegraded":"2024-04-19T02:20:58.187235+0000","last_fullsized":"2024-04-19T02:20:58.187235+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":917,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186716+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:58.186716+0000","last_peered":"2024-04-19T02:20:58.186716+0000","last_clean":"2024-04-19T02:20:58.186716+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:58.186716+0000","last_undegraded":"2024-04-19T02:20:58.186716+0000","last_fullsized":"2024-04-19T02:20:58.186716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1000,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":551,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185085+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:58.185085+0000","last_peered":"2024-04-19T02:20:58.185085+0000","last_clean":"2024-04-19T02:20:58.185085+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:58.185085+0000","last_undegraded":"2024-04-19T02:20:58.185085+0000","last_fullsized":"2024-04-19T02:20:58.185085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188798+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:58.188798+0000","last_peered":"2024-04-19T02:20:58.188798+0000","last_clean":"2024-04-19T02:20:58.188798+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:58.188798+0000","last_undegraded":"2024-04-19T02:20:58.188798+0000","last_fullsized":"2024-04-19T02:20:58.188798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":640,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185254+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:58.185254+0000","last_peered":"2024-04-19T02:20:58.185254+0000","last_clean":"2024-04-19T02:20:58.185254+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:58.185254+0000","last_undegraded":"2024-04-19T02:20:58.185254+0000","last_fullsized":"2024-04-19T02:20:58.185254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183559+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:58.183559+0000","last_peered":"2024-04-19T02:20:58.183559+0000","last_clean":"2024-04-19T02:20:58.183559+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:58.183559+0000","last_undegraded":"2024-04-19T02:20:58.183559+0000","last_fullsized":"2024-04-19T02:20:58.183559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":930,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184453+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:20:58.184453+0000","last_peered":"2024-04-19T02:20:58.184453+0000","last_clean":"2024-04-19T02:20:58.184453+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:20:58.184453+0000","last_undegraded":"2024-04-19T02:20:58.184453+0000","last_fullsized":"2024-04-19T02:20:58.184453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1113,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188435+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:58.188435+0000","last_peered":"2024-04-19T02:20:58.188435+0000","last_clean":"2024-04-19T02:20:58.188435+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:58.188435+0000","last_undegraded":"2024-04-19T02:20:58.188435+0000","last_fullsized":"2024-04-19T02:20:58.188435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":891,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182523+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:58.182523+0000","last_peered":"2024-04-19T02:20:58.182523+0000","last_clean":"2024-04-19T02:20:58.182523+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:58.182523+0000","last_undegraded":"2024-04-19T02:20:58.182523+0000","last_fullsized":"2024-04-19T02:20:58.182523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186542+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:58.186542+0000","last_peered":"2024-04-19T02:20:58.186542+0000","last_clean":"2024-04-19T02:20:58.186542+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:58.186542+0000","last_undegraded":"2024-04-19T02:20:58.186542+0000","last_fullsized":"2024-04-19T02:20:58.186542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":941,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197999+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:20:59.197999+0000","last_peered":"2024-04-19T02:20:59.197999+0000","last_clean":"2024-04-19T02:20:59.197999+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:20:59.197999+0000","last_undegraded":"2024-04-19T02:20:59.197999+0000","last_fullsized":"2024-04-19T02:20:59.197999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1165,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184976+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:20:58.184976+0000","last_peered":"2024-04-19T02:20:58.184976+0000","last_clean":"2024-04-19T02:20:58.184976+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:20:58.184976+0000","last_undegraded":"2024-04-19T02:20:58.184976+0000","last_fullsized":"2024-04-19T02:20:58.184976+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":937,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189199+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:20:58.189199+0000","last_peered":"2024-04-19T02:20:58.189199+0000","last_clean":"2024-04-19T02:20:58.189199+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:20:58.189199+0000","last_undegraded":"2024-04-19T02:20:58.189199+0000","last_fullsized":"2024-04-19T02:20:58.189199+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":807,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189123+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:58.189123+0000","last_peered":"2024-04-19T02:20:58.189123+0000","last_clean":"2024-04-19T02:20:58.189123+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:58.189123+0000","last_undegraded":"2024-04-19T02:20:58.189123+0000","last_fullsized":"2024-04-19T02:20:58.189123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":530,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183900+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:58.183900+0000","last_peered":"2024-04-19T02:20:58.183900+0000","last_clean":"2024-04-19T02:20:58.183900+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:58.183900+0000","last_undegraded":"2024-04-19T02:20:58.183900+0000","last_fullsized":"2024-04-19T02:20:58.183900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1068,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188849+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:20:58.188849+0000","last_peered":"2024-04-19T02:20:58.188849+0000","last_clean":"2024-04-19T02:20:58.188849+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:20:58.188849+0000","last_undegraded":"2024-04-19T02:20:58.188849+0000","last_fullsized":"2024-04-19T02:20:58.188849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":607,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183261+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:58.183261+0000","last_peered":"2024-04-19T02:20:58.183261+0000","last_clean":"2024-04-19T02:20:58.183261+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:58.183261+0000","last_undegraded":"2024-04-19T02:20:58.183261+0000","last_fullsized":"2024-04-19T02:20:58.183261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":924,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182736+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:20:58.182736+0000","last_peered":"2024-04-19T02:20:58.182736+0000","last_clean":"2024-04-19T02:20:58.182736+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:20:58.182736+0000","last_undegraded":"2024-04-19T02:20:58.182736+0000","last_fullsized":"2024-04-19T02:20:58.182736+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":488,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188256+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:58.188256+0000","last_peered":"2024-04-19T02:20:58.188256+0000","last_clean":"2024-04-19T02:20:58.188256+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:58.188256+0000","last_undegraded":"2024-04-19T02:20:58.188256+0000","last_fullsized":"2024-04-19T02:20:58.188256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":495,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183579+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:58.183579+0000","last_peered":"2024-04-19T02:20:58.183579+0000","last_clean":"2024-04-19T02:20:58.183579+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:58.183579+0000","last_undegraded":"2024-04-19T02:20:58.183579+0000","last_fullsized":"2024-04-19T02:20:58.183579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":537,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188626+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:58.188626+0000","last_peered":"2024-04-19T02:20:58.188626+0000","last_clean":"2024-04-19T02:20:58.188626+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:58.188626+0000","last_undegraded":"2024-04-19T02:20:58.188626+0000","last_fullsized":"2024-04-19T02:20:58.188626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183606+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:58.183606+0000","last_peered":"2024-04-19T02:20:58.183606+0000","last_clean":"2024-04-19T02:20:58.183606+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:58.183606+0000","last_undegraded":"2024-04-19T02:20:58.183606+0000","last_fullsized":"2024-04-19T02:20:58.183606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1011,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185435+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:20:58.185435+0000","last_peered":"2024-04-19T02:20:58.185435+0000","last_clean":"2024-04-19T02:20:58.185435+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:20:58.185435+0000","last_undegraded":"2024-04-19T02:20:58.185435+0000","last_fullsized":"2024-04-19T02:20:58.185435+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":184,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187169+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:58.187169+0000","last_peered":"2024-04-19T02:20:58.187169+0000","last_clean":"2024-04-19T02:20:58.187169+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:58.187169+0000","last_undegraded":"2024-04-19T02:20:58.187169+0000","last_fullsized":"2024-04-19T02:20:58.187169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":892,"reported_epoch":108,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:59.274114+0000","last_change":"2024-04-19T02:20:59.274607+0000","last_active":"2024-04-19T02:20:59.274114+0000","last_peered":"2024-04-19T02:20:59.274114+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:59.274114+0000","last_undegraded":"2024-04-19T02:20:59.274114+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":157,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186821+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:58.186821+0000","last_peered":"2024-04-19T02:20:58.186821+0000","last_clean":"2024-04-19T02:20:58.186821+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:58.186821+0000","last_undegraded":"2024-04-19T02:20:58.186821+0000","last_fullsized":"2024-04-19T02:20:58.186821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":281,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190716+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:58.190716+0000","last_peered":"2024-04-19T02:20:58.190716+0000","last_clean":"2024-04-19T02:20:58.190716+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:58.190716+0000","last_undegraded":"2024-04-19T02:20:58.190716+0000","last_fullsized":"2024-04-19T02:20:58.190716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":886,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186562+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:58.186562+0000","last_peered":"2024-04-19T02:20:58.186562+0000","last_clean":"2024-04-19T02:20:58.186562+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:58.186562+0000","last_undegraded":"2024-04-19T02:20:58.186562+0000","last_fullsized":"2024-04-19T02:20:58.186562+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":421,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187704+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:58.187704+0000","last_peered":"2024-04-19T02:20:58.187704+0000","last_clean":"2024-04-19T02:20:58.187704+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:58.187704+0000","last_undegraded":"2024-04-19T02:20:58.187704+0000","last_fullsized":"2024-04-19T02:20:58.187704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186946+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:58.186946+0000","last_peered":"2024-04-19T02:20:58.186946+0000","last_clean":"2024-04-19T02:20:58.186946+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:58.186946+0000","last_undegraded":"2024-04-19T02:20:58.186946+0000","last_fullsized":"2024-04-19T02:20:58.186946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":710,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188498+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:58.188498+0000","last_peered":"2024-04-19T02:20:58.188498+0000","last_clean":"2024-04-19T02:20:58.188498+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:58.188498+0000","last_undegraded":"2024-04-19T02:20:58.188498+0000","last_fullsized":"2024-04-19T02:20:58.188498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":889,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183389+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:58.183389+0000","last_peered":"2024-04-19T02:20:58.183389+0000","last_clean":"2024-04-19T02:20:58.183389+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:58.183389+0000","last_undegraded":"2024-04-19T02:20:58.183389+0000","last_fullsized":"2024-04-19T02:20:58.183389+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":148,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186108+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:58.186108+0000","last_peered":"2024-04-19T02:20:58.186108+0000","last_clean":"2024-04-19T02:20:58.186108+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:58.186108+0000","last_undegraded":"2024-04-19T02:20:58.186108+0000","last_fullsized":"2024-04-19T02:20:58.186108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1073,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197928+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:20:59.197928+0000","last_peered":"2024-04-19T02:20:59.197928+0000","last_clean":"2024-04-19T02:20:59.197928+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:20:59.197928+0000","last_undegraded":"2024-04-19T02:20:59.197928+0000","last_fullsized":"2024-04-19T02:20:59.197928+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":261,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184702+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:58.184702+0000","last_peered":"2024-04-19T02:20:58.184702+0000","last_clean":"2024-04-19T02:20:58.184702+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:58.184702+0000","last_undegraded":"2024-04-19T02:20:58.184702+0000","last_fullsized":"2024-04-19T02:20:58.184702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":959,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183337+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:58.183337+0000","last_peered":"2024-04-19T02:20:58.183337+0000","last_clean":"2024-04-19T02:20:58.183337+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:58.183337+0000","last_undegraded":"2024-04-19T02:20:58.183337+0000","last_fullsized":"2024-04-19T02:20:58.183337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":311,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182928+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:58.182928+0000","last_peered":"2024-04-19T02:20:58.182928+0000","last_clean":"2024-04-19T02:20:58.182928+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:58.182928+0000","last_undegraded":"2024-04-19T02:20:58.182928+0000","last_fullsized":"2024-04-19T02:20:58.182928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":981,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188951+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:20:58.188951+0000","last_peered":"2024-04-19T02:20:58.188951+0000","last_clean":"2024-04-19T02:20:58.188951+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:20:58.188951+0000","last_undegraded":"2024-04-19T02:20:58.188951+0000","last_fullsized":"2024-04-19T02:20:58.188951+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":169,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187255+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:58.187255+0000","last_peered":"2024-04-19T02:20:58.187255+0000","last_clean":"2024-04-19T02:20:58.187255+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:58.187255+0000","last_undegraded":"2024-04-19T02:20:58.187255+0000","last_fullsized":"2024-04-19T02:20:58.187255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":812,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187556+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:58.187556+0000","last_peered":"2024-04-19T02:20:58.187556+0000","last_clean":"2024-04-19T02:20:58.187556+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:58.187556+0000","last_undegraded":"2024-04-19T02:20:58.187556+0000","last_fullsized":"2024-04-19T02:20:58.187556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":493,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186923+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:58.186923+0000","last_peered":"2024-04-19T02:20:58.186923+0000","last_clean":"2024-04-19T02:20:58.186923+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:58.186923+0000","last_undegraded":"2024-04-19T02:20:58.186923+0000","last_fullsized":"2024-04-19T02:20:58.186923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":522,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184350+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:58.184350+0000","last_peered":"2024-04-19T02:20:58.184350+0000","last_clean":"2024-04-19T02:20:58.184350+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:58.184350+0000","last_undegraded":"2024-04-19T02:20:58.184350+0000","last_fullsized":"2024-04-19T02:20:58.184350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":296,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187952+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:58.187952+0000","last_peered":"2024-04-19T02:20:58.187952+0000","last_clean":"2024-04-19T02:20:58.187952+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:58.187952+0000","last_undegraded":"2024-04-19T02:20:58.187952+0000","last_fullsized":"2024-04-19T02:20:58.187952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184943+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:58.184943+0000","last_peered":"2024-04-19T02:20:58.184943+0000","last_clean":"2024-04-19T02:20:58.184943+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:58.184943+0000","last_undegraded":"2024-04-19T02:20:58.184943+0000","last_fullsized":"2024-04-19T02:20:58.184943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":864,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183855+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:58.183855+0000","last_peered":"2024-04-19T02:20:58.183855+0000","last_clean":"2024-04-19T02:20:58.183855+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:58.183855+0000","last_undegraded":"2024-04-19T02:20:58.183855+0000","last_fullsized":"2024-04-19T02:20:58.183855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":960,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188320+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:20:58.188320+0000","last_peered":"2024-04-19T02:20:58.188320+0000","last_clean":"2024-04-19T02:20:58.188320+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:20:58.188320+0000","last_undegraded":"2024-04-19T02:20:58.188320+0000","last_fullsized":"2024-04-19T02:20:58.188320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187173+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:58.187173+0000","last_peered":"2024-04-19T02:20:58.187173+0000","last_clean":"2024-04-19T02:20:58.187173+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:58.187173+0000","last_undegraded":"2024-04-19T02:20:58.187173+0000","last_fullsized":"2024-04-19T02:20:58.187173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":301,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184037+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:58.184037+0000","last_peered":"2024-04-19T02:20:58.184037+0000","last_clean":"2024-04-19T02:20:58.184037+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:58.184037+0000","last_undegraded":"2024-04-19T02:20:58.184037+0000","last_fullsized":"2024-04-19T02:20:58.184037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":547,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188897+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:58.188897+0000","last_peered":"2024-04-19T02:20:58.188897+0000","last_clean":"2024-04-19T02:20:58.188897+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:58.188897+0000","last_undegraded":"2024-04-19T02:20:58.188897+0000","last_fullsized":"2024-04-19T02:20:58.188897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184454+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:58.184454+0000","last_peered":"2024-04-19T02:20:58.184454+0000","last_clean":"2024-04-19T02:20:58.184454+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:58.184454+0000","last_undegraded":"2024-04-19T02:20:58.184454+0000","last_fullsized":"2024-04-19T02:20:58.184454+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":514,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187090+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:58.187090+0000","last_peered":"2024-04-19T02:20:58.187090+0000","last_clean":"2024-04-19T02:20:58.187090+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:58.187090+0000","last_undegraded":"2024-04-19T02:20:58.187090+0000","last_fullsized":"2024-04-19T02:20:58.187090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":459,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184597+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:58.184597+0000","last_peered":"2024-04-19T02:20:58.184597+0000","last_clean":"2024-04-19T02:20:58.184597+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:58.184597+0000","last_undegraded":"2024-04-19T02:20:58.184597+0000","last_fullsized":"2024-04-19T02:20:58.184597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184094+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:58.184094+0000","last_peered":"2024-04-19T02:20:58.184094+0000","last_clean":"2024-04-19T02:20:58.184094+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:58.184094+0000","last_undegraded":"2024-04-19T02:20:58.184094+0000","last_fullsized":"2024-04-19T02:20:58.184094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184203+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:58.184203+0000","last_peered":"2024-04-19T02:20:58.184203+0000","last_clean":"2024-04-19T02:20:58.184203+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:58.184203+0000","last_undegraded":"2024-04-19T02:20:58.184203+0000","last_fullsized":"2024-04-19T02:20:58.184203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":564,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186156+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:58.186156+0000","last_peered":"2024-04-19T02:20:58.186156+0000","last_clean":"2024-04-19T02:20:58.186156+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:58.186156+0000","last_undegraded":"2024-04-19T02:20:58.186156+0000","last_fullsized":"2024-04-19T02:20:58.186156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":848,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188727+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:58.188727+0000","last_peered":"2024-04-19T02:20:58.188727+0000","last_clean":"2024-04-19T02:20:58.188727+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:58.188727+0000","last_undegraded":"2024-04-19T02:20:58.188727+0000","last_fullsized":"2024-04-19T02:20:58.188727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":158,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185942+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:58.185942+0000","last_peered":"2024-04-19T02:20:58.185942+0000","last_clean":"2024-04-19T02:20:58.185942+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:58.185942+0000","last_undegraded":"2024-04-19T02:20:58.185942+0000","last_fullsized":"2024-04-19T02:20:58.185942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189368+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:58.189368+0000","last_peered":"2024-04-19T02:20:58.189368+0000","last_clean":"2024-04-19T02:20:58.189368+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:58.189368+0000","last_undegraded":"2024-04-19T02:20:58.189368+0000","last_fullsized":"2024-04-19T02:20:58.189368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":965,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187927+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:58.187927+0000","last_peered":"2024-04-19T02:20:58.187927+0000","last_clean":"2024-04-19T02:20:58.187927+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:58.187927+0000","last_undegraded":"2024-04-19T02:20:58.187927+0000","last_fullsized":"2024-04-19T02:20:58.187927+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185300+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:58.185300+0000","last_peered":"2024-04-19T02:20:58.185300+0000","last_clean":"2024-04-19T02:20:58.185300+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:58.185300+0000","last_undegraded":"2024-04-19T02:20:58.185300+0000","last_fullsized":"2024-04-19T02:20:58.185300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185705+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:58.185705+0000","last_peered":"2024-04-19T02:20:58.185705+0000","last_clean":"2024-04-19T02:20:58.185705+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:58.185705+0000","last_undegraded":"2024-04-19T02:20:58.185705+0000","last_fullsized":"2024-04-19T02:20:58.185705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":935,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-19T02:20:59.188187+0000","last_change":"2024-04-19T02:20:59.188612+0000","last_active":"2024-04-19T02:20:59.188187+0000","last_peered":"2024-04-19T02:20:58.677847+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:59.188187+0000","last_undegraded":"2024-04-19T02:20:59.188187+0000","last_fullsized":"2024-04-19T02:20:59.188187+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:19.653804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":195,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185569+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:58.185569+0000","last_peered":"2024-04-19T02:20:58.185569+0000","last_clean":"2024-04-19T02:20:58.185569+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:58.185569+0000","last_undegraded":"2024-04-19T02:20:58.185569+0000","last_fullsized":"2024-04-19T02:20:58.185569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190807+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:58.190807+0000","last_peered":"2024-04-19T02:20:58.190807+0000","last_clean":"2024-04-19T02:20:58.190807+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:58.190807+0000","last_undegraded":"2024-04-19T02:20:58.190807+0000","last_fullsized":"2024-04-19T02:20:58.190807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":568,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182220+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:58.182220+0000","last_peered":"2024-04-19T02:20:58.182220+0000","last_clean":"2024-04-19T02:20:58.182220+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:58.182220+0000","last_undegraded":"2024-04-19T02:20:58.182220+0000","last_fullsized":"2024-04-19T02:20:58.182220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":871,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187693+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:58.187693+0000","last_peered":"2024-04-19T02:20:58.187693+0000","last_clean":"2024-04-19T02:20:58.187693+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:58.187693+0000","last_undegraded":"2024-04-19T02:20:58.187693+0000","last_fullsized":"2024-04-19T02:20:58.187693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":573,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187907+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:58.187907+0000","last_peered":"2024-04-19T02:20:58.187907+0000","last_clean":"2024-04-19T02:20:58.187907+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:58.187907+0000","last_undegraded":"2024-04-19T02:20:58.187907+0000","last_fullsized":"2024-04-19T02:20:58.187907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":545,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182531+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:58.182531+0000","last_peered":"2024-04-19T02:20:58.182531+0000","last_clean":"2024-04-19T02:20:58.182531+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:58.182531+0000","last_undegraded":"2024-04-19T02:20:58.182531+0000","last_fullsized":"2024-04-19T02:20:58.182531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":206,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189192+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:58.189192+0000","last_peered":"2024-04-19T02:20:58.189192+0000","last_clean":"2024-04-19T02:20:58.189192+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:58.189192+0000","last_undegraded":"2024-04-19T02:20:58.189192+0000","last_fullsized":"2024-04-19T02:20:58.189192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":428,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185082+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:58.185082+0000","last_peered":"2024-04-19T02:20:58.185082+0000","last_clean":"2024-04-19T02:20:58.185082+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:58.185082+0000","last_undegraded":"2024-04-19T02:20:58.185082+0000","last_fullsized":"2024-04-19T02:20:58.185082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1009,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.191099+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:20:58.191099+0000","last_peered":"2024-04-19T02:20:58.191099+0000","last_clean":"2024-04-19T02:20:58.191099+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:20:58.191099+0000","last_undegraded":"2024-04-19T02:20:58.191099+0000","last_fullsized":"2024-04-19T02:20:58.191099+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184996+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:58.184996+0000","last_peered":"2024-04-19T02:20:58.184996+0000","last_clean":"2024-04-19T02:20:58.184996+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:58.184996+0000","last_undegraded":"2024-04-19T02:20:58.184996+0000","last_fullsized":"2024-04-19T02:20:58.184996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":619,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182945+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:58.182945+0000","last_peered":"2024-04-19T02:20:58.182945+0000","last_clean":"2024-04-19T02:20:58.182945+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:58.182945+0000","last_undegraded":"2024-04-19T02:20:58.182945+0000","last_fullsized":"2024-04-19T02:20:58.182945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":909,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190489+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:58.190489+0000","last_peered":"2024-04-19T02:20:58.190489+0000","last_clean":"2024-04-19T02:20:58.190489+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:58.190489+0000","last_undegraded":"2024-04-19T02:20:58.190489+0000","last_fullsized":"2024-04-19T02:20:58.190489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":673,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183238+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:58.183238+0000","last_peered":"2024-04-19T02:20:58.183238+0000","last_clean":"2024-04-19T02:20:58.183238+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:58.183238+0000","last_undegraded":"2024-04-19T02:20:58.183238+0000","last_fullsized":"2024-04-19T02:20:58.183238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":934,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184606+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:58.184606+0000","last_peered":"2024-04-19T02:20:58.184606+0000","last_clean":"2024-04-19T02:20:58.184606+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:58.184606+0000","last_undegraded":"2024-04-19T02:20:58.184606+0000","last_fullsized":"2024-04-19T02:20:58.184606+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":451,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183734+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:58.183734+0000","last_peered":"2024-04-19T02:20:58.183734+0000","last_clean":"2024-04-19T02:20:58.183734+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:58.183734+0000","last_undegraded":"2024-04-19T02:20:58.183734+0000","last_fullsized":"2024-04-19T02:20:58.183734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":851,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187699+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:58.187699+0000","last_peered":"2024-04-19T02:20:58.187699+0000","last_clean":"2024-04-19T02:20:58.187699+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:58.187699+0000","last_undegraded":"2024-04-19T02:20:58.187699+0000","last_fullsized":"2024-04-19T02:20:58.187699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":598,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188970+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:58.188970+0000","last_peered":"2024-04-19T02:20:58.188970+0000","last_clean":"2024-04-19T02:20:58.188970+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:58.188970+0000","last_undegraded":"2024-04-19T02:20:58.188970+0000","last_fullsized":"2024-04-19T02:20:58.188970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":540,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188374+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:58.188374+0000","last_peered":"2024-04-19T02:20:58.188374+0000","last_clean":"2024-04-19T02:20:58.188374+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:58.188374+0000","last_undegraded":"2024-04-19T02:20:58.188374+0000","last_fullsized":"2024-04-19T02:20:58.188374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188183+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:58.188183+0000","last_peered":"2024-04-19T02:20:58.188183+0000","last_clean":"2024-04-19T02:20:58.188183+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:58.188183+0000","last_undegraded":"2024-04-19T02:20:58.188183+0000","last_fullsized":"2024-04-19T02:20:58.188183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":828,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182835+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:58.182835+0000","last_peered":"2024-04-19T02:20:58.182835+0000","last_clean":"2024-04-19T02:20:58.182835+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:58.182835+0000","last_undegraded":"2024-04-19T02:20:58.182835+0000","last_fullsized":"2024-04-19T02:20:58.182835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":438,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185768+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:58.185768+0000","last_peered":"2024-04-19T02:20:58.185768+0000","last_clean":"2024-04-19T02:20:58.185768+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:58.185768+0000","last_undegraded":"2024-04-19T02:20:58.185768+0000","last_fullsized":"2024-04-19T02:20:58.185768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":881,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182801+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:58.182801+0000","last_peered":"2024-04-19T02:20:58.182801+0000","last_clean":"2024-04-19T02:20:58.182801+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:58.182801+0000","last_undegraded":"2024-04-19T02:20:58.182801+0000","last_fullsized":"2024-04-19T02:20:58.182801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":498,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188888+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:58.188888+0000","last_peered":"2024-04-19T02:20:58.188888+0000","last_clean":"2024-04-19T02:20:58.188888+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:58.188888+0000","last_undegraded":"2024-04-19T02:20:58.188888+0000","last_fullsized":"2024-04-19T02:20:58.188888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":623,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187425+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:58.187425+0000","last_peered":"2024-04-19T02:20:58.187425+0000","last_clean":"2024-04-19T02:20:58.187425+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:58.187425+0000","last_undegraded":"2024-04-19T02:20:58.187425+0000","last_fullsized":"2024-04-19T02:20:58.187425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185343+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:58.185343+0000","last_peered":"2024-04-19T02:20:58.185343+0000","last_clean":"2024-04-19T02:20:58.185343+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:58.185343+0000","last_undegraded":"2024-04-19T02:20:58.185343+0000","last_fullsized":"2024-04-19T02:20:58.185343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":984,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182511+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:20:58.182511+0000","last_peered":"2024-04-19T02:20:58.182511+0000","last_clean":"2024-04-19T02:20:58.182511+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:20:58.182511+0000","last_undegraded":"2024-04-19T02:20:58.182511+0000","last_fullsized":"2024-04-19T02:20:58.182511+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":172,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184740+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:58.184740+0000","last_peered":"2024-04-19T02:20:58.184740+0000","last_clean":"2024-04-19T02:20:58.184740+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:58.184740+0000","last_undegraded":"2024-04-19T02:20:58.184740+0000","last_fullsized":"2024-04-19T02:20:58.184740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":127,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142964,"kb_used_data":27432,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228876,"statfs":{"total":96636764160,"available":96490369024,"internally_reserved":0,"allocated":28090368,"data_stored":81624046,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":78,"seq":335007449095,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66032,"kb_used_data":12264,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305808,"statfs":{"total":96636764160,"available":96569147392,"internally_reserved":0,"allocated":12558336,"data_stored":91899324,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139536,"kb_used_data":28092,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232304,"statfs":{"total":96636764160,"available":96493879296,"internally_reserved":0,"allocated":28766208,"data_stored":86242173,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:04.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:05.314 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:05.316 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:05.332 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-04-19T02:21:04.301646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7190,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":209,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348568,"kb_used_data":67820,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766952,"statfs":{"total":289910292480,"available":289553358848,"internally_reserved":0,"allocated":69447680,"data_stored":259782878,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1249,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001777"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189611+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:58.189611+0000","last_peered":"2024-04-19T02:20:58.189611+0000","last_clean":"2024-04-19T02:20:58.189611+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:58.189611+0000","last_undegraded":"2024-04-19T02:20:58.189611+0000","last_fullsized":"2024-04-19T02:20:58.189611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":584,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187906+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:58.187906+0000","last_peered":"2024-04-19T02:20:58.187906+0000","last_clean":"2024-04-19T02:20:58.187906+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:58.187906+0000","last_undegraded":"2024-04-19T02:20:58.187906+0000","last_fullsized":"2024-04-19T02:20:58.187906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":861,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187272+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:20:58.187272+0000","last_peered":"2024-04-19T02:20:58.187272+0000","last_clean":"2024-04-19T02:20:58.187272+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:20:58.187272+0000","last_undegraded":"2024-04-19T02:20:58.187272+0000","last_fullsized":"2024-04-19T02:20:58.187272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":835,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183265+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:58.183265+0000","last_peered":"2024-04-19T02:20:58.183265+0000","last_clean":"2024-04-19T02:20:58.183265+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:58.183265+0000","last_undegraded":"2024-04-19T02:20:58.183265+0000","last_fullsized":"2024-04-19T02:20:58.183265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":532,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:58.188108+0000","last_peered":"2024-04-19T02:20:58.188108+0000","last_clean":"2024-04-19T02:20:58.188108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:58.188108+0000","last_undegraded":"2024-04-19T02:20:58.188108+0000","last_fullsized":"2024-04-19T02:20:58.188108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186929+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:58.186929+0000","last_peered":"2024-04-19T02:20:58.186929+0000","last_clean":"2024-04-19T02:20:58.186929+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:58.186929+0000","last_undegraded":"2024-04-19T02:20:58.186929+0000","last_fullsized":"2024-04-19T02:20:58.186929+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":918,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":946,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182437+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:58.182437+0000","last_peered":"2024-04-19T02:20:58.182437+0000","last_clean":"2024-04-19T02:20:58.182437+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:58.182437+0000","last_undegraded":"2024-04-19T02:20:58.182437+0000","last_fullsized":"2024-04-19T02:20:58.182437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":553,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184099+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:58.184099+0000","last_peered":"2024-04-19T02:20:58.184099+0000","last_clean":"2024-04-19T02:20:58.184099+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:58.184099+0000","last_undegraded":"2024-04-19T02:20:58.184099+0000","last_fullsized":"2024-04-19T02:20:58.184099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":544,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188531+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:58.188531+0000","last_peered":"2024-04-19T02:20:58.188531+0000","last_clean":"2024-04-19T02:20:58.188531+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:58.188531+0000","last_undegraded":"2024-04-19T02:20:58.188531+0000","last_fullsized":"2024-04-19T02:20:58.188531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":833,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185427+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:58.185427+0000","last_peered":"2024-04-19T02:20:58.185427+0000","last_clean":"2024-04-19T02:20:58.185427+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:58.185427+0000","last_undegraded":"2024-04-19T02:20:58.185427+0000","last_fullsized":"2024-04-19T02:20:58.185427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":901,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187669+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:58.187669+0000","last_peered":"2024-04-19T02:20:58.187669+0000","last_clean":"2024-04-19T02:20:58.187669+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:58.187669+0000","last_undegraded":"2024-04-19T02:20:58.187669+0000","last_fullsized":"2024-04-19T02:20:58.187669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187872+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:58.187872+0000","last_peered":"2024-04-19T02:20:58.187872+0000","last_clean":"2024-04-19T02:20:58.187872+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:58.187872+0000","last_undegraded":"2024-04-19T02:20:58.187872+0000","last_fullsized":"2024-04-19T02:20:58.187872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":897,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187235+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:20:58.187235+0000","last_peered":"2024-04-19T02:20:58.187235+0000","last_clean":"2024-04-19T02:20:58.187235+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:20:58.187235+0000","last_undegraded":"2024-04-19T02:20:58.187235+0000","last_fullsized":"2024-04-19T02:20:58.187235+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":917,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186716+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:58.186716+0000","last_peered":"2024-04-19T02:20:58.186716+0000","last_clean":"2024-04-19T02:20:58.186716+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:58.186716+0000","last_undegraded":"2024-04-19T02:20:58.186716+0000","last_fullsized":"2024-04-19T02:20:58.186716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1000,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":551,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185085+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:58.185085+0000","last_peered":"2024-04-19T02:20:58.185085+0000","last_clean":"2024-04-19T02:20:58.185085+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:58.185085+0000","last_undegraded":"2024-04-19T02:20:58.185085+0000","last_fullsized":"2024-04-19T02:20:58.185085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188798+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:58.188798+0000","last_peered":"2024-04-19T02:20:58.188798+0000","last_clean":"2024-04-19T02:20:58.188798+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:58.188798+0000","last_undegraded":"2024-04-19T02:20:58.188798+0000","last_fullsized":"2024-04-19T02:20:58.188798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":640,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185254+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:58.185254+0000","last_peered":"2024-04-19T02:20:58.185254+0000","last_clean":"2024-04-19T02:20:58.185254+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:58.185254+0000","last_undegraded":"2024-04-19T02:20:58.185254+0000","last_fullsized":"2024-04-19T02:20:58.185254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183559+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:58.183559+0000","last_peered":"2024-04-19T02:20:58.183559+0000","last_clean":"2024-04-19T02:20:58.183559+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:58.183559+0000","last_undegraded":"2024-04-19T02:20:58.183559+0000","last_fullsized":"2024-04-19T02:20:58.183559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":930,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184453+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:20:58.184453+0000","last_peered":"2024-04-19T02:20:58.184453+0000","last_clean":"2024-04-19T02:20:58.184453+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:20:58.184453+0000","last_undegraded":"2024-04-19T02:20:58.184453+0000","last_fullsized":"2024-04-19T02:20:58.184453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1113,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188435+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:58.188435+0000","last_peered":"2024-04-19T02:20:58.188435+0000","last_clean":"2024-04-19T02:20:58.188435+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:58.188435+0000","last_undegraded":"2024-04-19T02:20:58.188435+0000","last_fullsized":"2024-04-19T02:20:58.188435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":891,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182523+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:58.182523+0000","last_peered":"2024-04-19T02:20:58.182523+0000","last_clean":"2024-04-19T02:20:58.182523+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:58.182523+0000","last_undegraded":"2024-04-19T02:20:58.182523+0000","last_fullsized":"2024-04-19T02:20:58.182523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186542+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:58.186542+0000","last_peered":"2024-04-19T02:20:58.186542+0000","last_clean":"2024-04-19T02:20:58.186542+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:58.186542+0000","last_undegraded":"2024-04-19T02:20:58.186542+0000","last_fullsized":"2024-04-19T02:20:58.186542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":941,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197999+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:20:59.197999+0000","last_peered":"2024-04-19T02:20:59.197999+0000","last_clean":"2024-04-19T02:20:59.197999+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:20:59.197999+0000","last_undegraded":"2024-04-19T02:20:59.197999+0000","last_fullsized":"2024-04-19T02:20:59.197999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1165,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184976+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:20:58.184976+0000","last_peered":"2024-04-19T02:20:58.184976+0000","last_clean":"2024-04-19T02:20:58.184976+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:20:58.184976+0000","last_undegraded":"2024-04-19T02:20:58.184976+0000","last_fullsized":"2024-04-19T02:20:58.184976+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":937,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189199+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:20:58.189199+0000","last_peered":"2024-04-19T02:20:58.189199+0000","last_clean":"2024-04-19T02:20:58.189199+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:20:58.189199+0000","last_undegraded":"2024-04-19T02:20:58.189199+0000","last_fullsized":"2024-04-19T02:20:58.189199+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":807,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189123+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:58.189123+0000","last_peered":"2024-04-19T02:20:58.189123+0000","last_clean":"2024-04-19T02:20:58.189123+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:58.189123+0000","last_undegraded":"2024-04-19T02:20:58.189123+0000","last_fullsized":"2024-04-19T02:20:58.189123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":530,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183900+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:58.183900+0000","last_peered":"2024-04-19T02:20:58.183900+0000","last_clean":"2024-04-19T02:20:58.183900+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:58.183900+0000","last_undegraded":"2024-04-19T02:20:58.183900+0000","last_fullsized":"2024-04-19T02:20:58.183900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1068,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188849+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:20:58.188849+0000","last_peered":"2024-04-19T02:20:58.188849+0000","last_clean":"2024-04-19T02:20:58.188849+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:20:58.188849+0000","last_undegraded":"2024-04-19T02:20:58.188849+0000","last_fullsized":"2024-04-19T02:20:58.188849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":607,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183261+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:58.183261+0000","last_peered":"2024-04-19T02:20:58.183261+0000","last_clean":"2024-04-19T02:20:58.183261+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:58.183261+0000","last_undegraded":"2024-04-19T02:20:58.183261+0000","last_fullsized":"2024-04-19T02:20:58.183261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":924,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182736+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:20:58.182736+0000","last_peered":"2024-04-19T02:20:58.182736+0000","last_clean":"2024-04-19T02:20:58.182736+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:20:58.182736+0000","last_undegraded":"2024-04-19T02:20:58.182736+0000","last_fullsized":"2024-04-19T02:20:58.182736+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":488,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188256+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:58.188256+0000","last_peered":"2024-04-19T02:20:58.188256+0000","last_clean":"2024-04-19T02:20:58.188256+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:58.188256+0000","last_undegraded":"2024-04-19T02:20:58.188256+0000","last_fullsized":"2024-04-19T02:20:58.188256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":495,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183579+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:58.183579+0000","last_peered":"2024-04-19T02:20:58.183579+0000","last_clean":"2024-04-19T02:20:58.183579+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:58.183579+0000","last_undegraded":"2024-04-19T02:20:58.183579+0000","last_fullsized":"2024-04-19T02:20:58.183579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":537,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188626+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:58.188626+0000","last_peered":"2024-04-19T02:20:58.188626+0000","last_clean":"2024-04-19T02:20:58.188626+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:58.188626+0000","last_undegraded":"2024-04-19T02:20:58.188626+0000","last_fullsized":"2024-04-19T02:20:58.188626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183606+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:58.183606+0000","last_peered":"2024-04-19T02:20:58.183606+0000","last_clean":"2024-04-19T02:20:58.183606+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:58.183606+0000","last_undegraded":"2024-04-19T02:20:58.183606+0000","last_fullsized":"2024-04-19T02:20:58.183606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1011,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185435+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:20:58.185435+0000","last_peered":"2024-04-19T02:20:58.185435+0000","last_clean":"2024-04-19T02:20:58.185435+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:20:58.185435+0000","last_undegraded":"2024-04-19T02:20:58.185435+0000","last_fullsized":"2024-04-19T02:20:58.185435+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":184,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187169+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:58.187169+0000","last_peered":"2024-04-19T02:20:58.187169+0000","last_clean":"2024-04-19T02:20:58.187169+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:58.187169+0000","last_undegraded":"2024-04-19T02:20:58.187169+0000","last_fullsized":"2024-04-19T02:20:58.187169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":892,"reported_epoch":108,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:59.274114+0000","last_change":"2024-04-19T02:20:59.274607+0000","last_active":"2024-04-19T02:20:59.274114+0000","last_peered":"2024-04-19T02:20:59.274114+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:59.274114+0000","last_undegraded":"2024-04-19T02:20:59.274114+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":157,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186821+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:58.186821+0000","last_peered":"2024-04-19T02:20:58.186821+0000","last_clean":"2024-04-19T02:20:58.186821+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:58.186821+0000","last_undegraded":"2024-04-19T02:20:58.186821+0000","last_fullsized":"2024-04-19T02:20:58.186821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":281,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190716+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:58.190716+0000","last_peered":"2024-04-19T02:20:58.190716+0000","last_clean":"2024-04-19T02:20:58.190716+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:58.190716+0000","last_undegraded":"2024-04-19T02:20:58.190716+0000","last_fullsized":"2024-04-19T02:20:58.190716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":886,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186562+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:58.186562+0000","last_peered":"2024-04-19T02:20:58.186562+0000","last_clean":"2024-04-19T02:20:58.186562+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:58.186562+0000","last_undegraded":"2024-04-19T02:20:58.186562+0000","last_fullsized":"2024-04-19T02:20:58.186562+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":421,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187704+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:58.187704+0000","last_peered":"2024-04-19T02:20:58.187704+0000","last_clean":"2024-04-19T02:20:58.187704+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:58.187704+0000","last_undegraded":"2024-04-19T02:20:58.187704+0000","last_fullsized":"2024-04-19T02:20:58.187704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186946+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:58.186946+0000","last_peered":"2024-04-19T02:20:58.186946+0000","last_clean":"2024-04-19T02:20:58.186946+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:58.186946+0000","last_undegraded":"2024-04-19T02:20:58.186946+0000","last_fullsized":"2024-04-19T02:20:58.186946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":710,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188498+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:58.188498+0000","last_peered":"2024-04-19T02:20:58.188498+0000","last_clean":"2024-04-19T02:20:58.188498+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:58.188498+0000","last_undegraded":"2024-04-19T02:20:58.188498+0000","last_fullsized":"2024-04-19T02:20:58.188498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":889,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183389+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:58.183389+0000","last_peered":"2024-04-19T02:20:58.183389+0000","last_clean":"2024-04-19T02:20:58.183389+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:58.183389+0000","last_undegraded":"2024-04-19T02:20:58.183389+0000","last_fullsized":"2024-04-19T02:20:58.183389+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":148,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186108+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:58.186108+0000","last_peered":"2024-04-19T02:20:58.186108+0000","last_clean":"2024-04-19T02:20:58.186108+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:58.186108+0000","last_undegraded":"2024-04-19T02:20:58.186108+0000","last_fullsized":"2024-04-19T02:20:58.186108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1073,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197928+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:20:59.197928+0000","last_peered":"2024-04-19T02:20:59.197928+0000","last_clean":"2024-04-19T02:20:59.197928+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:20:59.197928+0000","last_undegraded":"2024-04-19T02:20:59.197928+0000","last_fullsized":"2024-04-19T02:20:59.197928+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":261,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184702+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:58.184702+0000","last_peered":"2024-04-19T02:20:58.184702+0000","last_clean":"2024-04-19T02:20:58.184702+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:58.184702+0000","last_undegraded":"2024-04-19T02:20:58.184702+0000","last_fullsized":"2024-04-19T02:20:58.184702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":959,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183337+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:58.183337+0000","last_peered":"2024-04-19T02:20:58.183337+0000","last_clean":"2024-04-19T02:20:58.183337+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:58.183337+0000","last_undegraded":"2024-04-19T02:20:58.183337+0000","last_fullsized":"2024-04-19T02:20:58.183337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":311,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182928+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:58.182928+0000","last_peered":"2024-04-19T02:20:58.182928+0000","last_clean":"2024-04-19T02:20:58.182928+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:58.182928+0000","last_undegraded":"2024-04-19T02:20:58.182928+0000","last_fullsized":"2024-04-19T02:20:58.182928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":981,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188951+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:20:58.188951+0000","last_peered":"2024-04-19T02:20:58.188951+0000","last_clean":"2024-04-19T02:20:58.188951+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:20:58.188951+0000","last_undegraded":"2024-04-19T02:20:58.188951+0000","last_fullsized":"2024-04-19T02:20:58.188951+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":169,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187255+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:58.187255+0000","last_peered":"2024-04-19T02:20:58.187255+0000","last_clean":"2024-04-19T02:20:58.187255+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:58.187255+0000","last_undegraded":"2024-04-19T02:20:58.187255+0000","last_fullsized":"2024-04-19T02:20:58.187255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":812,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187556+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:58.187556+0000","last_peered":"2024-04-19T02:20:58.187556+0000","last_clean":"2024-04-19T02:20:58.187556+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:58.187556+0000","last_undegraded":"2024-04-19T02:20:58.187556+0000","last_fullsized":"2024-04-19T02:20:58.187556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":493,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186923+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:58.186923+0000","last_peered":"2024-04-19T02:20:58.186923+0000","last_clean":"2024-04-19T02:20:58.186923+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:58.186923+0000","last_undegraded":"2024-04-19T02:20:58.186923+0000","last_fullsized":"2024-04-19T02:20:58.186923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":522,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184350+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:58.184350+0000","last_peered":"2024-04-19T02:20:58.184350+0000","last_clean":"2024-04-19T02:20:58.184350+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:58.184350+0000","last_undegraded":"2024-04-19T02:20:58.184350+0000","last_fullsized":"2024-04-19T02:20:58.184350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":296,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187952+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:58.187952+0000","last_peered":"2024-04-19T02:20:58.187952+0000","last_clean":"2024-04-19T02:20:58.187952+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:58.187952+0000","last_undegraded":"2024-04-19T02:20:58.187952+0000","last_fullsized":"2024-04-19T02:20:58.187952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184943+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:58.184943+0000","last_peered":"2024-04-19T02:20:58.184943+0000","last_clean":"2024-04-19T02:20:58.184943+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:58.184943+0000","last_undegraded":"2024-04-19T02:20:58.184943+0000","last_fullsized":"2024-04-19T02:20:58.184943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":864,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183855+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:58.183855+0000","last_peered":"2024-04-19T02:20:58.183855+0000","last_clean":"2024-04-19T02:20:58.183855+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:58.183855+0000","last_undegraded":"2024-04-19T02:20:58.183855+0000","last_fullsized":"2024-04-19T02:20:58.183855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":960,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188320+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:20:58.188320+0000","last_peered":"2024-04-19T02:20:58.188320+0000","last_clean":"2024-04-19T02:20:58.188320+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:20:58.188320+0000","last_undegraded":"2024-04-19T02:20:58.188320+0000","last_fullsized":"2024-04-19T02:20:58.188320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187173+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:58.187173+0000","last_peered":"2024-04-19T02:20:58.187173+0000","last_clean":"2024-04-19T02:20:58.187173+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:58.187173+0000","last_undegraded":"2024-04-19T02:20:58.187173+0000","last_fullsized":"2024-04-19T02:20:58.187173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":301,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184037+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:58.184037+0000","last_peered":"2024-04-19T02:20:58.184037+0000","last_clean":"2024-04-19T02:20:58.184037+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:58.184037+0000","last_undegraded":"2024-04-19T02:20:58.184037+0000","last_fullsized":"2024-04-19T02:20:58.184037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":547,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188897+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:58.188897+0000","last_peered":"2024-04-19T02:20:58.188897+0000","last_clean":"2024-04-19T02:20:58.188897+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:58.188897+0000","last_undegraded":"2024-04-19T02:20:58.188897+0000","last_fullsized":"2024-04-19T02:20:58.188897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184454+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:58.184454+0000","last_peered":"2024-04-19T02:20:58.184454+0000","last_clean":"2024-04-19T02:20:58.184454+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:58.184454+0000","last_undegraded":"2024-04-19T02:20:58.184454+0000","last_fullsized":"2024-04-19T02:20:58.184454+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":514,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187090+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:58.187090+0000","last_peered":"2024-04-19T02:20:58.187090+0000","last_clean":"2024-04-19T02:20:58.187090+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:58.187090+0000","last_undegraded":"2024-04-19T02:20:58.187090+0000","last_fullsized":"2024-04-19T02:20:58.187090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":459,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184597+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:58.184597+0000","last_peered":"2024-04-19T02:20:58.184597+0000","last_clean":"2024-04-19T02:20:58.184597+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:58.184597+0000","last_undegraded":"2024-04-19T02:20:58.184597+0000","last_fullsized":"2024-04-19T02:20:58.184597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184094+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:58.184094+0000","last_peered":"2024-04-19T02:20:58.184094+0000","last_clean":"2024-04-19T02:20:58.184094+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:58.184094+0000","last_undegraded":"2024-04-19T02:20:58.184094+0000","last_fullsized":"2024-04-19T02:20:58.184094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184203+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:58.184203+0000","last_peered":"2024-04-19T02:20:58.184203+0000","last_clean":"2024-04-19T02:20:58.184203+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:58.184203+0000","last_undegraded":"2024-04-19T02:20:58.184203+0000","last_fullsized":"2024-04-19T02:20:58.184203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":564,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186156+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:58.186156+0000","last_peered":"2024-04-19T02:20:58.186156+0000","last_clean":"2024-04-19T02:20:58.186156+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:58.186156+0000","last_undegraded":"2024-04-19T02:20:58.186156+0000","last_fullsized":"2024-04-19T02:20:58.186156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":848,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188727+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:58.188727+0000","last_peered":"2024-04-19T02:20:58.188727+0000","last_clean":"2024-04-19T02:20:58.188727+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:58.188727+0000","last_undegraded":"2024-04-19T02:20:58.188727+0000","last_fullsized":"2024-04-19T02:20:58.188727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":158,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185942+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:58.185942+0000","last_peered":"2024-04-19T02:20:58.185942+0000","last_clean":"2024-04-19T02:20:58.185942+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:58.185942+0000","last_undegraded":"2024-04-19T02:20:58.185942+0000","last_fullsized":"2024-04-19T02:20:58.185942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189368+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:58.189368+0000","last_peered":"2024-04-19T02:20:58.189368+0000","last_clean":"2024-04-19T02:20:58.189368+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:58.189368+0000","last_undegraded":"2024-04-19T02:20:58.189368+0000","last_fullsized":"2024-04-19T02:20:58.189368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":965,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187927+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:58.187927+0000","last_peered":"2024-04-19T02:20:58.187927+0000","last_clean":"2024-04-19T02:20:58.187927+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:58.187927+0000","last_undegraded":"2024-04-19T02:20:58.187927+0000","last_fullsized":"2024-04-19T02:20:58.187927+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185300+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:58.185300+0000","last_peered":"2024-04-19T02:20:58.185300+0000","last_clean":"2024-04-19T02:20:58.185300+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:58.185300+0000","last_undegraded":"2024-04-19T02:20:58.185300+0000","last_fullsized":"2024-04-19T02:20:58.185300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185705+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:58.185705+0000","last_peered":"2024-04-19T02:20:58.185705+0000","last_clean":"2024-04-19T02:20:58.185705+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:58.185705+0000","last_undegraded":"2024-04-19T02:20:58.185705+0000","last_fullsized":"2024-04-19T02:20:58.185705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":935,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-19T02:20:59.188187+0000","last_change":"2024-04-19T02:20:59.188612+0000","last_active":"2024-04-19T02:20:59.188187+0000","last_peered":"2024-04-19T02:20:58.677847+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:59.188187+0000","last_undegraded":"2024-04-19T02:20:59.188187+0000","last_fullsized":"2024-04-19T02:20:59.188187+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:19.653804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":195,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185569+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:58.185569+0000","last_peered":"2024-04-19T02:20:58.185569+0000","last_clean":"2024-04-19T02:20:58.185569+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:58.185569+0000","last_undegraded":"2024-04-19T02:20:58.185569+0000","last_fullsized":"2024-04-19T02:20:58.185569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190807+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:58.190807+0000","last_peered":"2024-04-19T02:20:58.190807+0000","last_clean":"2024-04-19T02:20:58.190807+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:58.190807+0000","last_undegraded":"2024-04-19T02:20:58.190807+0000","last_fullsized":"2024-04-19T02:20:58.190807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":568,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182220+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:58.182220+0000","last_peered":"2024-04-19T02:20:58.182220+0000","last_clean":"2024-04-19T02:20:58.182220+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:58.182220+0000","last_undegraded":"2024-04-19T02:20:58.182220+0000","last_fullsized":"2024-04-19T02:20:58.182220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":871,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187693+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:58.187693+0000","last_peered":"2024-04-19T02:20:58.187693+0000","last_clean":"2024-04-19T02:20:58.187693+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:58.187693+0000","last_undegraded":"2024-04-19T02:20:58.187693+0000","last_fullsized":"2024-04-19T02:20:58.187693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":573,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187907+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:58.187907+0000","last_peered":"2024-04-19T02:20:58.187907+0000","last_clean":"2024-04-19T02:20:58.187907+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:58.187907+0000","last_undegraded":"2024-04-19T02:20:58.187907+0000","last_fullsized":"2024-04-19T02:20:58.187907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":545,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182531+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:58.182531+0000","last_peered":"2024-04-19T02:20:58.182531+0000","last_clean":"2024-04-19T02:20:58.182531+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:58.182531+0000","last_undegraded":"2024-04-19T02:20:58.182531+0000","last_fullsized":"2024-04-19T02:20:58.182531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":206,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189192+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:58.189192+0000","last_peered":"2024-04-19T02:20:58.189192+0000","last_clean":"2024-04-19T02:20:58.189192+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:58.189192+0000","last_undegraded":"2024-04-19T02:20:58.189192+0000","last_fullsized":"2024-04-19T02:20:58.189192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":428,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185082+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:58.185082+0000","last_peered":"2024-04-19T02:20:58.185082+0000","last_clean":"2024-04-19T02:20:58.185082+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:58.185082+0000","last_undegraded":"2024-04-19T02:20:58.185082+0000","last_fullsized":"2024-04-19T02:20:58.185082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1009,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.191099+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:20:58.191099+0000","last_peered":"2024-04-19T02:20:58.191099+0000","last_clean":"2024-04-19T02:20:58.191099+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:20:58.191099+0000","last_undegraded":"2024-04-19T02:20:58.191099+0000","last_fullsized":"2024-04-19T02:20:58.191099+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184996+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:58.184996+0000","last_peered":"2024-04-19T02:20:58.184996+0000","last_clean":"2024-04-19T02:20:58.184996+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:58.184996+0000","last_undegraded":"2024-04-19T02:20:58.184996+0000","last_fullsized":"2024-04-19T02:20:58.184996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":619,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182945+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:58.182945+0000","last_peered":"2024-04-19T02:20:58.182945+0000","last_clean":"2024-04-19T02:20:58.182945+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:58.182945+0000","last_undegraded":"2024-04-19T02:20:58.182945+0000","last_fullsized":"2024-04-19T02:20:58.182945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":909,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190489+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:58.190489+0000","last_peered":"2024-04-19T02:20:58.190489+0000","last_clean":"2024-04-19T02:20:58.190489+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:58.190489+0000","last_undegraded":"2024-04-19T02:20:58.190489+0000","last_fullsized":"2024-04-19T02:20:58.190489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":673,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183238+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:58.183238+0000","last_peered":"2024-04-19T02:20:58.183238+0000","last_clean":"2024-04-19T02:20:58.183238+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:58.183238+0000","last_undegraded":"2024-04-19T02:20:58.183238+0000","last_fullsized":"2024-04-19T02:20:58.183238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":934,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184606+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:58.184606+0000","last_peered":"2024-04-19T02:20:58.184606+0000","last_clean":"2024-04-19T02:20:58.184606+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:58.184606+0000","last_undegraded":"2024-04-19T02:20:58.184606+0000","last_fullsized":"2024-04-19T02:20:58.184606+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":451,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183734+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:58.183734+0000","last_peered":"2024-04-19T02:20:58.183734+0000","last_clean":"2024-04-19T02:20:58.183734+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:58.183734+0000","last_undegraded":"2024-04-19T02:20:58.183734+0000","last_fullsized":"2024-04-19T02:20:58.183734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":851,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187699+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:58.187699+0000","last_peered":"2024-04-19T02:20:58.187699+0000","last_clean":"2024-04-19T02:20:58.187699+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:58.187699+0000","last_undegraded":"2024-04-19T02:20:58.187699+0000","last_fullsized":"2024-04-19T02:20:58.187699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":598,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188970+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:58.188970+0000","last_peered":"2024-04-19T02:20:58.188970+0000","last_clean":"2024-04-19T02:20:58.188970+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:58.188970+0000","last_undegraded":"2024-04-19T02:20:58.188970+0000","last_fullsized":"2024-04-19T02:20:58.188970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":540,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188374+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:58.188374+0000","last_peered":"2024-04-19T02:20:58.188374+0000","last_clean":"2024-04-19T02:20:58.188374+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:58.188374+0000","last_undegraded":"2024-04-19T02:20:58.188374+0000","last_fullsized":"2024-04-19T02:20:58.188374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188183+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:58.188183+0000","last_peered":"2024-04-19T02:20:58.188183+0000","last_clean":"2024-04-19T02:20:58.188183+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:58.188183+0000","last_undegraded":"2024-04-19T02:20:58.188183+0000","last_fullsized":"2024-04-19T02:20:58.188183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":828,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182835+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:58.182835+0000","last_peered":"2024-04-19T02:20:58.182835+0000","last_clean":"2024-04-19T02:20:58.182835+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:58.182835+0000","last_undegraded":"2024-04-19T02:20:58.182835+0000","last_fullsized":"2024-04-19T02:20:58.182835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":438,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185768+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:58.185768+0000","last_peered":"2024-04-19T02:20:58.185768+0000","last_clean":"2024-04-19T02:20:58.185768+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:58.185768+0000","last_undegraded":"2024-04-19T02:20:58.185768+0000","last_fullsized":"2024-04-19T02:20:58.185768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":881,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182801+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:58.182801+0000","last_peered":"2024-04-19T02:20:58.182801+0000","last_clean":"2024-04-19T02:20:58.182801+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:58.182801+0000","last_undegraded":"2024-04-19T02:20:58.182801+0000","last_fullsized":"2024-04-19T02:20:58.182801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":498,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188888+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:58.188888+0000","last_peered":"2024-04-19T02:20:58.188888+0000","last_clean":"2024-04-19T02:20:58.188888+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:58.188888+0000","last_undegraded":"2024-04-19T02:20:58.188888+0000","last_fullsized":"2024-04-19T02:20:58.188888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":623,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187425+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:58.187425+0000","last_peered":"2024-04-19T02:20:58.187425+0000","last_clean":"2024-04-19T02:20:58.187425+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:58.187425+0000","last_undegraded":"2024-04-19T02:20:58.187425+0000","last_fullsized":"2024-04-19T02:20:58.187425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185343+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:58.185343+0000","last_peered":"2024-04-19T02:20:58.185343+0000","last_clean":"2024-04-19T02:20:58.185343+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:58.185343+0000","last_undegraded":"2024-04-19T02:20:58.185343+0000","last_fullsized":"2024-04-19T02:20:58.185343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":984,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182511+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:20:58.182511+0000","last_peered":"2024-04-19T02:20:58.182511+0000","last_clean":"2024-04-19T02:20:58.182511+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:20:58.182511+0000","last_undegraded":"2024-04-19T02:20:58.182511+0000","last_fullsized":"2024-04-19T02:20:58.182511+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":172,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184740+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:58.184740+0000","last_peered":"2024-04-19T02:20:58.184740+0000","last_clean":"2024-04-19T02:20:58.184740+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:58.184740+0000","last_undegraded":"2024-04-19T02:20:58.184740+0000","last_fullsized":"2024-04-19T02:20:58.184740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":127,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142964,"kb_used_data":27432,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228876,"statfs":{"total":96636764160,"available":96490369024,"internally_reserved":0,"allocated":28090368,"data_stored":81624046,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":78,"seq":335007449096,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66068,"kb_used_data":12296,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305772,"statfs":{"total":96636764160,"available":96569110528,"internally_reserved":0,"allocated":12591104,"data_stored":91916659,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139536,"kb_used_data":28092,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232304,"statfs":{"total":96636764160,"available":96493879296,"internally_reserved":0,"allocated":28766208,"data_stored":86242173,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:05.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:21:05.709 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:05.709 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":302,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":110,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":103},{"state_name":"active+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":356933632,"bytes_avail":289553358848,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"recovering_objects_per_sec":208,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1249,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:21:05.727 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:21:05.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:06.023 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:06.025 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:06.040 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-04-19T02:21:04.301646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7190,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":209,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348568,"kb_used_data":67820,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766952,"statfs":{"total":289910292480,"available":289553358848,"internally_reserved":0,"allocated":69447680,"data_stored":259782878,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1249,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001777"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189611+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:20:58.189611+0000","last_peered":"2024-04-19T02:20:58.189611+0000","last_clean":"2024-04-19T02:20:58.189611+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:20:58.189611+0000","last_undegraded":"2024-04-19T02:20:58.189611+0000","last_fullsized":"2024-04-19T02:20:58.189611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":584,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187906+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:20:58.187906+0000","last_peered":"2024-04-19T02:20:58.187906+0000","last_clean":"2024-04-19T02:20:58.187906+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:20:58.187906+0000","last_undegraded":"2024-04-19T02:20:58.187906+0000","last_fullsized":"2024-04-19T02:20:58.187906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":861,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187272+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:20:58.187272+0000","last_peered":"2024-04-19T02:20:58.187272+0000","last_clean":"2024-04-19T02:20:58.187272+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:20:58.187272+0000","last_undegraded":"2024-04-19T02:20:58.187272+0000","last_fullsized":"2024-04-19T02:20:58.187272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":835,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183265+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:20:58.183265+0000","last_peered":"2024-04-19T02:20:58.183265+0000","last_clean":"2024-04-19T02:20:58.183265+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:20:58.183265+0000","last_undegraded":"2024-04-19T02:20:58.183265+0000","last_fullsized":"2024-04-19T02:20:58.183265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":532,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:20:58.188108+0000","last_peered":"2024-04-19T02:20:58.188108+0000","last_clean":"2024-04-19T02:20:58.188108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:20:58.188108+0000","last_undegraded":"2024-04-19T02:20:58.188108+0000","last_fullsized":"2024-04-19T02:20:58.188108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186929+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:20:58.186929+0000","last_peered":"2024-04-19T02:20:58.186929+0000","last_clean":"2024-04-19T02:20:58.186929+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:20:58.186929+0000","last_undegraded":"2024-04-19T02:20:58.186929+0000","last_fullsized":"2024-04-19T02:20:58.186929+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":918,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":946,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182437+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:20:58.182437+0000","last_peered":"2024-04-19T02:20:58.182437+0000","last_clean":"2024-04-19T02:20:58.182437+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:20:58.182437+0000","last_undegraded":"2024-04-19T02:20:58.182437+0000","last_fullsized":"2024-04-19T02:20:58.182437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":553,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184099+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:20:58.184099+0000","last_peered":"2024-04-19T02:20:58.184099+0000","last_clean":"2024-04-19T02:20:58.184099+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:20:58.184099+0000","last_undegraded":"2024-04-19T02:20:58.184099+0000","last_fullsized":"2024-04-19T02:20:58.184099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":544,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188531+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:20:58.188531+0000","last_peered":"2024-04-19T02:20:58.188531+0000","last_clean":"2024-04-19T02:20:58.188531+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:20:58.188531+0000","last_undegraded":"2024-04-19T02:20:58.188531+0000","last_fullsized":"2024-04-19T02:20:58.188531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":833,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185427+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:20:58.185427+0000","last_peered":"2024-04-19T02:20:58.185427+0000","last_clean":"2024-04-19T02:20:58.185427+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:20:58.185427+0000","last_undegraded":"2024-04-19T02:20:58.185427+0000","last_fullsized":"2024-04-19T02:20:58.185427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":901,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187669+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:20:58.187669+0000","last_peered":"2024-04-19T02:20:58.187669+0000","last_clean":"2024-04-19T02:20:58.187669+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:20:58.187669+0000","last_undegraded":"2024-04-19T02:20:58.187669+0000","last_fullsized":"2024-04-19T02:20:58.187669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187872+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:20:58.187872+0000","last_peered":"2024-04-19T02:20:58.187872+0000","last_clean":"2024-04-19T02:20:58.187872+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:20:58.187872+0000","last_undegraded":"2024-04-19T02:20:58.187872+0000","last_fullsized":"2024-04-19T02:20:58.187872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":897,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187235+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:20:58.187235+0000","last_peered":"2024-04-19T02:20:58.187235+0000","last_clean":"2024-04-19T02:20:58.187235+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:20:58.187235+0000","last_undegraded":"2024-04-19T02:20:58.187235+0000","last_fullsized":"2024-04-19T02:20:58.187235+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":917,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186716+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:20:58.186716+0000","last_peered":"2024-04-19T02:20:58.186716+0000","last_clean":"2024-04-19T02:20:58.186716+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:20:58.186716+0000","last_undegraded":"2024-04-19T02:20:58.186716+0000","last_fullsized":"2024-04-19T02:20:58.186716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1000,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182224+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:20:58.182224+0000","last_peered":"2024-04-19T02:20:58.182224+0000","last_clean":"2024-04-19T02:20:58.182224+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:20:58.182224+0000","last_undegraded":"2024-04-19T02:20:58.182224+0000","last_fullsized":"2024-04-19T02:20:58.182224+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":551,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185085+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:20:58.185085+0000","last_peered":"2024-04-19T02:20:58.185085+0000","last_clean":"2024-04-19T02:20:58.185085+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:20:58.185085+0000","last_undegraded":"2024-04-19T02:20:58.185085+0000","last_fullsized":"2024-04-19T02:20:58.185085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":528,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188798+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:20:58.188798+0000","last_peered":"2024-04-19T02:20:58.188798+0000","last_clean":"2024-04-19T02:20:58.188798+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:20:58.188798+0000","last_undegraded":"2024-04-19T02:20:58.188798+0000","last_fullsized":"2024-04-19T02:20:58.188798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":640,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185254+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:20:58.185254+0000","last_peered":"2024-04-19T02:20:58.185254+0000","last_clean":"2024-04-19T02:20:58.185254+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:20:58.185254+0000","last_undegraded":"2024-04-19T02:20:58.185254+0000","last_fullsized":"2024-04-19T02:20:58.185254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":929,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183559+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:20:58.183559+0000","last_peered":"2024-04-19T02:20:58.183559+0000","last_clean":"2024-04-19T02:20:58.183559+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:20:58.183559+0000","last_undegraded":"2024-04-19T02:20:58.183559+0000","last_fullsized":"2024-04-19T02:20:58.183559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":930,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184453+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:20:58.184453+0000","last_peered":"2024-04-19T02:20:58.184453+0000","last_clean":"2024-04-19T02:20:58.184453+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:20:58.184453+0000","last_undegraded":"2024-04-19T02:20:58.184453+0000","last_fullsized":"2024-04-19T02:20:58.184453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1113,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188435+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:20:58.188435+0000","last_peered":"2024-04-19T02:20:58.188435+0000","last_clean":"2024-04-19T02:20:58.188435+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:20:58.188435+0000","last_undegraded":"2024-04-19T02:20:58.188435+0000","last_fullsized":"2024-04-19T02:20:58.188435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":891,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182523+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:20:58.182523+0000","last_peered":"2024-04-19T02:20:58.182523+0000","last_clean":"2024-04-19T02:20:58.182523+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:20:58.182523+0000","last_undegraded":"2024-04-19T02:20:58.182523+0000","last_fullsized":"2024-04-19T02:20:58.182523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186542+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:20:58.186542+0000","last_peered":"2024-04-19T02:20:58.186542+0000","last_clean":"2024-04-19T02:20:58.186542+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:20:58.186542+0000","last_undegraded":"2024-04-19T02:20:58.186542+0000","last_fullsized":"2024-04-19T02:20:58.186542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":941,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197999+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:20:59.197999+0000","last_peered":"2024-04-19T02:20:59.197999+0000","last_clean":"2024-04-19T02:20:59.197999+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:20:59.197999+0000","last_undegraded":"2024-04-19T02:20:59.197999+0000","last_fullsized":"2024-04-19T02:20:59.197999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1165,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184976+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:20:58.184976+0000","last_peered":"2024-04-19T02:20:58.184976+0000","last_clean":"2024-04-19T02:20:58.184976+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:20:58.184976+0000","last_undegraded":"2024-04-19T02:20:58.184976+0000","last_fullsized":"2024-04-19T02:20:58.184976+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":937,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189199+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:20:58.189199+0000","last_peered":"2024-04-19T02:20:58.189199+0000","last_clean":"2024-04-19T02:20:58.189199+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:20:58.189199+0000","last_undegraded":"2024-04-19T02:20:58.189199+0000","last_fullsized":"2024-04-19T02:20:58.189199+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":807,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189123+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:20:58.189123+0000","last_peered":"2024-04-19T02:20:58.189123+0000","last_clean":"2024-04-19T02:20:58.189123+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:20:58.189123+0000","last_undegraded":"2024-04-19T02:20:58.189123+0000","last_fullsized":"2024-04-19T02:20:58.189123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":530,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183900+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:20:58.183900+0000","last_peered":"2024-04-19T02:20:58.183900+0000","last_clean":"2024-04-19T02:20:58.183900+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:20:58.183900+0000","last_undegraded":"2024-04-19T02:20:58.183900+0000","last_fullsized":"2024-04-19T02:20:58.183900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1068,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188849+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:20:58.188849+0000","last_peered":"2024-04-19T02:20:58.188849+0000","last_clean":"2024-04-19T02:20:58.188849+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:20:58.188849+0000","last_undegraded":"2024-04-19T02:20:58.188849+0000","last_fullsized":"2024-04-19T02:20:58.188849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":607,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183261+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:20:58.183261+0000","last_peered":"2024-04-19T02:20:58.183261+0000","last_clean":"2024-04-19T02:20:58.183261+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:20:58.183261+0000","last_undegraded":"2024-04-19T02:20:58.183261+0000","last_fullsized":"2024-04-19T02:20:58.183261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":924,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182736+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:20:58.182736+0000","last_peered":"2024-04-19T02:20:58.182736+0000","last_clean":"2024-04-19T02:20:58.182736+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:20:58.182736+0000","last_undegraded":"2024-04-19T02:20:58.182736+0000","last_fullsized":"2024-04-19T02:20:58.182736+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":488,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188256+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:20:58.188256+0000","last_peered":"2024-04-19T02:20:58.188256+0000","last_clean":"2024-04-19T02:20:58.188256+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:20:58.188256+0000","last_undegraded":"2024-04-19T02:20:58.188256+0000","last_fullsized":"2024-04-19T02:20:58.188256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":495,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183579+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:20:58.183579+0000","last_peered":"2024-04-19T02:20:58.183579+0000","last_clean":"2024-04-19T02:20:58.183579+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:20:58.183579+0000","last_undegraded":"2024-04-19T02:20:58.183579+0000","last_fullsized":"2024-04-19T02:20:58.183579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":537,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188626+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:20:58.188626+0000","last_peered":"2024-04-19T02:20:58.188626+0000","last_clean":"2024-04-19T02:20:58.188626+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:20:58.188626+0000","last_undegraded":"2024-04-19T02:20:58.188626+0000","last_fullsized":"2024-04-19T02:20:58.188626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183606+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:20:58.183606+0000","last_peered":"2024-04-19T02:20:58.183606+0000","last_clean":"2024-04-19T02:20:58.183606+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:20:58.183606+0000","last_undegraded":"2024-04-19T02:20:58.183606+0000","last_fullsized":"2024-04-19T02:20:58.183606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1011,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185435+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:20:58.185435+0000","last_peered":"2024-04-19T02:20:58.185435+0000","last_clean":"2024-04-19T02:20:58.185435+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:20:58.185435+0000","last_undegraded":"2024-04-19T02:20:58.185435+0000","last_fullsized":"2024-04-19T02:20:58.185435+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":184,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187169+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:20:58.187169+0000","last_peered":"2024-04-19T02:20:58.187169+0000","last_clean":"2024-04-19T02:20:58.187169+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:20:58.187169+0000","last_undegraded":"2024-04-19T02:20:58.187169+0000","last_fullsized":"2024-04-19T02:20:58.187169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":892,"reported_epoch":108,"state":"active+undersized+remapped","last_fresh":"2024-04-19T02:20:59.274114+0000","last_change":"2024-04-19T02:20:59.274607+0000","last_active":"2024-04-19T02:20:59.274114+0000","last_peered":"2024-04-19T02:20:59.274114+0000","last_clean":"2024-04-19T02:17:07.003015+0000","last_became_active":"2024-04-19T02:20:31.603321+0000","last_became_peered":"2024-04-19T02:20:31.603321+0000","last_unstale":"2024-04-19T02:20:59.274114+0000","last_undegraded":"2024-04-19T02:20:59.274114+0000","last_fullsized":"2024-04-19T02:20:31.502476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:28:20.196317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":157,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186821+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:20:58.186821+0000","last_peered":"2024-04-19T02:20:58.186821+0000","last_clean":"2024-04-19T02:20:58.186821+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:20:58.186821+0000","last_undegraded":"2024-04-19T02:20:58.186821+0000","last_fullsized":"2024-04-19T02:20:58.186821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":281,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190716+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:20:58.190716+0000","last_peered":"2024-04-19T02:20:58.190716+0000","last_clean":"2024-04-19T02:20:58.190716+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:20:58.190716+0000","last_undegraded":"2024-04-19T02:20:58.190716+0000","last_fullsized":"2024-04-19T02:20:58.190716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":886,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186562+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:20:58.186562+0000","last_peered":"2024-04-19T02:20:58.186562+0000","last_clean":"2024-04-19T02:20:58.186562+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:20:58.186562+0000","last_undegraded":"2024-04-19T02:20:58.186562+0000","last_fullsized":"2024-04-19T02:20:58.186562+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":421,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187704+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:20:58.187704+0000","last_peered":"2024-04-19T02:20:58.187704+0000","last_clean":"2024-04-19T02:20:58.187704+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:20:58.187704+0000","last_undegraded":"2024-04-19T02:20:58.187704+0000","last_fullsized":"2024-04-19T02:20:58.187704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":558,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186946+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:20:58.186946+0000","last_peered":"2024-04-19T02:20:58.186946+0000","last_clean":"2024-04-19T02:20:58.186946+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:20:58.186946+0000","last_undegraded":"2024-04-19T02:20:58.186946+0000","last_fullsized":"2024-04-19T02:20:58.186946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":710,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188498+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:20:58.188498+0000","last_peered":"2024-04-19T02:20:58.188498+0000","last_clean":"2024-04-19T02:20:58.188498+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:20:58.188498+0000","last_undegraded":"2024-04-19T02:20:58.188498+0000","last_fullsized":"2024-04-19T02:20:58.188498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":889,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183389+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:20:58.183389+0000","last_peered":"2024-04-19T02:20:58.183389+0000","last_clean":"2024-04-19T02:20:58.183389+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:20:58.183389+0000","last_undegraded":"2024-04-19T02:20:58.183389+0000","last_fullsized":"2024-04-19T02:20:58.183389+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":148,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186108+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:20:58.186108+0000","last_peered":"2024-04-19T02:20:58.186108+0000","last_clean":"2024-04-19T02:20:58.186108+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:20:58.186108+0000","last_undegraded":"2024-04-19T02:20:58.186108+0000","last_fullsized":"2024-04-19T02:20:58.186108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1073,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.197928+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:20:59.197928+0000","last_peered":"2024-04-19T02:20:59.197928+0000","last_clean":"2024-04-19T02:20:59.197928+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:20:59.197928+0000","last_undegraded":"2024-04-19T02:20:59.197928+0000","last_fullsized":"2024-04-19T02:20:59.197928+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":261,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184702+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:20:58.184702+0000","last_peered":"2024-04-19T02:20:58.184702+0000","last_clean":"2024-04-19T02:20:58.184702+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:20:58.184702+0000","last_undegraded":"2024-04-19T02:20:58.184702+0000","last_fullsized":"2024-04-19T02:20:58.184702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":959,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183337+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:20:58.183337+0000","last_peered":"2024-04-19T02:20:58.183337+0000","last_clean":"2024-04-19T02:20:58.183337+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:20:58.183337+0000","last_undegraded":"2024-04-19T02:20:58.183337+0000","last_fullsized":"2024-04-19T02:20:58.183337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":311,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182928+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:20:58.182928+0000","last_peered":"2024-04-19T02:20:58.182928+0000","last_clean":"2024-04-19T02:20:58.182928+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:20:58.182928+0000","last_undegraded":"2024-04-19T02:20:58.182928+0000","last_fullsized":"2024-04-19T02:20:58.182928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":981,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188951+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:20:58.188951+0000","last_peered":"2024-04-19T02:20:58.188951+0000","last_clean":"2024-04-19T02:20:58.188951+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:20:58.188951+0000","last_undegraded":"2024-04-19T02:20:58.188951+0000","last_fullsized":"2024-04-19T02:20:58.188951+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":169,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187255+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:20:58.187255+0000","last_peered":"2024-04-19T02:20:58.187255+0000","last_clean":"2024-04-19T02:20:58.187255+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:20:58.187255+0000","last_undegraded":"2024-04-19T02:20:58.187255+0000","last_fullsized":"2024-04-19T02:20:58.187255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":812,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187556+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:20:58.187556+0000","last_peered":"2024-04-19T02:20:58.187556+0000","last_clean":"2024-04-19T02:20:58.187556+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:20:58.187556+0000","last_undegraded":"2024-04-19T02:20:58.187556+0000","last_fullsized":"2024-04-19T02:20:58.187556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":493,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186923+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:20:58.186923+0000","last_peered":"2024-04-19T02:20:58.186923+0000","last_clean":"2024-04-19T02:20:58.186923+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:20:58.186923+0000","last_undegraded":"2024-04-19T02:20:58.186923+0000","last_fullsized":"2024-04-19T02:20:58.186923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":522,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184350+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:20:58.184350+0000","last_peered":"2024-04-19T02:20:58.184350+0000","last_clean":"2024-04-19T02:20:58.184350+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:20:58.184350+0000","last_undegraded":"2024-04-19T02:20:58.184350+0000","last_fullsized":"2024-04-19T02:20:58.184350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":296,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187952+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:20:58.187952+0000","last_peered":"2024-04-19T02:20:58.187952+0000","last_clean":"2024-04-19T02:20:58.187952+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:20:58.187952+0000","last_undegraded":"2024-04-19T02:20:58.187952+0000","last_fullsized":"2024-04-19T02:20:58.187952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184943+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:20:58.184943+0000","last_peered":"2024-04-19T02:20:58.184943+0000","last_clean":"2024-04-19T02:20:58.184943+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:20:58.184943+0000","last_undegraded":"2024-04-19T02:20:58.184943+0000","last_fullsized":"2024-04-19T02:20:58.184943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":864,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183855+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:20:58.183855+0000","last_peered":"2024-04-19T02:20:58.183855+0000","last_clean":"2024-04-19T02:20:58.183855+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:20:58.183855+0000","last_undegraded":"2024-04-19T02:20:58.183855+0000","last_fullsized":"2024-04-19T02:20:58.183855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":960,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188320+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:20:58.188320+0000","last_peered":"2024-04-19T02:20:58.188320+0000","last_clean":"2024-04-19T02:20:58.188320+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:20:58.188320+0000","last_undegraded":"2024-04-19T02:20:58.188320+0000","last_fullsized":"2024-04-19T02:20:58.188320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187173+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:20:58.187173+0000","last_peered":"2024-04-19T02:20:58.187173+0000","last_clean":"2024-04-19T02:20:58.187173+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:20:58.187173+0000","last_undegraded":"2024-04-19T02:20:58.187173+0000","last_fullsized":"2024-04-19T02:20:58.187173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":301,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184037+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:20:58.184037+0000","last_peered":"2024-04-19T02:20:58.184037+0000","last_clean":"2024-04-19T02:20:58.184037+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:20:58.184037+0000","last_undegraded":"2024-04-19T02:20:58.184037+0000","last_fullsized":"2024-04-19T02:20:58.184037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":547,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188897+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:20:58.188897+0000","last_peered":"2024-04-19T02:20:58.188897+0000","last_clean":"2024-04-19T02:20:58.188897+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:20:58.188897+0000","last_undegraded":"2024-04-19T02:20:58.188897+0000","last_fullsized":"2024-04-19T02:20:58.188897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184454+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:20:58.184454+0000","last_peered":"2024-04-19T02:20:58.184454+0000","last_clean":"2024-04-19T02:20:58.184454+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:20:58.184454+0000","last_undegraded":"2024-04-19T02:20:58.184454+0000","last_fullsized":"2024-04-19T02:20:58.184454+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":514,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187090+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:20:58.187090+0000","last_peered":"2024-04-19T02:20:58.187090+0000","last_clean":"2024-04-19T02:20:58.187090+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:20:58.187090+0000","last_undegraded":"2024-04-19T02:20:58.187090+0000","last_fullsized":"2024-04-19T02:20:58.187090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":459,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184597+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:20:58.184597+0000","last_peered":"2024-04-19T02:20:58.184597+0000","last_clean":"2024-04-19T02:20:58.184597+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:20:58.184597+0000","last_undegraded":"2024-04-19T02:20:58.184597+0000","last_fullsized":"2024-04-19T02:20:58.184597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184094+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:20:58.184094+0000","last_peered":"2024-04-19T02:20:58.184094+0000","last_clean":"2024-04-19T02:20:58.184094+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:20:58.184094+0000","last_undegraded":"2024-04-19T02:20:58.184094+0000","last_fullsized":"2024-04-19T02:20:58.184094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184203+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:20:58.184203+0000","last_peered":"2024-04-19T02:20:58.184203+0000","last_clean":"2024-04-19T02:20:58.184203+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:20:58.184203+0000","last_undegraded":"2024-04-19T02:20:58.184203+0000","last_fullsized":"2024-04-19T02:20:58.184203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":560,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":564,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185556+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:20:58.185556+0000","last_peered":"2024-04-19T02:20:58.185556+0000","last_clean":"2024-04-19T02:20:58.185556+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:20:58.185556+0000","last_undegraded":"2024-04-19T02:20:58.185556+0000","last_fullsized":"2024-04-19T02:20:58.185556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.186156+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:20:58.186156+0000","last_peered":"2024-04-19T02:20:58.186156+0000","last_clean":"2024-04-19T02:20:58.186156+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:20:58.186156+0000","last_undegraded":"2024-04-19T02:20:58.186156+0000","last_fullsized":"2024-04-19T02:20:58.186156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":848,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188727+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:20:58.188727+0000","last_peered":"2024-04-19T02:20:58.188727+0000","last_clean":"2024-04-19T02:20:58.188727+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:20:58.188727+0000","last_undegraded":"2024-04-19T02:20:58.188727+0000","last_fullsized":"2024-04-19T02:20:58.188727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":158,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185942+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:20:58.185942+0000","last_peered":"2024-04-19T02:20:58.185942+0000","last_clean":"2024-04-19T02:20:58.185942+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:20:58.185942+0000","last_undegraded":"2024-04-19T02:20:58.185942+0000","last_fullsized":"2024-04-19T02:20:58.185942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189368+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:20:58.189368+0000","last_peered":"2024-04-19T02:20:58.189368+0000","last_clean":"2024-04-19T02:20:58.189368+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:20:58.189368+0000","last_undegraded":"2024-04-19T02:20:58.189368+0000","last_fullsized":"2024-04-19T02:20:58.189368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":965,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187927+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:20:58.187927+0000","last_peered":"2024-04-19T02:20:58.187927+0000","last_clean":"2024-04-19T02:20:58.187927+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:20:58.187927+0000","last_undegraded":"2024-04-19T02:20:58.187927+0000","last_fullsized":"2024-04-19T02:20:58.187927+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185300+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:20:58.185300+0000","last_peered":"2024-04-19T02:20:58.185300+0000","last_clean":"2024-04-19T02:20:58.185300+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:20:58.185300+0000","last_undegraded":"2024-04-19T02:20:58.185300+0000","last_fullsized":"2024-04-19T02:20:58.185300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185705+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:20:58.185705+0000","last_peered":"2024-04-19T02:20:58.185705+0000","last_clean":"2024-04-19T02:20:58.185705+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:20:58.185705+0000","last_undegraded":"2024-04-19T02:20:58.185705+0000","last_fullsized":"2024-04-19T02:20:58.185705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":935,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-19T02:20:59.188187+0000","last_change":"2024-04-19T02:20:59.188612+0000","last_active":"2024-04-19T02:20:59.188187+0000","last_peered":"2024-04-19T02:20:58.677847+0000","last_clean":"2024-04-19T02:17:07.002028+0000","last_became_active":"2024-04-19T02:20:31.678509+0000","last_became_peered":"2024-04-19T02:20:31.678509+0000","last_unstale":"2024-04-19T02:20:59.188187+0000","last_undegraded":"2024-04-19T02:20:59.188187+0000","last_fullsized":"2024-04-19T02:20:59.188187+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:19.653804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":195,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185569+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:20:58.185569+0000","last_peered":"2024-04-19T02:20:58.185569+0000","last_clean":"2024-04-19T02:20:58.185569+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:20:58.185569+0000","last_undegraded":"2024-04-19T02:20:58.185569+0000","last_fullsized":"2024-04-19T02:20:58.185569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190807+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:20:58.190807+0000","last_peered":"2024-04-19T02:20:58.190807+0000","last_clean":"2024-04-19T02:20:58.190807+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:20:58.190807+0000","last_undegraded":"2024-04-19T02:20:58.190807+0000","last_fullsized":"2024-04-19T02:20:58.190807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":568,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182220+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:20:58.182220+0000","last_peered":"2024-04-19T02:20:58.182220+0000","last_clean":"2024-04-19T02:20:58.182220+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:20:58.182220+0000","last_undegraded":"2024-04-19T02:20:58.182220+0000","last_fullsized":"2024-04-19T02:20:58.182220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":871,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187693+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:20:58.187693+0000","last_peered":"2024-04-19T02:20:58.187693+0000","last_clean":"2024-04-19T02:20:58.187693+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:20:58.187693+0000","last_undegraded":"2024-04-19T02:20:58.187693+0000","last_fullsized":"2024-04-19T02:20:58.187693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":573,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187907+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:20:58.187907+0000","last_peered":"2024-04-19T02:20:58.187907+0000","last_clean":"2024-04-19T02:20:58.187907+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:20:58.187907+0000","last_undegraded":"2024-04-19T02:20:58.187907+0000","last_fullsized":"2024-04-19T02:20:58.187907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":545,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182531+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:20:58.182531+0000","last_peered":"2024-04-19T02:20:58.182531+0000","last_clean":"2024-04-19T02:20:58.182531+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:20:58.182531+0000","last_undegraded":"2024-04-19T02:20:58.182531+0000","last_fullsized":"2024-04-19T02:20:58.182531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":206,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.189192+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:20:58.189192+0000","last_peered":"2024-04-19T02:20:58.189192+0000","last_clean":"2024-04-19T02:20:58.189192+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:20:58.189192+0000","last_undegraded":"2024-04-19T02:20:58.189192+0000","last_fullsized":"2024-04-19T02:20:58.189192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":428,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185082+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:20:58.185082+0000","last_peered":"2024-04-19T02:20:58.185082+0000","last_clean":"2024-04-19T02:20:58.185082+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:20:58.185082+0000","last_undegraded":"2024-04-19T02:20:58.185082+0000","last_fullsized":"2024-04-19T02:20:58.185082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1009,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.191099+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:20:58.191099+0000","last_peered":"2024-04-19T02:20:58.191099+0000","last_clean":"2024-04-19T02:20:58.191099+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:20:58.191099+0000","last_undegraded":"2024-04-19T02:20:58.191099+0000","last_fullsized":"2024-04-19T02:20:58.191099+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184996+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:20:58.184996+0000","last_peered":"2024-04-19T02:20:58.184996+0000","last_clean":"2024-04-19T02:20:58.184996+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:20:58.184996+0000","last_undegraded":"2024-04-19T02:20:58.184996+0000","last_fullsized":"2024-04-19T02:20:58.184996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":619,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182945+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:20:58.182945+0000","last_peered":"2024-04-19T02:20:58.182945+0000","last_clean":"2024-04-19T02:20:58.182945+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:20:58.182945+0000","last_undegraded":"2024-04-19T02:20:58.182945+0000","last_fullsized":"2024-04-19T02:20:58.182945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":909,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.190489+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:20:58.190489+0000","last_peered":"2024-04-19T02:20:58.190489+0000","last_clean":"2024-04-19T02:20:58.190489+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:20:58.190489+0000","last_undegraded":"2024-04-19T02:20:58.190489+0000","last_fullsized":"2024-04-19T02:20:58.190489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":673,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183238+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:20:58.183238+0000","last_peered":"2024-04-19T02:20:58.183238+0000","last_clean":"2024-04-19T02:20:58.183238+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:20:58.183238+0000","last_undegraded":"2024-04-19T02:20:58.183238+0000","last_fullsized":"2024-04-19T02:20:58.183238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":934,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184606+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:20:58.184606+0000","last_peered":"2024-04-19T02:20:58.184606+0000","last_clean":"2024-04-19T02:20:58.184606+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:20:58.184606+0000","last_undegraded":"2024-04-19T02:20:58.184606+0000","last_fullsized":"2024-04-19T02:20:58.184606+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":451,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.183734+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:20:58.183734+0000","last_peered":"2024-04-19T02:20:58.183734+0000","last_clean":"2024-04-19T02:20:58.183734+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:20:58.183734+0000","last_undegraded":"2024-04-19T02:20:58.183734+0000","last_fullsized":"2024-04-19T02:20:58.183734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":851,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187699+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:20:58.187699+0000","last_peered":"2024-04-19T02:20:58.187699+0000","last_clean":"2024-04-19T02:20:58.187699+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:20:58.187699+0000","last_undegraded":"2024-04-19T02:20:58.187699+0000","last_fullsized":"2024-04-19T02:20:58.187699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":598,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188970+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:20:58.188970+0000","last_peered":"2024-04-19T02:20:58.188970+0000","last_clean":"2024-04-19T02:20:58.188970+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:20:58.188970+0000","last_undegraded":"2024-04-19T02:20:58.188970+0000","last_fullsized":"2024-04-19T02:20:58.188970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":540,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188374+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:20:58.188374+0000","last_peered":"2024-04-19T02:20:58.188374+0000","last_clean":"2024-04-19T02:20:58.188374+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:20:58.188374+0000","last_undegraded":"2024-04-19T02:20:58.188374+0000","last_fullsized":"2024-04-19T02:20:58.188374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":178,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188183+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:20:58.188183+0000","last_peered":"2024-04-19T02:20:58.188183+0000","last_clean":"2024-04-19T02:20:58.188183+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:20:58.188183+0000","last_undegraded":"2024-04-19T02:20:58.188183+0000","last_fullsized":"2024-04-19T02:20:58.188183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":828,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182835+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:20:58.182835+0000","last_peered":"2024-04-19T02:20:58.182835+0000","last_clean":"2024-04-19T02:20:58.182835+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:20:58.182835+0000","last_undegraded":"2024-04-19T02:20:58.182835+0000","last_fullsized":"2024-04-19T02:20:58.182835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":438,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185768+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:20:58.185768+0000","last_peered":"2024-04-19T02:20:58.185768+0000","last_clean":"2024-04-19T02:20:58.185768+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:20:58.185768+0000","last_undegraded":"2024-04-19T02:20:58.185768+0000","last_fullsized":"2024-04-19T02:20:58.185768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":881,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182801+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:20:58.182801+0000","last_peered":"2024-04-19T02:20:58.182801+0000","last_clean":"2024-04-19T02:20:58.182801+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:20:58.182801+0000","last_undegraded":"2024-04-19T02:20:58.182801+0000","last_fullsized":"2024-04-19T02:20:58.182801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":498,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.188888+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:20:58.188888+0000","last_peered":"2024-04-19T02:20:58.188888+0000","last_clean":"2024-04-19T02:20:58.188888+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:20:58.188888+0000","last_undegraded":"2024-04-19T02:20:58.188888+0000","last_fullsized":"2024-04-19T02:20:58.188888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":623,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.187425+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:20:58.187425+0000","last_peered":"2024-04-19T02:20:58.187425+0000","last_clean":"2024-04-19T02:20:58.187425+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:20:58.187425+0000","last_undegraded":"2024-04-19T02:20:58.187425+0000","last_fullsized":"2024-04-19T02:20:58.187425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.185343+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:20:58.185343+0000","last_peered":"2024-04-19T02:20:58.185343+0000","last_clean":"2024-04-19T02:20:58.185343+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:20:58.185343+0000","last_undegraded":"2024-04-19T02:20:58.185343+0000","last_fullsized":"2024-04-19T02:20:58.185343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":984,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.182511+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:20:58.182511+0000","last_peered":"2024-04-19T02:20:58.182511+0000","last_clean":"2024-04-19T02:20:58.182511+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:20:58.182511+0000","last_undegraded":"2024-04-19T02:20:58.182511+0000","last_fullsized":"2024-04-19T02:20:58.182511+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":172,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-19T02:20:58.184740+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:20:58.184740+0000","last_peered":"2024-04-19T02:20:58.184740+0000","last_clean":"2024-04-19T02:20:58.184740+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:20:58.184740+0000","last_undegraded":"2024-04-19T02:20:58.184740+0000","last_fullsized":"2024-04-19T02:20:58.184740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":127,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142964,"kb_used_data":27432,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228876,"statfs":{"total":96636764160,"available":96490369024,"internally_reserved":0,"allocated":28090368,"data_stored":81624046,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":78,"seq":335007449096,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66068,"kb_used_data":12296,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305772,"statfs":{"total":96636764160,"available":96569110528,"internally_reserved":0,"allocated":12591104,"data_stored":91916659,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139536,"kb_used_data":28092,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232304,"statfs":{"total":96636764160,"available":96493879296,"internally_reserved":0,"allocated":28766208,"data_stored":86242173,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:09.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:09.368 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:09.370 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:09.388 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-19T02:21:08.303194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7190,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348616,"kb_used_data":67860,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766904,"statfs":{"total":289910292480,"available":289553309696,"internally_reserved":0,"allocated":69488640,"data_stored":259804424,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.119305"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":560,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189091+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:00.189091+0000","last_peered":"2024-04-19T02:21:00.189091+0000","last_clean":"2024-04-19T02:21:00.189091+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:00.189091+0000","last_undegraded":"2024-04-19T02:21:00.189091+0000","last_fullsized":"2024-04-19T02:21:00.189091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":586,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188555+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:00.188555+0000","last_peered":"2024-04-19T02:21:00.188555+0000","last_clean":"2024-04-19T02:21:00.188555+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:00.188555+0000","last_undegraded":"2024-04-19T02:21:00.188555+0000","last_fullsized":"2024-04-19T02:21:00.188555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":863,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187761+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:21:00.187761+0000","last_peered":"2024-04-19T02:21:00.187761+0000","last_clean":"2024-04-19T02:21:00.187761+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:21:00.187761+0000","last_undegraded":"2024-04-19T02:21:00.187761+0000","last_fullsized":"2024-04-19T02:21:00.187761+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":837,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186341+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:21:00.186341+0000","last_peered":"2024-04-19T02:21:00.186341+0000","last_clean":"2024-04-19T02:21:00.186341+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:21:00.186341+0000","last_undegraded":"2024-04-19T02:21:00.186341+0000","last_fullsized":"2024-04-19T02:21:00.186341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":534,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187689+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:00.187689+0000","last_peered":"2024-04-19T02:21:00.187689+0000","last_clean":"2024-04-19T02:21:00.187689+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:00.187689+0000","last_undegraded":"2024-04-19T02:21:00.187689+0000","last_fullsized":"2024-04-19T02:21:00.187689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":931,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186938+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:21:00.186938+0000","last_peered":"2024-04-19T02:21:00.186938+0000","last_clean":"2024-04-19T02:21:00.186938+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:21:00.186938+0000","last_undegraded":"2024-04-19T02:21:00.186938+0000","last_fullsized":"2024-04-19T02:21:00.186938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":920,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185811+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:21:00.185811+0000","last_peered":"2024-04-19T02:21:00.185811+0000","last_clean":"2024-04-19T02:21:00.185811+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:21:00.185811+0000","last_undegraded":"2024-04-19T02:21:00.185811+0000","last_fullsized":"2024-04-19T02:21:00.185811+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":948,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185905+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:21:00.185905+0000","last_peered":"2024-04-19T02:21:00.185905+0000","last_clean":"2024-04-19T02:21:00.185905+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:21:00.185905+0000","last_undegraded":"2024-04-19T02:21:00.185905+0000","last_fullsized":"2024-04-19T02:21:00.185905+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":555,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187085+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:00.187085+0000","last_peered":"2024-04-19T02:21:00.187085+0000","last_clean":"2024-04-19T02:21:00.187085+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:00.187085+0000","last_undegraded":"2024-04-19T02:21:00.187085+0000","last_fullsized":"2024-04-19T02:21:00.187085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":546,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188596+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:00.188596+0000","last_peered":"2024-04-19T02:21:00.188596+0000","last_clean":"2024-04-19T02:21:00.188596+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:00.188596+0000","last_undegraded":"2024-04-19T02:21:00.188596+0000","last_fullsized":"2024-04-19T02:21:00.188596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":835,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187152+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:21:00.187152+0000","last_peered":"2024-04-19T02:21:00.187152+0000","last_clean":"2024-04-19T02:21:00.187152+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:21:00.187152+0000","last_undegraded":"2024-04-19T02:21:00.187152+0000","last_fullsized":"2024-04-19T02:21:00.187152+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":903,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187431+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:00.187431+0000","last_peered":"2024-04-19T02:21:00.187431+0000","last_clean":"2024-04-19T02:21:00.187431+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:00.187431+0000","last_undegraded":"2024-04-19T02:21:00.187431+0000","last_fullsized":"2024-04-19T02:21:00.187431+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":530,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187447+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:00.187447+0000","last_peered":"2024-04-19T02:21:00.187447+0000","last_clean":"2024-04-19T02:21:00.187447+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:00.187447+0000","last_undegraded":"2024-04-19T02:21:00.187447+0000","last_fullsized":"2024-04-19T02:21:00.187447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":899,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186920+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:21:00.186920+0000","last_peered":"2024-04-19T02:21:00.186920+0000","last_clean":"2024-04-19T02:21:00.186920+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:21:00.186920+0000","last_undegraded":"2024-04-19T02:21:00.186920+0000","last_fullsized":"2024-04-19T02:21:00.186920+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":919,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186901+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:21:00.186901+0000","last_peered":"2024-04-19T02:21:00.186901+0000","last_clean":"2024-04-19T02:21:00.186901+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:21:00.186901+0000","last_undegraded":"2024-04-19T02:21:00.186901+0000","last_fullsized":"2024-04-19T02:21:00.186901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1002,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185718+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:21:00.185718+0000","last_peered":"2024-04-19T02:21:00.185718+0000","last_clean":"2024-04-19T02:21:00.185718+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:21:00.185718+0000","last_undegraded":"2024-04-19T02:21:00.185718+0000","last_fullsized":"2024-04-19T02:21:00.185718+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":554,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.197765+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:01.197765+0000","last_peered":"2024-04-19T02:21:01.197765+0000","last_clean":"2024-04-19T02:21:01.197765+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:01.197765+0000","last_undegraded":"2024-04-19T02:21:01.197765+0000","last_fullsized":"2024-04-19T02:21:01.197765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":531,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.199552+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:01.199552+0000","last_peered":"2024-04-19T02:21:01.199552+0000","last_clean":"2024-04-19T02:21:01.199552+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:01.199552+0000","last_undegraded":"2024-04-19T02:21:01.199552+0000","last_fullsized":"2024-04-19T02:21:01.199552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":642,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187216+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:00.187216+0000","last_peered":"2024-04-19T02:21:00.187216+0000","last_clean":"2024-04-19T02:21:00.187216+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:00.187216+0000","last_undegraded":"2024-04-19T02:21:00.187216+0000","last_fullsized":"2024-04-19T02:21:00.187216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":931,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186614+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:21:00.186614+0000","last_peered":"2024-04-19T02:21:00.186614+0000","last_clean":"2024-04-19T02:21:00.186614+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:21:00.186614+0000","last_undegraded":"2024-04-19T02:21:00.186614+0000","last_fullsized":"2024-04-19T02:21:00.186614+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":932,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187063+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:21:00.187063+0000","last_peered":"2024-04-19T02:21:00.187063+0000","last_clean":"2024-04-19T02:21:00.187063+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:21:00.187063+0000","last_undegraded":"2024-04-19T02:21:00.187063+0000","last_fullsized":"2024-04-19T02:21:00.187063+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1115,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187358+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:00.187358+0000","last_peered":"2024-04-19T02:21:00.187358+0000","last_clean":"2024-04-19T02:21:00.187358+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:00.187358+0000","last_undegraded":"2024-04-19T02:21:00.187358+0000","last_fullsized":"2024-04-19T02:21:00.187358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":893,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185789+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:00.185789+0000","last_peered":"2024-04-19T02:21:00.185789+0000","last_clean":"2024-04-19T02:21:00.185789+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:00.185789+0000","last_undegraded":"2024-04-19T02:21:00.185789+0000","last_fullsized":"2024-04-19T02:21:00.185789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":562,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186653+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:00.186653+0000","last_peered":"2024-04-19T02:21:00.186653+0000","last_clean":"2024-04-19T02:21:00.186653+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:00.186653+0000","last_undegraded":"2024-04-19T02:21:00.186653+0000","last_fullsized":"2024-04-19T02:21:00.186653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":943,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189089+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:00.189089+0000","last_peered":"2024-04-19T02:21:00.189089+0000","last_clean":"2024-04-19T02:21:00.189089+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:00.189089+0000","last_undegraded":"2024-04-19T02:21:00.189089+0000","last_fullsized":"2024-04-19T02:21:00.189089+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1167,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186969+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:00.186969+0000","last_peered":"2024-04-19T02:21:00.186969+0000","last_clean":"2024-04-19T02:21:00.186969+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:00.186969+0000","last_undegraded":"2024-04-19T02:21:00.186969+0000","last_fullsized":"2024-04-19T02:21:00.186969+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":939,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189304+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:21:00.189304+0000","last_peered":"2024-04-19T02:21:00.189304+0000","last_clean":"2024-04-19T02:21:00.189304+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:21:00.189304+0000","last_undegraded":"2024-04-19T02:21:00.189304+0000","last_fullsized":"2024-04-19T02:21:00.189304+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":809,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188310+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:00.188310+0000","last_peered":"2024-04-19T02:21:00.188310+0000","last_clean":"2024-04-19T02:21:00.188310+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:00.188310+0000","last_undegraded":"2024-04-19T02:21:00.188310+0000","last_fullsized":"2024-04-19T02:21:00.188310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":532,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186817+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:00.186817+0000","last_peered":"2024-04-19T02:21:00.186817+0000","last_clean":"2024-04-19T02:21:00.186817+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:00.186817+0000","last_undegraded":"2024-04-19T02:21:00.186817+0000","last_fullsized":"2024-04-19T02:21:00.186817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1070,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187593+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:00.187593+0000","last_peered":"2024-04-19T02:21:00.187593+0000","last_clean":"2024-04-19T02:21:00.187593+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:00.187593+0000","last_undegraded":"2024-04-19T02:21:00.187593+0000","last_fullsized":"2024-04-19T02:21:00.187593+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":609,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185907+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:00.185907+0000","last_peered":"2024-04-19T02:21:00.185907+0000","last_clean":"2024-04-19T02:21:00.185907+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:00.185907+0000","last_undegraded":"2024-04-19T02:21:00.185907+0000","last_fullsized":"2024-04-19T02:21:00.185907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":926,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186149+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:21:00.186149+0000","last_peered":"2024-04-19T02:21:00.186149+0000","last_clean":"2024-04-19T02:21:00.186149+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:21:00.186149+0000","last_undegraded":"2024-04-19T02:21:00.186149+0000","last_fullsized":"2024-04-19T02:21:00.186149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":491,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.199216+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:01.199216+0000","last_peered":"2024-04-19T02:21:01.199216+0000","last_clean":"2024-04-19T02:21:01.199216+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:01.199216+0000","last_undegraded":"2024-04-19T02:21:01.199216+0000","last_fullsized":"2024-04-19T02:21:01.199216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":497,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186708+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:21:00.186708+0000","last_peered":"2024-04-19T02:21:00.186708+0000","last_clean":"2024-04-19T02:21:00.186708+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:21:00.186708+0000","last_undegraded":"2024-04-19T02:21:00.186708+0000","last_fullsized":"2024-04-19T02:21:00.186708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":539,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188813+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:00.188813+0000","last_peered":"2024-04-19T02:21:00.188813+0000","last_clean":"2024-04-19T02:21:00.188813+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:00.188813+0000","last_undegraded":"2024-04-19T02:21:00.188813+0000","last_fullsized":"2024-04-19T02:21:00.188813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195359+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:01.195359+0000","last_peered":"2024-04-19T02:21:01.195359+0000","last_clean":"2024-04-19T02:21:01.195359+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:01.195359+0000","last_undegraded":"2024-04-19T02:21:01.195359+0000","last_fullsized":"2024-04-19T02:21:01.195359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1013,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187291+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:00.187291+0000","last_peered":"2024-04-19T02:21:00.187291+0000","last_clean":"2024-04-19T02:21:00.187291+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:00.187291+0000","last_undegraded":"2024-04-19T02:21:00.187291+0000","last_fullsized":"2024-04-19T02:21:00.187291+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.198003+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:01.198003+0000","last_peered":"2024-04-19T02:21:01.198003+0000","last_clean":"2024-04-19T02:21:01.198003+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:01.198003+0000","last_undegraded":"2024-04-19T02:21:01.198003+0000","last_fullsized":"2024-04-19T02:21:01.198003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":902,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.206349+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:01.206349+0000","last_peered":"2024-04-19T02:21:01.206349+0000","last_clean":"2024-04-19T02:21:01.206349+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:01.206349+0000","last_undegraded":"2024-04-19T02:21:01.206349+0000","last_fullsized":"2024-04-19T02:21:01.206349+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":159,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186918+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:21:00.186918+0000","last_peered":"2024-04-19T02:21:00.186918+0000","last_clean":"2024-04-19T02:21:00.186918+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:21:00.186918+0000","last_undegraded":"2024-04-19T02:21:00.186918+0000","last_fullsized":"2024-04-19T02:21:00.186918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":283,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189564+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:21:00.189564+0000","last_peered":"2024-04-19T02:21:00.189564+0000","last_clean":"2024-04-19T02:21:00.189564+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:21:00.189564+0000","last_undegraded":"2024-04-19T02:21:00.189564+0000","last_fullsized":"2024-04-19T02:21:00.189564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":888,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186876+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:00.186876+0000","last_peered":"2024-04-19T02:21:00.186876+0000","last_clean":"2024-04-19T02:21:00.186876+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:00.186876+0000","last_undegraded":"2024-04-19T02:21:00.186876+0000","last_fullsized":"2024-04-19T02:21:00.186876+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":423,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188948+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:00.188948+0000","last_peered":"2024-04-19T02:21:00.188948+0000","last_clean":"2024-04-19T02:21:00.188948+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:00.188948+0000","last_undegraded":"2024-04-19T02:21:00.188948+0000","last_fullsized":"2024-04-19T02:21:00.188948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":560,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187186+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:00.187186+0000","last_peered":"2024-04-19T02:21:00.187186+0000","last_clean":"2024-04-19T02:21:00.187186+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:00.187186+0000","last_undegraded":"2024-04-19T02:21:00.187186+0000","last_fullsized":"2024-04-19T02:21:00.187186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":712,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188749+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:21:00.188749+0000","last_peered":"2024-04-19T02:21:00.188749+0000","last_clean":"2024-04-19T02:21:00.188749+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:21:00.188749+0000","last_undegraded":"2024-04-19T02:21:00.188749+0000","last_fullsized":"2024-04-19T02:21:00.188749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":891,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185988+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:21:00.185988+0000","last_peered":"2024-04-19T02:21:00.185988+0000","last_clean":"2024-04-19T02:21:00.185988+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:21:00.185988+0000","last_undegraded":"2024-04-19T02:21:00.185988+0000","last_fullsized":"2024-04-19T02:21:00.185988+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":150,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186707+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:21:00.186707+0000","last_peered":"2024-04-19T02:21:00.186707+0000","last_clean":"2024-04-19T02:21:00.186707+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:21:00.186707+0000","last_undegraded":"2024-04-19T02:21:00.186707+0000","last_fullsized":"2024-04-19T02:21:00.186707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1075,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186549+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:00.186549+0000","last_peered":"2024-04-19T02:21:00.186549+0000","last_clean":"2024-04-19T02:21:00.186549+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:00.186549+0000","last_undegraded":"2024-04-19T02:21:00.186549+0000","last_fullsized":"2024-04-19T02:21:00.186549+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187218+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:00.187218+0000","last_peered":"2024-04-19T02:21:00.187218+0000","last_clean":"2024-04-19T02:21:00.187218+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:00.187218+0000","last_undegraded":"2024-04-19T02:21:00.187218+0000","last_fullsized":"2024-04-19T02:21:00.187218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":961,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186507+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:21:00.186507+0000","last_peered":"2024-04-19T02:21:00.186507+0000","last_clean":"2024-04-19T02:21:00.186507+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:21:00.186507+0000","last_undegraded":"2024-04-19T02:21:00.186507+0000","last_fullsized":"2024-04-19T02:21:00.186507+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":313,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185922+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:21:00.185922+0000","last_peered":"2024-04-19T02:21:00.185922+0000","last_clean":"2024-04-19T02:21:00.185922+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:21:00.185922+0000","last_undegraded":"2024-04-19T02:21:00.185922+0000","last_fullsized":"2024-04-19T02:21:00.185922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":983,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189071+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:21:00.189071+0000","last_peered":"2024-04-19T02:21:00.189071+0000","last_clean":"2024-04-19T02:21:00.189071+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:21:00.189071+0000","last_undegraded":"2024-04-19T02:21:00.189071+0000","last_fullsized":"2024-04-19T02:21:00.189071+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187763+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:00.187763+0000","last_peered":"2024-04-19T02:21:00.187763+0000","last_clean":"2024-04-19T02:21:00.187763+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:00.187763+0000","last_undegraded":"2024-04-19T02:21:00.187763+0000","last_fullsized":"2024-04-19T02:21:00.187763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":814,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188306+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:21:00.188306+0000","last_peered":"2024-04-19T02:21:00.188306+0000","last_clean":"2024-04-19T02:21:00.188306+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:21:00.188306+0000","last_undegraded":"2024-04-19T02:21:00.188306+0000","last_fullsized":"2024-04-19T02:21:00.188306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":495,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187896+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:00.187896+0000","last_peered":"2024-04-19T02:21:00.187896+0000","last_clean":"2024-04-19T02:21:00.187896+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:00.187896+0000","last_undegraded":"2024-04-19T02:21:00.187896+0000","last_fullsized":"2024-04-19T02:21:00.187896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":524,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187545+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:00.187545+0000","last_peered":"2024-04-19T02:21:00.187545+0000","last_clean":"2024-04-19T02:21:00.187545+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:00.187545+0000","last_undegraded":"2024-04-19T02:21:00.187545+0000","last_fullsized":"2024-04-19T02:21:00.187545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":298,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188456+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:21:00.188456+0000","last_peered":"2024-04-19T02:21:00.188456+0000","last_clean":"2024-04-19T02:21:00.188456+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:21:00.188456+0000","last_undegraded":"2024-04-19T02:21:00.188456+0000","last_fullsized":"2024-04-19T02:21:00.188456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187287+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:21:00.187287+0000","last_peered":"2024-04-19T02:21:00.187287+0000","last_clean":"2024-04-19T02:21:00.187287+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:21:00.187287+0000","last_undegraded":"2024-04-19T02:21:00.187287+0000","last_fullsized":"2024-04-19T02:21:00.187287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":866,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186344+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:00.186344+0000","last_peered":"2024-04-19T02:21:00.186344+0000","last_clean":"2024-04-19T02:21:00.186344+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:00.186344+0000","last_undegraded":"2024-04-19T02:21:00.186344+0000","last_fullsized":"2024-04-19T02:21:00.186344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":962,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188539+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:21:00.188539+0000","last_peered":"2024-04-19T02:21:00.188539+0000","last_clean":"2024-04-19T02:21:00.188539+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:21:00.188539+0000","last_undegraded":"2024-04-19T02:21:00.188539+0000","last_fullsized":"2024-04-19T02:21:00.188539+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188250+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:21:00.188250+0000","last_peered":"2024-04-19T02:21:00.188250+0000","last_clean":"2024-04-19T02:21:00.188250+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:21:00.188250+0000","last_undegraded":"2024-04-19T02:21:00.188250+0000","last_fullsized":"2024-04-19T02:21:00.188250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":303,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186195+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:00.186195+0000","last_peered":"2024-04-19T02:21:00.186195+0000","last_clean":"2024-04-19T02:21:00.186195+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:00.186195+0000","last_undegraded":"2024-04-19T02:21:00.186195+0000","last_fullsized":"2024-04-19T02:21:00.186195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":549,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188796+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:00.188796+0000","last_peered":"2024-04-19T02:21:00.188796+0000","last_clean":"2024-04-19T02:21:00.188796+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:00.188796+0000","last_undegraded":"2024-04-19T02:21:00.188796+0000","last_fullsized":"2024-04-19T02:21:00.188796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186333+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:00.186333+0000","last_peered":"2024-04-19T02:21:00.186333+0000","last_clean":"2024-04-19T02:21:00.186333+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:00.186333+0000","last_undegraded":"2024-04-19T02:21:00.186333+0000","last_fullsized":"2024-04-19T02:21:00.186333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":516,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187901+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:00.187901+0000","last_peered":"2024-04-19T02:21:00.187901+0000","last_clean":"2024-04-19T02:21:00.187901+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:00.187901+0000","last_undegraded":"2024-04-19T02:21:00.187901+0000","last_fullsized":"2024-04-19T02:21:00.187901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":461,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187603+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:00.187603+0000","last_peered":"2024-04-19T02:21:00.187603+0000","last_clean":"2024-04-19T02:21:00.187603+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:00.187603+0000","last_undegraded":"2024-04-19T02:21:00.187603+0000","last_fullsized":"2024-04-19T02:21:00.187603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186212+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:21:00.186212+0000","last_peered":"2024-04-19T02:21:00.186212+0000","last_clean":"2024-04-19T02:21:00.186212+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:21:00.186212+0000","last_undegraded":"2024-04-19T02:21:00.186212+0000","last_fullsized":"2024-04-19T02:21:00.186212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186960+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:21:00.186960+0000","last_peered":"2024-04-19T02:21:00.186960+0000","last_clean":"2024-04-19T02:21:00.186960+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:21:00.186960+0000","last_undegraded":"2024-04-19T02:21:00.186960+0000","last_fullsized":"2024-04-19T02:21:00.186960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":562,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186602+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:00.186602+0000","last_peered":"2024-04-19T02:21:00.186602+0000","last_clean":"2024-04-19T02:21:00.186602+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:00.186602+0000","last_undegraded":"2024-04-19T02:21:00.186602+0000","last_fullsized":"2024-04-19T02:21:00.186602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":566,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187455+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:21:00.187455+0000","last_peered":"2024-04-19T02:21:00.187455+0000","last_clean":"2024-04-19T02:21:00.187455+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:21:00.187455+0000","last_undegraded":"2024-04-19T02:21:00.187455+0000","last_fullsized":"2024-04-19T02:21:00.187455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186889+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:00.186889+0000","last_peered":"2024-04-19T02:21:00.186889+0000","last_clean":"2024-04-19T02:21:00.186889+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:00.186889+0000","last_undegraded":"2024-04-19T02:21:00.186889+0000","last_fullsized":"2024-04-19T02:21:00.186889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":850,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187441+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:00.187441+0000","last_peered":"2024-04-19T02:21:00.187441+0000","last_clean":"2024-04-19T02:21:00.187441+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:00.187441+0000","last_undegraded":"2024-04-19T02:21:00.187441+0000","last_fullsized":"2024-04-19T02:21:00.187441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":160,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186809+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:00.186809+0000","last_peered":"2024-04-19T02:21:00.186809+0000","last_clean":"2024-04-19T02:21:00.186809+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:00.186809+0000","last_undegraded":"2024-04-19T02:21:00.186809+0000","last_fullsized":"2024-04-19T02:21:00.186809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189284+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:00.189284+0000","last_peered":"2024-04-19T02:21:00.189284+0000","last_clean":"2024-04-19T02:21:00.189284+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:00.189284+0000","last_undegraded":"2024-04-19T02:21:00.189284+0000","last_fullsized":"2024-04-19T02:21:00.189284+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":967,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187470+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:00.187470+0000","last_peered":"2024-04-19T02:21:00.187470+0000","last_clean":"2024-04-19T02:21:00.187470+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:00.187470+0000","last_undegraded":"2024-04-19T02:21:00.187470+0000","last_fullsized":"2024-04-19T02:21:00.187470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187860+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:00.187860+0000","last_peered":"2024-04-19T02:21:00.187860+0000","last_clean":"2024-04-19T02:21:00.187860+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:00.187860+0000","last_undegraded":"2024-04-19T02:21:00.187860+0000","last_fullsized":"2024-04-19T02:21:00.187860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187446+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:00.187446+0000","last_peered":"2024-04-19T02:21:00.187446+0000","last_clean":"2024-04-19T02:21:00.187446+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:00.187446+0000","last_undegraded":"2024-04-19T02:21:00.187446+0000","last_fullsized":"2024-04-19T02:21:00.187446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":944,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.198669+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:00.198669+0000","last_peered":"2024-04-19T02:21:00.198669+0000","last_clean":"2024-04-19T02:21:00.198669+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:00.198669+0000","last_undegraded":"2024-04-19T02:21:00.198669+0000","last_fullsized":"2024-04-19T02:21:00.198669+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187375+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:00.187375+0000","last_peered":"2024-04-19T02:21:00.187375+0000","last_clean":"2024-04-19T02:21:00.187375+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:00.187375+0000","last_undegraded":"2024-04-19T02:21:00.187375+0000","last_fullsized":"2024-04-19T02:21:00.187375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189491+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:21:00.189491+0000","last_peered":"2024-04-19T02:21:00.189491+0000","last_clean":"2024-04-19T02:21:00.189491+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:21:00.189491+0000","last_undegraded":"2024-04-19T02:21:00.189491+0000","last_fullsized":"2024-04-19T02:21:00.189491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":570,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185672+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:00.185672+0000","last_peered":"2024-04-19T02:21:00.185672+0000","last_clean":"2024-04-19T02:21:00.185672+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:00.185672+0000","last_undegraded":"2024-04-19T02:21:00.185672+0000","last_fullsized":"2024-04-19T02:21:00.185672+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":873,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187140+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:21:00.187140+0000","last_peered":"2024-04-19T02:21:00.187140+0000","last_clean":"2024-04-19T02:21:00.187140+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:21:00.187140+0000","last_undegraded":"2024-04-19T02:21:00.187140+0000","last_fullsized":"2024-04-19T02:21:00.187140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":575,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187579+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:21:00.187579+0000","last_peered":"2024-04-19T02:21:00.187579+0000","last_clean":"2024-04-19T02:21:00.187579+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:21:00.187579+0000","last_undegraded":"2024-04-19T02:21:00.187579+0000","last_fullsized":"2024-04-19T02:21:00.187579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":548,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195012+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:01.195012+0000","last_peered":"2024-04-19T02:21:01.195012+0000","last_clean":"2024-04-19T02:21:01.195012+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:01.195012+0000","last_undegraded":"2024-04-19T02:21:01.195012+0000","last_fullsized":"2024-04-19T02:21:01.195012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189168+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:00.189168+0000","last_peered":"2024-04-19T02:21:00.189168+0000","last_clean":"2024-04-19T02:21:00.189168+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:00.189168+0000","last_undegraded":"2024-04-19T02:21:00.189168+0000","last_fullsized":"2024-04-19T02:21:00.189168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":430,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187070+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:21:00.187070+0000","last_peered":"2024-04-19T02:21:00.187070+0000","last_clean":"2024-04-19T02:21:00.187070+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:21:00.187070+0000","last_undegraded":"2024-04-19T02:21:00.187070+0000","last_fullsized":"2024-04-19T02:21:00.187070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1012,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195263+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:01.195263+0000","last_peered":"2024-04-19T02:21:01.195263+0000","last_clean":"2024-04-19T02:21:01.195263+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:01.195263+0000","last_undegraded":"2024-04-19T02:21:01.195263+0000","last_fullsized":"2024-04-19T02:21:01.195263+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187770+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:00.187770+0000","last_peered":"2024-04-19T02:21:00.187770+0000","last_clean":"2024-04-19T02:21:00.187770+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:00.187770+0000","last_undegraded":"2024-04-19T02:21:00.187770+0000","last_fullsized":"2024-04-19T02:21:00.187770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":622,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195827+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:01.195827+0000","last_peered":"2024-04-19T02:21:01.195827+0000","last_clean":"2024-04-19T02:21:01.195827+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:01.195827+0000","last_undegraded":"2024-04-19T02:21:01.195827+0000","last_fullsized":"2024-04-19T02:21:01.195827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":911,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189345+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:00.189345+0000","last_peered":"2024-04-19T02:21:00.189345+0000","last_clean":"2024-04-19T02:21:00.189345+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:00.189345+0000","last_undegraded":"2024-04-19T02:21:00.189345+0000","last_fullsized":"2024-04-19T02:21:00.189345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":675,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186551+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:00.186551+0000","last_peered":"2024-04-19T02:21:00.186551+0000","last_clean":"2024-04-19T02:21:00.186551+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:00.186551+0000","last_undegraded":"2024-04-19T02:21:00.186551+0000","last_fullsized":"2024-04-19T02:21:00.186551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":936,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186910+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:00.186910+0000","last_peered":"2024-04-19T02:21:00.186910+0000","last_clean":"2024-04-19T02:21:00.186910+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:00.186910+0000","last_undegraded":"2024-04-19T02:21:00.186910+0000","last_fullsized":"2024-04-19T02:21:00.186910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":453,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186102+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:00.186102+0000","last_peered":"2024-04-19T02:21:00.186102+0000","last_clean":"2024-04-19T02:21:00.186102+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:00.186102+0000","last_undegraded":"2024-04-19T02:21:00.186102+0000","last_fullsized":"2024-04-19T02:21:00.186102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":853,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188248+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:00.188248+0000","last_peered":"2024-04-19T02:21:00.188248+0000","last_clean":"2024-04-19T02:21:00.188248+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:00.188248+0000","last_undegraded":"2024-04-19T02:21:00.188248+0000","last_fullsized":"2024-04-19T02:21:00.188248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":600,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187691+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:00.187691+0000","last_peered":"2024-04-19T02:21:00.187691+0000","last_clean":"2024-04-19T02:21:00.187691+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:00.187691+0000","last_undegraded":"2024-04-19T02:21:00.187691+0000","last_fullsized":"2024-04-19T02:21:00.187691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":542,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188007+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:00.188007+0000","last_peered":"2024-04-19T02:21:00.188007+0000","last_clean":"2024-04-19T02:21:00.188007+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:00.188007+0000","last_undegraded":"2024-04-19T02:21:00.188007+0000","last_fullsized":"2024-04-19T02:21:00.188007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187759+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:00.187759+0000","last_peered":"2024-04-19T02:21:00.187759+0000","last_clean":"2024-04-19T02:21:00.187759+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:00.187759+0000","last_undegraded":"2024-04-19T02:21:00.187759+0000","last_fullsized":"2024-04-19T02:21:00.187759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":830,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186236+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:21:00.186236+0000","last_peered":"2024-04-19T02:21:00.186236+0000","last_clean":"2024-04-19T02:21:00.186236+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:21:00.186236+0000","last_undegraded":"2024-04-19T02:21:00.186236+0000","last_fullsized":"2024-04-19T02:21:00.186236+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":440,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186885+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:21:00.186885+0000","last_peered":"2024-04-19T02:21:00.186885+0000","last_clean":"2024-04-19T02:21:00.186885+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:21:00.186885+0000","last_undegraded":"2024-04-19T02:21:00.186885+0000","last_fullsized":"2024-04-19T02:21:00.186885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":883,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185797+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:21:00.185797+0000","last_peered":"2024-04-19T02:21:00.185797+0000","last_clean":"2024-04-19T02:21:00.185797+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:21:00.185797+0000","last_undegraded":"2024-04-19T02:21:00.185797+0000","last_fullsized":"2024-04-19T02:21:00.185797+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":500,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189000+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:00.189000+0000","last_peered":"2024-04-19T02:21:00.189000+0000","last_clean":"2024-04-19T02:21:00.189000+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:00.189000+0000","last_undegraded":"2024-04-19T02:21:00.189000+0000","last_fullsized":"2024-04-19T02:21:00.189000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":625,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188008+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:00.188008+0000","last_peered":"2024-04-19T02:21:00.188008+0000","last_clean":"2024-04-19T02:21:00.188008+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:00.188008+0000","last_undegraded":"2024-04-19T02:21:00.188008+0000","last_fullsized":"2024-04-19T02:21:00.188008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187227+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:00.187227+0000","last_peered":"2024-04-19T02:21:00.187227+0000","last_clean":"2024-04-19T02:21:00.187227+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:00.187227+0000","last_undegraded":"2024-04-19T02:21:00.187227+0000","last_fullsized":"2024-04-19T02:21:00.187227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":986,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185993+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:21:00.185993+0000","last_peered":"2024-04-19T02:21:00.185993+0000","last_clean":"2024-04-19T02:21:00.185993+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:21:00.185993+0000","last_undegraded":"2024-04-19T02:21:00.185993+0000","last_fullsized":"2024-04-19T02:21:00.185993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187679+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:00.187679+0000","last_peered":"2024-04-19T02:21:00.187679+0000","last_clean":"2024-04-19T02:21:00.187679+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:00.187679+0000","last_undegraded":"2024-04-19T02:21:00.187679+0000","last_fullsized":"2024-04-19T02:21:00.187679+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142988,"kb_used_data":27448,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228852,"statfs":{"total":96636764160,"available":96490344448,"internally_reserved":0,"allocated":28106752,"data_stored":81632647,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":1,"up_from":78,"seq":335007449096,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66068,"kb_used_data":12296,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305772,"statfs":{"total":96636764160,"available":96569110528,"internally_reserved":0,"allocated":12591104,"data_stored":91916659,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139560,"kb_used_data":28116,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232280,"statfs":{"total":96636764160,"available":96493854720,"internally_reserved":0,"allocated":28790784,"data_stored":86255118,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:09.392 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T02:21:09.392 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:21:09.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:09.744 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:09.762 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-19T02:21:08.303194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7190,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348616,"kb_used_data":67860,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766904,"statfs":{"total":289910292480,"available":289553309696,"internally_reserved":0,"allocated":69488640,"data_stored":259804424,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.119305"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":560,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189091+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:00.189091+0000","last_peered":"2024-04-19T02:21:00.189091+0000","last_clean":"2024-04-19T02:21:00.189091+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:00.189091+0000","last_undegraded":"2024-04-19T02:21:00.189091+0000","last_fullsized":"2024-04-19T02:21:00.189091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":586,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188555+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:00.188555+0000","last_peered":"2024-04-19T02:21:00.188555+0000","last_clean":"2024-04-19T02:21:00.188555+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:00.188555+0000","last_undegraded":"2024-04-19T02:21:00.188555+0000","last_fullsized":"2024-04-19T02:21:00.188555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":863,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187761+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:21:00.187761+0000","last_peered":"2024-04-19T02:21:00.187761+0000","last_clean":"2024-04-19T02:21:00.187761+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:21:00.187761+0000","last_undegraded":"2024-04-19T02:21:00.187761+0000","last_fullsized":"2024-04-19T02:21:00.187761+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":837,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186341+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:21:00.186341+0000","last_peered":"2024-04-19T02:21:00.186341+0000","last_clean":"2024-04-19T02:21:00.186341+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:21:00.186341+0000","last_undegraded":"2024-04-19T02:21:00.186341+0000","last_fullsized":"2024-04-19T02:21:00.186341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":534,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187689+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:00.187689+0000","last_peered":"2024-04-19T02:21:00.187689+0000","last_clean":"2024-04-19T02:21:00.187689+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:00.187689+0000","last_undegraded":"2024-04-19T02:21:00.187689+0000","last_fullsized":"2024-04-19T02:21:00.187689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":931,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186938+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:21:00.186938+0000","last_peered":"2024-04-19T02:21:00.186938+0000","last_clean":"2024-04-19T02:21:00.186938+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:21:00.186938+0000","last_undegraded":"2024-04-19T02:21:00.186938+0000","last_fullsized":"2024-04-19T02:21:00.186938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":920,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185811+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:21:00.185811+0000","last_peered":"2024-04-19T02:21:00.185811+0000","last_clean":"2024-04-19T02:21:00.185811+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:21:00.185811+0000","last_undegraded":"2024-04-19T02:21:00.185811+0000","last_fullsized":"2024-04-19T02:21:00.185811+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":948,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185905+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:21:00.185905+0000","last_peered":"2024-04-19T02:21:00.185905+0000","last_clean":"2024-04-19T02:21:00.185905+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:21:00.185905+0000","last_undegraded":"2024-04-19T02:21:00.185905+0000","last_fullsized":"2024-04-19T02:21:00.185905+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":555,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187085+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:00.187085+0000","last_peered":"2024-04-19T02:21:00.187085+0000","last_clean":"2024-04-19T02:21:00.187085+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:00.187085+0000","last_undegraded":"2024-04-19T02:21:00.187085+0000","last_fullsized":"2024-04-19T02:21:00.187085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":546,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188596+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:00.188596+0000","last_peered":"2024-04-19T02:21:00.188596+0000","last_clean":"2024-04-19T02:21:00.188596+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:00.188596+0000","last_undegraded":"2024-04-19T02:21:00.188596+0000","last_fullsized":"2024-04-19T02:21:00.188596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":835,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187152+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:21:00.187152+0000","last_peered":"2024-04-19T02:21:00.187152+0000","last_clean":"2024-04-19T02:21:00.187152+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:21:00.187152+0000","last_undegraded":"2024-04-19T02:21:00.187152+0000","last_fullsized":"2024-04-19T02:21:00.187152+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":903,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187431+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:00.187431+0000","last_peered":"2024-04-19T02:21:00.187431+0000","last_clean":"2024-04-19T02:21:00.187431+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:00.187431+0000","last_undegraded":"2024-04-19T02:21:00.187431+0000","last_fullsized":"2024-04-19T02:21:00.187431+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":530,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187447+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:00.187447+0000","last_peered":"2024-04-19T02:21:00.187447+0000","last_clean":"2024-04-19T02:21:00.187447+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:00.187447+0000","last_undegraded":"2024-04-19T02:21:00.187447+0000","last_fullsized":"2024-04-19T02:21:00.187447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":899,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186920+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:21:00.186920+0000","last_peered":"2024-04-19T02:21:00.186920+0000","last_clean":"2024-04-19T02:21:00.186920+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:21:00.186920+0000","last_undegraded":"2024-04-19T02:21:00.186920+0000","last_fullsized":"2024-04-19T02:21:00.186920+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":919,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186901+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:21:00.186901+0000","last_peered":"2024-04-19T02:21:00.186901+0000","last_clean":"2024-04-19T02:21:00.186901+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:21:00.186901+0000","last_undegraded":"2024-04-19T02:21:00.186901+0000","last_fullsized":"2024-04-19T02:21:00.186901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1002,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185718+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:21:00.185718+0000","last_peered":"2024-04-19T02:21:00.185718+0000","last_clean":"2024-04-19T02:21:00.185718+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:21:00.185718+0000","last_undegraded":"2024-04-19T02:21:00.185718+0000","last_fullsized":"2024-04-19T02:21:00.185718+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":554,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.197765+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:01.197765+0000","last_peered":"2024-04-19T02:21:01.197765+0000","last_clean":"2024-04-19T02:21:01.197765+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:01.197765+0000","last_undegraded":"2024-04-19T02:21:01.197765+0000","last_fullsized":"2024-04-19T02:21:01.197765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":531,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.199552+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:01.199552+0000","last_peered":"2024-04-19T02:21:01.199552+0000","last_clean":"2024-04-19T02:21:01.199552+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:01.199552+0000","last_undegraded":"2024-04-19T02:21:01.199552+0000","last_fullsized":"2024-04-19T02:21:01.199552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":642,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187216+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:00.187216+0000","last_peered":"2024-04-19T02:21:00.187216+0000","last_clean":"2024-04-19T02:21:00.187216+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:00.187216+0000","last_undegraded":"2024-04-19T02:21:00.187216+0000","last_fullsized":"2024-04-19T02:21:00.187216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":931,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186614+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:21:00.186614+0000","last_peered":"2024-04-19T02:21:00.186614+0000","last_clean":"2024-04-19T02:21:00.186614+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:21:00.186614+0000","last_undegraded":"2024-04-19T02:21:00.186614+0000","last_fullsized":"2024-04-19T02:21:00.186614+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":932,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187063+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:21:00.187063+0000","last_peered":"2024-04-19T02:21:00.187063+0000","last_clean":"2024-04-19T02:21:00.187063+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:21:00.187063+0000","last_undegraded":"2024-04-19T02:21:00.187063+0000","last_fullsized":"2024-04-19T02:21:00.187063+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1115,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187358+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:00.187358+0000","last_peered":"2024-04-19T02:21:00.187358+0000","last_clean":"2024-04-19T02:21:00.187358+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:00.187358+0000","last_undegraded":"2024-04-19T02:21:00.187358+0000","last_fullsized":"2024-04-19T02:21:00.187358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":893,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185789+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:00.185789+0000","last_peered":"2024-04-19T02:21:00.185789+0000","last_clean":"2024-04-19T02:21:00.185789+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:00.185789+0000","last_undegraded":"2024-04-19T02:21:00.185789+0000","last_fullsized":"2024-04-19T02:21:00.185789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":562,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186653+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:00.186653+0000","last_peered":"2024-04-19T02:21:00.186653+0000","last_clean":"2024-04-19T02:21:00.186653+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:00.186653+0000","last_undegraded":"2024-04-19T02:21:00.186653+0000","last_fullsized":"2024-04-19T02:21:00.186653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":943,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189089+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:00.189089+0000","last_peered":"2024-04-19T02:21:00.189089+0000","last_clean":"2024-04-19T02:21:00.189089+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:00.189089+0000","last_undegraded":"2024-04-19T02:21:00.189089+0000","last_fullsized":"2024-04-19T02:21:00.189089+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1167,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186969+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:00.186969+0000","last_peered":"2024-04-19T02:21:00.186969+0000","last_clean":"2024-04-19T02:21:00.186969+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:00.186969+0000","last_undegraded":"2024-04-19T02:21:00.186969+0000","last_fullsized":"2024-04-19T02:21:00.186969+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":939,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189304+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:21:00.189304+0000","last_peered":"2024-04-19T02:21:00.189304+0000","last_clean":"2024-04-19T02:21:00.189304+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:21:00.189304+0000","last_undegraded":"2024-04-19T02:21:00.189304+0000","last_fullsized":"2024-04-19T02:21:00.189304+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":809,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188310+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:00.188310+0000","last_peered":"2024-04-19T02:21:00.188310+0000","last_clean":"2024-04-19T02:21:00.188310+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:00.188310+0000","last_undegraded":"2024-04-19T02:21:00.188310+0000","last_fullsized":"2024-04-19T02:21:00.188310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":532,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186817+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:00.186817+0000","last_peered":"2024-04-19T02:21:00.186817+0000","last_clean":"2024-04-19T02:21:00.186817+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:00.186817+0000","last_undegraded":"2024-04-19T02:21:00.186817+0000","last_fullsized":"2024-04-19T02:21:00.186817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1070,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187593+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:00.187593+0000","last_peered":"2024-04-19T02:21:00.187593+0000","last_clean":"2024-04-19T02:21:00.187593+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:00.187593+0000","last_undegraded":"2024-04-19T02:21:00.187593+0000","last_fullsized":"2024-04-19T02:21:00.187593+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":609,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185907+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:00.185907+0000","last_peered":"2024-04-19T02:21:00.185907+0000","last_clean":"2024-04-19T02:21:00.185907+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:00.185907+0000","last_undegraded":"2024-04-19T02:21:00.185907+0000","last_fullsized":"2024-04-19T02:21:00.185907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":926,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186149+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:21:00.186149+0000","last_peered":"2024-04-19T02:21:00.186149+0000","last_clean":"2024-04-19T02:21:00.186149+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:21:00.186149+0000","last_undegraded":"2024-04-19T02:21:00.186149+0000","last_fullsized":"2024-04-19T02:21:00.186149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":491,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.199216+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:01.199216+0000","last_peered":"2024-04-19T02:21:01.199216+0000","last_clean":"2024-04-19T02:21:01.199216+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:01.199216+0000","last_undegraded":"2024-04-19T02:21:01.199216+0000","last_fullsized":"2024-04-19T02:21:01.199216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":497,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186708+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:21:00.186708+0000","last_peered":"2024-04-19T02:21:00.186708+0000","last_clean":"2024-04-19T02:21:00.186708+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:21:00.186708+0000","last_undegraded":"2024-04-19T02:21:00.186708+0000","last_fullsized":"2024-04-19T02:21:00.186708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":539,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188813+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:00.188813+0000","last_peered":"2024-04-19T02:21:00.188813+0000","last_clean":"2024-04-19T02:21:00.188813+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:00.188813+0000","last_undegraded":"2024-04-19T02:21:00.188813+0000","last_fullsized":"2024-04-19T02:21:00.188813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195359+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:01.195359+0000","last_peered":"2024-04-19T02:21:01.195359+0000","last_clean":"2024-04-19T02:21:01.195359+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:01.195359+0000","last_undegraded":"2024-04-19T02:21:01.195359+0000","last_fullsized":"2024-04-19T02:21:01.195359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1013,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187291+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:00.187291+0000","last_peered":"2024-04-19T02:21:00.187291+0000","last_clean":"2024-04-19T02:21:00.187291+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:00.187291+0000","last_undegraded":"2024-04-19T02:21:00.187291+0000","last_fullsized":"2024-04-19T02:21:00.187291+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.198003+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:01.198003+0000","last_peered":"2024-04-19T02:21:01.198003+0000","last_clean":"2024-04-19T02:21:01.198003+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:01.198003+0000","last_undegraded":"2024-04-19T02:21:01.198003+0000","last_fullsized":"2024-04-19T02:21:01.198003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":902,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.206349+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:01.206349+0000","last_peered":"2024-04-19T02:21:01.206349+0000","last_clean":"2024-04-19T02:21:01.206349+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:01.206349+0000","last_undegraded":"2024-04-19T02:21:01.206349+0000","last_fullsized":"2024-04-19T02:21:01.206349+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":159,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186918+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:21:00.186918+0000","last_peered":"2024-04-19T02:21:00.186918+0000","last_clean":"2024-04-19T02:21:00.186918+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:21:00.186918+0000","last_undegraded":"2024-04-19T02:21:00.186918+0000","last_fullsized":"2024-04-19T02:21:00.186918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":283,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189564+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:21:00.189564+0000","last_peered":"2024-04-19T02:21:00.189564+0000","last_clean":"2024-04-19T02:21:00.189564+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:21:00.189564+0000","last_undegraded":"2024-04-19T02:21:00.189564+0000","last_fullsized":"2024-04-19T02:21:00.189564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":888,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186876+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:00.186876+0000","last_peered":"2024-04-19T02:21:00.186876+0000","last_clean":"2024-04-19T02:21:00.186876+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:00.186876+0000","last_undegraded":"2024-04-19T02:21:00.186876+0000","last_fullsized":"2024-04-19T02:21:00.186876+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":423,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188948+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:00.188948+0000","last_peered":"2024-04-19T02:21:00.188948+0000","last_clean":"2024-04-19T02:21:00.188948+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:00.188948+0000","last_undegraded":"2024-04-19T02:21:00.188948+0000","last_fullsized":"2024-04-19T02:21:00.188948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":560,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187186+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:00.187186+0000","last_peered":"2024-04-19T02:21:00.187186+0000","last_clean":"2024-04-19T02:21:00.187186+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:00.187186+0000","last_undegraded":"2024-04-19T02:21:00.187186+0000","last_fullsized":"2024-04-19T02:21:00.187186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":712,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188749+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:21:00.188749+0000","last_peered":"2024-04-19T02:21:00.188749+0000","last_clean":"2024-04-19T02:21:00.188749+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:21:00.188749+0000","last_undegraded":"2024-04-19T02:21:00.188749+0000","last_fullsized":"2024-04-19T02:21:00.188749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":891,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185988+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:21:00.185988+0000","last_peered":"2024-04-19T02:21:00.185988+0000","last_clean":"2024-04-19T02:21:00.185988+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:21:00.185988+0000","last_undegraded":"2024-04-19T02:21:00.185988+0000","last_fullsized":"2024-04-19T02:21:00.185988+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":150,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186707+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:21:00.186707+0000","last_peered":"2024-04-19T02:21:00.186707+0000","last_clean":"2024-04-19T02:21:00.186707+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:21:00.186707+0000","last_undegraded":"2024-04-19T02:21:00.186707+0000","last_fullsized":"2024-04-19T02:21:00.186707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1075,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186549+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:00.186549+0000","last_peered":"2024-04-19T02:21:00.186549+0000","last_clean":"2024-04-19T02:21:00.186549+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:00.186549+0000","last_undegraded":"2024-04-19T02:21:00.186549+0000","last_fullsized":"2024-04-19T02:21:00.186549+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187218+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:00.187218+0000","last_peered":"2024-04-19T02:21:00.187218+0000","last_clean":"2024-04-19T02:21:00.187218+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:00.187218+0000","last_undegraded":"2024-04-19T02:21:00.187218+0000","last_fullsized":"2024-04-19T02:21:00.187218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":961,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186507+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:21:00.186507+0000","last_peered":"2024-04-19T02:21:00.186507+0000","last_clean":"2024-04-19T02:21:00.186507+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:21:00.186507+0000","last_undegraded":"2024-04-19T02:21:00.186507+0000","last_fullsized":"2024-04-19T02:21:00.186507+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":313,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185922+0000","last_change":"2024-04-19T02:20:34.186437+0000","last_active":"2024-04-19T02:21:00.185922+0000","last_peered":"2024-04-19T02:21:00.185922+0000","last_clean":"2024-04-19T02:21:00.185922+0000","last_became_active":"2024-04-19T02:20:34.185490+0000","last_became_peered":"2024-04-19T02:20:34.185490+0000","last_unstale":"2024-04-19T02:21:00.185922+0000","last_undegraded":"2024-04-19T02:21:00.185922+0000","last_fullsized":"2024-04-19T02:21:00.185922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:30.990026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":983,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189071+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:21:00.189071+0000","last_peered":"2024-04-19T02:21:00.189071+0000","last_clean":"2024-04-19T02:21:00.189071+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:21:00.189071+0000","last_undegraded":"2024-04-19T02:21:00.189071+0000","last_fullsized":"2024-04-19T02:21:00.189071+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187763+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:00.187763+0000","last_peered":"2024-04-19T02:21:00.187763+0000","last_clean":"2024-04-19T02:21:00.187763+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:00.187763+0000","last_undegraded":"2024-04-19T02:21:00.187763+0000","last_fullsized":"2024-04-19T02:21:00.187763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":814,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188306+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:21:00.188306+0000","last_peered":"2024-04-19T02:21:00.188306+0000","last_clean":"2024-04-19T02:21:00.188306+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:21:00.188306+0000","last_undegraded":"2024-04-19T02:21:00.188306+0000","last_fullsized":"2024-04-19T02:21:00.188306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":495,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187896+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:00.187896+0000","last_peered":"2024-04-19T02:21:00.187896+0000","last_clean":"2024-04-19T02:21:00.187896+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:00.187896+0000","last_undegraded":"2024-04-19T02:21:00.187896+0000","last_fullsized":"2024-04-19T02:21:00.187896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":524,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187545+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:00.187545+0000","last_peered":"2024-04-19T02:21:00.187545+0000","last_clean":"2024-04-19T02:21:00.187545+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:00.187545+0000","last_undegraded":"2024-04-19T02:21:00.187545+0000","last_fullsized":"2024-04-19T02:21:00.187545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":298,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188456+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:21:00.188456+0000","last_peered":"2024-04-19T02:21:00.188456+0000","last_clean":"2024-04-19T02:21:00.188456+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:21:00.188456+0000","last_undegraded":"2024-04-19T02:21:00.188456+0000","last_fullsized":"2024-04-19T02:21:00.188456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187287+0000","last_change":"2024-04-19T02:20:30.539554+0000","last_active":"2024-04-19T02:21:00.187287+0000","last_peered":"2024-04-19T02:21:00.187287+0000","last_clean":"2024-04-19T02:21:00.187287+0000","last_became_active":"2024-04-19T02:20:30.539043+0000","last_became_peered":"2024-04-19T02:20:30.539043+0000","last_unstale":"2024-04-19T02:21:00.187287+0000","last_undegraded":"2024-04-19T02:21:00.187287+0000","last_fullsized":"2024-04-19T02:21:00.187287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:02.006124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":866,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186344+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:00.186344+0000","last_peered":"2024-04-19T02:21:00.186344+0000","last_clean":"2024-04-19T02:21:00.186344+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:00.186344+0000","last_undegraded":"2024-04-19T02:21:00.186344+0000","last_fullsized":"2024-04-19T02:21:00.186344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":962,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188539+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:21:00.188539+0000","last_peered":"2024-04-19T02:21:00.188539+0000","last_clean":"2024-04-19T02:21:00.188539+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:21:00.188539+0000","last_undegraded":"2024-04-19T02:21:00.188539+0000","last_fullsized":"2024-04-19T02:21:00.188539+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188250+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:21:00.188250+0000","last_peered":"2024-04-19T02:21:00.188250+0000","last_clean":"2024-04-19T02:21:00.188250+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:21:00.188250+0000","last_undegraded":"2024-04-19T02:21:00.188250+0000","last_fullsized":"2024-04-19T02:21:00.188250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":303,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186195+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:00.186195+0000","last_peered":"2024-04-19T02:21:00.186195+0000","last_clean":"2024-04-19T02:21:00.186195+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:00.186195+0000","last_undegraded":"2024-04-19T02:21:00.186195+0000","last_fullsized":"2024-04-19T02:21:00.186195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":549,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188796+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:00.188796+0000","last_peered":"2024-04-19T02:21:00.188796+0000","last_clean":"2024-04-19T02:21:00.188796+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:00.188796+0000","last_undegraded":"2024-04-19T02:21:00.188796+0000","last_fullsized":"2024-04-19T02:21:00.188796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186333+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:00.186333+0000","last_peered":"2024-04-19T02:21:00.186333+0000","last_clean":"2024-04-19T02:21:00.186333+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:00.186333+0000","last_undegraded":"2024-04-19T02:21:00.186333+0000","last_fullsized":"2024-04-19T02:21:00.186333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":516,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187901+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:00.187901+0000","last_peered":"2024-04-19T02:21:00.187901+0000","last_clean":"2024-04-19T02:21:00.187901+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:00.187901+0000","last_undegraded":"2024-04-19T02:21:00.187901+0000","last_fullsized":"2024-04-19T02:21:00.187901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":461,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187603+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:00.187603+0000","last_peered":"2024-04-19T02:21:00.187603+0000","last_clean":"2024-04-19T02:21:00.187603+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:00.187603+0000","last_undegraded":"2024-04-19T02:21:00.187603+0000","last_fullsized":"2024-04-19T02:21:00.187603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186212+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:21:00.186212+0000","last_peered":"2024-04-19T02:21:00.186212+0000","last_clean":"2024-04-19T02:21:00.186212+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:21:00.186212+0000","last_undegraded":"2024-04-19T02:21:00.186212+0000","last_fullsized":"2024-04-19T02:21:00.186212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186960+0000","last_change":"2024-04-19T02:20:30.539309+0000","last_active":"2024-04-19T02:21:00.186960+0000","last_peered":"2024-04-19T02:21:00.186960+0000","last_clean":"2024-04-19T02:21:00.186960+0000","last_became_active":"2024-04-19T02:20:30.538937+0000","last_became_peered":"2024-04-19T02:20:30.538937+0000","last_unstale":"2024-04-19T02:21:00.186960+0000","last_undegraded":"2024-04-19T02:21:00.186960+0000","last_fullsized":"2024-04-19T02:21:00.186960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:14:09.337061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":562,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186602+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:00.186602+0000","last_peered":"2024-04-19T02:21:00.186602+0000","last_clean":"2024-04-19T02:21:00.186602+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:00.186602+0000","last_undegraded":"2024-04-19T02:21:00.186602+0000","last_fullsized":"2024-04-19T02:21:00.186602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":566,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187455+0000","last_change":"2024-04-19T02:20:35.197408+0000","last_active":"2024-04-19T02:21:00.187455+0000","last_peered":"2024-04-19T02:21:00.187455+0000","last_clean":"2024-04-19T02:21:00.187455+0000","last_became_active":"2024-04-19T02:20:35.196299+0000","last_became_peered":"2024-04-19T02:20:35.196299+0000","last_unstale":"2024-04-19T02:21:00.187455+0000","last_undegraded":"2024-04-19T02:21:00.187455+0000","last_fullsized":"2024-04-19T02:21:00.187455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:28.781841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186889+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:00.186889+0000","last_peered":"2024-04-19T02:21:00.186889+0000","last_clean":"2024-04-19T02:21:00.186889+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:00.186889+0000","last_undegraded":"2024-04-19T02:21:00.186889+0000","last_fullsized":"2024-04-19T02:21:00.186889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":850,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187441+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:00.187441+0000","last_peered":"2024-04-19T02:21:00.187441+0000","last_clean":"2024-04-19T02:21:00.187441+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:00.187441+0000","last_undegraded":"2024-04-19T02:21:00.187441+0000","last_fullsized":"2024-04-19T02:21:00.187441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":160,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186809+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:00.186809+0000","last_peered":"2024-04-19T02:21:00.186809+0000","last_clean":"2024-04-19T02:21:00.186809+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:00.186809+0000","last_undegraded":"2024-04-19T02:21:00.186809+0000","last_fullsized":"2024-04-19T02:21:00.186809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189284+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:00.189284+0000","last_peered":"2024-04-19T02:21:00.189284+0000","last_clean":"2024-04-19T02:21:00.189284+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:00.189284+0000","last_undegraded":"2024-04-19T02:21:00.189284+0000","last_fullsized":"2024-04-19T02:21:00.189284+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":967,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187470+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:00.187470+0000","last_peered":"2024-04-19T02:21:00.187470+0000","last_clean":"2024-04-19T02:21:00.187470+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:00.187470+0000","last_undegraded":"2024-04-19T02:21:00.187470+0000","last_fullsized":"2024-04-19T02:21:00.187470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187860+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:00.187860+0000","last_peered":"2024-04-19T02:21:00.187860+0000","last_clean":"2024-04-19T02:21:00.187860+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:00.187860+0000","last_undegraded":"2024-04-19T02:21:00.187860+0000","last_fullsized":"2024-04-19T02:21:00.187860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187446+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:00.187446+0000","last_peered":"2024-04-19T02:21:00.187446+0000","last_clean":"2024-04-19T02:21:00.187446+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:00.187446+0000","last_undegraded":"2024-04-19T02:21:00.187446+0000","last_fullsized":"2024-04-19T02:21:00.187446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":944,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.198669+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:00.198669+0000","last_peered":"2024-04-19T02:21:00.198669+0000","last_clean":"2024-04-19T02:21:00.198669+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:00.198669+0000","last_undegraded":"2024-04-19T02:21:00.198669+0000","last_fullsized":"2024-04-19T02:21:00.198669+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187375+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:00.187375+0000","last_peered":"2024-04-19T02:21:00.187375+0000","last_clean":"2024-04-19T02:21:00.187375+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:00.187375+0000","last_undegraded":"2024-04-19T02:21:00.187375+0000","last_fullsized":"2024-04-19T02:21:00.187375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189491+0000","last_change":"2024-04-19T02:20:30.532163+0000","last_active":"2024-04-19T02:21:00.189491+0000","last_peered":"2024-04-19T02:21:00.189491+0000","last_clean":"2024-04-19T02:21:00.189491+0000","last_became_active":"2024-04-19T02:20:30.531398+0000","last_became_peered":"2024-04-19T02:20:30.531398+0000","last_unstale":"2024-04-19T02:21:00.189491+0000","last_undegraded":"2024-04-19T02:21:00.189491+0000","last_fullsized":"2024-04-19T02:21:00.189491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:59.070419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":570,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185672+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:00.185672+0000","last_peered":"2024-04-19T02:21:00.185672+0000","last_clean":"2024-04-19T02:21:00.185672+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:00.185672+0000","last_undegraded":"2024-04-19T02:21:00.185672+0000","last_fullsized":"2024-04-19T02:21:00.185672+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":873,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187140+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:21:00.187140+0000","last_peered":"2024-04-19T02:21:00.187140+0000","last_clean":"2024-04-19T02:21:00.187140+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:21:00.187140+0000","last_undegraded":"2024-04-19T02:21:00.187140+0000","last_fullsized":"2024-04-19T02:21:00.187140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":575,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187579+0000","last_change":"2024-04-19T02:20:33.183911+0000","last_active":"2024-04-19T02:21:00.187579+0000","last_peered":"2024-04-19T02:21:00.187579+0000","last_clean":"2024-04-19T02:21:00.187579+0000","last_became_active":"2024-04-19T02:20:33.181940+0000","last_became_peered":"2024-04-19T02:20:33.181940+0000","last_unstale":"2024-04-19T02:21:00.187579+0000","last_undegraded":"2024-04-19T02:21:00.187579+0000","last_fullsized":"2024-04-19T02:21:00.187579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:25.186926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9687045,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":548,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195012+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:01.195012+0000","last_peered":"2024-04-19T02:21:01.195012+0000","last_clean":"2024-04-19T02:21:01.195012+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:01.195012+0000","last_undegraded":"2024-04-19T02:21:01.195012+0000","last_fullsized":"2024-04-19T02:21:01.195012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189168+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:00.189168+0000","last_peered":"2024-04-19T02:21:00.189168+0000","last_clean":"2024-04-19T02:21:00.189168+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:00.189168+0000","last_undegraded":"2024-04-19T02:21:00.189168+0000","last_fullsized":"2024-04-19T02:21:00.189168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":430,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187070+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:21:00.187070+0000","last_peered":"2024-04-19T02:21:00.187070+0000","last_clean":"2024-04-19T02:21:00.187070+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:21:00.187070+0000","last_undegraded":"2024-04-19T02:21:00.187070+0000","last_fullsized":"2024-04-19T02:21:00.187070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1012,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195263+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:01.195263+0000","last_peered":"2024-04-19T02:21:01.195263+0000","last_clean":"2024-04-19T02:21:01.195263+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:01.195263+0000","last_undegraded":"2024-04-19T02:21:01.195263+0000","last_fullsized":"2024-04-19T02:21:01.195263+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187770+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:00.187770+0000","last_peered":"2024-04-19T02:21:00.187770+0000","last_clean":"2024-04-19T02:21:00.187770+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:00.187770+0000","last_undegraded":"2024-04-19T02:21:00.187770+0000","last_fullsized":"2024-04-19T02:21:00.187770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":622,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.195827+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:01.195827+0000","last_peered":"2024-04-19T02:21:01.195827+0000","last_clean":"2024-04-19T02:21:01.195827+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:01.195827+0000","last_undegraded":"2024-04-19T02:21:01.195827+0000","last_fullsized":"2024-04-19T02:21:01.195827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":911,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189345+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:00.189345+0000","last_peered":"2024-04-19T02:21:00.189345+0000","last_clean":"2024-04-19T02:21:00.189345+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:00.189345+0000","last_undegraded":"2024-04-19T02:21:00.189345+0000","last_fullsized":"2024-04-19T02:21:00.189345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":675,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186551+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:00.186551+0000","last_peered":"2024-04-19T02:21:00.186551+0000","last_clean":"2024-04-19T02:21:00.186551+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:00.186551+0000","last_undegraded":"2024-04-19T02:21:00.186551+0000","last_fullsized":"2024-04-19T02:21:00.186551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":936,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186910+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:00.186910+0000","last_peered":"2024-04-19T02:21:00.186910+0000","last_clean":"2024-04-19T02:21:00.186910+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:00.186910+0000","last_undegraded":"2024-04-19T02:21:00.186910+0000","last_fullsized":"2024-04-19T02:21:00.186910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":453,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186102+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:00.186102+0000","last_peered":"2024-04-19T02:21:00.186102+0000","last_clean":"2024-04-19T02:21:00.186102+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:00.186102+0000","last_undegraded":"2024-04-19T02:21:00.186102+0000","last_fullsized":"2024-04-19T02:21:00.186102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":853,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188248+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:00.188248+0000","last_peered":"2024-04-19T02:21:00.188248+0000","last_clean":"2024-04-19T02:21:00.188248+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:00.188248+0000","last_undegraded":"2024-04-19T02:21:00.188248+0000","last_fullsized":"2024-04-19T02:21:00.188248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":600,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187691+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:00.187691+0000","last_peered":"2024-04-19T02:21:00.187691+0000","last_clean":"2024-04-19T02:21:00.187691+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:00.187691+0000","last_undegraded":"2024-04-19T02:21:00.187691+0000","last_fullsized":"2024-04-19T02:21:00.187691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":542,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188007+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:00.188007+0000","last_peered":"2024-04-19T02:21:00.188007+0000","last_clean":"2024-04-19T02:21:00.188007+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:00.188007+0000","last_undegraded":"2024-04-19T02:21:00.188007+0000","last_fullsized":"2024-04-19T02:21:00.188007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187759+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:00.187759+0000","last_peered":"2024-04-19T02:21:00.187759+0000","last_clean":"2024-04-19T02:21:00.187759+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:00.187759+0000","last_undegraded":"2024-04-19T02:21:00.187759+0000","last_fullsized":"2024-04-19T02:21:00.187759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":830,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186236+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:21:00.186236+0000","last_peered":"2024-04-19T02:21:00.186236+0000","last_clean":"2024-04-19T02:21:00.186236+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:21:00.186236+0000","last_undegraded":"2024-04-19T02:21:00.186236+0000","last_fullsized":"2024-04-19T02:21:00.186236+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":440,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.186885+0000","last_change":"2024-04-19T02:20:35.197840+0000","last_active":"2024-04-19T02:21:00.186885+0000","last_peered":"2024-04-19T02:21:00.186885+0000","last_clean":"2024-04-19T02:21:00.186885+0000","last_became_active":"2024-04-19T02:20:35.196767+0000","last_became_peered":"2024-04-19T02:20:35.196767+0000","last_unstale":"2024-04-19T02:21:00.186885+0000","last_undegraded":"2024-04-19T02:21:00.186885+0000","last_fullsized":"2024-04-19T02:21:00.186885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:08.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":883,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185797+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:21:00.185797+0000","last_peered":"2024-04-19T02:21:00.185797+0000","last_clean":"2024-04-19T02:21:00.185797+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:21:00.185797+0000","last_undegraded":"2024-04-19T02:21:00.185797+0000","last_fullsized":"2024-04-19T02:21:00.185797+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":500,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.189000+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:00.189000+0000","last_peered":"2024-04-19T02:21:00.189000+0000","last_clean":"2024-04-19T02:21:00.189000+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:00.189000+0000","last_undegraded":"2024-04-19T02:21:00.189000+0000","last_fullsized":"2024-04-19T02:21:00.189000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":625,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.188008+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:00.188008+0000","last_peered":"2024-04-19T02:21:00.188008+0000","last_clean":"2024-04-19T02:21:00.188008+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:00.188008+0000","last_undegraded":"2024-04-19T02:21:00.188008+0000","last_fullsized":"2024-04-19T02:21:00.188008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187227+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:00.187227+0000","last_peered":"2024-04-19T02:21:00.187227+0000","last_clean":"2024-04-19T02:21:00.187227+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:00.187227+0000","last_undegraded":"2024-04-19T02:21:00.187227+0000","last_fullsized":"2024-04-19T02:21:00.187227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":986,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.185993+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:21:00.185993+0000","last_peered":"2024-04-19T02:21:00.185993+0000","last_clean":"2024-04-19T02:21:00.185993+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:21:00.185993+0000","last_undegraded":"2024-04-19T02:21:00.185993+0000","last_fullsized":"2024-04-19T02:21:00.185993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.187679+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:00.187679+0000","last_peered":"2024-04-19T02:21:00.187679+0000","last_clean":"2024-04-19T02:21:00.187679+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:00.187679+0000","last_undegraded":"2024-04-19T02:21:00.187679+0000","last_fullsized":"2024-04-19T02:21:00.187679+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":90845532,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142988,"kb_used_data":27448,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228852,"statfs":{"total":96636764160,"available":96490344448,"internally_reserved":0,"allocated":28106752,"data_stored":81632647,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":1,"up_from":78,"seq":335007449096,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66068,"kb_used_data":12296,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305772,"statfs":{"total":96636764160,"available":96569110528,"internally_reserved":0,"allocated":12591104,"data_stored":91916659,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139560,"kb_used_data":28116,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232280,"statfs":{"total":96636764160,"available":96493854720,"internally_reserved":0,"allocated":28790784,"data_stored":86255118,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:14.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-19T02:21:14.915 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a: {} 2024-04-19T02:21:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:21:14.924 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b: {} 2024-04-19T02:21:14.924 INFO:teuthology.orchestra.run.smithi073.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:21:14.933 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c: {} 2024-04-19T02:21:14.934 INFO:teuthology.orchestra.run.smithi073.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:21:14.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T02:21:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T02:21:15.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-19T02:21:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-19T02:21:16.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T02:21:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T02:21:17.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-19T02:21:18.443 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-19T02:21:18.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T02:21:19.445 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T02:21:19.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-19T02:21:20.460 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-19T02:21:20.485 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-19T02:21:20.485 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-19T02:21:20.485 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-19T02:21:20.485 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-19T02:21:20.485 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T02:21:20.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:21:20.777 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:20.777 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":116,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:21:20.450170+0000","last_up_change":"2024-04-19T02:20:29.461222+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":78,"up_thru":16,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1526},{"type":"v1","addr":"172.21.15.136:6801","nonce":1526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1526},{"type":"v1","addr":"172.21.15.136:6803","nonce":1526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1526},{"type":"v1","addr":"172.21.15.136:6807","nonce":1526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1526},{"type":"v1","addr":"172.21.15.136:6805","nonce":1526}]},"public_addr":"172.21.15.136:6801/1526","cluster_addr":"172.21.15.136:6803/1526","heartbeat_back_addr":"172.21.15.136:6807/1526","heartbeat_front_addr":"172.21.15.136:6805/1526","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":30},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1","osds":[2,0]},{"pgid":"4.3a","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:21:20.796 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T02:21:20.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:21:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:21.072 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":116,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:21:20.450170+0000","last_up_change":"2024-04-19T02:20:29.461222+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":78,"up_thru":16,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1526},{"type":"v1","addr":"172.21.15.136:6801","nonce":1526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1526},{"type":"v1","addr":"172.21.15.136:6803","nonce":1526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1526},{"type":"v1","addr":"172.21.15.136:6807","nonce":1526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1526},{"type":"v1","addr":"172.21.15.136:6805","nonce":1526}]},"public_addr":"172.21.15.136:6801/1526","cluster_addr":"172.21.15.136:6803/1526","heartbeat_back_addr":"172.21.15.136:6807/1526","heartbeat_front_addr":"172.21.15.136:6805/1526","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":30},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1","osds":[2,0]},{"pgid":"4.3a","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:21:21.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T02:21:21.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T02:21:21.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T02:21:21.245 INFO:teuthology.orchestra.run.smithi073.stdout:34359738435 2024-04-19T02:21:21.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:21:21.249 INFO:teuthology.orchestra.run.smithi073.stdout:34359738436 2024-04-19T02:21:21.250 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:21:21.270 INFO:teuthology.orchestra.run.smithi073.stdout:335007449100 2024-04-19T02:21:21.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:21:21.542 INFO:teuthology.orchestra.run.smithi073.stdout:34359738434 2024-04-19T02:21:21.546 INFO:teuthology.orchestra.run.smithi073.stdout:34359738435 2024-04-19T02:21:21.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738435 got 34359738434 for osd.2 2024-04-19T02:21:21.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738436 got 34359738435 for osd.0 2024-04-19T02:21:21.600 INFO:teuthology.orchestra.run.smithi073.stdout:335007449099 2024-04-19T02:21:21.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 335007449100 got 335007449099 for osd.1 2024-04-19T02:21:22.568 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:21:22.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:21:22.619 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:21:22.861 INFO:teuthology.orchestra.run.smithi073.stdout:34359738436 2024-04-19T02:21:22.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738436 got 34359738436 for osd.0 2024-04-19T02:21:22.885 DEBUG:teuthology.parallel:result is None 2024-04-19T02:21:22.888 INFO:teuthology.orchestra.run.smithi073.stdout:34359738435 2024-04-19T02:21:22.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738435 got 34359738435 for osd.2 2024-04-19T02:21:22.906 DEBUG:teuthology.parallel:result is None 2024-04-19T02:21:22.929 INFO:teuthology.orchestra.run.smithi073.stdout:335007449100 2024-04-19T02:21:22.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 335007449100 got 335007449100 for osd.1 2024-04-19T02:21:22.946 DEBUG:teuthology.parallel:result is None 2024-04-19T02:21:22.946 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T02:21:22.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:23.293 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-04-19T02:21:22.308305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7183,"num_bytes_recovered":68575575,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348744,"kb_used_data":67988,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766776,"statfs":{"total":289910292480,"available":289553178624,"internally_reserved":0,"allocated":69619712,"data_stored":259873064,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-22269957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001593"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":566,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319560+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.319560+0000","last_peered":"2024-04-19T02:21:20.319560+0000","last_clean":"2024-04-19T02:21:20.319560+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.319560+0000","last_undegraded":"2024-04-19T02:21:20.319560+0000","last_fullsized":"2024-04-19T02:21:20.319560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":592,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319147+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.319147+0000","last_peered":"2024-04-19T02:21:20.319147+0000","last_clean":"2024-04-19T02:21:20.319147+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.319147+0000","last_undegraded":"2024-04-19T02:21:20.319147+0000","last_fullsized":"2024-04-19T02:21:20.319147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":867,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377249+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:21:18.377249+0000","last_peered":"2024-04-19T02:21:18.377249+0000","last_clean":"2024-04-19T02:21:18.377249+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:21:18.377249+0000","last_undegraded":"2024-04-19T02:21:18.377249+0000","last_fullsized":"2024-04-19T02:21:18.377249+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":843,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443690+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:21:18.443690+0000","last_peered":"2024-04-19T02:21:18.443690+0000","last_clean":"2024-04-19T02:21:18.443690+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:21:18.443690+0000","last_undegraded":"2024-04-19T02:21:18.443690+0000","last_fullsized":"2024-04-19T02:21:18.443690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318430+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:20.318430+0000","last_peered":"2024-04-19T02:21:20.318430+0000","last_clean":"2024-04-19T02:21:20.318430+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:20.318430+0000","last_undegraded":"2024-04-19T02:21:20.318430+0000","last_fullsized":"2024-04-19T02:21:20.318430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":935,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375704+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:21:18.375704+0000","last_peered":"2024-04-19T02:21:18.375704+0000","last_clean":"2024-04-19T02:21:18.375704+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:21:18.375704+0000","last_undegraded":"2024-04-19T02:21:18.375704+0000","last_fullsized":"2024-04-19T02:21:18.375704+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":925,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442128+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:21:18.442128+0000","last_peered":"2024-04-19T02:21:18.442128+0000","last_clean":"2024-04-19T02:21:18.442128+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:21:18.442128+0000","last_undegraded":"2024-04-19T02:21:18.442128+0000","last_fullsized":"2024-04-19T02:21:18.442128+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":953,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442209+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:21:18.442209+0000","last_peered":"2024-04-19T02:21:18.442209+0000","last_clean":"2024-04-19T02:21:18.442209+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:21:18.442209+0000","last_undegraded":"2024-04-19T02:21:18.442209+0000","last_fullsized":"2024-04-19T02:21:18.442209+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":562,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446507+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:19.446507+0000","last_peered":"2024-04-19T02:21:19.446507+0000","last_clean":"2024-04-19T02:21:19.446507+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:19.446507+0000","last_undegraded":"2024-04-19T02:21:19.446507+0000","last_fullsized":"2024-04-19T02:21:19.446507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319379+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.319379+0000","last_peered":"2024-04-19T02:21:20.319379+0000","last_clean":"2024-04-19T02:21:20.319379+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.319379+0000","last_undegraded":"2024-04-19T02:21:20.319379+0000","last_fullsized":"2024-04-19T02:21:20.319379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":840,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443921+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:21:18.443921+0000","last_peered":"2024-04-19T02:21:18.443921+0000","last_clean":"2024-04-19T02:21:18.443921+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:21:18.443921+0000","last_undegraded":"2024-04-19T02:21:18.443921+0000","last_fullsized":"2024-04-19T02:21:18.443921+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":910,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318246+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.318246+0000","last_peered":"2024-04-19T02:21:20.318246+0000","last_clean":"2024-04-19T02:21:20.318246+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.318246+0000","last_undegraded":"2024-04-19T02:21:20.318246+0000","last_fullsized":"2024-04-19T02:21:20.318246+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317988+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.317988+0000","last_peered":"2024-04-19T02:21:20.317988+0000","last_clean":"2024-04-19T02:21:20.317988+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.317988+0000","last_undegraded":"2024-04-19T02:21:20.317988+0000","last_fullsized":"2024-04-19T02:21:20.317988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":903,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375142+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:21:18.375142+0000","last_peered":"2024-04-19T02:21:18.375142+0000","last_clean":"2024-04-19T02:21:18.375142+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:21:18.375142+0000","last_undegraded":"2024-04-19T02:21:18.375142+0000","last_fullsized":"2024-04-19T02:21:18.375142+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":923,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375475+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:21:18.375475+0000","last_peered":"2024-04-19T02:21:18.375475+0000","last_clean":"2024-04-19T02:21:18.375475+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:21:18.375475+0000","last_undegraded":"2024-04-19T02:21:18.375475+0000","last_fullsized":"2024-04-19T02:21:18.375475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1007,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442128+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:21:18.442128+0000","last_peered":"2024-04-19T02:21:18.442128+0000","last_clean":"2024-04-19T02:21:18.442128+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:21:18.442128+0000","last_undegraded":"2024-04-19T02:21:18.442128+0000","last_fullsized":"2024-04-19T02:21:18.442128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":560,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447329+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:19.447329+0000","last_peered":"2024-04-19T02:21:19.447329+0000","last_clean":"2024-04-19T02:21:19.447329+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:19.447329+0000","last_undegraded":"2024-04-19T02:21:19.447329+0000","last_fullsized":"2024-04-19T02:21:19.447329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319435+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.319435+0000","last_peered":"2024-04-19T02:21:20.319435+0000","last_clean":"2024-04-19T02:21:20.319435+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.319435+0000","last_undegraded":"2024-04-19T02:21:20.319435+0000","last_fullsized":"2024-04-19T02:21:20.319435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445733+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:19.445733+0000","last_peered":"2024-04-19T02:21:19.445733+0000","last_clean":"2024-04-19T02:21:19.445733+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:19.445733+0000","last_undegraded":"2024-04-19T02:21:19.445733+0000","last_fullsized":"2024-04-19T02:21:19.445733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":936,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443935+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:21:18.443935+0000","last_peered":"2024-04-19T02:21:18.443935+0000","last_clean":"2024-04-19T02:21:18.443935+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:21:18.443935+0000","last_undegraded":"2024-04-19T02:21:18.443935+0000","last_fullsized":"2024-04-19T02:21:18.443935+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":937,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443619+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:21:18.443619+0000","last_peered":"2024-04-19T02:21:18.443619+0000","last_clean":"2024-04-19T02:21:18.443619+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:21:18.443619+0000","last_undegraded":"2024-04-19T02:21:18.443619+0000","last_fullsized":"2024-04-19T02:21:18.443619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1121,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317875+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.317875+0000","last_peered":"2024-04-19T02:21:20.317875+0000","last_clean":"2024-04-19T02:21:20.317875+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.317875+0000","last_undegraded":"2024-04-19T02:21:20.317875+0000","last_fullsized":"2024-04-19T02:21:20.317875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":899,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444658+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:19.444658+0000","last_peered":"2024-04-19T02:21:19.444658+0000","last_clean":"2024-04-19T02:21:19.444658+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:19.444658+0000","last_undegraded":"2024-04-19T02:21:19.444658+0000","last_fullsized":"2024-04-19T02:21:19.444658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":568,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317193+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.317193+0000","last_peered":"2024-04-19T02:21:20.317193+0000","last_clean":"2024-04-19T02:21:20.317193+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.317193+0000","last_undegraded":"2024-04-19T02:21:20.317193+0000","last_fullsized":"2024-04-19T02:21:20.317193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":949,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319510+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.319510+0000","last_peered":"2024-04-19T02:21:20.319510+0000","last_clean":"2024-04-19T02:21:20.319510+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.319510+0000","last_undegraded":"2024-04-19T02:21:20.319510+0000","last_fullsized":"2024-04-19T02:21:20.319510+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1173,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446511+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:19.446511+0000","last_peered":"2024-04-19T02:21:19.446511+0000","last_clean":"2024-04-19T02:21:19.446511+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:19.446511+0000","last_undegraded":"2024-04-19T02:21:19.446511+0000","last_fullsized":"2024-04-19T02:21:19.446511+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":943,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.378244+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:21:18.378244+0000","last_peered":"2024-04-19T02:21:18.378244+0000","last_clean":"2024-04-19T02:21:18.378244+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:21:18.378244+0000","last_undegraded":"2024-04-19T02:21:18.378244+0000","last_fullsized":"2024-04-19T02:21:18.378244+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":815,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318807+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.318807+0000","last_peered":"2024-04-19T02:21:20.318807+0000","last_clean":"2024-04-19T02:21:20.318807+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.318807+0000","last_undegraded":"2024-04-19T02:21:20.318807+0000","last_fullsized":"2024-04-19T02:21:20.318807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":538,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446358+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:19.446358+0000","last_peered":"2024-04-19T02:21:19.446358+0000","last_clean":"2024-04-19T02:21:19.446358+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:19.446358+0000","last_undegraded":"2024-04-19T02:21:19.446358+0000","last_fullsized":"2024-04-19T02:21:19.446358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1076,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316697+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.316697+0000","last_peered":"2024-04-19T02:21:20.316697+0000","last_clean":"2024-04-19T02:21:20.316697+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.316697+0000","last_undegraded":"2024-04-19T02:21:20.316697+0000","last_fullsized":"2024-04-19T02:21:20.316697+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":615,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445684+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:19.445684+0000","last_peered":"2024-04-19T02:21:19.445684+0000","last_clean":"2024-04-19T02:21:19.445684+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:19.445684+0000","last_undegraded":"2024-04-19T02:21:19.445684+0000","last_fullsized":"2024-04-19T02:21:19.445684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":931,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442564+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:21:18.442564+0000","last_peered":"2024-04-19T02:21:18.442564+0000","last_clean":"2024-04-19T02:21:18.442564+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:21:18.442564+0000","last_undegraded":"2024-04-19T02:21:18.442564+0000","last_fullsized":"2024-04-19T02:21:18.442564+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":497,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318541+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.318541+0000","last_peered":"2024-04-19T02:21:20.318541+0000","last_clean":"2024-04-19T02:21:20.318541+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.318541+0000","last_undegraded":"2024-04-19T02:21:20.318541+0000","last_fullsized":"2024-04-19T02:21:20.318541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443334+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:21:18.443334+0000","last_peered":"2024-04-19T02:21:18.443334+0000","last_clean":"2024-04-19T02:21:18.443334+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:21:18.443334+0000","last_undegraded":"2024-04-19T02:21:18.443334+0000","last_fullsized":"2024-04-19T02:21:18.443334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":546,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319073+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.319073+0000","last_peered":"2024-04-19T02:21:20.319073+0000","last_clean":"2024-04-19T02:21:20.319073+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.319073+0000","last_undegraded":"2024-04-19T02:21:20.319073+0000","last_fullsized":"2024-04-19T02:21:20.319073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":187,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444971+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:19.444971+0000","last_peered":"2024-04-19T02:21:19.444971+0000","last_clean":"2024-04-19T02:21:19.444971+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:19.444971+0000","last_undegraded":"2024-04-19T02:21:19.444971+0000","last_fullsized":"2024-04-19T02:21:19.444971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1020,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447065+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:19.447065+0000","last_peered":"2024-04-19T02:21:19.447065+0000","last_clean":"2024-04-19T02:21:19.447065+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:19.447065+0000","last_undegraded":"2024-04-19T02:21:19.447065+0000","last_fullsized":"2024-04-19T02:21:19.447065+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":193,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317894+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.317894+0000","last_peered":"2024-04-19T02:21:20.317894+0000","last_clean":"2024-04-19T02:21:20.317894+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.317894+0000","last_undegraded":"2024-04-19T02:21:20.317894+0000","last_fullsized":"2024-04-19T02:21:20.317894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":909,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446488+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:19.446488+0000","last_peered":"2024-04-19T02:21:19.446488+0000","last_clean":"2024-04-19T02:21:19.446488+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:19.446488+0000","last_undegraded":"2024-04-19T02:21:19.446488+0000","last_fullsized":"2024-04-19T02:21:19.446488+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":163,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375615+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:21:18.375615+0000","last_peered":"2024-04-19T02:21:18.375615+0000","last_clean":"2024-04-19T02:21:18.375615+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:21:18.375615+0000","last_undegraded":"2024-04-19T02:21:18.375615+0000","last_fullsized":"2024-04-19T02:21:18.375615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":287,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.378029+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:21:18.378029+0000","last_peered":"2024-04-19T02:21:18.378029+0000","last_clean":"2024-04-19T02:21:18.378029+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:21:18.378029+0000","last_undegraded":"2024-04-19T02:21:18.378029+0000","last_fullsized":"2024-04-19T02:21:18.378029+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":894,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317362+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.317362+0000","last_peered":"2024-04-19T02:21:20.317362+0000","last_clean":"2024-04-19T02:21:20.317362+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.317362+0000","last_undegraded":"2024-04-19T02:21:20.317362+0000","last_fullsized":"2024-04-19T02:21:20.317362+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":429,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319685+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.319685+0000","last_peered":"2024-04-19T02:21:20.319685+0000","last_clean":"2024-04-19T02:21:20.319685+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.319685+0000","last_undegraded":"2024-04-19T02:21:20.319685+0000","last_fullsized":"2024-04-19T02:21:20.319685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":566,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317545+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.317545+0000","last_peered":"2024-04-19T02:21:20.317545+0000","last_clean":"2024-04-19T02:21:20.317545+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.317545+0000","last_undegraded":"2024-04-19T02:21:20.317545+0000","last_fullsized":"2024-04-19T02:21:20.317545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":716,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377764+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:21:18.377764+0000","last_peered":"2024-04-19T02:21:18.377764+0000","last_clean":"2024-04-19T02:21:18.377764+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:21:18.377764+0000","last_undegraded":"2024-04-19T02:21:18.377764+0000","last_fullsized":"2024-04-19T02:21:18.377764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":896,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442820+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:21:18.442820+0000","last_peered":"2024-04-19T02:21:18.442820+0000","last_clean":"2024-04-19T02:21:18.442820+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:21:18.442820+0000","last_undegraded":"2024-04-19T02:21:18.442820+0000","last_fullsized":"2024-04-19T02:21:18.442820+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":155,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.444214+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:21:18.444214+0000","last_peered":"2024-04-19T02:21:18.444214+0000","last_clean":"2024-04-19T02:21:18.444214+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:21:18.444214+0000","last_undegraded":"2024-04-19T02:21:18.444214+0000","last_fullsized":"2024-04-19T02:21:18.444214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1081,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445096+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:19.445096+0000","last_peered":"2024-04-19T02:21:19.445096+0000","last_clean":"2024-04-19T02:21:19.445096+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:19.445096+0000","last_undegraded":"2024-04-19T02:21:19.445096+0000","last_fullsized":"2024-04-19T02:21:19.445096+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":269,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446744+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:19.446744+0000","last_peered":"2024-04-19T02:21:19.446744+0000","last_clean":"2024-04-19T02:21:19.446744+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:19.446744+0000","last_undegraded":"2024-04-19T02:21:19.446744+0000","last_fullsized":"2024-04-19T02:21:19.446744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":966,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443851+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:21:18.443851+0000","last_peered":"2024-04-19T02:21:18.443851+0000","last_clean":"2024-04-19T02:21:18.443851+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:21:18.443851+0000","last_undegraded":"2024-04-19T02:21:18.443851+0000","last_fullsized":"2024-04-19T02:21:18.443851+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":268,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.303318+0000","last_change":"2024-04-19T02:21:20.303318+0000","last_active":"2024-04-19T02:20:29.476347+0000","last_peered":"2024-04-19T02:20:28.470100+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.470775+0000","last_became_peered":"2024-04-19T02:17:12.470775+0000","last_unstale":"2024-04-19T02:21:20.303318+0000","last_undegraded":"2024-04-19T02:21:20.303318+0000","last_fullsized":"2024-04-19T02:21:20.303318+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":987,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377970+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:21:18.377970+0000","last_peered":"2024-04-19T02:21:18.377970+0000","last_clean":"2024-04-19T02:21:18.377970+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:21:18.377970+0000","last_undegraded":"2024-04-19T02:21:18.377970+0000","last_fullsized":"2024-04-19T02:21:18.377970+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317853+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.317853+0000","last_peered":"2024-04-19T02:21:20.317853+0000","last_clean":"2024-04-19T02:21:20.317853+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.317853+0000","last_undegraded":"2024-04-19T02:21:20.317853+0000","last_fullsized":"2024-04-19T02:21:20.317853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":818,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.376759+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:21:18.376759+0000","last_peered":"2024-04-19T02:21:18.376759+0000","last_clean":"2024-04-19T02:21:18.376759+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:21:18.376759+0000","last_undegraded":"2024-04-19T02:21:18.376759+0000","last_fullsized":"2024-04-19T02:21:18.376759+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":501,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316611+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.316611+0000","last_peered":"2024-04-19T02:21:20.316611+0000","last_clean":"2024-04-19T02:21:20.316611+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.316611+0000","last_undegraded":"2024-04-19T02:21:20.316611+0000","last_fullsized":"2024-04-19T02:21:20.316611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":530,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446842+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:19.446842+0000","last_peered":"2024-04-19T02:21:19.446842+0000","last_clean":"2024-04-19T02:21:19.446842+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:19.446842+0000","last_undegraded":"2024-04-19T02:21:19.446842+0000","last_fullsized":"2024-04-19T02:21:19.446842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":303,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.376459+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:21:18.376459+0000","last_peered":"2024-04-19T02:21:18.376459+0000","last_clean":"2024-04-19T02:21:18.376459+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:21:18.376459+0000","last_undegraded":"2024-04-19T02:21:18.376459+0000","last_fullsized":"2024-04-19T02:21:18.376459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":60,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.287071+0000","last_change":"2024-04-19T02:20:29.496650+0000","last_active":"2024-04-19T02:20:29.496416+0000","last_peered":"2024-04-19T02:20:28.472748+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.483202+0000","last_became_peered":"2024-04-19T02:17:12.483202+0000","last_unstale":"2024-04-19T02:21:20.287071+0000","last_undegraded":"2024-04-19T02:21:20.287071+0000","last_fullsized":"2024-04-19T02:21:20.287071+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":872,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445604+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:19.445604+0000","last_peered":"2024-04-19T02:21:19.445604+0000","last_clean":"2024-04-19T02:21:19.445604+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:19.445604+0000","last_undegraded":"2024-04-19T02:21:19.445604+0000","last_fullsized":"2024-04-19T02:21:19.445604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":966,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377670+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:21:18.377670+0000","last_peered":"2024-04-19T02:21:18.377670+0000","last_clean":"2024-04-19T02:21:18.377670+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:21:18.377670+0000","last_undegraded":"2024-04-19T02:21:18.377670+0000","last_fullsized":"2024-04-19T02:21:18.377670+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.376114+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:21:18.376114+0000","last_peered":"2024-04-19T02:21:18.376114+0000","last_clean":"2024-04-19T02:21:18.376114+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:21:18.376114+0000","last_undegraded":"2024-04-19T02:21:18.376114+0000","last_fullsized":"2024-04-19T02:21:18.376114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":309,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445970+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:19.445970+0000","last_peered":"2024-04-19T02:21:19.445970+0000","last_clean":"2024-04-19T02:21:19.445970+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:19.445970+0000","last_undegraded":"2024-04-19T02:21:19.445970+0000","last_fullsized":"2024-04-19T02:21:19.445970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":555,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319678+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.319678+0000","last_peered":"2024-04-19T02:21:20.319678+0000","last_clean":"2024-04-19T02:21:20.319678+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.319678+0000","last_undegraded":"2024-04-19T02:21:20.319678+0000","last_fullsized":"2024-04-19T02:21:20.319678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446123+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:19.446123+0000","last_peered":"2024-04-19T02:21:19.446123+0000","last_clean":"2024-04-19T02:21:19.446123+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:19.446123+0000","last_undegraded":"2024-04-19T02:21:19.446123+0000","last_fullsized":"2024-04-19T02:21:19.446123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":522,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318328+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.318328+0000","last_peered":"2024-04-19T02:21:20.318328+0000","last_clean":"2024-04-19T02:21:20.318328+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.318328+0000","last_undegraded":"2024-04-19T02:21:20.318328+0000","last_fullsized":"2024-04-19T02:21:20.318328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":467,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446930+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:19.446930+0000","last_peered":"2024-04-19T02:21:19.446930+0000","last_clean":"2024-04-19T02:21:19.446930+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:19.446930+0000","last_undegraded":"2024-04-19T02:21:19.446930+0000","last_fullsized":"2024-04-19T02:21:19.446930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443298+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:21:18.443298+0000","last_peered":"2024-04-19T02:21:18.443298+0000","last_clean":"2024-04-19T02:21:18.443298+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:21:18.443298+0000","last_undegraded":"2024-04-19T02:21:18.443298+0000","last_fullsized":"2024-04-19T02:21:18.443298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":128,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.296172+0000","last_change":"2024-04-19T02:20:29.492758+0000","last_active":"2024-04-19T02:20:29.492282+0000","last_peered":"2024-04-19T02:20:28.471566+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480849+0000","last_became_peered":"2024-04-19T02:17:12.480849+0000","last_unstale":"2024-04-19T02:21:20.296172+0000","last_undegraded":"2024-04-19T02:21:20.296172+0000","last_fullsized":"2024-04-19T02:21:20.296172+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":568,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445838+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:19.445838+0000","last_peered":"2024-04-19T02:21:19.445838+0000","last_clean":"2024-04-19T02:21:19.445838+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:19.445838+0000","last_undegraded":"2024-04-19T02:21:19.445838+0000","last_fullsized":"2024-04-19T02:21:19.445838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":521,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.284478+0000","last_change":"2024-04-19T02:21:20.284478+0000","last_active":"2024-04-19T02:20:29.482637+0000","last_peered":"2024-04-19T02:20:28.472648+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.475695+0000","last_became_peered":"2024-04-19T02:17:12.475695+0000","last_unstale":"2024-04-19T02:21:20.284478+0000","last_undegraded":"2024-04-19T02:21:20.284478+0000","last_fullsized":"2024-04-19T02:21:20.284478+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446667+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:19.446667+0000","last_peered":"2024-04-19T02:21:19.446667+0000","last_clean":"2024-04-19T02:21:19.446667+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:19.446667+0000","last_undegraded":"2024-04-19T02:21:19.446667+0000","last_fullsized":"2024-04-19T02:21:19.446667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":856,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318127+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.318127+0000","last_peered":"2024-04-19T02:21:20.318127+0000","last_clean":"2024-04-19T02:21:20.318127+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.318127+0000","last_undegraded":"2024-04-19T02:21:20.318127+0000","last_fullsized":"2024-04-19T02:21:20.318127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":166,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446672+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:19.446672+0000","last_peered":"2024-04-19T02:21:19.446672+0000","last_clean":"2024-04-19T02:21:19.446672+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:19.446672+0000","last_undegraded":"2024-04-19T02:21:19.446672+0000","last_fullsized":"2024-04-19T02:21:19.446672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319600+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.319600+0000","last_peered":"2024-04-19T02:21:20.319600+0000","last_clean":"2024-04-19T02:21:20.319600+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.319600+0000","last_undegraded":"2024-04-19T02:21:20.319600+0000","last_fullsized":"2024-04-19T02:21:20.319600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":973,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318383+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.318383+0000","last_peered":"2024-04-19T02:21:20.318383+0000","last_clean":"2024-04-19T02:21:20.318383+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.318383+0000","last_undegraded":"2024-04-19T02:21:20.318383+0000","last_fullsized":"2024-04-19T02:21:20.318383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":176,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447475+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:19.447475+0000","last_peered":"2024-04-19T02:21:19.447475+0000","last_clean":"2024-04-19T02:21:19.447475+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:19.447475+0000","last_undegraded":"2024-04-19T02:21:19.447475+0000","last_fullsized":"2024-04-19T02:21:19.447475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447284+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:19.447284+0000","last_peered":"2024-04-19T02:21:19.447284+0000","last_clean":"2024-04-19T02:21:19.447284+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:19.447284+0000","last_undegraded":"2024-04-19T02:21:19.447284+0000","last_fullsized":"2024-04-19T02:21:19.447284+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":950,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445018+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:19.445018+0000","last_peered":"2024-04-19T02:21:19.445018+0000","last_clean":"2024-04-19T02:21:19.445018+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:19.445018+0000","last_undegraded":"2024-04-19T02:21:19.445018+0000","last_fullsized":"2024-04-19T02:21:19.445018+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":203,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447195+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:19.447195+0000","last_peered":"2024-04-19T02:21:19.447195+0000","last_clean":"2024-04-19T02:21:19.447195+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:19.447195+0000","last_undegraded":"2024-04-19T02:21:19.447195+0000","last_fullsized":"2024-04-19T02:21:19.447195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.295523+0000","last_change":"2024-04-19T02:20:29.486433+0000","last_active":"2024-04-19T02:20:29.485809+0000","last_peered":"2024-04-19T02:20:28.473951+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.473583+0000","last_became_peered":"2024-04-19T02:17:12.473583+0000","last_unstale":"2024-04-19T02:21:20.295523+0000","last_undegraded":"2024-04-19T02:21:20.295523+0000","last_fullsized":"2024-04-19T02:21:20.295523+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444423+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:19.444423+0000","last_peered":"2024-04-19T02:21:19.444423+0000","last_clean":"2024-04-19T02:21:19.444423+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:19.444423+0000","last_undegraded":"2024-04-19T02:21:19.444423+0000","last_fullsized":"2024-04-19T02:21:19.444423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":877,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375950+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:21:18.375950+0000","last_peered":"2024-04-19T02:21:18.375950+0000","last_clean":"2024-04-19T02:21:18.375950+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:21:18.375950+0000","last_undegraded":"2024-04-19T02:21:18.375950+0000","last_fullsized":"2024-04-19T02:21:18.375950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":524,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.301461+0000","last_change":"2024-04-19T02:21:20.301461+0000","last_active":"2024-04-19T02:20:29.482560+0000","last_peered":"2024-04-19T02:20:28.471129+0000","last_clean":"2024-04-19T02:16:54.341172+0000","last_became_active":"2024-04-19T02:17:12.468266+0000","last_became_peered":"2024-04-19T02:17:12.468266+0000","last_unstale":"2024-04-19T02:21:20.301461+0000","last_undegraded":"2024-04-19T02:21:20.301461+0000","last_fullsized":"2024-04-19T02:21:20.301461+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":554,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444675+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:19.444675+0000","last_peered":"2024-04-19T02:21:19.444675+0000","last_clean":"2024-04-19T02:21:19.444675+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:19.444675+0000","last_undegraded":"2024-04-19T02:21:19.444675+0000","last_fullsized":"2024-04-19T02:21:19.444675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":215,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319334+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.319334+0000","last_peered":"2024-04-19T02:21:20.319334+0000","last_clean":"2024-04-19T02:21:20.319334+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.319334+0000","last_undegraded":"2024-04-19T02:21:20.319334+0000","last_fullsized":"2024-04-19T02:21:20.319334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":435,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.444752+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:21:18.444752+0000","last_peered":"2024-04-19T02:21:18.444752+0000","last_clean":"2024-04-19T02:21:18.444752+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:21:18.444752+0000","last_undegraded":"2024-04-19T02:21:18.444752+0000","last_fullsized":"2024-04-19T02:21:18.444752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1018,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444920+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:19.444920+0000","last_peered":"2024-04-19T02:21:19.444920+0000","last_clean":"2024-04-19T02:21:19.444920+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:19.444920+0000","last_undegraded":"2024-04-19T02:21:19.444920+0000","last_fullsized":"2024-04-19T02:21:19.444920+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447357+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:19.447357+0000","last_peered":"2024-04-19T02:21:19.447357+0000","last_clean":"2024-04-19T02:21:19.447357+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:19.447357+0000","last_undegraded":"2024-04-19T02:21:19.447357+0000","last_fullsized":"2024-04-19T02:21:19.447357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":628,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444907+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:19.444907+0000","last_peered":"2024-04-19T02:21:19.444907+0000","last_clean":"2024-04-19T02:21:19.444907+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:19.444907+0000","last_undegraded":"2024-04-19T02:21:19.444907+0000","last_fullsized":"2024-04-19T02:21:19.444907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":917,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316736+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.316736+0000","last_peered":"2024-04-19T02:21:20.316736+0000","last_clean":"2024-04-19T02:21:20.316736+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.316736+0000","last_undegraded":"2024-04-19T02:21:20.316736+0000","last_fullsized":"2024-04-19T02:21:20.316736+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":682,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445725+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:19.445725+0000","last_peered":"2024-04-19T02:21:19.445725+0000","last_clean":"2024-04-19T02:21:19.445725+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:19.445725+0000","last_undegraded":"2024-04-19T02:21:19.445725+0000","last_fullsized":"2024-04-19T02:21:19.445725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":942,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446472+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:19.446472+0000","last_peered":"2024-04-19T02:21:19.446472+0000","last_clean":"2024-04-19T02:21:19.446472+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:19.446472+0000","last_undegraded":"2024-04-19T02:21:19.446472+0000","last_fullsized":"2024-04-19T02:21:19.446472+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":460,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445345+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:19.445345+0000","last_peered":"2024-04-19T02:21:19.445345+0000","last_clean":"2024-04-19T02:21:19.445345+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:19.445345+0000","last_undegraded":"2024-04-19T02:21:19.445345+0000","last_fullsized":"2024-04-19T02:21:19.445345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":859,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318609+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:20.318609+0000","last_peered":"2024-04-19T02:21:20.318609+0000","last_clean":"2024-04-19T02:21:20.318609+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:20.318609+0000","last_undegraded":"2024-04-19T02:21:20.318609+0000","last_fullsized":"2024-04-19T02:21:20.318609+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":607,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462735+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:20.462735+0000","last_peered":"2024-04-19T02:21:20.462735+0000","last_clean":"2024-04-19T02:21:20.462735+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:20.462735+0000","last_undegraded":"2024-04-19T02:21:20.462735+0000","last_fullsized":"2024-04-19T02:21:20.462735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":548,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318531+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:20.318531+0000","last_peered":"2024-04-19T02:21:20.318531+0000","last_clean":"2024-04-19T02:21:20.318531+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:20.318531+0000","last_undegraded":"2024-04-19T02:21:20.318531+0000","last_fullsized":"2024-04-19T02:21:20.318531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318583+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:20.318583+0000","last_peered":"2024-04-19T02:21:20.318583+0000","last_clean":"2024-04-19T02:21:20.318583+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:20.318583+0000","last_undegraded":"2024-04-19T02:21:20.318583+0000","last_fullsized":"2024-04-19T02:21:20.318583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":835,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442700+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:21:18.442700+0000","last_peered":"2024-04-19T02:21:18.442700+0000","last_clean":"2024-04-19T02:21:18.442700+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:21:18.442700+0000","last_undegraded":"2024-04-19T02:21:18.442700+0000","last_fullsized":"2024-04-19T02:21:18.442700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":395,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.306353+0000","last_change":"2024-04-19T02:21:20.306353+0000","last_active":"2024-04-19T02:20:29.490295+0000","last_peered":"2024-04-19T02:20:28.473037+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:17:12.478521+0000","last_became_peered":"2024-04-19T02:17:12.478521+0000","last_unstale":"2024-04-19T02:21:20.306353+0000","last_undegraded":"2024-04-19T02:21:20.306353+0000","last_fullsized":"2024-04-19T02:21:20.306353+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":888,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442525+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:21:18.442525+0000","last_peered":"2024-04-19T02:21:18.442525+0000","last_clean":"2024-04-19T02:21:18.442525+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:21:18.442525+0000","last_undegraded":"2024-04-19T02:21:18.442525+0000","last_fullsized":"2024-04-19T02:21:18.442525+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":506,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319052+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:20.319052+0000","last_peered":"2024-04-19T02:21:20.319052+0000","last_clean":"2024-04-19T02:21:20.319052+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:20.319052+0000","last_undegraded":"2024-04-19T02:21:20.319052+0000","last_fullsized":"2024-04-19T02:21:20.319052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":632,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318135+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.318135+0000","last_peered":"2024-04-19T02:21:20.318135+0000","last_clean":"2024-04-19T02:21:20.318135+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.318135+0000","last_undegraded":"2024-04-19T02:21:20.318135+0000","last_fullsized":"2024-04-19T02:21:20.318135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":178,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446932+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:19.446932+0000","last_peered":"2024-04-19T02:21:19.446932+0000","last_clean":"2024-04-19T02:21:19.446932+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:19.446932+0000","last_undegraded":"2024-04-19T02:21:19.446932+0000","last_fullsized":"2024-04-19T02:21:19.446932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":991,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442419+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:21:18.442419+0000","last_peered":"2024-04-19T02:21:18.442419+0000","last_clean":"2024-04-19T02:21:18.442419+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:21:18.442419+0000","last_undegraded":"2024-04-19T02:21:18.442419+0000","last_fullsized":"2024-04-19T02:21:18.442419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":180,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447110+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:19.447110+0000","last_peered":"2024-04-19T02:21:19.447110+0000","last_clean":"2024-04-19T02:21:19.447110+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:19.447110+0000","last_undegraded":"2024-04-19T02:21:19.447110+0000","last_fullsized":"2024-04-19T02:21:19.447110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":68575575,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738435,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143028,"kb_used_data":27496,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228812,"statfs":{"total":96636764160,"available":96490303488,"internally_reserved":0,"allocated":28155904,"data_stored":81658387,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":78,"seq":335007449100,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66124,"kb_used_data":12344,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305716,"statfs":{"total":96636764160,"available":96569053184,"internally_reserved":0,"allocated":12640256,"data_stored":91942399,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139592,"kb_used_data":28148,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232248,"statfs":{"total":96636764160,"available":96493821952,"internally_reserved":0,"allocated":28823552,"data_stored":86272278,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:23.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:23.642 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:23.658 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-04-19T02:21:22.308305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7183,"num_bytes_recovered":68575575,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348744,"kb_used_data":67988,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766776,"statfs":{"total":289910292480,"available":289553178624,"internally_reserved":0,"allocated":69619712,"data_stored":259873064,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-22269957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001593"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":566,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319560+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.319560+0000","last_peered":"2024-04-19T02:21:20.319560+0000","last_clean":"2024-04-19T02:21:20.319560+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.319560+0000","last_undegraded":"2024-04-19T02:21:20.319560+0000","last_fullsized":"2024-04-19T02:21:20.319560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":592,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319147+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.319147+0000","last_peered":"2024-04-19T02:21:20.319147+0000","last_clean":"2024-04-19T02:21:20.319147+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.319147+0000","last_undegraded":"2024-04-19T02:21:20.319147+0000","last_fullsized":"2024-04-19T02:21:20.319147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":867,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377249+0000","last_change":"2024-04-19T02:20:57.238132+0000","last_active":"2024-04-19T02:21:18.377249+0000","last_peered":"2024-04-19T02:21:18.377249+0000","last_clean":"2024-04-19T02:21:18.377249+0000","last_became_active":"2024-04-19T02:20:57.235206+0000","last_became_peered":"2024-04-19T02:20:57.235206+0000","last_unstale":"2024-04-19T02:21:18.377249+0000","last_undegraded":"2024-04-19T02:21:18.377249+0000","last_fullsized":"2024-04-19T02:21:18.377249+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:33.934325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":843,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443690+0000","last_change":"2024-04-19T02:20:39.191757+0000","last_active":"2024-04-19T02:21:18.443690+0000","last_peered":"2024-04-19T02:21:18.443690+0000","last_clean":"2024-04-19T02:21:18.443690+0000","last_became_active":"2024-04-19T02:20:39.188939+0000","last_became_peered":"2024-04-19T02:20:39.188939+0000","last_unstale":"2024-04-19T02:21:18.443690+0000","last_undegraded":"2024-04-19T02:21:18.443690+0000","last_fullsized":"2024-04-19T02:21:18.443690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318430+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:20.318430+0000","last_peered":"2024-04-19T02:21:20.318430+0000","last_clean":"2024-04-19T02:21:20.318430+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:20.318430+0000","last_undegraded":"2024-04-19T02:21:20.318430+0000","last_fullsized":"2024-04-19T02:21:20.318430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":935,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375704+0000","last_change":"2024-04-19T02:20:45.204669+0000","last_active":"2024-04-19T02:21:18.375704+0000","last_peered":"2024-04-19T02:21:18.375704+0000","last_clean":"2024-04-19T02:21:18.375704+0000","last_became_active":"2024-04-19T02:20:45.201646+0000","last_became_peered":"2024-04-19T02:20:45.201646+0000","last_unstale":"2024-04-19T02:21:18.375704+0000","last_undegraded":"2024-04-19T02:21:18.375704+0000","last_fullsized":"2024-04-19T02:21:18.375704+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:18.780440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":925,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442128+0000","last_change":"2024-04-19T02:20:37.203666+0000","last_active":"2024-04-19T02:21:18.442128+0000","last_peered":"2024-04-19T02:21:18.442128+0000","last_clean":"2024-04-19T02:21:18.442128+0000","last_became_active":"2024-04-19T02:20:37.200741+0000","last_became_peered":"2024-04-19T02:20:37.200741+0000","last_unstale":"2024-04-19T02:21:18.442128+0000","last_undegraded":"2024-04-19T02:21:18.442128+0000","last_fullsized":"2024-04-19T02:21:18.442128+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:02:41.104183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":953,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442209+0000","last_change":"2024-04-19T02:20:40.191164+0000","last_active":"2024-04-19T02:21:18.442209+0000","last_peered":"2024-04-19T02:21:18.442209+0000","last_clean":"2024-04-19T02:21:18.442209+0000","last_became_active":"2024-04-19T02:20:40.188438+0000","last_became_peered":"2024-04-19T02:20:40.188438+0000","last_unstale":"2024-04-19T02:21:18.442209+0000","last_undegraded":"2024-04-19T02:21:18.442209+0000","last_fullsized":"2024-04-19T02:21:18.442209+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":562,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446507+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:19.446507+0000","last_peered":"2024-04-19T02:21:19.446507+0000","last_clean":"2024-04-19T02:21:19.446507+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:19.446507+0000","last_undegraded":"2024-04-19T02:21:19.446507+0000","last_fullsized":"2024-04-19T02:21:19.446507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319379+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.319379+0000","last_peered":"2024-04-19T02:21:20.319379+0000","last_clean":"2024-04-19T02:21:20.319379+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.319379+0000","last_undegraded":"2024-04-19T02:21:20.319379+0000","last_fullsized":"2024-04-19T02:21:20.319379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":840,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443921+0000","last_change":"2024-04-19T02:20:48.197954+0000","last_active":"2024-04-19T02:21:18.443921+0000","last_peered":"2024-04-19T02:21:18.443921+0000","last_clean":"2024-04-19T02:21:18.443921+0000","last_became_active":"2024-04-19T02:20:48.194964+0000","last_became_peered":"2024-04-19T02:20:48.194964+0000","last_unstale":"2024-04-19T02:21:18.443921+0000","last_undegraded":"2024-04-19T02:21:18.443921+0000","last_fullsized":"2024-04-19T02:21:18.443921+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:03.003344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":910,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318246+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.318246+0000","last_peered":"2024-04-19T02:21:20.318246+0000","last_clean":"2024-04-19T02:21:20.318246+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.318246+0000","last_undegraded":"2024-04-19T02:21:20.318246+0000","last_fullsized":"2024-04-19T02:21:20.318246+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317988+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.317988+0000","last_peered":"2024-04-19T02:21:20.317988+0000","last_clean":"2024-04-19T02:21:20.317988+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.317988+0000","last_undegraded":"2024-04-19T02:21:20.317988+0000","last_fullsized":"2024-04-19T02:21:20.317988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":903,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375142+0000","last_change":"2024-04-19T02:20:54.208376+0000","last_active":"2024-04-19T02:21:18.375142+0000","last_peered":"2024-04-19T02:21:18.375142+0000","last_clean":"2024-04-19T02:21:18.375142+0000","last_became_active":"2024-04-19T02:20:54.202308+0000","last_became_peered":"2024-04-19T02:20:54.202308+0000","last_unstale":"2024-04-19T02:21:18.375142+0000","last_undegraded":"2024-04-19T02:21:18.375142+0000","last_fullsized":"2024-04-19T02:21:18.375142+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:26.202035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":923,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375475+0000","last_change":"2024-04-19T02:20:36.199896+0000","last_active":"2024-04-19T02:21:18.375475+0000","last_peered":"2024-04-19T02:21:18.375475+0000","last_clean":"2024-04-19T02:21:18.375475+0000","last_became_active":"2024-04-19T02:20:36.196717+0000","last_became_peered":"2024-04-19T02:20:36.196717+0000","last_unstale":"2024-04-19T02:21:18.375475+0000","last_undegraded":"2024-04-19T02:21:18.375475+0000","last_fullsized":"2024-04-19T02:21:18.375475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:37:17.304877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":1007,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442128+0000","last_change":"2024-04-19T02:20:42.205322+0000","last_active":"2024-04-19T02:21:18.442128+0000","last_peered":"2024-04-19T02:21:18.442128+0000","last_clean":"2024-04-19T02:21:18.442128+0000","last_became_active":"2024-04-19T02:20:42.201849+0000","last_became_peered":"2024-04-19T02:20:42.201849+0000","last_unstale":"2024-04-19T02:21:18.442128+0000","last_undegraded":"2024-04-19T02:21:18.442128+0000","last_fullsized":"2024-04-19T02:21:18.442128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:13.386154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":560,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447329+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:19.447329+0000","last_peered":"2024-04-19T02:21:19.447329+0000","last_clean":"2024-04-19T02:21:19.447329+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:19.447329+0000","last_undegraded":"2024-04-19T02:21:19.447329+0000","last_fullsized":"2024-04-19T02:21:19.447329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319435+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.319435+0000","last_peered":"2024-04-19T02:21:20.319435+0000","last_clean":"2024-04-19T02:21:20.319435+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.319435+0000","last_undegraded":"2024-04-19T02:21:20.319435+0000","last_fullsized":"2024-04-19T02:21:20.319435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445733+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:19.445733+0000","last_peered":"2024-04-19T02:21:19.445733+0000","last_clean":"2024-04-19T02:21:19.445733+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:19.445733+0000","last_undegraded":"2024-04-19T02:21:19.445733+0000","last_fullsized":"2024-04-19T02:21:19.445733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":936,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443935+0000","last_change":"2024-04-19T02:20:43.200104+0000","last_active":"2024-04-19T02:21:18.443935+0000","last_peered":"2024-04-19T02:21:18.443935+0000","last_clean":"2024-04-19T02:21:18.443935+0000","last_became_active":"2024-04-19T02:20:43.194557+0000","last_became_peered":"2024-04-19T02:20:43.194557+0000","last_unstale":"2024-04-19T02:21:18.443935+0000","last_undegraded":"2024-04-19T02:21:18.443935+0000","last_fullsized":"2024-04-19T02:21:18.443935+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:54.960110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":937,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443619+0000","last_change":"2024-04-19T02:20:52.196370+0000","last_active":"2024-04-19T02:21:18.443619+0000","last_peered":"2024-04-19T02:21:18.443619+0000","last_clean":"2024-04-19T02:21:18.443619+0000","last_became_active":"2024-04-19T02:20:52.193525+0000","last_became_peered":"2024-04-19T02:20:52.193525+0000","last_unstale":"2024-04-19T02:21:18.443619+0000","last_undegraded":"2024-04-19T02:21:18.443619+0000","last_fullsized":"2024-04-19T02:21:18.443619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:37.056549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1121,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317875+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.317875+0000","last_peered":"2024-04-19T02:21:20.317875+0000","last_clean":"2024-04-19T02:21:20.317875+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.317875+0000","last_undegraded":"2024-04-19T02:21:20.317875+0000","last_fullsized":"2024-04-19T02:21:20.317875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":899,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444658+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:19.444658+0000","last_peered":"2024-04-19T02:21:19.444658+0000","last_clean":"2024-04-19T02:21:19.444658+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:19.444658+0000","last_undegraded":"2024-04-19T02:21:19.444658+0000","last_fullsized":"2024-04-19T02:21:19.444658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":568,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317193+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.317193+0000","last_peered":"2024-04-19T02:21:20.317193+0000","last_clean":"2024-04-19T02:21:20.317193+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.317193+0000","last_undegraded":"2024-04-19T02:21:20.317193+0000","last_fullsized":"2024-04-19T02:21:20.317193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":949,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319510+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.319510+0000","last_peered":"2024-04-19T02:21:20.319510+0000","last_clean":"2024-04-19T02:21:20.319510+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.319510+0000","last_undegraded":"2024-04-19T02:21:20.319510+0000","last_fullsized":"2024-04-19T02:21:20.319510+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1173,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446511+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:19.446511+0000","last_peered":"2024-04-19T02:21:19.446511+0000","last_clean":"2024-04-19T02:21:19.446511+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:19.446511+0000","last_undegraded":"2024-04-19T02:21:19.446511+0000","last_fullsized":"2024-04-19T02:21:19.446511+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":943,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.378244+0000","last_change":"2024-04-19T02:20:51.203753+0000","last_active":"2024-04-19T02:21:18.378244+0000","last_peered":"2024-04-19T02:21:18.378244+0000","last_clean":"2024-04-19T02:21:18.378244+0000","last_became_active":"2024-04-19T02:20:51.200809+0000","last_became_peered":"2024-04-19T02:20:51.200809+0000","last_unstale":"2024-04-19T02:21:18.378244+0000","last_undegraded":"2024-04-19T02:21:18.378244+0000","last_fullsized":"2024-04-19T02:21:18.378244+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:19.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":815,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318807+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.318807+0000","last_peered":"2024-04-19T02:21:20.318807+0000","last_clean":"2024-04-19T02:21:20.318807+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.318807+0000","last_undegraded":"2024-04-19T02:21:20.318807+0000","last_fullsized":"2024-04-19T02:21:20.318807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":538,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446358+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:19.446358+0000","last_peered":"2024-04-19T02:21:19.446358+0000","last_clean":"2024-04-19T02:21:19.446358+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:19.446358+0000","last_undegraded":"2024-04-19T02:21:19.446358+0000","last_fullsized":"2024-04-19T02:21:19.446358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1076,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316697+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.316697+0000","last_peered":"2024-04-19T02:21:20.316697+0000","last_clean":"2024-04-19T02:21:20.316697+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.316697+0000","last_undegraded":"2024-04-19T02:21:20.316697+0000","last_fullsized":"2024-04-19T02:21:20.316697+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":615,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445684+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:19.445684+0000","last_peered":"2024-04-19T02:21:19.445684+0000","last_clean":"2024-04-19T02:21:19.445684+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:19.445684+0000","last_undegraded":"2024-04-19T02:21:19.445684+0000","last_fullsized":"2024-04-19T02:21:19.445684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":931,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442564+0000","last_change":"2024-04-19T02:20:53.191772+0000","last_active":"2024-04-19T02:21:18.442564+0000","last_peered":"2024-04-19T02:21:18.442564+0000","last_clean":"2024-04-19T02:21:18.442564+0000","last_became_active":"2024-04-19T02:20:53.188568+0000","last_became_peered":"2024-04-19T02:20:53.188568+0000","last_unstale":"2024-04-19T02:21:18.442564+0000","last_undegraded":"2024-04-19T02:21:18.442564+0000","last_fullsized":"2024-04-19T02:21:18.442564+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:52.479876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":497,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318541+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.318541+0000","last_peered":"2024-04-19T02:21:20.318541+0000","last_clean":"2024-04-19T02:21:20.318541+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.318541+0000","last_undegraded":"2024-04-19T02:21:20.318541+0000","last_fullsized":"2024-04-19T02:21:20.318541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443334+0000","last_change":"2024-04-19T02:20:34.187866+0000","last_active":"2024-04-19T02:21:18.443334+0000","last_peered":"2024-04-19T02:21:18.443334+0000","last_clean":"2024-04-19T02:21:18.443334+0000","last_became_active":"2024-04-19T02:20:34.186599+0000","last_became_peered":"2024-04-19T02:20:34.186599+0000","last_unstale":"2024-04-19T02:21:18.443334+0000","last_undegraded":"2024-04-19T02:21:18.443334+0000","last_fullsized":"2024-04-19T02:21:18.443334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.587891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":546,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319073+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.319073+0000","last_peered":"2024-04-19T02:21:20.319073+0000","last_clean":"2024-04-19T02:21:20.319073+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.319073+0000","last_undegraded":"2024-04-19T02:21:20.319073+0000","last_fullsized":"2024-04-19T02:21:20.319073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":187,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444971+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:19.444971+0000","last_peered":"2024-04-19T02:21:19.444971+0000","last_clean":"2024-04-19T02:21:19.444971+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:19.444971+0000","last_undegraded":"2024-04-19T02:21:19.444971+0000","last_fullsized":"2024-04-19T02:21:19.444971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1020,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447065+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:19.447065+0000","last_peered":"2024-04-19T02:21:19.447065+0000","last_clean":"2024-04-19T02:21:19.447065+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:19.447065+0000","last_undegraded":"2024-04-19T02:21:19.447065+0000","last_fullsized":"2024-04-19T02:21:19.447065+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":193,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317894+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.317894+0000","last_peered":"2024-04-19T02:21:20.317894+0000","last_clean":"2024-04-19T02:21:20.317894+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.317894+0000","last_undegraded":"2024-04-19T02:21:20.317894+0000","last_fullsized":"2024-04-19T02:21:20.317894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":909,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446488+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:19.446488+0000","last_peered":"2024-04-19T02:21:19.446488+0000","last_clean":"2024-04-19T02:21:19.446488+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:19.446488+0000","last_undegraded":"2024-04-19T02:21:19.446488+0000","last_fullsized":"2024-04-19T02:21:19.446488+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":163,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375615+0000","last_change":"2024-04-19T02:20:30.534872+0000","last_active":"2024-04-19T02:21:18.375615+0000","last_peered":"2024-04-19T02:21:18.375615+0000","last_clean":"2024-04-19T02:21:18.375615+0000","last_became_active":"2024-04-19T02:20:30.534236+0000","last_became_peered":"2024-04-19T02:20:30.534236+0000","last_unstale":"2024-04-19T02:21:18.375615+0000","last_undegraded":"2024-04-19T02:21:18.375615+0000","last_fullsized":"2024-04-19T02:21:18.375615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:19.732212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":287,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.378029+0000","last_change":"2024-04-19T02:20:33.184624+0000","last_active":"2024-04-19T02:21:18.378029+0000","last_peered":"2024-04-19T02:21:18.378029+0000","last_clean":"2024-04-19T02:21:18.378029+0000","last_became_active":"2024-04-19T02:20:33.183677+0000","last_became_peered":"2024-04-19T02:20:33.183677+0000","last_unstale":"2024-04-19T02:21:18.378029+0000","last_undegraded":"2024-04-19T02:21:18.378029+0000","last_fullsized":"2024-04-19T02:21:18.378029+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:24.527669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":894,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317362+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.317362+0000","last_peered":"2024-04-19T02:21:20.317362+0000","last_clean":"2024-04-19T02:21:20.317362+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.317362+0000","last_undegraded":"2024-04-19T02:21:20.317362+0000","last_fullsized":"2024-04-19T02:21:20.317362+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":429,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319685+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.319685+0000","last_peered":"2024-04-19T02:21:20.319685+0000","last_clean":"2024-04-19T02:21:20.319685+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.319685+0000","last_undegraded":"2024-04-19T02:21:20.319685+0000","last_fullsized":"2024-04-19T02:21:20.319685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":566,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317545+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.317545+0000","last_peered":"2024-04-19T02:21:20.317545+0000","last_clean":"2024-04-19T02:21:20.317545+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.317545+0000","last_undegraded":"2024-04-19T02:21:20.317545+0000","last_fullsized":"2024-04-19T02:21:20.317545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":716,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377764+0000","last_change":"2024-04-19T02:20:35.197065+0000","last_active":"2024-04-19T02:21:18.377764+0000","last_peered":"2024-04-19T02:21:18.377764+0000","last_clean":"2024-04-19T02:21:18.377764+0000","last_became_active":"2024-04-19T02:20:35.196263+0000","last_became_peered":"2024-04-19T02:20:35.196263+0000","last_unstale":"2024-04-19T02:21:18.377764+0000","last_undegraded":"2024-04-19T02:21:18.377764+0000","last_fullsized":"2024-04-19T02:21:18.377764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:03:23.437176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":896,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442820+0000","last_change":"2024-04-19T02:20:49.201498+0000","last_active":"2024-04-19T02:21:18.442820+0000","last_peered":"2024-04-19T02:21:18.442820+0000","last_clean":"2024-04-19T02:21:18.442820+0000","last_became_active":"2024-04-19T02:20:49.196194+0000","last_became_peered":"2024-04-19T02:20:49.196194+0000","last_unstale":"2024-04-19T02:21:18.442820+0000","last_undegraded":"2024-04-19T02:21:18.442820+0000","last_fullsized":"2024-04-19T02:21:18.442820+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:51.016296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":155,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.444214+0000","last_change":"2024-04-19T02:20:30.531260+0000","last_active":"2024-04-19T02:21:18.444214+0000","last_peered":"2024-04-19T02:21:18.444214+0000","last_clean":"2024-04-19T02:21:18.444214+0000","last_became_active":"2024-04-19T02:20:30.530266+0000","last_became_peered":"2024-04-19T02:20:30.530266+0000","last_unstale":"2024-04-19T02:21:18.444214+0000","last_undegraded":"2024-04-19T02:21:18.444214+0000","last_fullsized":"2024-04-19T02:21:18.444214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:15.918632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1081,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445096+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:19.445096+0000","last_peered":"2024-04-19T02:21:19.445096+0000","last_clean":"2024-04-19T02:21:19.445096+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:19.445096+0000","last_undegraded":"2024-04-19T02:21:19.445096+0000","last_fullsized":"2024-04-19T02:21:19.445096+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":269,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446744+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:19.446744+0000","last_peered":"2024-04-19T02:21:19.446744+0000","last_clean":"2024-04-19T02:21:19.446744+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:19.446744+0000","last_undegraded":"2024-04-19T02:21:19.446744+0000","last_fullsized":"2024-04-19T02:21:19.446744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":966,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443851+0000","last_change":"2024-04-19T02:20:44.190361+0000","last_active":"2024-04-19T02:21:18.443851+0000","last_peered":"2024-04-19T02:21:18.443851+0000","last_clean":"2024-04-19T02:21:18.443851+0000","last_became_active":"2024-04-19T02:20:44.187108+0000","last_became_peered":"2024-04-19T02:20:44.187108+0000","last_unstale":"2024-04-19T02:21:18.443851+0000","last_undegraded":"2024-04-19T02:21:18.443851+0000","last_fullsized":"2024-04-19T02:21:18.443851+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:58.200490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":268,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.303318+0000","last_change":"2024-04-19T02:21:20.303318+0000","last_active":"2024-04-19T02:20:29.476347+0000","last_peered":"2024-04-19T02:20:28.470100+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.470775+0000","last_became_peered":"2024-04-19T02:17:12.470775+0000","last_unstale":"2024-04-19T02:21:20.303318+0000","last_undegraded":"2024-04-19T02:21:20.303318+0000","last_fullsized":"2024-04-19T02:21:20.303318+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":987,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377970+0000","last_change":"2024-04-19T02:20:53.191272+0000","last_active":"2024-04-19T02:21:18.377970+0000","last_peered":"2024-04-19T02:21:18.377970+0000","last_clean":"2024-04-19T02:21:18.377970+0000","last_became_active":"2024-04-19T02:20:53.188344+0000","last_became_peered":"2024-04-19T02:20:53.188344+0000","last_unstale":"2024-04-19T02:21:18.377970+0000","last_undegraded":"2024-04-19T02:21:18.377970+0000","last_fullsized":"2024-04-19T02:21:18.377970+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:16.587821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317853+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.317853+0000","last_peered":"2024-04-19T02:21:20.317853+0000","last_clean":"2024-04-19T02:21:20.317853+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.317853+0000","last_undegraded":"2024-04-19T02:21:20.317853+0000","last_fullsized":"2024-04-19T02:21:20.317853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":818,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.376759+0000","last_change":"2024-04-19T02:20:39.191148+0000","last_active":"2024-04-19T02:21:18.376759+0000","last_peered":"2024-04-19T02:21:18.376759+0000","last_clean":"2024-04-19T02:21:18.376759+0000","last_became_active":"2024-04-19T02:20:39.188099+0000","last_became_peered":"2024-04-19T02:20:39.188099+0000","last_unstale":"2024-04-19T02:21:18.376759+0000","last_undegraded":"2024-04-19T02:21:18.376759+0000","last_fullsized":"2024-04-19T02:21:18.376759+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:31.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":501,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316611+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.316611+0000","last_peered":"2024-04-19T02:21:20.316611+0000","last_clean":"2024-04-19T02:21:20.316611+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.316611+0000","last_undegraded":"2024-04-19T02:21:20.316611+0000","last_fullsized":"2024-04-19T02:21:20.316611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":530,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446842+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:19.446842+0000","last_peered":"2024-04-19T02:21:19.446842+0000","last_clean":"2024-04-19T02:21:19.446842+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:19.446842+0000","last_undegraded":"2024-04-19T02:21:19.446842+0000","last_fullsized":"2024-04-19T02:21:19.446842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":303,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.376459+0000","last_change":"2024-04-19T02:20:30.539677+0000","last_active":"2024-04-19T02:21:18.376459+0000","last_peered":"2024-04-19T02:21:18.376459+0000","last_clean":"2024-04-19T02:21:18.376459+0000","last_became_active":"2024-04-19T02:20:30.538952+0000","last_became_peered":"2024-04-19T02:20:30.538952+0000","last_unstale":"2024-04-19T02:21:18.376459+0000","last_undegraded":"2024-04-19T02:21:18.376459+0000","last_fullsized":"2024-04-19T02:21:18.376459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:52.187796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":60,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.287071+0000","last_change":"2024-04-19T02:20:29.496650+0000","last_active":"2024-04-19T02:20:29.496416+0000","last_peered":"2024-04-19T02:20:28.472748+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.483202+0000","last_became_peered":"2024-04-19T02:17:12.483202+0000","last_unstale":"2024-04-19T02:21:20.287071+0000","last_undegraded":"2024-04-19T02:21:20.287071+0000","last_fullsized":"2024-04-19T02:21:20.287071+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":872,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445604+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:19.445604+0000","last_peered":"2024-04-19T02:21:19.445604+0000","last_clean":"2024-04-19T02:21:19.445604+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:19.445604+0000","last_undegraded":"2024-04-19T02:21:19.445604+0000","last_fullsized":"2024-04-19T02:21:19.445604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":966,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.377670+0000","last_change":"2024-04-19T02:20:50.197327+0000","last_active":"2024-04-19T02:21:18.377670+0000","last_peered":"2024-04-19T02:21:18.377670+0000","last_clean":"2024-04-19T02:21:18.377670+0000","last_became_active":"2024-04-19T02:20:50.194431+0000","last_became_peered":"2024-04-19T02:20:50.194431+0000","last_unstale":"2024-04-19T02:21:18.377670+0000","last_undegraded":"2024-04-19T02:21:18.377670+0000","last_fullsized":"2024-04-19T02:21:18.377670+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:37.958910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.376114+0000","last_change":"2024-04-19T02:20:30.534644+0000","last_active":"2024-04-19T02:21:18.376114+0000","last_peered":"2024-04-19T02:21:18.376114+0000","last_clean":"2024-04-19T02:21:18.376114+0000","last_became_active":"2024-04-19T02:20:30.534109+0000","last_became_peered":"2024-04-19T02:20:30.534109+0000","last_unstale":"2024-04-19T02:21:18.376114+0000","last_undegraded":"2024-04-19T02:21:18.376114+0000","last_fullsized":"2024-04-19T02:21:18.376114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:36.872946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":309,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445970+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:19.445970+0000","last_peered":"2024-04-19T02:21:19.445970+0000","last_clean":"2024-04-19T02:21:19.445970+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:19.445970+0000","last_undegraded":"2024-04-19T02:21:19.445970+0000","last_fullsized":"2024-04-19T02:21:19.445970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":555,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319678+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.319678+0000","last_peered":"2024-04-19T02:21:20.319678+0000","last_clean":"2024-04-19T02:21:20.319678+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.319678+0000","last_undegraded":"2024-04-19T02:21:20.319678+0000","last_fullsized":"2024-04-19T02:21:20.319678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446123+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:19.446123+0000","last_peered":"2024-04-19T02:21:19.446123+0000","last_clean":"2024-04-19T02:21:19.446123+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:19.446123+0000","last_undegraded":"2024-04-19T02:21:19.446123+0000","last_fullsized":"2024-04-19T02:21:19.446123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":522,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318328+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.318328+0000","last_peered":"2024-04-19T02:21:20.318328+0000","last_clean":"2024-04-19T02:21:20.318328+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.318328+0000","last_undegraded":"2024-04-19T02:21:20.318328+0000","last_fullsized":"2024-04-19T02:21:20.318328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":467,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446930+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:19.446930+0000","last_peered":"2024-04-19T02:21:19.446930+0000","last_clean":"2024-04-19T02:21:19.446930+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:19.446930+0000","last_undegraded":"2024-04-19T02:21:19.446930+0000","last_fullsized":"2024-04-19T02:21:19.446930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.443298+0000","last_change":"2024-04-19T02:20:30.540240+0000","last_active":"2024-04-19T02:21:18.443298+0000","last_peered":"2024-04-19T02:21:18.443298+0000","last_clean":"2024-04-19T02:21:18.443298+0000","last_became_active":"2024-04-19T02:20:30.539876+0000","last_became_peered":"2024-04-19T02:20:30.539876+0000","last_unstale":"2024-04-19T02:21:18.443298+0000","last_undegraded":"2024-04-19T02:21:18.443298+0000","last_fullsized":"2024-04-19T02:21:18.443298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:01.527419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":128,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.296172+0000","last_change":"2024-04-19T02:20:29.492758+0000","last_active":"2024-04-19T02:20:29.492282+0000","last_peered":"2024-04-19T02:20:28.471566+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.480849+0000","last_became_peered":"2024-04-19T02:17:12.480849+0000","last_unstale":"2024-04-19T02:21:20.296172+0000","last_undegraded":"2024-04-19T02:21:20.296172+0000","last_fullsized":"2024-04-19T02:21:20.296172+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":568,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445838+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:19.445838+0000","last_peered":"2024-04-19T02:21:19.445838+0000","last_clean":"2024-04-19T02:21:19.445838+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:19.445838+0000","last_undegraded":"2024-04-19T02:21:19.445838+0000","last_fullsized":"2024-04-19T02:21:19.445838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":521,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.284478+0000","last_change":"2024-04-19T02:21:20.284478+0000","last_active":"2024-04-19T02:20:29.482637+0000","last_peered":"2024-04-19T02:20:28.472648+0000","last_clean":"2024-04-19T02:16:23.094612+0000","last_became_active":"2024-04-19T02:17:12.475695+0000","last_became_peered":"2024-04-19T02:17:12.475695+0000","last_unstale":"2024-04-19T02:21:20.284478+0000","last_undegraded":"2024-04-19T02:21:20.284478+0000","last_fullsized":"2024-04-19T02:21:20.284478+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446667+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:19.446667+0000","last_peered":"2024-04-19T02:21:19.446667+0000","last_clean":"2024-04-19T02:21:19.446667+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:19.446667+0000","last_undegraded":"2024-04-19T02:21:19.446667+0000","last_fullsized":"2024-04-19T02:21:19.446667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":856,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318127+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.318127+0000","last_peered":"2024-04-19T02:21:20.318127+0000","last_clean":"2024-04-19T02:21:20.318127+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.318127+0000","last_undegraded":"2024-04-19T02:21:20.318127+0000","last_fullsized":"2024-04-19T02:21:20.318127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":166,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446672+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:19.446672+0000","last_peered":"2024-04-19T02:21:19.446672+0000","last_clean":"2024-04-19T02:21:19.446672+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:19.446672+0000","last_undegraded":"2024-04-19T02:21:19.446672+0000","last_fullsized":"2024-04-19T02:21:19.446672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319600+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.319600+0000","last_peered":"2024-04-19T02:21:20.319600+0000","last_clean":"2024-04-19T02:21:20.319600+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.319600+0000","last_undegraded":"2024-04-19T02:21:20.319600+0000","last_fullsized":"2024-04-19T02:21:20.319600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":973,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318383+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.318383+0000","last_peered":"2024-04-19T02:21:20.318383+0000","last_clean":"2024-04-19T02:21:20.318383+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.318383+0000","last_undegraded":"2024-04-19T02:21:20.318383+0000","last_fullsized":"2024-04-19T02:21:20.318383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":176,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447475+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:19.447475+0000","last_peered":"2024-04-19T02:21:19.447475+0000","last_clean":"2024-04-19T02:21:19.447475+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:19.447475+0000","last_undegraded":"2024-04-19T02:21:19.447475+0000","last_fullsized":"2024-04-19T02:21:19.447475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447284+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:19.447284+0000","last_peered":"2024-04-19T02:21:19.447284+0000","last_clean":"2024-04-19T02:21:19.447284+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:19.447284+0000","last_undegraded":"2024-04-19T02:21:19.447284+0000","last_fullsized":"2024-04-19T02:21:19.447284+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":950,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445018+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:19.445018+0000","last_peered":"2024-04-19T02:21:19.445018+0000","last_clean":"2024-04-19T02:21:19.445018+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:19.445018+0000","last_undegraded":"2024-04-19T02:21:19.445018+0000","last_fullsized":"2024-04-19T02:21:19.445018+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":203,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447195+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:19.447195+0000","last_peered":"2024-04-19T02:21:19.447195+0000","last_clean":"2024-04-19T02:21:19.447195+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:19.447195+0000","last_undegraded":"2024-04-19T02:21:19.447195+0000","last_fullsized":"2024-04-19T02:21:19.447195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.295523+0000","last_change":"2024-04-19T02:20:29.486433+0000","last_active":"2024-04-19T02:20:29.485809+0000","last_peered":"2024-04-19T02:20:28.473951+0000","last_clean":"2024-04-19T02:16:19.062013+0000","last_became_active":"2024-04-19T02:17:12.473583+0000","last_became_peered":"2024-04-19T02:17:12.473583+0000","last_unstale":"2024-04-19T02:21:20.295523+0000","last_undegraded":"2024-04-19T02:21:20.295523+0000","last_fullsized":"2024-04-19T02:21:20.295523+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444423+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:19.444423+0000","last_peered":"2024-04-19T02:21:19.444423+0000","last_clean":"2024-04-19T02:21:19.444423+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:19.444423+0000","last_undegraded":"2024-04-19T02:21:19.444423+0000","last_fullsized":"2024-04-19T02:21:19.444423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":877,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.375950+0000","last_change":"2024-04-19T02:20:43.196946+0000","last_active":"2024-04-19T02:21:18.375950+0000","last_peered":"2024-04-19T02:21:18.375950+0000","last_clean":"2024-04-19T02:21:18.375950+0000","last_became_active":"2024-04-19T02:20:43.194098+0000","last_became_peered":"2024-04-19T02:20:43.194098+0000","last_unstale":"2024-04-19T02:21:18.375950+0000","last_undegraded":"2024-04-19T02:21:18.375950+0000","last_fullsized":"2024-04-19T02:21:18.375950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:52.390270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":524,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.301461+0000","last_change":"2024-04-19T02:21:20.301461+0000","last_active":"2024-04-19T02:20:29.482560+0000","last_peered":"2024-04-19T02:20:28.471129+0000","last_clean":"2024-04-19T02:16:54.341172+0000","last_became_active":"2024-04-19T02:17:12.468266+0000","last_became_peered":"2024-04-19T02:17:12.468266+0000","last_unstale":"2024-04-19T02:21:20.301461+0000","last_undegraded":"2024-04-19T02:21:20.301461+0000","last_fullsized":"2024-04-19T02:21:20.301461+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":554,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444675+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:19.444675+0000","last_peered":"2024-04-19T02:21:19.444675+0000","last_clean":"2024-04-19T02:21:19.444675+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:19.444675+0000","last_undegraded":"2024-04-19T02:21:19.444675+0000","last_fullsized":"2024-04-19T02:21:19.444675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":215,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319334+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.319334+0000","last_peered":"2024-04-19T02:21:20.319334+0000","last_clean":"2024-04-19T02:21:20.319334+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.319334+0000","last_undegraded":"2024-04-19T02:21:20.319334+0000","last_fullsized":"2024-04-19T02:21:20.319334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":435,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.444752+0000","last_change":"2024-04-19T02:20:33.181900+0000","last_active":"2024-04-19T02:21:18.444752+0000","last_peered":"2024-04-19T02:21:18.444752+0000","last_clean":"2024-04-19T02:21:18.444752+0000","last_became_active":"2024-04-19T02:20:33.179886+0000","last_became_peered":"2024-04-19T02:20:33.179886+0000","last_unstale":"2024-04-19T02:21:18.444752+0000","last_undegraded":"2024-04-19T02:21:18.444752+0000","last_fullsized":"2024-04-19T02:21:18.444752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:17.329291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1018,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444920+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:19.444920+0000","last_peered":"2024-04-19T02:21:19.444920+0000","last_clean":"2024-04-19T02:21:19.444920+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:19.444920+0000","last_undegraded":"2024-04-19T02:21:19.444920+0000","last_fullsized":"2024-04-19T02:21:19.444920+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447357+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:19.447357+0000","last_peered":"2024-04-19T02:21:19.447357+0000","last_clean":"2024-04-19T02:21:19.447357+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:19.447357+0000","last_undegraded":"2024-04-19T02:21:19.447357+0000","last_fullsized":"2024-04-19T02:21:19.447357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":628,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444907+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:19.444907+0000","last_peered":"2024-04-19T02:21:19.444907+0000","last_clean":"2024-04-19T02:21:19.444907+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:19.444907+0000","last_undegraded":"2024-04-19T02:21:19.444907+0000","last_fullsized":"2024-04-19T02:21:19.444907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":917,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316736+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.316736+0000","last_peered":"2024-04-19T02:21:20.316736+0000","last_clean":"2024-04-19T02:21:20.316736+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.316736+0000","last_undegraded":"2024-04-19T02:21:20.316736+0000","last_fullsized":"2024-04-19T02:21:20.316736+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":682,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445725+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:19.445725+0000","last_peered":"2024-04-19T02:21:19.445725+0000","last_clean":"2024-04-19T02:21:19.445725+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:19.445725+0000","last_undegraded":"2024-04-19T02:21:19.445725+0000","last_fullsized":"2024-04-19T02:21:19.445725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":942,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446472+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:19.446472+0000","last_peered":"2024-04-19T02:21:19.446472+0000","last_clean":"2024-04-19T02:21:19.446472+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:19.446472+0000","last_undegraded":"2024-04-19T02:21:19.446472+0000","last_fullsized":"2024-04-19T02:21:19.446472+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":460,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445345+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:19.445345+0000","last_peered":"2024-04-19T02:21:19.445345+0000","last_clean":"2024-04-19T02:21:19.445345+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:19.445345+0000","last_undegraded":"2024-04-19T02:21:19.445345+0000","last_fullsized":"2024-04-19T02:21:19.445345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":859,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318609+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:20.318609+0000","last_peered":"2024-04-19T02:21:20.318609+0000","last_clean":"2024-04-19T02:21:20.318609+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:20.318609+0000","last_undegraded":"2024-04-19T02:21:20.318609+0000","last_fullsized":"2024-04-19T02:21:20.318609+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":607,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462735+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:20.462735+0000","last_peered":"2024-04-19T02:21:20.462735+0000","last_clean":"2024-04-19T02:21:20.462735+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:20.462735+0000","last_undegraded":"2024-04-19T02:21:20.462735+0000","last_fullsized":"2024-04-19T02:21:20.462735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":548,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318531+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:20.318531+0000","last_peered":"2024-04-19T02:21:20.318531+0000","last_clean":"2024-04-19T02:21:20.318531+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:20.318531+0000","last_undegraded":"2024-04-19T02:21:20.318531+0000","last_fullsized":"2024-04-19T02:21:20.318531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318583+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:20.318583+0000","last_peered":"2024-04-19T02:21:20.318583+0000","last_clean":"2024-04-19T02:21:20.318583+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:20.318583+0000","last_undegraded":"2024-04-19T02:21:20.318583+0000","last_fullsized":"2024-04-19T02:21:20.318583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":835,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442700+0000","last_change":"2024-04-19T02:20:46.204381+0000","last_active":"2024-04-19T02:21:18.442700+0000","last_peered":"2024-04-19T02:21:18.442700+0000","last_clean":"2024-04-19T02:21:18.442700+0000","last_became_active":"2024-04-19T02:20:46.201640+0000","last_became_peered":"2024-04-19T02:20:46.201640+0000","last_unstale":"2024-04-19T02:21:18.442700+0000","last_undegraded":"2024-04-19T02:21:18.442700+0000","last_fullsized":"2024-04-19T02:21:18.442700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":395,"reported_epoch":116,"state":"peering","last_fresh":"2024-04-19T02:21:20.306353+0000","last_change":"2024-04-19T02:21:20.306353+0000","last_active":"2024-04-19T02:20:29.490295+0000","last_peered":"2024-04-19T02:20:28.473037+0000","last_clean":"2024-04-19T02:16:24.497316+0000","last_became_active":"2024-04-19T02:17:12.478521+0000","last_became_peered":"2024-04-19T02:17:12.478521+0000","last_unstale":"2024-04-19T02:21:20.306353+0000","last_undegraded":"2024-04-19T02:21:20.306353+0000","last_fullsized":"2024-04-19T02:21:20.306353+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":888,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442525+0000","last_change":"2024-04-19T02:20:47.204723+0000","last_active":"2024-04-19T02:21:18.442525+0000","last_peered":"2024-04-19T02:21:18.442525+0000","last_clean":"2024-04-19T02:21:18.442525+0000","last_became_active":"2024-04-19T02:20:47.201126+0000","last_became_peered":"2024-04-19T02:20:47.201126+0000","last_unstale":"2024-04-19T02:21:18.442525+0000","last_undegraded":"2024-04-19T02:21:18.442525+0000","last_fullsized":"2024-04-19T02:21:18.442525+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:45.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":506,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319052+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:20.319052+0000","last_peered":"2024-04-19T02:21:20.319052+0000","last_clean":"2024-04-19T02:21:20.319052+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:20.319052+0000","last_undegraded":"2024-04-19T02:21:20.319052+0000","last_fullsized":"2024-04-19T02:21:20.319052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":632,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318135+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.318135+0000","last_peered":"2024-04-19T02:21:20.318135+0000","last_clean":"2024-04-19T02:21:20.318135+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.318135+0000","last_undegraded":"2024-04-19T02:21:20.318135+0000","last_fullsized":"2024-04-19T02:21:20.318135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":178,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446932+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:19.446932+0000","last_peered":"2024-04-19T02:21:19.446932+0000","last_clean":"2024-04-19T02:21:19.446932+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:19.446932+0000","last_undegraded":"2024-04-19T02:21:19.446932+0000","last_fullsized":"2024-04-19T02:21:19.446932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":991,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.442419+0000","last_change":"2024-04-19T02:20:55.211881+0000","last_active":"2024-04-19T02:21:18.442419+0000","last_peered":"2024-04-19T02:21:18.442419+0000","last_clean":"2024-04-19T02:21:18.442419+0000","last_became_active":"2024-04-19T02:20:55.208791+0000","last_became_peered":"2024-04-19T02:20:55.208791+0000","last_unstale":"2024-04-19T02:21:18.442419+0000","last_undegraded":"2024-04-19T02:21:18.442419+0000","last_fullsized":"2024-04-19T02:21:18.442419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:33:46.974376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":180,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447110+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:19.447110+0000","last_peered":"2024-04-19T02:21:19.447110+0000","last_clean":"2024-04-19T02:21:19.447110+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:19.447110+0000","last_undegraded":"2024-04-19T02:21:19.447110+0000","last_fullsized":"2024-04-19T02:21:19.447110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":68575575,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738435,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143028,"kb_used_data":27496,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228812,"statfs":{"total":96636764160,"available":96490303488,"internally_reserved":0,"allocated":28155904,"data_stored":81658387,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":78,"seq":335007449100,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66124,"kb_used_data":12344,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305716,"statfs":{"total":96636764160,"available":96569053184,"internally_reserved":0,"allocated":12640256,"data_stored":91942399,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139592,"kb_used_data":28148,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232248,"statfs":{"total":96636764160,"available":96493821952,"internally_reserved":0,"allocated":28823552,"data_stored":86272278,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:23.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:21:24.039 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:24.039 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":320,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":117,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493229,"num_in_osds":3,"osd_in_since":1713492964,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":98},{"state_name":"peering","count":7}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129191761,"bytes_used":357113856,"bytes_avail":289553178624,"bytes_total":289910292480,"inactive_pgs_ratio":0.066666670143604279},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4198}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T02:17:32.195548+0000","services":{}},"progress_events":{}} 2024-04-19T02:21:24.057 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-19T02:21:24.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:24.369 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-04-19T02:21:24.308958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":348756,"kb_used_data":67996,"kb_used_omap":10,"kb_used_meta":280693,"kb_avail":282766764,"statfs":{"total":289910292480,"available":289553166336,"internally_reserved":0,"allocated":69627904,"data_stored":259877354,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":287430539},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3934,"num_bytes_recovered":-43241477,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870056"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":566,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319560+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.319560+0000","last_peered":"2024-04-19T02:21:20.319560+0000","last_clean":"2024-04-19T02:21:20.319560+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.319560+0000","last_undegraded":"2024-04-19T02:21:20.319560+0000","last_fullsized":"2024-04-19T02:21:20.319560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":592,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319147+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.319147+0000","last_peered":"2024-04-19T02:21:20.319147+0000","last_clean":"2024-04-19T02:21:20.319147+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.319147+0000","last_undegraded":"2024-04-19T02:21:20.319147+0000","last_fullsized":"2024-04-19T02:21:20.319147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":483,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343830+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.343830+0000","last_peered":"2024-04-19T02:21:21.343830+0000","last_clean":"2024-04-19T02:21:21.343830+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.343830+0000","last_undegraded":"2024-04-19T02:21:21.343830+0000","last_fullsized":"2024-04-19T02:21:21.343830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:49.457654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":465,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342642+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.342642+0000","last_peered":"2024-04-19T02:21:21.342642+0000","last_clean":"2024-04-19T02:21:21.342642+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.342642+0000","last_undegraded":"2024-04-19T02:21:21.342642+0000","last_fullsized":"2024-04-19T02:21:21.342642+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:28.873039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318430+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:20.318430+0000","last_peered":"2024-04-19T02:21:20.318430+0000","last_clean":"2024-04-19T02:21:20.318430+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:20.318430+0000","last_undegraded":"2024-04-19T02:21:20.318430+0000","last_fullsized":"2024-04-19T02:21:20.318430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":535,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348147+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348147+0000","last_peered":"2024-04-19T02:21:21.348147+0000","last_clean":"2024-04-19T02:21:21.348147+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348147+0000","last_undegraded":"2024-04-19T02:21:21.348147+0000","last_fullsized":"2024-04-19T02:21:21.348147+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:44.275063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":518,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.311849+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.311849+0000","last_peered":"2024-04-19T02:21:21.311849+0000","last_clean":"2024-04-19T02:21:21.311849+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.311849+0000","last_undegraded":"2024-04-19T02:21:21.311849+0000","last_fullsized":"2024-04-19T02:21:21.311849+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:51.111106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340703+0000","last_change":"2024-04-19T02:21:21.340703+0000","last_active":"2024-04-19T02:21:21.340703+0000","last_peered":"2024-04-19T02:21:21.340703+0000","last_clean":"2024-04-19T02:21:21.340703+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:21.340703+0000","last_undegraded":"2024-04-19T02:21:21.340703+0000","last_fullsized":"2024-04-19T02:21:21.340703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:48:22.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":562,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446507+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:19.446507+0000","last_peered":"2024-04-19T02:21:19.446507+0000","last_clean":"2024-04-19T02:21:19.446507+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:19.446507+0000","last_undegraded":"2024-04-19T02:21:19.446507+0000","last_fullsized":"2024-04-19T02:21:19.446507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319379+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.319379+0000","last_peered":"2024-04-19T02:21:20.319379+0000","last_clean":"2024-04-19T02:21:20.319379+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.319379+0000","last_undegraded":"2024-04-19T02:21:20.319379+0000","last_fullsized":"2024-04-19T02:21:20.319379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317186+0000","last_change":"2024-04-19T02:21:21.317186+0000","last_active":"2024-04-19T02:21:21.317186+0000","last_peered":"2024-04-19T02:21:21.317186+0000","last_clean":"2024-04-19T02:21:21.317186+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:21.317186+0000","last_undegraded":"2024-04-19T02:21:21.317186+0000","last_fullsized":"2024-04-19T02:21:21.317186+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:23.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":910,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318246+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.318246+0000","last_peered":"2024-04-19T02:21:20.318246+0000","last_clean":"2024-04-19T02:21:20.318246+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.318246+0000","last_undegraded":"2024-04-19T02:21:20.318246+0000","last_fullsized":"2024-04-19T02:21:20.318246+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317988+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.317988+0000","last_peered":"2024-04-19T02:21:20.317988+0000","last_clean":"2024-04-19T02:21:20.317988+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.317988+0000","last_undegraded":"2024-04-19T02:21:20.317988+0000","last_fullsized":"2024-04-19T02:21:20.317988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341036+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.341036+0000","last_peered":"2024-04-19T02:21:21.341036+0000","last_clean":"2024-04-19T02:21:21.341036+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.341036+0000","last_undegraded":"2024-04-19T02:21:21.341036+0000","last_fullsized":"2024-04-19T02:21:21.341036+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:35.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330764+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.330764+0000","last_peered":"2024-04-19T02:21:21.330764+0000","last_clean":"2024-04-19T02:21:21.330764+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.330764+0000","last_undegraded":"2024-04-19T02:21:21.330764+0000","last_fullsized":"2024-04-19T02:21:21.330764+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:28.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":576,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.337686+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.337686+0000","last_peered":"2024-04-19T02:21:21.337686+0000","last_clean":"2024-04-19T02:21:21.337686+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.337686+0000","last_undegraded":"2024-04-19T02:21:21.337686+0000","last_fullsized":"2024-04-19T02:21:21.337686+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:03.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":560,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447329+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:19.447329+0000","last_peered":"2024-04-19T02:21:19.447329+0000","last_clean":"2024-04-19T02:21:19.447329+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:19.447329+0000","last_undegraded":"2024-04-19T02:21:19.447329+0000","last_fullsized":"2024-04-19T02:21:19.447329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319435+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.319435+0000","last_peered":"2024-04-19T02:21:20.319435+0000","last_clean":"2024-04-19T02:21:20.319435+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.319435+0000","last_undegraded":"2024-04-19T02:21:20.319435+0000","last_fullsized":"2024-04-19T02:21:20.319435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445733+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:19.445733+0000","last_peered":"2024-04-19T02:21:19.445733+0000","last_clean":"2024-04-19T02:21:19.445733+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:19.445733+0000","last_undegraded":"2024-04-19T02:21:19.445733+0000","last_fullsized":"2024-04-19T02:21:19.445733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":511,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341981+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.341981+0000","last_peered":"2024-04-19T02:21:21.341981+0000","last_clean":"2024-04-19T02:21:21.341981+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.341981+0000","last_undegraded":"2024-04-19T02:21:21.341981+0000","last_fullsized":"2024-04-19T02:21:21.341981+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:37.611409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.321511+0000","last_change":"2024-04-19T02:21:21.321511+0000","last_active":"2024-04-19T02:21:21.321511+0000","last_peered":"2024-04-19T02:21:21.321511+0000","last_clean":"2024-04-19T02:21:21.321511+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:21.321511+0000","last_undegraded":"2024-04-19T02:21:21.321511+0000","last_fullsized":"2024-04-19T02:21:21.321511+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:01.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1121,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317875+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.317875+0000","last_peered":"2024-04-19T02:21:20.317875+0000","last_clean":"2024-04-19T02:21:20.317875+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.317875+0000","last_undegraded":"2024-04-19T02:21:20.317875+0000","last_fullsized":"2024-04-19T02:21:20.317875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":899,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444658+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:19.444658+0000","last_peered":"2024-04-19T02:21:19.444658+0000","last_clean":"2024-04-19T02:21:19.444658+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:19.444658+0000","last_undegraded":"2024-04-19T02:21:19.444658+0000","last_fullsized":"2024-04-19T02:21:19.444658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":568,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317193+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.317193+0000","last_peered":"2024-04-19T02:21:20.317193+0000","last_clean":"2024-04-19T02:21:20.317193+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.317193+0000","last_undegraded":"2024-04-19T02:21:20.317193+0000","last_fullsized":"2024-04-19T02:21:20.317193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":949,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319510+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.319510+0000","last_peered":"2024-04-19T02:21:20.319510+0000","last_clean":"2024-04-19T02:21:20.319510+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.319510+0000","last_undegraded":"2024-04-19T02:21:20.319510+0000","last_fullsized":"2024-04-19T02:21:20.319510+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1173,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446511+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:19.446511+0000","last_peered":"2024-04-19T02:21:19.446511+0000","last_clean":"2024-04-19T02:21:19.446511+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:19.446511+0000","last_undegraded":"2024-04-19T02:21:19.446511+0000","last_fullsized":"2024-04-19T02:21:19.446511+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346297+0000","last_change":"2024-04-19T02:21:21.346297+0000","last_active":"2024-04-19T02:21:21.346297+0000","last_peered":"2024-04-19T02:21:21.346297+0000","last_clean":"2024-04-19T02:21:21.346297+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:21.346297+0000","last_undegraded":"2024-04-19T02:21:21.346297+0000","last_fullsized":"2024-04-19T02:21:21.346297+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:35.018270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":815,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318807+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.318807+0000","last_peered":"2024-04-19T02:21:20.318807+0000","last_clean":"2024-04-19T02:21:20.318807+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.318807+0000","last_undegraded":"2024-04-19T02:21:20.318807+0000","last_fullsized":"2024-04-19T02:21:20.318807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":538,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446358+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:19.446358+0000","last_peered":"2024-04-19T02:21:19.446358+0000","last_clean":"2024-04-19T02:21:19.446358+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:19.446358+0000","last_undegraded":"2024-04-19T02:21:19.446358+0000","last_fullsized":"2024-04-19T02:21:19.446358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1076,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316697+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.316697+0000","last_peered":"2024-04-19T02:21:20.316697+0000","last_clean":"2024-04-19T02:21:20.316697+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.316697+0000","last_undegraded":"2024-04-19T02:21:20.316697+0000","last_fullsized":"2024-04-19T02:21:20.316697+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":615,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445684+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:19.445684+0000","last_peered":"2024-04-19T02:21:19.445684+0000","last_clean":"2024-04-19T02:21:19.445684+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:19.445684+0000","last_undegraded":"2024-04-19T02:21:19.445684+0000","last_fullsized":"2024-04-19T02:21:19.445684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341631+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.341631+0000","last_peered":"2024-04-19T02:21:21.341631+0000","last_clean":"2024-04-19T02:21:21.341631+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.341631+0000","last_undegraded":"2024-04-19T02:21:21.341631+0000","last_fullsized":"2024-04-19T02:21:21.341631+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:57.921400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":497,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318541+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.318541+0000","last_peered":"2024-04-19T02:21:20.318541+0000","last_clean":"2024-04-19T02:21:20.318541+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.318541+0000","last_undegraded":"2024-04-19T02:21:20.318541+0000","last_fullsized":"2024-04-19T02:21:20.318541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330108+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.330108+0000","last_peered":"2024-04-19T02:21:21.330108+0000","last_clean":"2024-04-19T02:21:21.330108+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.330108+0000","last_undegraded":"2024-04-19T02:21:21.330108+0000","last_fullsized":"2024-04-19T02:21:21.330108+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:26.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":546,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319073+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.319073+0000","last_peered":"2024-04-19T02:21:20.319073+0000","last_clean":"2024-04-19T02:21:20.319073+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.319073+0000","last_undegraded":"2024-04-19T02:21:20.319073+0000","last_fullsized":"2024-04-19T02:21:20.319073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":187,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444971+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:19.444971+0000","last_peered":"2024-04-19T02:21:19.444971+0000","last_clean":"2024-04-19T02:21:19.444971+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:19.444971+0000","last_undegraded":"2024-04-19T02:21:19.444971+0000","last_fullsized":"2024-04-19T02:21:19.444971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1020,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447065+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:19.447065+0000","last_peered":"2024-04-19T02:21:19.447065+0000","last_clean":"2024-04-19T02:21:19.447065+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:19.447065+0000","last_undegraded":"2024-04-19T02:21:19.447065+0000","last_fullsized":"2024-04-19T02:21:19.447065+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":193,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317894+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.317894+0000","last_peered":"2024-04-19T02:21:20.317894+0000","last_clean":"2024-04-19T02:21:20.317894+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.317894+0000","last_undegraded":"2024-04-19T02:21:20.317894+0000","last_fullsized":"2024-04-19T02:21:20.317894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":909,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446488+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:19.446488+0000","last_peered":"2024-04-19T02:21:19.446488+0000","last_clean":"2024-04-19T02:21:19.446488+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:19.446488+0000","last_undegraded":"2024-04-19T02:21:19.446488+0000","last_fullsized":"2024-04-19T02:21:19.446488+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":130,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341978+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.341978+0000","last_peered":"2024-04-19T02:21:21.341978+0000","last_clean":"2024-04-19T02:21:21.341978+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.341978+0000","last_undegraded":"2024-04-19T02:21:21.341978+0000","last_fullsized":"2024-04-19T02:21:21.341978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:38.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":245,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.320439+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.320439+0000","last_peered":"2024-04-19T02:21:21.320439+0000","last_clean":"2024-04-19T02:21:21.320439+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.320439+0000","last_undegraded":"2024-04-19T02:21:21.320439+0000","last_fullsized":"2024-04-19T02:21:21.320439+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:12.736548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":894,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317362+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.317362+0000","last_peered":"2024-04-19T02:21:20.317362+0000","last_clean":"2024-04-19T02:21:20.317362+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.317362+0000","last_undegraded":"2024-04-19T02:21:20.317362+0000","last_fullsized":"2024-04-19T02:21:20.317362+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":429,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319685+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.319685+0000","last_peered":"2024-04-19T02:21:20.319685+0000","last_clean":"2024-04-19T02:21:20.319685+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.319685+0000","last_undegraded":"2024-04-19T02:21:20.319685+0000","last_fullsized":"2024-04-19T02:21:20.319685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":566,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317545+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.317545+0000","last_peered":"2024-04-19T02:21:20.317545+0000","last_clean":"2024-04-19T02:21:20.317545+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.317545+0000","last_undegraded":"2024-04-19T02:21:20.317545+0000","last_fullsized":"2024-04-19T02:21:20.317545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":674,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.339398+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.339398+0000","last_peered":"2024-04-19T02:21:21.339398+0000","last_clean":"2024-04-19T02:21:21.339398+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.339398+0000","last_undegraded":"2024-04-19T02:21:21.339398+0000","last_fullsized":"2024-04-19T02:21:21.339398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:50.683246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":491,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.327562+0000","last_change":"2024-04-19T02:21:21.327562+0000","last_active":"2024-04-19T02:21:21.327562+0000","last_peered":"2024-04-19T02:21:21.327562+0000","last_clean":"2024-04-19T02:21:21.327562+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:21.327562+0000","last_undegraded":"2024-04-19T02:21:21.327562+0000","last_fullsized":"2024-04-19T02:21:21.327562+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:00:27.273002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":121,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.304724+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.304724+0000","last_peered":"2024-04-19T02:21:21.304724+0000","last_clean":"2024-04-19T02:21:21.304724+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.304724+0000","last_undegraded":"2024-04-19T02:21:21.304724+0000","last_fullsized":"2024-04-19T02:21:21.304724+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:58.461641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1081,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445096+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:19.445096+0000","last_peered":"2024-04-19T02:21:19.445096+0000","last_clean":"2024-04-19T02:21:19.445096+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:19.445096+0000","last_undegraded":"2024-04-19T02:21:19.445096+0000","last_fullsized":"2024-04-19T02:21:19.445096+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":269,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446744+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:19.446744+0000","last_peered":"2024-04-19T02:21:19.446744+0000","last_clean":"2024-04-19T02:21:19.446744+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:19.446744+0000","last_undegraded":"2024-04-19T02:21:19.446744+0000","last_fullsized":"2024-04-19T02:21:19.446744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323437+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.323437+0000","last_peered":"2024-04-19T02:21:21.323437+0000","last_clean":"2024-04-19T02:21:21.323437+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.323437+0000","last_undegraded":"2024-04-19T02:21:21.323437+0000","last_fullsized":"2024-04-19T02:21:21.323437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:15.338811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323460+0000","last_change":"2024-04-19T02:21:21.323460+0000","last_active":"2024-04-19T02:21:21.323460+0000","last_peered":"2024-04-19T02:21:21.323460+0000","last_clean":"2024-04-19T02:21:21.323460+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:21.323460+0000","last_undegraded":"2024-04-19T02:21:21.323460+0000","last_fullsized":"2024-04-19T02:21:21.323460+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":583,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344252+0000","last_change":"2024-04-19T02:21:21.344252+0000","last_active":"2024-04-19T02:21:21.344252+0000","last_peered":"2024-04-19T02:21:21.344252+0000","last_clean":"2024-04-19T02:21:21.344252+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:21:21.344252+0000","last_undegraded":"2024-04-19T02:21:21.344252+0000","last_fullsized":"2024-04-19T02:21:21.344252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:47.406900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.317853+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.317853+0000","last_peered":"2024-04-19T02:21:20.317853+0000","last_clean":"2024-04-19T02:21:20.317853+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.317853+0000","last_undegraded":"2024-04-19T02:21:20.317853+0000","last_fullsized":"2024-04-19T02:21:20.317853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":450,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.319032+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.319032+0000","last_peered":"2024-04-19T02:21:21.319032+0000","last_clean":"2024-04-19T02:21:21.319032+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.319032+0000","last_undegraded":"2024-04-19T02:21:21.319032+0000","last_fullsized":"2024-04-19T02:21:21.319032+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:03.038712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":501,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316611+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.316611+0000","last_peered":"2024-04-19T02:21:20.316611+0000","last_clean":"2024-04-19T02:21:20.316611+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.316611+0000","last_undegraded":"2024-04-19T02:21:20.316611+0000","last_fullsized":"2024-04-19T02:21:20.316611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":530,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446842+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:19.446842+0000","last_peered":"2024-04-19T02:21:19.446842+0000","last_clean":"2024-04-19T02:21:19.446842+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:19.446842+0000","last_undegraded":"2024-04-19T02:21:19.446842+0000","last_fullsized":"2024-04-19T02:21:19.446842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341047+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.341047+0000","last_peered":"2024-04-19T02:21:21.341047+0000","last_clean":"2024-04-19T02:21:21.341047+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.341047+0000","last_undegraded":"2024-04-19T02:21:21.341047+0000","last_fullsized":"2024-04-19T02:21:21.341047+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:30.201443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334723+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.334723+0000","last_peered":"2024-04-19T02:21:21.334723+0000","last_clean":"2024-04-19T02:21:21.334723+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.334723+0000","last_undegraded":"2024-04-19T02:21:21.334723+0000","last_fullsized":"2024-04-19T02:21:21.334723+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":872,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445604+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:19.445604+0000","last_peered":"2024-04-19T02:21:19.445604+0000","last_clean":"2024-04-19T02:21:19.445604+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:19.445604+0000","last_undegraded":"2024-04-19T02:21:19.445604+0000","last_fullsized":"2024-04-19T02:21:19.445604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346189+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.346189+0000","last_peered":"2024-04-19T02:21:21.346189+0000","last_clean":"2024-04-19T02:21:21.346189+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.346189+0000","last_undegraded":"2024-04-19T02:21:21.346189+0000","last_fullsized":"2024-04-19T02:21:21.346189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:25.982675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342225+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.342225+0000","last_peered":"2024-04-19T02:21:21.342225+0000","last_clean":"2024-04-19T02:21:21.342225+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.342225+0000","last_undegraded":"2024-04-19T02:21:21.342225+0000","last_fullsized":"2024-04-19T02:21:21.342225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:40.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":309,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445970+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:19.445970+0000","last_peered":"2024-04-19T02:21:19.445970+0000","last_clean":"2024-04-19T02:21:19.445970+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:19.445970+0000","last_undegraded":"2024-04-19T02:21:19.445970+0000","last_fullsized":"2024-04-19T02:21:19.445970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":555,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319678+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.319678+0000","last_peered":"2024-04-19T02:21:20.319678+0000","last_clean":"2024-04-19T02:21:20.319678+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.319678+0000","last_undegraded":"2024-04-19T02:21:20.319678+0000","last_fullsized":"2024-04-19T02:21:20.319678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446123+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:19.446123+0000","last_peered":"2024-04-19T02:21:19.446123+0000","last_clean":"2024-04-19T02:21:19.446123+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:19.446123+0000","last_undegraded":"2024-04-19T02:21:19.446123+0000","last_fullsized":"2024-04-19T02:21:19.446123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":522,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318328+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.318328+0000","last_peered":"2024-04-19T02:21:20.318328+0000","last_clean":"2024-04-19T02:21:20.318328+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.318328+0000","last_undegraded":"2024-04-19T02:21:20.318328+0000","last_fullsized":"2024-04-19T02:21:20.318328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":467,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446930+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:19.446930+0000","last_peered":"2024-04-19T02:21:19.446930+0000","last_clean":"2024-04-19T02:21:19.446930+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:19.446930+0000","last_undegraded":"2024-04-19T02:21:19.446930+0000","last_fullsized":"2024-04-19T02:21:19.446930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323975+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.323975+0000","last_peered":"2024-04-19T02:21:21.323975+0000","last_clean":"2024-04-19T02:21:21.323975+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.323975+0000","last_undegraded":"2024-04-19T02:21:21.323975+0000","last_fullsized":"2024-04-19T02:21:21.323975+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:35.319733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":136,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334181+0000","last_change":"2024-04-19T02:21:21.334181+0000","last_active":"2024-04-19T02:21:21.334181+0000","last_peered":"2024-04-19T02:21:21.334181+0000","last_clean":"2024-04-19T02:21:21.334181+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:21.334181+0000","last_undegraded":"2024-04-19T02:21:21.334181+0000","last_fullsized":"2024-04-19T02:21:21.334181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":568,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445838+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:19.445838+0000","last_peered":"2024-04-19T02:21:19.445838+0000","last_clean":"2024-04-19T02:21:19.445838+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:19.445838+0000","last_undegraded":"2024-04-19T02:21:19.445838+0000","last_fullsized":"2024-04-19T02:21:19.445838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317369+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.317369+0000","last_peered":"2024-04-19T02:21:21.317369+0000","last_clean":"2024-04-19T02:21:21.317369+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.317369+0000","last_undegraded":"2024-04-19T02:21:21.317369+0000","last_fullsized":"2024-04-19T02:21:21.317369+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446667+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:19.446667+0000","last_peered":"2024-04-19T02:21:19.446667+0000","last_clean":"2024-04-19T02:21:19.446667+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:19.446667+0000","last_undegraded":"2024-04-19T02:21:19.446667+0000","last_fullsized":"2024-04-19T02:21:19.446667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":856,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318127+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.318127+0000","last_peered":"2024-04-19T02:21:20.318127+0000","last_clean":"2024-04-19T02:21:20.318127+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.318127+0000","last_undegraded":"2024-04-19T02:21:20.318127+0000","last_fullsized":"2024-04-19T02:21:20.318127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":166,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446672+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:19.446672+0000","last_peered":"2024-04-19T02:21:19.446672+0000","last_clean":"2024-04-19T02:21:19.446672+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:19.446672+0000","last_undegraded":"2024-04-19T02:21:19.446672+0000","last_fullsized":"2024-04-19T02:21:19.446672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319600+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.319600+0000","last_peered":"2024-04-19T02:21:20.319600+0000","last_clean":"2024-04-19T02:21:20.319600+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.319600+0000","last_undegraded":"2024-04-19T02:21:20.319600+0000","last_fullsized":"2024-04-19T02:21:20.319600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":973,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318383+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.318383+0000","last_peered":"2024-04-19T02:21:20.318383+0000","last_clean":"2024-04-19T02:21:20.318383+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.318383+0000","last_undegraded":"2024-04-19T02:21:20.318383+0000","last_fullsized":"2024-04-19T02:21:20.318383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":176,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447475+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:19.447475+0000","last_peered":"2024-04-19T02:21:19.447475+0000","last_clean":"2024-04-19T02:21:19.447475+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:19.447475+0000","last_undegraded":"2024-04-19T02:21:19.447475+0000","last_fullsized":"2024-04-19T02:21:19.447475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447284+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:19.447284+0000","last_peered":"2024-04-19T02:21:19.447284+0000","last_clean":"2024-04-19T02:21:19.447284+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:19.447284+0000","last_undegraded":"2024-04-19T02:21:19.447284+0000","last_fullsized":"2024-04-19T02:21:19.447284+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":950,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445018+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:19.445018+0000","last_peered":"2024-04-19T02:21:19.445018+0000","last_clean":"2024-04-19T02:21:19.445018+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:19.445018+0000","last_undegraded":"2024-04-19T02:21:19.445018+0000","last_fullsized":"2024-04-19T02:21:19.445018+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":203,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447195+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:19.447195+0000","last_peered":"2024-04-19T02:21:19.447195+0000","last_clean":"2024-04-19T02:21:19.447195+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:19.447195+0000","last_undegraded":"2024-04-19T02:21:19.447195+0000","last_fullsized":"2024-04-19T02:21:19.447195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307515+0000","last_change":"2024-04-19T02:21:21.307515+0000","last_active":"2024-04-19T02:21:21.307515+0000","last_peered":"2024-04-19T02:21:21.307515+0000","last_clean":"2024-04-19T02:21:21.307515+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:21.307515+0000","last_undegraded":"2024-04-19T02:21:21.307515+0000","last_fullsized":"2024-04-19T02:21:21.307515+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444423+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:19.444423+0000","last_peered":"2024-04-19T02:21:19.444423+0000","last_clean":"2024-04-19T02:21:19.444423+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:19.444423+0000","last_undegraded":"2024-04-19T02:21:19.444423+0000","last_fullsized":"2024-04-19T02:21:19.444423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":501,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343149+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.343149+0000","last_peered":"2024-04-19T02:21:21.343149+0000","last_clean":"2024-04-19T02:21:21.343149+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.343149+0000","last_undegraded":"2024-04-19T02:21:21.343149+0000","last_fullsized":"2024-04-19T02:21:21.343149+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:38.509822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342574+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.342574+0000","last_peered":"2024-04-19T02:21:21.342574+0000","last_clean":"2024-04-19T02:21:21.342574+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.342574+0000","last_undegraded":"2024-04-19T02:21:21.342574+0000","last_fullsized":"2024-04-19T02:21:21.342574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":554,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444675+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:19.444675+0000","last_peered":"2024-04-19T02:21:19.444675+0000","last_clean":"2024-04-19T02:21:19.444675+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:19.444675+0000","last_undegraded":"2024-04-19T02:21:19.444675+0000","last_fullsized":"2024-04-19T02:21:19.444675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":215,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319334+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.319334+0000","last_peered":"2024-04-19T02:21:20.319334+0000","last_clean":"2024-04-19T02:21:20.319334+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.319334+0000","last_undegraded":"2024-04-19T02:21:20.319334+0000","last_fullsized":"2024-04-19T02:21:20.319334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":392,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307675+0000","last_change":"2024-04-19T02:21:21.307675+0000","last_active":"2024-04-19T02:21:21.307675+0000","last_peered":"2024-04-19T02:21:21.307675+0000","last_clean":"2024-04-19T02:21:21.307675+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:21.307675+0000","last_undegraded":"2024-04-19T02:21:21.307675+0000","last_fullsized":"2024-04-19T02:21:21.307675+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:47:29.710039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1018,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444920+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:19.444920+0000","last_peered":"2024-04-19T02:21:19.444920+0000","last_clean":"2024-04-19T02:21:19.444920+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:19.444920+0000","last_undegraded":"2024-04-19T02:21:19.444920+0000","last_fullsized":"2024-04-19T02:21:19.444920+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447357+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:19.447357+0000","last_peered":"2024-04-19T02:21:19.447357+0000","last_clean":"2024-04-19T02:21:19.447357+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:19.447357+0000","last_undegraded":"2024-04-19T02:21:19.447357+0000","last_fullsized":"2024-04-19T02:21:19.447357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":628,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.444907+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:19.444907+0000","last_peered":"2024-04-19T02:21:19.444907+0000","last_clean":"2024-04-19T02:21:19.444907+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:19.444907+0000","last_undegraded":"2024-04-19T02:21:19.444907+0000","last_fullsized":"2024-04-19T02:21:19.444907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":917,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.316736+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.316736+0000","last_peered":"2024-04-19T02:21:20.316736+0000","last_clean":"2024-04-19T02:21:20.316736+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.316736+0000","last_undegraded":"2024-04-19T02:21:20.316736+0000","last_fullsized":"2024-04-19T02:21:20.316736+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":682,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445725+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:19.445725+0000","last_peered":"2024-04-19T02:21:19.445725+0000","last_clean":"2024-04-19T02:21:19.445725+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:19.445725+0000","last_undegraded":"2024-04-19T02:21:19.445725+0000","last_fullsized":"2024-04-19T02:21:19.445725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":942,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446472+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:19.446472+0000","last_peered":"2024-04-19T02:21:19.446472+0000","last_clean":"2024-04-19T02:21:19.446472+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:19.446472+0000","last_undegraded":"2024-04-19T02:21:19.446472+0000","last_fullsized":"2024-04-19T02:21:19.446472+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":460,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.445345+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:19.445345+0000","last_peered":"2024-04-19T02:21:19.445345+0000","last_clean":"2024-04-19T02:21:19.445345+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:19.445345+0000","last_undegraded":"2024-04-19T02:21:19.445345+0000","last_fullsized":"2024-04-19T02:21:19.445345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":859,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318609+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:20.318609+0000","last_peered":"2024-04-19T02:21:20.318609+0000","last_clean":"2024-04-19T02:21:20.318609+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:20.318609+0000","last_undegraded":"2024-04-19T02:21:20.318609+0000","last_fullsized":"2024-04-19T02:21:20.318609+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":607,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462735+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:20.462735+0000","last_peered":"2024-04-19T02:21:20.462735+0000","last_clean":"2024-04-19T02:21:20.462735+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:20.462735+0000","last_undegraded":"2024-04-19T02:21:20.462735+0000","last_fullsized":"2024-04-19T02:21:20.462735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":548,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318531+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:20.318531+0000","last_peered":"2024-04-19T02:21:20.318531+0000","last_clean":"2024-04-19T02:21:20.318531+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:20.318531+0000","last_undegraded":"2024-04-19T02:21:20.318531+0000","last_fullsized":"2024-04-19T02:21:20.318531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318583+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:20.318583+0000","last_peered":"2024-04-19T02:21:20.318583+0000","last_clean":"2024-04-19T02:21:20.318583+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:20.318583+0000","last_undegraded":"2024-04-19T02:21:20.318583+0000","last_fullsized":"2024-04-19T02:21:20.318583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342619+0000","last_change":"2024-04-19T02:21:21.342619+0000","last_active":"2024-04-19T02:21:21.342619+0000","last_peered":"2024-04-19T02:21:21.342619+0000","last_clean":"2024-04-19T02:21:21.342619+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:21.342619+0000","last_undegraded":"2024-04-19T02:21:21.342619+0000","last_fullsized":"2024-04-19T02:21:21.342619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:44.328651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":403,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.336126+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.336126+0000","last_peered":"2024-04-19T02:21:21.336126+0000","last_clean":"2024-04-19T02:21:21.336126+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.336126+0000","last_undegraded":"2024-04-19T02:21:21.336126+0000","last_fullsized":"2024-04-19T02:21:21.336126+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":495,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.328166+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.328166+0000","last_peered":"2024-04-19T02:21:21.328166+0000","last_clean":"2024-04-19T02:21:21.328166+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.328166+0000","last_undegraded":"2024-04-19T02:21:21.328166+0000","last_fullsized":"2024-04-19T02:21:21.328166+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:04.798376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":506,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.319052+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:20.319052+0000","last_peered":"2024-04-19T02:21:20.319052+0000","last_clean":"2024-04-19T02:21:20.319052+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:20.319052+0000","last_undegraded":"2024-04-19T02:21:20.319052+0000","last_fullsized":"2024-04-19T02:21:20.319052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":632,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.318135+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.318135+0000","last_peered":"2024-04-19T02:21:20.318135+0000","last_clean":"2024-04-19T02:21:20.318135+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.318135+0000","last_undegraded":"2024-04-19T02:21:20.318135+0000","last_fullsized":"2024-04-19T02:21:20.318135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":178,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.446932+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:19.446932+0000","last_peered":"2024-04-19T02:21:19.446932+0000","last_clean":"2024-04-19T02:21:19.446932+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:19.446932+0000","last_undegraded":"2024-04-19T02:21:19.446932+0000","last_fullsized":"2024-04-19T02:21:19.446932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":558,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.338347+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.338347+0000","last_peered":"2024-04-19T02:21:21.338347+0000","last_clean":"2024-04-19T02:21:21.338347+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.338347+0000","last_undegraded":"2024-04-19T02:21:21.338347+0000","last_fullsized":"2024-04-19T02:21:21.338347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:19.012981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":180,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-19T02:21:19.447110+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:19.447110+0000","last_peered":"2024-04-19T02:21:19.447110+0000","last_clean":"2024-04-19T02:21:19.447110+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:19.447110+0000","last_undegraded":"2024-04-19T02:21:19.447110+0000","last_fullsized":"2024-04-19T02:21:19.447110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738435,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143028,"kb_used_data":27496,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94228812,"statfs":{"total":96636764160,"available":96490303488,"internally_reserved":0,"allocated":28155904,"data_stored":81658387,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":78,"seq":335007449101,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66136,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305704,"statfs":{"total":96636764160,"available":96569040896,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139592,"kb_used_data":28148,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232248,"statfs":{"total":96636764160,"available":96493821952,"internally_reserved":0,"allocated":28823552,"data_stored":86272278,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.58399999999999996,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.75600000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.69799999999999995},"min":{"1min":0.56999999999999995,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.76400000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:27.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:27.693 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:27.695 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:27.712 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-04-19T02:21:26.309760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332408,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783112,"statfs":{"total":289910292480,"available":289569906688,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3934,"num_bytes_recovered":-43241477,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.868537"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464171+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.464171+0000","last_peered":"2024-04-19T02:21:20.464171+0000","last_clean":"2024-04-19T02:21:20.464171+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.464171+0000","last_undegraded":"2024-04-19T02:21:20.464171+0000","last_fullsized":"2024-04-19T02:21:20.464171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":593,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463448+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.463448+0000","last_peered":"2024-04-19T02:21:20.463448+0000","last_clean":"2024-04-19T02:21:20.463448+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.463448+0000","last_undegraded":"2024-04-19T02:21:20.463448+0000","last_fullsized":"2024-04-19T02:21:20.463448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":483,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343830+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.343830+0000","last_peered":"2024-04-19T02:21:21.343830+0000","last_clean":"2024-04-19T02:21:21.343830+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.343830+0000","last_undegraded":"2024-04-19T02:21:21.343830+0000","last_fullsized":"2024-04-19T02:21:21.343830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:49.457654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":465,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342642+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.342642+0000","last_peered":"2024-04-19T02:21:21.342642+0000","last_clean":"2024-04-19T02:21:21.342642+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.342642+0000","last_undegraded":"2024-04-19T02:21:21.342642+0000","last_fullsized":"2024-04-19T02:21:21.342642+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:28.873039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:21.474108+0000","last_peered":"2024-04-19T02:21:21.474108+0000","last_clean":"2024-04-19T02:21:21.474108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:21.474108+0000","last_undegraded":"2024-04-19T02:21:21.474108+0000","last_fullsized":"2024-04-19T02:21:21.474108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":535,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348147+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348147+0000","last_peered":"2024-04-19T02:21:21.348147+0000","last_clean":"2024-04-19T02:21:21.348147+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348147+0000","last_undegraded":"2024-04-19T02:21:21.348147+0000","last_fullsized":"2024-04-19T02:21:21.348147+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:44.275063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":518,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.311849+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.311849+0000","last_peered":"2024-04-19T02:21:21.311849+0000","last_clean":"2024-04-19T02:21:21.311849+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.311849+0000","last_undegraded":"2024-04-19T02:21:21.311849+0000","last_fullsized":"2024-04-19T02:21:21.311849+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:51.111106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340703+0000","last_change":"2024-04-19T02:21:21.340703+0000","last_active":"2024-04-19T02:21:21.340703+0000","last_peered":"2024-04-19T02:21:21.340703+0000","last_clean":"2024-04-19T02:21:21.340703+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:21.340703+0000","last_undegraded":"2024-04-19T02:21:21.340703+0000","last_fullsized":"2024-04-19T02:21:21.340703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:48:22.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":563,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461341+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:20.461341+0000","last_peered":"2024-04-19T02:21:20.461341+0000","last_clean":"2024-04-19T02:21:20.461341+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:20.461341+0000","last_undegraded":"2024-04-19T02:21:20.461341+0000","last_fullsized":"2024-04-19T02:21:20.461341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":554,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462529+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.462529+0000","last_peered":"2024-04-19T02:21:20.462529+0000","last_clean":"2024-04-19T02:21:20.462529+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.462529+0000","last_undegraded":"2024-04-19T02:21:20.462529+0000","last_fullsized":"2024-04-19T02:21:20.462529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317186+0000","last_change":"2024-04-19T02:21:21.317186+0000","last_active":"2024-04-19T02:21:21.317186+0000","last_peered":"2024-04-19T02:21:21.317186+0000","last_clean":"2024-04-19T02:21:21.317186+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:21.317186+0000","last_undegraded":"2024-04-19T02:21:21.317186+0000","last_fullsized":"2024-04-19T02:21:21.317186+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:23.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":911,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460461+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.460461+0000","last_peered":"2024-04-19T02:21:20.460461+0000","last_clean":"2024-04-19T02:21:20.460461+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.460461+0000","last_undegraded":"2024-04-19T02:21:20.460461+0000","last_fullsized":"2024-04-19T02:21:20.460461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460799+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.460799+0000","last_peered":"2024-04-19T02:21:20.460799+0000","last_clean":"2024-04-19T02:21:20.460799+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.460799+0000","last_undegraded":"2024-04-19T02:21:20.460799+0000","last_fullsized":"2024-04-19T02:21:20.460799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341036+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.341036+0000","last_peered":"2024-04-19T02:21:21.341036+0000","last_clean":"2024-04-19T02:21:21.341036+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.341036+0000","last_undegraded":"2024-04-19T02:21:21.341036+0000","last_fullsized":"2024-04-19T02:21:21.341036+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:35.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330764+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.330764+0000","last_peered":"2024-04-19T02:21:21.330764+0000","last_clean":"2024-04-19T02:21:21.330764+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.330764+0000","last_undegraded":"2024-04-19T02:21:21.330764+0000","last_fullsized":"2024-04-19T02:21:21.330764+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:28.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":576,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.337686+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.337686+0000","last_peered":"2024-04-19T02:21:21.337686+0000","last_clean":"2024-04-19T02:21:21.337686+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.337686+0000","last_undegraded":"2024-04-19T02:21:21.337686+0000","last_fullsized":"2024-04-19T02:21:21.337686+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:03.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":561,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463208+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:20.463208+0000","last_peered":"2024-04-19T02:21:20.463208+0000","last_clean":"2024-04-19T02:21:20.463208+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:20.463208+0000","last_undegraded":"2024-04-19T02:21:20.463208+0000","last_fullsized":"2024-04-19T02:21:20.463208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463438+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.463438+0000","last_peered":"2024-04-19T02:21:20.463438+0000","last_clean":"2024-04-19T02:21:20.463438+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.463438+0000","last_undegraded":"2024-04-19T02:21:20.463438+0000","last_fullsized":"2024-04-19T02:21:20.463438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":649,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460217+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:20.460217+0000","last_peered":"2024-04-19T02:21:20.460217+0000","last_clean":"2024-04-19T02:21:20.460217+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:20.460217+0000","last_undegraded":"2024-04-19T02:21:20.460217+0000","last_fullsized":"2024-04-19T02:21:20.460217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":511,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341981+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.341981+0000","last_peered":"2024-04-19T02:21:21.341981+0000","last_clean":"2024-04-19T02:21:21.341981+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.341981+0000","last_undegraded":"2024-04-19T02:21:21.341981+0000","last_fullsized":"2024-04-19T02:21:21.341981+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:37.611409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.321511+0000","last_change":"2024-04-19T02:21:21.321511+0000","last_active":"2024-04-19T02:21:21.321511+0000","last_peered":"2024-04-19T02:21:21.321511+0000","last_clean":"2024-04-19T02:21:21.321511+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:21.321511+0000","last_undegraded":"2024-04-19T02:21:21.321511+0000","last_fullsized":"2024-04-19T02:21:21.321511+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:01.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1122,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462258+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.462258+0000","last_peered":"2024-04-19T02:21:20.462258+0000","last_clean":"2024-04-19T02:21:20.462258+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.462258+0000","last_undegraded":"2024-04-19T02:21:20.462258+0000","last_fullsized":"2024-04-19T02:21:20.462258+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":900,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459195+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:20.459195+0000","last_peered":"2024-04-19T02:21:20.459195+0000","last_clean":"2024-04-19T02:21:20.459195+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:20.459195+0000","last_undegraded":"2024-04-19T02:21:20.459195+0000","last_fullsized":"2024-04-19T02:21:20.459195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459306+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.459306+0000","last_peered":"2024-04-19T02:21:20.459306+0000","last_clean":"2024-04-19T02:21:20.459306+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.459306+0000","last_undegraded":"2024-04-19T02:21:20.459306+0000","last_fullsized":"2024-04-19T02:21:20.459306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":950,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463490+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.463490+0000","last_peered":"2024-04-19T02:21:20.463490+0000","last_clean":"2024-04-19T02:21:20.463490+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.463490+0000","last_undegraded":"2024-04-19T02:21:20.463490+0000","last_fullsized":"2024-04-19T02:21:20.463490+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462020+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:20.462020+0000","last_peered":"2024-04-19T02:21:20.462020+0000","last_clean":"2024-04-19T02:21:20.462020+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:20.462020+0000","last_undegraded":"2024-04-19T02:21:20.462020+0000","last_fullsized":"2024-04-19T02:21:20.462020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346297+0000","last_change":"2024-04-19T02:21:21.346297+0000","last_active":"2024-04-19T02:21:21.346297+0000","last_peered":"2024-04-19T02:21:21.346297+0000","last_clean":"2024-04-19T02:21:21.346297+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:21.346297+0000","last_undegraded":"2024-04-19T02:21:21.346297+0000","last_fullsized":"2024-04-19T02:21:21.346297+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:35.018270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":816,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462465+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.462465+0000","last_peered":"2024-04-19T02:21:20.462465+0000","last_clean":"2024-04-19T02:21:20.462465+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.462465+0000","last_undegraded":"2024-04-19T02:21:20.462465+0000","last_fullsized":"2024-04-19T02:21:20.462465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":539,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466063+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:20.466063+0000","last_peered":"2024-04-19T02:21:20.466063+0000","last_clean":"2024-04-19T02:21:20.466063+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:20.466063+0000","last_undegraded":"2024-04-19T02:21:20.466063+0000","last_fullsized":"2024-04-19T02:21:20.466063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1077,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":616,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459476+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:20.459476+0000","last_peered":"2024-04-19T02:21:20.459476+0000","last_clean":"2024-04-19T02:21:20.459476+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:20.459476+0000","last_undegraded":"2024-04-19T02:21:20.459476+0000","last_fullsized":"2024-04-19T02:21:20.459476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341631+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.341631+0000","last_peered":"2024-04-19T02:21:21.341631+0000","last_clean":"2024-04-19T02:21:21.341631+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.341631+0000","last_undegraded":"2024-04-19T02:21:21.341631+0000","last_fullsized":"2024-04-19T02:21:21.341631+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:57.921400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":498,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462207+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.462207+0000","last_peered":"2024-04-19T02:21:20.462207+0000","last_clean":"2024-04-19T02:21:20.462207+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.462207+0000","last_undegraded":"2024-04-19T02:21:20.462207+0000","last_fullsized":"2024-04-19T02:21:20.462207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330108+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.330108+0000","last_peered":"2024-04-19T02:21:21.330108+0000","last_clean":"2024-04-19T02:21:21.330108+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.330108+0000","last_undegraded":"2024-04-19T02:21:21.330108+0000","last_fullsized":"2024-04-19T02:21:21.330108+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:26.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":547,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.465527+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.465527+0000","last_peered":"2024-04-19T02:21:20.465527+0000","last_clean":"2024-04-19T02:21:20.465527+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.465527+0000","last_undegraded":"2024-04-19T02:21:20.465527+0000","last_fullsized":"2024-04-19T02:21:20.465527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1021,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464416+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:20.464416+0000","last_peered":"2024-04-19T02:21:20.464416+0000","last_clean":"2024-04-19T02:21:20.464416+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:20.464416+0000","last_undegraded":"2024-04-19T02:21:20.464416+0000","last_fullsized":"2024-04-19T02:21:20.464416+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460150+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.460150+0000","last_peered":"2024-04-19T02:21:20.460150+0000","last_clean":"2024-04-19T02:21:20.460150+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.460150+0000","last_undegraded":"2024-04-19T02:21:20.460150+0000","last_fullsized":"2024-04-19T02:21:20.460150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":910,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461582+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:20.461582+0000","last_peered":"2024-04-19T02:21:20.461582+0000","last_clean":"2024-04-19T02:21:20.461582+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:20.461582+0000","last_undegraded":"2024-04-19T02:21:20.461582+0000","last_fullsized":"2024-04-19T02:21:20.461582+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":130,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341978+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.341978+0000","last_peered":"2024-04-19T02:21:21.341978+0000","last_clean":"2024-04-19T02:21:21.341978+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.341978+0000","last_undegraded":"2024-04-19T02:21:21.341978+0000","last_fullsized":"2024-04-19T02:21:21.341978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:38.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":245,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.320439+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.320439+0000","last_peered":"2024-04-19T02:21:21.320439+0000","last_clean":"2024-04-19T02:21:21.320439+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.320439+0000","last_undegraded":"2024-04-19T02:21:21.320439+0000","last_fullsized":"2024-04-19T02:21:21.320439+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:12.736548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":895,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459571+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.459571+0000","last_peered":"2024-04-19T02:21:20.459571+0000","last_clean":"2024-04-19T02:21:20.459571+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.459571+0000","last_undegraded":"2024-04-19T02:21:20.459571+0000","last_fullsized":"2024-04-19T02:21:20.459571+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463759+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.463759+0000","last_peered":"2024-04-19T02:21:20.463759+0000","last_clean":"2024-04-19T02:21:20.463759+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.463759+0000","last_undegraded":"2024-04-19T02:21:20.463759+0000","last_fullsized":"2024-04-19T02:21:20.463759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459688+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.459688+0000","last_peered":"2024-04-19T02:21:20.459688+0000","last_clean":"2024-04-19T02:21:20.459688+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.459688+0000","last_undegraded":"2024-04-19T02:21:20.459688+0000","last_fullsized":"2024-04-19T02:21:20.459688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":674,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.339398+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.339398+0000","last_peered":"2024-04-19T02:21:21.339398+0000","last_clean":"2024-04-19T02:21:21.339398+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.339398+0000","last_undegraded":"2024-04-19T02:21:21.339398+0000","last_fullsized":"2024-04-19T02:21:21.339398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:50.683246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":491,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.327562+0000","last_change":"2024-04-19T02:21:21.327562+0000","last_active":"2024-04-19T02:21:21.327562+0000","last_peered":"2024-04-19T02:21:21.327562+0000","last_clean":"2024-04-19T02:21:21.327562+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:21.327562+0000","last_undegraded":"2024-04-19T02:21:21.327562+0000","last_fullsized":"2024-04-19T02:21:21.327562+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:00:27.273002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":121,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.304724+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.304724+0000","last_peered":"2024-04-19T02:21:21.304724+0000","last_clean":"2024-04-19T02:21:21.304724+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.304724+0000","last_undegraded":"2024-04-19T02:21:21.304724+0000","last_fullsized":"2024-04-19T02:21:21.304724+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:58.461641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1082,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463986+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:20.463986+0000","last_peered":"2024-04-19T02:21:20.463986+0000","last_clean":"2024-04-19T02:21:20.463986+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:20.463986+0000","last_undegraded":"2024-04-19T02:21:20.463986+0000","last_fullsized":"2024-04-19T02:21:20.463986+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.468359+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:20.468359+0000","last_peered":"2024-04-19T02:21:20.468359+0000","last_clean":"2024-04-19T02:21:20.468359+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:20.468359+0000","last_undegraded":"2024-04-19T02:21:20.468359+0000","last_fullsized":"2024-04-19T02:21:20.468359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323437+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.323437+0000","last_peered":"2024-04-19T02:21:21.323437+0000","last_clean":"2024-04-19T02:21:21.323437+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.323437+0000","last_undegraded":"2024-04-19T02:21:21.323437+0000","last_fullsized":"2024-04-19T02:21:21.323437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:15.338811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323460+0000","last_change":"2024-04-19T02:21:21.323460+0000","last_active":"2024-04-19T02:21:21.323460+0000","last_peered":"2024-04-19T02:21:21.323460+0000","last_clean":"2024-04-19T02:21:21.323460+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:21.323460+0000","last_undegraded":"2024-04-19T02:21:21.323460+0000","last_fullsized":"2024-04-19T02:21:21.323460+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":583,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344252+0000","last_change":"2024-04-19T02:21:21.344252+0000","last_active":"2024-04-19T02:21:21.344252+0000","last_peered":"2024-04-19T02:21:21.344252+0000","last_clean":"2024-04-19T02:21:21.344252+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:21:21.344252+0000","last_undegraded":"2024-04-19T02:21:21.344252+0000","last_fullsized":"2024-04-19T02:21:21.344252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:47.406900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460409+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.460409+0000","last_peered":"2024-04-19T02:21:20.460409+0000","last_clean":"2024-04-19T02:21:20.460409+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.460409+0000","last_undegraded":"2024-04-19T02:21:20.460409+0000","last_fullsized":"2024-04-19T02:21:20.460409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":450,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.319032+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.319032+0000","last_peered":"2024-04-19T02:21:21.319032+0000","last_clean":"2024-04-19T02:21:21.319032+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.319032+0000","last_undegraded":"2024-04-19T02:21:21.319032+0000","last_fullsized":"2024-04-19T02:21:21.319032+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:03.038712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":502,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459835+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.459835+0000","last_peered":"2024-04-19T02:21:20.459835+0000","last_clean":"2024-04-19T02:21:20.459835+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.459835+0000","last_undegraded":"2024-04-19T02:21:20.459835+0000","last_fullsized":"2024-04-19T02:21:20.459835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":531,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462045+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:20.462045+0000","last_peered":"2024-04-19T02:21:20.462045+0000","last_clean":"2024-04-19T02:21:20.462045+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:20.462045+0000","last_undegraded":"2024-04-19T02:21:20.462045+0000","last_fullsized":"2024-04-19T02:21:20.462045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341047+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.341047+0000","last_peered":"2024-04-19T02:21:21.341047+0000","last_clean":"2024-04-19T02:21:21.341047+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.341047+0000","last_undegraded":"2024-04-19T02:21:21.341047+0000","last_fullsized":"2024-04-19T02:21:21.341047+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:30.201443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334723+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.334723+0000","last_peered":"2024-04-19T02:21:21.334723+0000","last_clean":"2024-04-19T02:21:21.334723+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.334723+0000","last_undegraded":"2024-04-19T02:21:21.334723+0000","last_fullsized":"2024-04-19T02:21:21.334723+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":873,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466035+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:20.466035+0000","last_peered":"2024-04-19T02:21:20.466035+0000","last_clean":"2024-04-19T02:21:20.466035+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:20.466035+0000","last_undegraded":"2024-04-19T02:21:20.466035+0000","last_fullsized":"2024-04-19T02:21:20.466035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346189+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.346189+0000","last_peered":"2024-04-19T02:21:21.346189+0000","last_clean":"2024-04-19T02:21:21.346189+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.346189+0000","last_undegraded":"2024-04-19T02:21:21.346189+0000","last_fullsized":"2024-04-19T02:21:21.346189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:25.982675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342225+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.342225+0000","last_peered":"2024-04-19T02:21:21.342225+0000","last_clean":"2024-04-19T02:21:21.342225+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.342225+0000","last_undegraded":"2024-04-19T02:21:21.342225+0000","last_fullsized":"2024-04-19T02:21:21.342225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:40.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":310,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461829+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:20.461829+0000","last_peered":"2024-04-19T02:21:20.461829+0000","last_clean":"2024-04-19T02:21:20.461829+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:20.461829+0000","last_undegraded":"2024-04-19T02:21:20.461829+0000","last_fullsized":"2024-04-19T02:21:20.461829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":556,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463696+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.463696+0000","last_peered":"2024-04-19T02:21:20.463696+0000","last_clean":"2024-04-19T02:21:20.463696+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.463696+0000","last_undegraded":"2024-04-19T02:21:20.463696+0000","last_fullsized":"2024-04-19T02:21:20.463696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462303+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:20.462303+0000","last_peered":"2024-04-19T02:21:20.462303+0000","last_clean":"2024-04-19T02:21:20.462303+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:20.462303+0000","last_undegraded":"2024-04-19T02:21:20.462303+0000","last_fullsized":"2024-04-19T02:21:20.462303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":523,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460080+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.460080+0000","last_peered":"2024-04-19T02:21:20.460080+0000","last_clean":"2024-04-19T02:21:20.460080+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.460080+0000","last_undegraded":"2024-04-19T02:21:20.460080+0000","last_fullsized":"2024-04-19T02:21:20.460080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":468,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462571+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:20.462571+0000","last_peered":"2024-04-19T02:21:20.462571+0000","last_clean":"2024-04-19T02:21:20.462571+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:20.462571+0000","last_undegraded":"2024-04-19T02:21:20.462571+0000","last_fullsized":"2024-04-19T02:21:20.462571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323975+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.323975+0000","last_peered":"2024-04-19T02:21:21.323975+0000","last_clean":"2024-04-19T02:21:21.323975+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.323975+0000","last_undegraded":"2024-04-19T02:21:21.323975+0000","last_fullsized":"2024-04-19T02:21:21.323975+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:35.319733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":136,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334181+0000","last_change":"2024-04-19T02:21:21.334181+0000","last_active":"2024-04-19T02:21:21.334181+0000","last_peered":"2024-04-19T02:21:21.334181+0000","last_clean":"2024-04-19T02:21:21.334181+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:21.334181+0000","last_undegraded":"2024-04-19T02:21:21.334181+0000","last_fullsized":"2024-04-19T02:21:21.334181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463012+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:20.463012+0000","last_peered":"2024-04-19T02:21:20.463012+0000","last_clean":"2024-04-19T02:21:20.463012+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:20.463012+0000","last_undegraded":"2024-04-19T02:21:20.463012+0000","last_fullsized":"2024-04-19T02:21:20.463012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317369+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.317369+0000","last_peered":"2024-04-19T02:21:21.317369+0000","last_clean":"2024-04-19T02:21:21.317369+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.317369+0000","last_undegraded":"2024-04-19T02:21:21.317369+0000","last_fullsized":"2024-04-19T02:21:21.317369+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466694+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:20.466694+0000","last_peered":"2024-04-19T02:21:20.466694+0000","last_clean":"2024-04-19T02:21:20.466694+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:20.466694+0000","last_undegraded":"2024-04-19T02:21:20.466694+0000","last_fullsized":"2024-04-19T02:21:20.466694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":857,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462444+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.462444+0000","last_peered":"2024-04-19T02:21:20.462444+0000","last_clean":"2024-04-19T02:21:20.462444+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.462444+0000","last_undegraded":"2024-04-19T02:21:20.462444+0000","last_fullsized":"2024-04-19T02:21:20.462444+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":167,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466454+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:20.466454+0000","last_peered":"2024-04-19T02:21:20.466454+0000","last_clean":"2024-04-19T02:21:20.466454+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:20.466454+0000","last_undegraded":"2024-04-19T02:21:20.466454+0000","last_fullsized":"2024-04-19T02:21:20.466454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":115,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467210+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.467210+0000","last_peered":"2024-04-19T02:21:20.467210+0000","last_clean":"2024-04-19T02:21:20.467210+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.467210+0000","last_undegraded":"2024-04-19T02:21:20.467210+0000","last_fullsized":"2024-04-19T02:21:20.467210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":974,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463297+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.463297+0000","last_peered":"2024-04-19T02:21:20.463297+0000","last_clean":"2024-04-19T02:21:20.463297+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.463297+0000","last_undegraded":"2024-04-19T02:21:20.463297+0000","last_fullsized":"2024-04-19T02:21:20.463297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463479+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:20.463479+0000","last_peered":"2024-04-19T02:21:20.463479+0000","last_clean":"2024-04-19T02:21:20.463479+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:20.463479+0000","last_undegraded":"2024-04-19T02:21:20.463479+0000","last_fullsized":"2024-04-19T02:21:20.463479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466709+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:20.466709+0000","last_peered":"2024-04-19T02:21:20.466709+0000","last_clean":"2024-04-19T02:21:20.466709+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:20.466709+0000","last_undegraded":"2024-04-19T02:21:20.466709+0000","last_fullsized":"2024-04-19T02:21:20.466709+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":951,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466559+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:20.466559+0000","last_peered":"2024-04-19T02:21:20.466559+0000","last_clean":"2024-04-19T02:21:20.466559+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:20.466559+0000","last_undegraded":"2024-04-19T02:21:20.466559+0000","last_fullsized":"2024-04-19T02:21:20.466559+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464664+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:20.464664+0000","last_peered":"2024-04-19T02:21:20.464664+0000","last_clean":"2024-04-19T02:21:20.464664+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:20.464664+0000","last_undegraded":"2024-04-19T02:21:20.464664+0000","last_fullsized":"2024-04-19T02:21:20.464664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307515+0000","last_change":"2024-04-19T02:21:21.307515+0000","last_active":"2024-04-19T02:21:21.307515+0000","last_peered":"2024-04-19T02:21:21.307515+0000","last_clean":"2024-04-19T02:21:21.307515+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:21.307515+0000","last_undegraded":"2024-04-19T02:21:21.307515+0000","last_fullsized":"2024-04-19T02:21:21.307515+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":577,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.458922+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:20.458922+0000","last_peered":"2024-04-19T02:21:20.458922+0000","last_clean":"2024-04-19T02:21:20.458922+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:20.458922+0000","last_undegraded":"2024-04-19T02:21:20.458922+0000","last_fullsized":"2024-04-19T02:21:20.458922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":501,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343149+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.343149+0000","last_peered":"2024-04-19T02:21:21.343149+0000","last_clean":"2024-04-19T02:21:21.343149+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.343149+0000","last_undegraded":"2024-04-19T02:21:21.343149+0000","last_fullsized":"2024-04-19T02:21:21.343149+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:38.509822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342574+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.342574+0000","last_peered":"2024-04-19T02:21:21.342574+0000","last_clean":"2024-04-19T02:21:21.342574+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.342574+0000","last_undegraded":"2024-04-19T02:21:21.342574+0000","last_fullsized":"2024-04-19T02:21:21.342574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":555,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459154+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:20.459154+0000","last_peered":"2024-04-19T02:21:20.459154+0000","last_clean":"2024-04-19T02:21:20.459154+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:20.459154+0000","last_undegraded":"2024-04-19T02:21:20.459154+0000","last_fullsized":"2024-04-19T02:21:20.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466348+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.466348+0000","last_peered":"2024-04-19T02:21:20.466348+0000","last_clean":"2024-04-19T02:21:20.466348+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.466348+0000","last_undegraded":"2024-04-19T02:21:20.466348+0000","last_fullsized":"2024-04-19T02:21:20.466348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":392,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307675+0000","last_change":"2024-04-19T02:21:21.307675+0000","last_active":"2024-04-19T02:21:21.307675+0000","last_peered":"2024-04-19T02:21:21.307675+0000","last_clean":"2024-04-19T02:21:21.307675+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:21.307675+0000","last_undegraded":"2024-04-19T02:21:21.307675+0000","last_fullsized":"2024-04-19T02:21:21.307675+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:47:29.710039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1019,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459723+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:20.459723+0000","last_peered":"2024-04-19T02:21:20.459723+0000","last_clean":"2024-04-19T02:21:20.459723+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:20.459723+0000","last_undegraded":"2024-04-19T02:21:20.459723+0000","last_fullsized":"2024-04-19T02:21:20.459723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463263+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:20.463263+0000","last_peered":"2024-04-19T02:21:20.463263+0000","last_clean":"2024-04-19T02:21:20.463263+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:20.463263+0000","last_undegraded":"2024-04-19T02:21:20.463263+0000","last_fullsized":"2024-04-19T02:21:20.463263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":629,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466275+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:20.466275+0000","last_peered":"2024-04-19T02:21:20.466275+0000","last_clean":"2024-04-19T02:21:20.466275+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:20.466275+0000","last_undegraded":"2024-04-19T02:21:20.466275+0000","last_fullsized":"2024-04-19T02:21:20.466275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":918,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463835+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.463835+0000","last_peered":"2024-04-19T02:21:20.463835+0000","last_clean":"2024-04-19T02:21:20.463835+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.463835+0000","last_undegraded":"2024-04-19T02:21:20.463835+0000","last_fullsized":"2024-04-19T02:21:20.463835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":683,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467179+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:20.467179+0000","last_peered":"2024-04-19T02:21:20.467179+0000","last_clean":"2024-04-19T02:21:20.467179+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:20.467179+0000","last_undegraded":"2024-04-19T02:21:20.467179+0000","last_fullsized":"2024-04-19T02:21:20.467179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":943,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461566+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:20.461566+0000","last_peered":"2024-04-19T02:21:20.461566+0000","last_clean":"2024-04-19T02:21:20.461566+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:20.461566+0000","last_undegraded":"2024-04-19T02:21:20.461566+0000","last_fullsized":"2024-04-19T02:21:20.461566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":461,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461576+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:20.461576+0000","last_peered":"2024-04-19T02:21:20.461576+0000","last_clean":"2024-04-19T02:21:20.461576+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:20.461576+0000","last_undegraded":"2024-04-19T02:21:20.461576+0000","last_fullsized":"2024-04-19T02:21:20.461576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":861,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474998+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:21.474998+0000","last_peered":"2024-04-19T02:21:21.474998+0000","last_clean":"2024-04-19T02:21:21.474998+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:21.474998+0000","last_undegraded":"2024-04-19T02:21:21.474998+0000","last_fullsized":"2024-04-19T02:21:21.474998+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":608,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.226780+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.226780+0000","last_peered":"2024-04-19T02:21:21.226780+0000","last_clean":"2024-04-19T02:21:21.226780+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.226780+0000","last_undegraded":"2024-04-19T02:21:21.226780+0000","last_fullsized":"2024-04-19T02:21:21.226780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474745+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:21.474745+0000","last_peered":"2024-04-19T02:21:21.474745+0000","last_clean":"2024-04-19T02:21:21.474745+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:21.474745+0000","last_undegraded":"2024-04-19T02:21:21.474745+0000","last_fullsized":"2024-04-19T02:21:21.474745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":188,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474193+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:21.474193+0000","last_peered":"2024-04-19T02:21:21.474193+0000","last_clean":"2024-04-19T02:21:21.474193+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:21.474193+0000","last_undegraded":"2024-04-19T02:21:21.474193+0000","last_fullsized":"2024-04-19T02:21:21.474193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342619+0000","last_change":"2024-04-19T02:21:21.342619+0000","last_active":"2024-04-19T02:21:21.342619+0000","last_peered":"2024-04-19T02:21:21.342619+0000","last_clean":"2024-04-19T02:21:21.342619+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:21.342619+0000","last_undegraded":"2024-04-19T02:21:21.342619+0000","last_fullsized":"2024-04-19T02:21:21.342619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:44.328651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":403,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.336126+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.336126+0000","last_peered":"2024-04-19T02:21:21.336126+0000","last_clean":"2024-04-19T02:21:21.336126+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.336126+0000","last_undegraded":"2024-04-19T02:21:21.336126+0000","last_fullsized":"2024-04-19T02:21:21.336126+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":495,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.328166+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.328166+0000","last_peered":"2024-04-19T02:21:21.328166+0000","last_clean":"2024-04-19T02:21:21.328166+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.328166+0000","last_undegraded":"2024-04-19T02:21:21.328166+0000","last_fullsized":"2024-04-19T02:21:21.328166+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:04.798376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475446+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:21.475446+0000","last_peered":"2024-04-19T02:21:21.475446+0000","last_clean":"2024-04-19T02:21:21.475446+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:21.475446+0000","last_undegraded":"2024-04-19T02:21:21.475446+0000","last_fullsized":"2024-04-19T02:21:21.475446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":633,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460698+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.460698+0000","last_peered":"2024-04-19T02:21:20.460698+0000","last_clean":"2024-04-19T02:21:20.460698+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.460698+0000","last_undegraded":"2024-04-19T02:21:20.460698+0000","last_fullsized":"2024-04-19T02:21:20.460698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464155+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:20.464155+0000","last_peered":"2024-04-19T02:21:20.464155+0000","last_clean":"2024-04-19T02:21:20.464155+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:20.464155+0000","last_undegraded":"2024-04-19T02:21:20.464155+0000","last_fullsized":"2024-04-19T02:21:20.464155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":558,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.338347+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.338347+0000","last_peered":"2024-04-19T02:21:21.338347+0000","last_clean":"2024-04-19T02:21:21.338347+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.338347+0000","last_undegraded":"2024-04-19T02:21:21.338347+0000","last_fullsized":"2024-04-19T02:21:21.338347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:19.012981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462736+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:20.462736+0000","last_peered":"2024-04-19T02:21:20.462736+0000","last_clean":"2024-04-19T02:21:20.462736+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:20.462736+0000","last_undegraded":"2024-04-19T02:21:20.462736+0000","last_fullsized":"2024-04-19T02:21:20.462736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126656,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245184,"statfs":{"total":96636764160,"available":96507068416,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":78,"seq":335007449101,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66136,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305704,"statfs":{"total":96636764160,"available":96569040896,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139616,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232224,"statfs":{"total":96636764160,"available":96493797376,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.499,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94499999999999995,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:27.717 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T02:21:27.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-19T02:21:28.075 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-19T02:21:28.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T02:21:28.085 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:28.383 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:28.384 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:28.402 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-19T02:21:28.310505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332408,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783112,"statfs":{"total":289910292480,"available":289569906688,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3934,"num_bytes_recovered":-43241477,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003125"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464171+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.464171+0000","last_peered":"2024-04-19T02:21:20.464171+0000","last_clean":"2024-04-19T02:21:20.464171+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.464171+0000","last_undegraded":"2024-04-19T02:21:20.464171+0000","last_fullsized":"2024-04-19T02:21:20.464171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":593,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463448+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.463448+0000","last_peered":"2024-04-19T02:21:20.463448+0000","last_clean":"2024-04-19T02:21:20.463448+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.463448+0000","last_undegraded":"2024-04-19T02:21:20.463448+0000","last_fullsized":"2024-04-19T02:21:20.463448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":483,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343830+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.343830+0000","last_peered":"2024-04-19T02:21:21.343830+0000","last_clean":"2024-04-19T02:21:21.343830+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.343830+0000","last_undegraded":"2024-04-19T02:21:21.343830+0000","last_fullsized":"2024-04-19T02:21:21.343830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:49.457654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":465,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342642+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.342642+0000","last_peered":"2024-04-19T02:21:21.342642+0000","last_clean":"2024-04-19T02:21:21.342642+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.342642+0000","last_undegraded":"2024-04-19T02:21:21.342642+0000","last_fullsized":"2024-04-19T02:21:21.342642+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:28.873039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:21.474108+0000","last_peered":"2024-04-19T02:21:21.474108+0000","last_clean":"2024-04-19T02:21:21.474108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:21.474108+0000","last_undegraded":"2024-04-19T02:21:21.474108+0000","last_fullsized":"2024-04-19T02:21:21.474108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":535,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348147+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348147+0000","last_peered":"2024-04-19T02:21:21.348147+0000","last_clean":"2024-04-19T02:21:21.348147+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348147+0000","last_undegraded":"2024-04-19T02:21:21.348147+0000","last_fullsized":"2024-04-19T02:21:21.348147+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:44.275063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":518,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.311849+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.311849+0000","last_peered":"2024-04-19T02:21:21.311849+0000","last_clean":"2024-04-19T02:21:21.311849+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.311849+0000","last_undegraded":"2024-04-19T02:21:21.311849+0000","last_fullsized":"2024-04-19T02:21:21.311849+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:51.111106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340703+0000","last_change":"2024-04-19T02:21:21.340703+0000","last_active":"2024-04-19T02:21:21.340703+0000","last_peered":"2024-04-19T02:21:21.340703+0000","last_clean":"2024-04-19T02:21:21.340703+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:21.340703+0000","last_undegraded":"2024-04-19T02:21:21.340703+0000","last_fullsized":"2024-04-19T02:21:21.340703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:48:22.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":563,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461341+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:20.461341+0000","last_peered":"2024-04-19T02:21:20.461341+0000","last_clean":"2024-04-19T02:21:20.461341+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:20.461341+0000","last_undegraded":"2024-04-19T02:21:20.461341+0000","last_fullsized":"2024-04-19T02:21:20.461341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":554,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462529+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.462529+0000","last_peered":"2024-04-19T02:21:20.462529+0000","last_clean":"2024-04-19T02:21:20.462529+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.462529+0000","last_undegraded":"2024-04-19T02:21:20.462529+0000","last_fullsized":"2024-04-19T02:21:20.462529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317186+0000","last_change":"2024-04-19T02:21:21.317186+0000","last_active":"2024-04-19T02:21:21.317186+0000","last_peered":"2024-04-19T02:21:21.317186+0000","last_clean":"2024-04-19T02:21:21.317186+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:21.317186+0000","last_undegraded":"2024-04-19T02:21:21.317186+0000","last_fullsized":"2024-04-19T02:21:21.317186+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:23.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":911,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460461+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.460461+0000","last_peered":"2024-04-19T02:21:20.460461+0000","last_clean":"2024-04-19T02:21:20.460461+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.460461+0000","last_undegraded":"2024-04-19T02:21:20.460461+0000","last_fullsized":"2024-04-19T02:21:20.460461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460799+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.460799+0000","last_peered":"2024-04-19T02:21:20.460799+0000","last_clean":"2024-04-19T02:21:20.460799+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.460799+0000","last_undegraded":"2024-04-19T02:21:20.460799+0000","last_fullsized":"2024-04-19T02:21:20.460799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341036+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.341036+0000","last_peered":"2024-04-19T02:21:21.341036+0000","last_clean":"2024-04-19T02:21:21.341036+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.341036+0000","last_undegraded":"2024-04-19T02:21:21.341036+0000","last_fullsized":"2024-04-19T02:21:21.341036+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:35.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330764+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.330764+0000","last_peered":"2024-04-19T02:21:21.330764+0000","last_clean":"2024-04-19T02:21:21.330764+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.330764+0000","last_undegraded":"2024-04-19T02:21:21.330764+0000","last_fullsized":"2024-04-19T02:21:21.330764+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:28.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":576,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.337686+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.337686+0000","last_peered":"2024-04-19T02:21:21.337686+0000","last_clean":"2024-04-19T02:21:21.337686+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.337686+0000","last_undegraded":"2024-04-19T02:21:21.337686+0000","last_fullsized":"2024-04-19T02:21:21.337686+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:03.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":561,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463208+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:20.463208+0000","last_peered":"2024-04-19T02:21:20.463208+0000","last_clean":"2024-04-19T02:21:20.463208+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:20.463208+0000","last_undegraded":"2024-04-19T02:21:20.463208+0000","last_fullsized":"2024-04-19T02:21:20.463208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463438+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.463438+0000","last_peered":"2024-04-19T02:21:20.463438+0000","last_clean":"2024-04-19T02:21:20.463438+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.463438+0000","last_undegraded":"2024-04-19T02:21:20.463438+0000","last_fullsized":"2024-04-19T02:21:20.463438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":649,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460217+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:20.460217+0000","last_peered":"2024-04-19T02:21:20.460217+0000","last_clean":"2024-04-19T02:21:20.460217+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:20.460217+0000","last_undegraded":"2024-04-19T02:21:20.460217+0000","last_fullsized":"2024-04-19T02:21:20.460217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":511,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341981+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.341981+0000","last_peered":"2024-04-19T02:21:21.341981+0000","last_clean":"2024-04-19T02:21:21.341981+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.341981+0000","last_undegraded":"2024-04-19T02:21:21.341981+0000","last_fullsized":"2024-04-19T02:21:21.341981+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:37.611409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.321511+0000","last_change":"2024-04-19T02:21:21.321511+0000","last_active":"2024-04-19T02:21:21.321511+0000","last_peered":"2024-04-19T02:21:21.321511+0000","last_clean":"2024-04-19T02:21:21.321511+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:21.321511+0000","last_undegraded":"2024-04-19T02:21:21.321511+0000","last_fullsized":"2024-04-19T02:21:21.321511+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:01.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1122,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462258+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.462258+0000","last_peered":"2024-04-19T02:21:20.462258+0000","last_clean":"2024-04-19T02:21:20.462258+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.462258+0000","last_undegraded":"2024-04-19T02:21:20.462258+0000","last_fullsized":"2024-04-19T02:21:20.462258+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":900,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459195+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:20.459195+0000","last_peered":"2024-04-19T02:21:20.459195+0000","last_clean":"2024-04-19T02:21:20.459195+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:20.459195+0000","last_undegraded":"2024-04-19T02:21:20.459195+0000","last_fullsized":"2024-04-19T02:21:20.459195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459306+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.459306+0000","last_peered":"2024-04-19T02:21:20.459306+0000","last_clean":"2024-04-19T02:21:20.459306+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.459306+0000","last_undegraded":"2024-04-19T02:21:20.459306+0000","last_fullsized":"2024-04-19T02:21:20.459306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":950,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463490+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.463490+0000","last_peered":"2024-04-19T02:21:20.463490+0000","last_clean":"2024-04-19T02:21:20.463490+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.463490+0000","last_undegraded":"2024-04-19T02:21:20.463490+0000","last_fullsized":"2024-04-19T02:21:20.463490+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462020+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:20.462020+0000","last_peered":"2024-04-19T02:21:20.462020+0000","last_clean":"2024-04-19T02:21:20.462020+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:20.462020+0000","last_undegraded":"2024-04-19T02:21:20.462020+0000","last_fullsized":"2024-04-19T02:21:20.462020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346297+0000","last_change":"2024-04-19T02:21:21.346297+0000","last_active":"2024-04-19T02:21:21.346297+0000","last_peered":"2024-04-19T02:21:21.346297+0000","last_clean":"2024-04-19T02:21:21.346297+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:21.346297+0000","last_undegraded":"2024-04-19T02:21:21.346297+0000","last_fullsized":"2024-04-19T02:21:21.346297+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:35.018270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":816,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462465+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.462465+0000","last_peered":"2024-04-19T02:21:20.462465+0000","last_clean":"2024-04-19T02:21:20.462465+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.462465+0000","last_undegraded":"2024-04-19T02:21:20.462465+0000","last_fullsized":"2024-04-19T02:21:20.462465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":539,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466063+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:20.466063+0000","last_peered":"2024-04-19T02:21:20.466063+0000","last_clean":"2024-04-19T02:21:20.466063+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:20.466063+0000","last_undegraded":"2024-04-19T02:21:20.466063+0000","last_fullsized":"2024-04-19T02:21:20.466063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1077,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":616,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459476+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:20.459476+0000","last_peered":"2024-04-19T02:21:20.459476+0000","last_clean":"2024-04-19T02:21:20.459476+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:20.459476+0000","last_undegraded":"2024-04-19T02:21:20.459476+0000","last_fullsized":"2024-04-19T02:21:20.459476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341631+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.341631+0000","last_peered":"2024-04-19T02:21:21.341631+0000","last_clean":"2024-04-19T02:21:21.341631+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.341631+0000","last_undegraded":"2024-04-19T02:21:21.341631+0000","last_fullsized":"2024-04-19T02:21:21.341631+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:57.921400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":498,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462207+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.462207+0000","last_peered":"2024-04-19T02:21:20.462207+0000","last_clean":"2024-04-19T02:21:20.462207+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.462207+0000","last_undegraded":"2024-04-19T02:21:20.462207+0000","last_fullsized":"2024-04-19T02:21:20.462207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330108+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.330108+0000","last_peered":"2024-04-19T02:21:21.330108+0000","last_clean":"2024-04-19T02:21:21.330108+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.330108+0000","last_undegraded":"2024-04-19T02:21:21.330108+0000","last_fullsized":"2024-04-19T02:21:21.330108+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:26.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":547,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.465527+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.465527+0000","last_peered":"2024-04-19T02:21:20.465527+0000","last_clean":"2024-04-19T02:21:20.465527+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.465527+0000","last_undegraded":"2024-04-19T02:21:20.465527+0000","last_fullsized":"2024-04-19T02:21:20.465527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1021,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464416+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:20.464416+0000","last_peered":"2024-04-19T02:21:20.464416+0000","last_clean":"2024-04-19T02:21:20.464416+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:20.464416+0000","last_undegraded":"2024-04-19T02:21:20.464416+0000","last_fullsized":"2024-04-19T02:21:20.464416+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460150+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.460150+0000","last_peered":"2024-04-19T02:21:20.460150+0000","last_clean":"2024-04-19T02:21:20.460150+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.460150+0000","last_undegraded":"2024-04-19T02:21:20.460150+0000","last_fullsized":"2024-04-19T02:21:20.460150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":910,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461582+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:20.461582+0000","last_peered":"2024-04-19T02:21:20.461582+0000","last_clean":"2024-04-19T02:21:20.461582+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:20.461582+0000","last_undegraded":"2024-04-19T02:21:20.461582+0000","last_fullsized":"2024-04-19T02:21:20.461582+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":130,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341978+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.341978+0000","last_peered":"2024-04-19T02:21:21.341978+0000","last_clean":"2024-04-19T02:21:21.341978+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.341978+0000","last_undegraded":"2024-04-19T02:21:21.341978+0000","last_fullsized":"2024-04-19T02:21:21.341978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:38.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":245,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.320439+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.320439+0000","last_peered":"2024-04-19T02:21:21.320439+0000","last_clean":"2024-04-19T02:21:21.320439+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.320439+0000","last_undegraded":"2024-04-19T02:21:21.320439+0000","last_fullsized":"2024-04-19T02:21:21.320439+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:12.736548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":895,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459571+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.459571+0000","last_peered":"2024-04-19T02:21:20.459571+0000","last_clean":"2024-04-19T02:21:20.459571+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.459571+0000","last_undegraded":"2024-04-19T02:21:20.459571+0000","last_fullsized":"2024-04-19T02:21:20.459571+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463759+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.463759+0000","last_peered":"2024-04-19T02:21:20.463759+0000","last_clean":"2024-04-19T02:21:20.463759+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.463759+0000","last_undegraded":"2024-04-19T02:21:20.463759+0000","last_fullsized":"2024-04-19T02:21:20.463759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459688+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.459688+0000","last_peered":"2024-04-19T02:21:20.459688+0000","last_clean":"2024-04-19T02:21:20.459688+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.459688+0000","last_undegraded":"2024-04-19T02:21:20.459688+0000","last_fullsized":"2024-04-19T02:21:20.459688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":674,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.339398+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.339398+0000","last_peered":"2024-04-19T02:21:21.339398+0000","last_clean":"2024-04-19T02:21:21.339398+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.339398+0000","last_undegraded":"2024-04-19T02:21:21.339398+0000","last_fullsized":"2024-04-19T02:21:21.339398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:50.683246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":491,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.327562+0000","last_change":"2024-04-19T02:21:21.327562+0000","last_active":"2024-04-19T02:21:21.327562+0000","last_peered":"2024-04-19T02:21:21.327562+0000","last_clean":"2024-04-19T02:21:21.327562+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:21.327562+0000","last_undegraded":"2024-04-19T02:21:21.327562+0000","last_fullsized":"2024-04-19T02:21:21.327562+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:00:27.273002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":121,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.304724+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.304724+0000","last_peered":"2024-04-19T02:21:21.304724+0000","last_clean":"2024-04-19T02:21:21.304724+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.304724+0000","last_undegraded":"2024-04-19T02:21:21.304724+0000","last_fullsized":"2024-04-19T02:21:21.304724+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:58.461641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1082,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463986+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:20.463986+0000","last_peered":"2024-04-19T02:21:20.463986+0000","last_clean":"2024-04-19T02:21:20.463986+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:20.463986+0000","last_undegraded":"2024-04-19T02:21:20.463986+0000","last_fullsized":"2024-04-19T02:21:20.463986+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.468359+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:20.468359+0000","last_peered":"2024-04-19T02:21:20.468359+0000","last_clean":"2024-04-19T02:21:20.468359+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:20.468359+0000","last_undegraded":"2024-04-19T02:21:20.468359+0000","last_fullsized":"2024-04-19T02:21:20.468359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323437+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.323437+0000","last_peered":"2024-04-19T02:21:21.323437+0000","last_clean":"2024-04-19T02:21:21.323437+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.323437+0000","last_undegraded":"2024-04-19T02:21:21.323437+0000","last_fullsized":"2024-04-19T02:21:21.323437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:15.338811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323460+0000","last_change":"2024-04-19T02:21:21.323460+0000","last_active":"2024-04-19T02:21:21.323460+0000","last_peered":"2024-04-19T02:21:21.323460+0000","last_clean":"2024-04-19T02:21:21.323460+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:21.323460+0000","last_undegraded":"2024-04-19T02:21:21.323460+0000","last_fullsized":"2024-04-19T02:21:21.323460+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":583,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344252+0000","last_change":"2024-04-19T02:21:21.344252+0000","last_active":"2024-04-19T02:21:21.344252+0000","last_peered":"2024-04-19T02:21:21.344252+0000","last_clean":"2024-04-19T02:21:21.344252+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:21:21.344252+0000","last_undegraded":"2024-04-19T02:21:21.344252+0000","last_fullsized":"2024-04-19T02:21:21.344252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:47.406900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460409+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.460409+0000","last_peered":"2024-04-19T02:21:20.460409+0000","last_clean":"2024-04-19T02:21:20.460409+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.460409+0000","last_undegraded":"2024-04-19T02:21:20.460409+0000","last_fullsized":"2024-04-19T02:21:20.460409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":450,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.319032+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.319032+0000","last_peered":"2024-04-19T02:21:21.319032+0000","last_clean":"2024-04-19T02:21:21.319032+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.319032+0000","last_undegraded":"2024-04-19T02:21:21.319032+0000","last_fullsized":"2024-04-19T02:21:21.319032+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:03.038712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":502,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459835+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.459835+0000","last_peered":"2024-04-19T02:21:20.459835+0000","last_clean":"2024-04-19T02:21:20.459835+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.459835+0000","last_undegraded":"2024-04-19T02:21:20.459835+0000","last_fullsized":"2024-04-19T02:21:20.459835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":531,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462045+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:20.462045+0000","last_peered":"2024-04-19T02:21:20.462045+0000","last_clean":"2024-04-19T02:21:20.462045+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:20.462045+0000","last_undegraded":"2024-04-19T02:21:20.462045+0000","last_fullsized":"2024-04-19T02:21:20.462045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341047+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.341047+0000","last_peered":"2024-04-19T02:21:21.341047+0000","last_clean":"2024-04-19T02:21:21.341047+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.341047+0000","last_undegraded":"2024-04-19T02:21:21.341047+0000","last_fullsized":"2024-04-19T02:21:21.341047+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:30.201443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334723+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.334723+0000","last_peered":"2024-04-19T02:21:21.334723+0000","last_clean":"2024-04-19T02:21:21.334723+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.334723+0000","last_undegraded":"2024-04-19T02:21:21.334723+0000","last_fullsized":"2024-04-19T02:21:21.334723+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":873,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466035+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:20.466035+0000","last_peered":"2024-04-19T02:21:20.466035+0000","last_clean":"2024-04-19T02:21:20.466035+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:20.466035+0000","last_undegraded":"2024-04-19T02:21:20.466035+0000","last_fullsized":"2024-04-19T02:21:20.466035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346189+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.346189+0000","last_peered":"2024-04-19T02:21:21.346189+0000","last_clean":"2024-04-19T02:21:21.346189+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.346189+0000","last_undegraded":"2024-04-19T02:21:21.346189+0000","last_fullsized":"2024-04-19T02:21:21.346189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:25.982675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342225+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.342225+0000","last_peered":"2024-04-19T02:21:21.342225+0000","last_clean":"2024-04-19T02:21:21.342225+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.342225+0000","last_undegraded":"2024-04-19T02:21:21.342225+0000","last_fullsized":"2024-04-19T02:21:21.342225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:40.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":310,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461829+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:20.461829+0000","last_peered":"2024-04-19T02:21:20.461829+0000","last_clean":"2024-04-19T02:21:20.461829+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:20.461829+0000","last_undegraded":"2024-04-19T02:21:20.461829+0000","last_fullsized":"2024-04-19T02:21:20.461829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":556,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463696+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.463696+0000","last_peered":"2024-04-19T02:21:20.463696+0000","last_clean":"2024-04-19T02:21:20.463696+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.463696+0000","last_undegraded":"2024-04-19T02:21:20.463696+0000","last_fullsized":"2024-04-19T02:21:20.463696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462303+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:20.462303+0000","last_peered":"2024-04-19T02:21:20.462303+0000","last_clean":"2024-04-19T02:21:20.462303+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:20.462303+0000","last_undegraded":"2024-04-19T02:21:20.462303+0000","last_fullsized":"2024-04-19T02:21:20.462303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":523,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460080+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.460080+0000","last_peered":"2024-04-19T02:21:20.460080+0000","last_clean":"2024-04-19T02:21:20.460080+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.460080+0000","last_undegraded":"2024-04-19T02:21:20.460080+0000","last_fullsized":"2024-04-19T02:21:20.460080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":468,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462571+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:20.462571+0000","last_peered":"2024-04-19T02:21:20.462571+0000","last_clean":"2024-04-19T02:21:20.462571+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:20.462571+0000","last_undegraded":"2024-04-19T02:21:20.462571+0000","last_fullsized":"2024-04-19T02:21:20.462571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323975+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.323975+0000","last_peered":"2024-04-19T02:21:21.323975+0000","last_clean":"2024-04-19T02:21:21.323975+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.323975+0000","last_undegraded":"2024-04-19T02:21:21.323975+0000","last_fullsized":"2024-04-19T02:21:21.323975+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:35.319733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":136,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334181+0000","last_change":"2024-04-19T02:21:21.334181+0000","last_active":"2024-04-19T02:21:21.334181+0000","last_peered":"2024-04-19T02:21:21.334181+0000","last_clean":"2024-04-19T02:21:21.334181+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:21.334181+0000","last_undegraded":"2024-04-19T02:21:21.334181+0000","last_fullsized":"2024-04-19T02:21:21.334181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463012+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:20.463012+0000","last_peered":"2024-04-19T02:21:20.463012+0000","last_clean":"2024-04-19T02:21:20.463012+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:20.463012+0000","last_undegraded":"2024-04-19T02:21:20.463012+0000","last_fullsized":"2024-04-19T02:21:20.463012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317369+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.317369+0000","last_peered":"2024-04-19T02:21:21.317369+0000","last_clean":"2024-04-19T02:21:21.317369+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.317369+0000","last_undegraded":"2024-04-19T02:21:21.317369+0000","last_fullsized":"2024-04-19T02:21:21.317369+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466694+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:20.466694+0000","last_peered":"2024-04-19T02:21:20.466694+0000","last_clean":"2024-04-19T02:21:20.466694+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:20.466694+0000","last_undegraded":"2024-04-19T02:21:20.466694+0000","last_fullsized":"2024-04-19T02:21:20.466694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":857,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462444+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.462444+0000","last_peered":"2024-04-19T02:21:20.462444+0000","last_clean":"2024-04-19T02:21:20.462444+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.462444+0000","last_undegraded":"2024-04-19T02:21:20.462444+0000","last_fullsized":"2024-04-19T02:21:20.462444+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":167,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466454+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:20.466454+0000","last_peered":"2024-04-19T02:21:20.466454+0000","last_clean":"2024-04-19T02:21:20.466454+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:20.466454+0000","last_undegraded":"2024-04-19T02:21:20.466454+0000","last_fullsized":"2024-04-19T02:21:20.466454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":115,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467210+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.467210+0000","last_peered":"2024-04-19T02:21:20.467210+0000","last_clean":"2024-04-19T02:21:20.467210+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.467210+0000","last_undegraded":"2024-04-19T02:21:20.467210+0000","last_fullsized":"2024-04-19T02:21:20.467210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":974,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463297+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.463297+0000","last_peered":"2024-04-19T02:21:20.463297+0000","last_clean":"2024-04-19T02:21:20.463297+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.463297+0000","last_undegraded":"2024-04-19T02:21:20.463297+0000","last_fullsized":"2024-04-19T02:21:20.463297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463479+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:20.463479+0000","last_peered":"2024-04-19T02:21:20.463479+0000","last_clean":"2024-04-19T02:21:20.463479+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:20.463479+0000","last_undegraded":"2024-04-19T02:21:20.463479+0000","last_fullsized":"2024-04-19T02:21:20.463479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466709+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:20.466709+0000","last_peered":"2024-04-19T02:21:20.466709+0000","last_clean":"2024-04-19T02:21:20.466709+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:20.466709+0000","last_undegraded":"2024-04-19T02:21:20.466709+0000","last_fullsized":"2024-04-19T02:21:20.466709+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":951,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466559+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:20.466559+0000","last_peered":"2024-04-19T02:21:20.466559+0000","last_clean":"2024-04-19T02:21:20.466559+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:20.466559+0000","last_undegraded":"2024-04-19T02:21:20.466559+0000","last_fullsized":"2024-04-19T02:21:20.466559+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464664+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:20.464664+0000","last_peered":"2024-04-19T02:21:20.464664+0000","last_clean":"2024-04-19T02:21:20.464664+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:20.464664+0000","last_undegraded":"2024-04-19T02:21:20.464664+0000","last_fullsized":"2024-04-19T02:21:20.464664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307515+0000","last_change":"2024-04-19T02:21:21.307515+0000","last_active":"2024-04-19T02:21:21.307515+0000","last_peered":"2024-04-19T02:21:21.307515+0000","last_clean":"2024-04-19T02:21:21.307515+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:21.307515+0000","last_undegraded":"2024-04-19T02:21:21.307515+0000","last_fullsized":"2024-04-19T02:21:21.307515+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":577,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.458922+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:20.458922+0000","last_peered":"2024-04-19T02:21:20.458922+0000","last_clean":"2024-04-19T02:21:20.458922+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:20.458922+0000","last_undegraded":"2024-04-19T02:21:20.458922+0000","last_fullsized":"2024-04-19T02:21:20.458922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":501,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343149+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.343149+0000","last_peered":"2024-04-19T02:21:21.343149+0000","last_clean":"2024-04-19T02:21:21.343149+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.343149+0000","last_undegraded":"2024-04-19T02:21:21.343149+0000","last_fullsized":"2024-04-19T02:21:21.343149+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:38.509822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342574+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.342574+0000","last_peered":"2024-04-19T02:21:21.342574+0000","last_clean":"2024-04-19T02:21:21.342574+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.342574+0000","last_undegraded":"2024-04-19T02:21:21.342574+0000","last_fullsized":"2024-04-19T02:21:21.342574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":555,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459154+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:20.459154+0000","last_peered":"2024-04-19T02:21:20.459154+0000","last_clean":"2024-04-19T02:21:20.459154+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:20.459154+0000","last_undegraded":"2024-04-19T02:21:20.459154+0000","last_fullsized":"2024-04-19T02:21:20.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466348+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.466348+0000","last_peered":"2024-04-19T02:21:20.466348+0000","last_clean":"2024-04-19T02:21:20.466348+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.466348+0000","last_undegraded":"2024-04-19T02:21:20.466348+0000","last_fullsized":"2024-04-19T02:21:20.466348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":392,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307675+0000","last_change":"2024-04-19T02:21:21.307675+0000","last_active":"2024-04-19T02:21:21.307675+0000","last_peered":"2024-04-19T02:21:21.307675+0000","last_clean":"2024-04-19T02:21:21.307675+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:21.307675+0000","last_undegraded":"2024-04-19T02:21:21.307675+0000","last_fullsized":"2024-04-19T02:21:21.307675+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:47:29.710039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1019,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459723+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:20.459723+0000","last_peered":"2024-04-19T02:21:20.459723+0000","last_clean":"2024-04-19T02:21:20.459723+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:20.459723+0000","last_undegraded":"2024-04-19T02:21:20.459723+0000","last_fullsized":"2024-04-19T02:21:20.459723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463263+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:20.463263+0000","last_peered":"2024-04-19T02:21:20.463263+0000","last_clean":"2024-04-19T02:21:20.463263+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:20.463263+0000","last_undegraded":"2024-04-19T02:21:20.463263+0000","last_fullsized":"2024-04-19T02:21:20.463263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":629,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466275+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:20.466275+0000","last_peered":"2024-04-19T02:21:20.466275+0000","last_clean":"2024-04-19T02:21:20.466275+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:20.466275+0000","last_undegraded":"2024-04-19T02:21:20.466275+0000","last_fullsized":"2024-04-19T02:21:20.466275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":918,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463835+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.463835+0000","last_peered":"2024-04-19T02:21:20.463835+0000","last_clean":"2024-04-19T02:21:20.463835+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.463835+0000","last_undegraded":"2024-04-19T02:21:20.463835+0000","last_fullsized":"2024-04-19T02:21:20.463835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":683,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467179+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:20.467179+0000","last_peered":"2024-04-19T02:21:20.467179+0000","last_clean":"2024-04-19T02:21:20.467179+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:20.467179+0000","last_undegraded":"2024-04-19T02:21:20.467179+0000","last_fullsized":"2024-04-19T02:21:20.467179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":943,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461566+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:20.461566+0000","last_peered":"2024-04-19T02:21:20.461566+0000","last_clean":"2024-04-19T02:21:20.461566+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:20.461566+0000","last_undegraded":"2024-04-19T02:21:20.461566+0000","last_fullsized":"2024-04-19T02:21:20.461566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":461,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461576+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:20.461576+0000","last_peered":"2024-04-19T02:21:20.461576+0000","last_clean":"2024-04-19T02:21:20.461576+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:20.461576+0000","last_undegraded":"2024-04-19T02:21:20.461576+0000","last_fullsized":"2024-04-19T02:21:20.461576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":861,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474998+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:21.474998+0000","last_peered":"2024-04-19T02:21:21.474998+0000","last_clean":"2024-04-19T02:21:21.474998+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:21.474998+0000","last_undegraded":"2024-04-19T02:21:21.474998+0000","last_fullsized":"2024-04-19T02:21:21.474998+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":608,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.226780+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.226780+0000","last_peered":"2024-04-19T02:21:21.226780+0000","last_clean":"2024-04-19T02:21:21.226780+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.226780+0000","last_undegraded":"2024-04-19T02:21:21.226780+0000","last_fullsized":"2024-04-19T02:21:21.226780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474745+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:21.474745+0000","last_peered":"2024-04-19T02:21:21.474745+0000","last_clean":"2024-04-19T02:21:21.474745+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:21.474745+0000","last_undegraded":"2024-04-19T02:21:21.474745+0000","last_fullsized":"2024-04-19T02:21:21.474745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":188,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474193+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:21.474193+0000","last_peered":"2024-04-19T02:21:21.474193+0000","last_clean":"2024-04-19T02:21:21.474193+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:21.474193+0000","last_undegraded":"2024-04-19T02:21:21.474193+0000","last_fullsized":"2024-04-19T02:21:21.474193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342619+0000","last_change":"2024-04-19T02:21:21.342619+0000","last_active":"2024-04-19T02:21:21.342619+0000","last_peered":"2024-04-19T02:21:21.342619+0000","last_clean":"2024-04-19T02:21:21.342619+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:21.342619+0000","last_undegraded":"2024-04-19T02:21:21.342619+0000","last_fullsized":"2024-04-19T02:21:21.342619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:44.328651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":403,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.336126+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.336126+0000","last_peered":"2024-04-19T02:21:21.336126+0000","last_clean":"2024-04-19T02:21:21.336126+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.336126+0000","last_undegraded":"2024-04-19T02:21:21.336126+0000","last_fullsized":"2024-04-19T02:21:21.336126+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":495,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.328166+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.328166+0000","last_peered":"2024-04-19T02:21:21.328166+0000","last_clean":"2024-04-19T02:21:21.328166+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.328166+0000","last_undegraded":"2024-04-19T02:21:21.328166+0000","last_fullsized":"2024-04-19T02:21:21.328166+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:04.798376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475446+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:21.475446+0000","last_peered":"2024-04-19T02:21:21.475446+0000","last_clean":"2024-04-19T02:21:21.475446+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:21.475446+0000","last_undegraded":"2024-04-19T02:21:21.475446+0000","last_fullsized":"2024-04-19T02:21:21.475446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":633,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460698+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.460698+0000","last_peered":"2024-04-19T02:21:20.460698+0000","last_clean":"2024-04-19T02:21:20.460698+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.460698+0000","last_undegraded":"2024-04-19T02:21:20.460698+0000","last_fullsized":"2024-04-19T02:21:20.460698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464155+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:20.464155+0000","last_peered":"2024-04-19T02:21:20.464155+0000","last_clean":"2024-04-19T02:21:20.464155+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:20.464155+0000","last_undegraded":"2024-04-19T02:21:20.464155+0000","last_fullsized":"2024-04-19T02:21:20.464155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":558,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.338347+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.338347+0000","last_peered":"2024-04-19T02:21:21.338347+0000","last_clean":"2024-04-19T02:21:21.338347+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.338347+0000","last_undegraded":"2024-04-19T02:21:21.338347+0000","last_fullsized":"2024-04-19T02:21:21.338347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:19.012981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462736+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:20.462736+0000","last_peered":"2024-04-19T02:21:20.462736+0000","last_clean":"2024-04-19T02:21:20.462736+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:20.462736+0000","last_undegraded":"2024-04-19T02:21:20.462736+0000","last_fullsized":"2024-04-19T02:21:20.462736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126656,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245184,"statfs":{"total":96636764160,"available":96507068416,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":78,"seq":335007449101,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66136,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305704,"statfs":{"total":96636764160,"available":96569040896,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139616,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232224,"statfs":{"total":96636764160,"available":96493797376,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.499,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94499999999999995,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:28.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:28.734 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:28.736 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-19T02:21:28.310505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332408,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783112,"statfs":{"total":289910292480,"available":289569906688,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3934,"num_bytes_recovered":-43241477,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003125"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464171+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.464171+0000","last_peered":"2024-04-19T02:21:20.464171+0000","last_clean":"2024-04-19T02:21:20.464171+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.464171+0000","last_undegraded":"2024-04-19T02:21:20.464171+0000","last_fullsized":"2024-04-19T02:21:20.464171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":593,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463448+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.463448+0000","last_peered":"2024-04-19T02:21:20.463448+0000","last_clean":"2024-04-19T02:21:20.463448+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.463448+0000","last_undegraded":"2024-04-19T02:21:20.463448+0000","last_fullsized":"2024-04-19T02:21:20.463448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":483,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343830+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.343830+0000","last_peered":"2024-04-19T02:21:21.343830+0000","last_clean":"2024-04-19T02:21:21.343830+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.343830+0000","last_undegraded":"2024-04-19T02:21:21.343830+0000","last_fullsized":"2024-04-19T02:21:21.343830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:49.457654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":465,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342642+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.342642+0000","last_peered":"2024-04-19T02:21:21.342642+0000","last_clean":"2024-04-19T02:21:21.342642+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.342642+0000","last_undegraded":"2024-04-19T02:21:21.342642+0000","last_fullsized":"2024-04-19T02:21:21.342642+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:28.873039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:21.474108+0000","last_peered":"2024-04-19T02:21:21.474108+0000","last_clean":"2024-04-19T02:21:21.474108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:21.474108+0000","last_undegraded":"2024-04-19T02:21:21.474108+0000","last_fullsized":"2024-04-19T02:21:21.474108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":535,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348147+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348147+0000","last_peered":"2024-04-19T02:21:21.348147+0000","last_clean":"2024-04-19T02:21:21.348147+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348147+0000","last_undegraded":"2024-04-19T02:21:21.348147+0000","last_fullsized":"2024-04-19T02:21:21.348147+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:44.275063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":518,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.311849+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.311849+0000","last_peered":"2024-04-19T02:21:21.311849+0000","last_clean":"2024-04-19T02:21:21.311849+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.311849+0000","last_undegraded":"2024-04-19T02:21:21.311849+0000","last_fullsized":"2024-04-19T02:21:21.311849+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:51.111106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340703+0000","last_change":"2024-04-19T02:21:21.340703+0000","last_active":"2024-04-19T02:21:21.340703+0000","last_peered":"2024-04-19T02:21:21.340703+0000","last_clean":"2024-04-19T02:21:21.340703+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:21.340703+0000","last_undegraded":"2024-04-19T02:21:21.340703+0000","last_fullsized":"2024-04-19T02:21:21.340703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:48:22.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":563,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461341+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:20.461341+0000","last_peered":"2024-04-19T02:21:20.461341+0000","last_clean":"2024-04-19T02:21:20.461341+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:20.461341+0000","last_undegraded":"2024-04-19T02:21:20.461341+0000","last_fullsized":"2024-04-19T02:21:20.461341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":554,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462529+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.462529+0000","last_peered":"2024-04-19T02:21:20.462529+0000","last_clean":"2024-04-19T02:21:20.462529+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.462529+0000","last_undegraded":"2024-04-19T02:21:20.462529+0000","last_fullsized":"2024-04-19T02:21:20.462529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317186+0000","last_change":"2024-04-19T02:21:21.317186+0000","last_active":"2024-04-19T02:21:21.317186+0000","last_peered":"2024-04-19T02:21:21.317186+0000","last_clean":"2024-04-19T02:21:21.317186+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:21.317186+0000","last_undegraded":"2024-04-19T02:21:21.317186+0000","last_fullsized":"2024-04-19T02:21:21.317186+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:23.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":911,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460461+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.460461+0000","last_peered":"2024-04-19T02:21:20.460461+0000","last_clean":"2024-04-19T02:21:20.460461+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.460461+0000","last_undegraded":"2024-04-19T02:21:20.460461+0000","last_fullsized":"2024-04-19T02:21:20.460461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460799+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.460799+0000","last_peered":"2024-04-19T02:21:20.460799+0000","last_clean":"2024-04-19T02:21:20.460799+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.460799+0000","last_undegraded":"2024-04-19T02:21:20.460799+0000","last_fullsized":"2024-04-19T02:21:20.460799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341036+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.341036+0000","last_peered":"2024-04-19T02:21:21.341036+0000","last_clean":"2024-04-19T02:21:21.341036+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.341036+0000","last_undegraded":"2024-04-19T02:21:21.341036+0000","last_fullsized":"2024-04-19T02:21:21.341036+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:35.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330764+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.330764+0000","last_peered":"2024-04-19T02:21:21.330764+0000","last_clean":"2024-04-19T02:21:21.330764+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.330764+0000","last_undegraded":"2024-04-19T02:21:21.330764+0000","last_fullsized":"2024-04-19T02:21:21.330764+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:28.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":576,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.337686+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.337686+0000","last_peered":"2024-04-19T02:21:21.337686+0000","last_clean":"2024-04-19T02:21:21.337686+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.337686+0000","last_undegraded":"2024-04-19T02:21:21.337686+0000","last_fullsized":"2024-04-19T02:21:21.337686+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:03.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":561,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463208+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:20.463208+0000","last_peered":"2024-04-19T02:21:20.463208+0000","last_clean":"2024-04-19T02:21:20.463208+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:20.463208+0000","last_undegraded":"2024-04-19T02:21:20.463208+0000","last_fullsized":"2024-04-19T02:21:20.463208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463438+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.463438+0000","last_peered":"2024-04-19T02:21:20.463438+0000","last_clean":"2024-04-19T02:21:20.463438+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.463438+0000","last_undegraded":"2024-04-19T02:21:20.463438+0000","last_fullsized":"2024-04-19T02:21:20.463438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":649,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460217+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:20.460217+0000","last_peered":"2024-04-19T02:21:20.460217+0000","last_clean":"2024-04-19T02:21:20.460217+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:20.460217+0000","last_undegraded":"2024-04-19T02:21:20.460217+0000","last_fullsized":"2024-04-19T02:21:20.460217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":511,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341981+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.341981+0000","last_peered":"2024-04-19T02:21:21.341981+0000","last_clean":"2024-04-19T02:21:21.341981+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.341981+0000","last_undegraded":"2024-04-19T02:21:21.341981+0000","last_fullsized":"2024-04-19T02:21:21.341981+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:37.611409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.321511+0000","last_change":"2024-04-19T02:21:21.321511+0000","last_active":"2024-04-19T02:21:21.321511+0000","last_peered":"2024-04-19T02:21:21.321511+0000","last_clean":"2024-04-19T02:21:21.321511+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:21.321511+0000","last_undegraded":"2024-04-19T02:21:21.321511+0000","last_fullsized":"2024-04-19T02:21:21.321511+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:01.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1122,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462258+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.462258+0000","last_peered":"2024-04-19T02:21:20.462258+0000","last_clean":"2024-04-19T02:21:20.462258+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.462258+0000","last_undegraded":"2024-04-19T02:21:20.462258+0000","last_fullsized":"2024-04-19T02:21:20.462258+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":900,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459195+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:20.459195+0000","last_peered":"2024-04-19T02:21:20.459195+0000","last_clean":"2024-04-19T02:21:20.459195+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:20.459195+0000","last_undegraded":"2024-04-19T02:21:20.459195+0000","last_fullsized":"2024-04-19T02:21:20.459195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459306+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.459306+0000","last_peered":"2024-04-19T02:21:20.459306+0000","last_clean":"2024-04-19T02:21:20.459306+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.459306+0000","last_undegraded":"2024-04-19T02:21:20.459306+0000","last_fullsized":"2024-04-19T02:21:20.459306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":950,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463490+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.463490+0000","last_peered":"2024-04-19T02:21:20.463490+0000","last_clean":"2024-04-19T02:21:20.463490+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.463490+0000","last_undegraded":"2024-04-19T02:21:20.463490+0000","last_fullsized":"2024-04-19T02:21:20.463490+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462020+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:20.462020+0000","last_peered":"2024-04-19T02:21:20.462020+0000","last_clean":"2024-04-19T02:21:20.462020+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:20.462020+0000","last_undegraded":"2024-04-19T02:21:20.462020+0000","last_fullsized":"2024-04-19T02:21:20.462020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346297+0000","last_change":"2024-04-19T02:21:21.346297+0000","last_active":"2024-04-19T02:21:21.346297+0000","last_peered":"2024-04-19T02:21:21.346297+0000","last_clean":"2024-04-19T02:21:21.346297+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:21.346297+0000","last_undegraded":"2024-04-19T02:21:21.346297+0000","last_fullsized":"2024-04-19T02:21:21.346297+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:35.018270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":816,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462465+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.462465+0000","last_peered":"2024-04-19T02:21:20.462465+0000","last_clean":"2024-04-19T02:21:20.462465+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.462465+0000","last_undegraded":"2024-04-19T02:21:20.462465+0000","last_fullsized":"2024-04-19T02:21:20.462465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":539,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466063+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:20.466063+0000","last_peered":"2024-04-19T02:21:20.466063+0000","last_clean":"2024-04-19T02:21:20.466063+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:20.466063+0000","last_undegraded":"2024-04-19T02:21:20.466063+0000","last_fullsized":"2024-04-19T02:21:20.466063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1077,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":616,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459476+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:20.459476+0000","last_peered":"2024-04-19T02:21:20.459476+0000","last_clean":"2024-04-19T02:21:20.459476+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:20.459476+0000","last_undegraded":"2024-04-19T02:21:20.459476+0000","last_fullsized":"2024-04-19T02:21:20.459476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341631+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.341631+0000","last_peered":"2024-04-19T02:21:21.341631+0000","last_clean":"2024-04-19T02:21:21.341631+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.341631+0000","last_undegraded":"2024-04-19T02:21:21.341631+0000","last_fullsized":"2024-04-19T02:21:21.341631+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:57.921400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":498,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462207+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.462207+0000","last_peered":"2024-04-19T02:21:20.462207+0000","last_clean":"2024-04-19T02:21:20.462207+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.462207+0000","last_undegraded":"2024-04-19T02:21:20.462207+0000","last_fullsized":"2024-04-19T02:21:20.462207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330108+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.330108+0000","last_peered":"2024-04-19T02:21:21.330108+0000","last_clean":"2024-04-19T02:21:21.330108+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.330108+0000","last_undegraded":"2024-04-19T02:21:21.330108+0000","last_fullsized":"2024-04-19T02:21:21.330108+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:26.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":547,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.465527+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.465527+0000","last_peered":"2024-04-19T02:21:20.465527+0000","last_clean":"2024-04-19T02:21:20.465527+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.465527+0000","last_undegraded":"2024-04-19T02:21:20.465527+0000","last_fullsized":"2024-04-19T02:21:20.465527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1021,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464416+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:20.464416+0000","last_peered":"2024-04-19T02:21:20.464416+0000","last_clean":"2024-04-19T02:21:20.464416+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:20.464416+0000","last_undegraded":"2024-04-19T02:21:20.464416+0000","last_fullsized":"2024-04-19T02:21:20.464416+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460150+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.460150+0000","last_peered":"2024-04-19T02:21:20.460150+0000","last_clean":"2024-04-19T02:21:20.460150+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.460150+0000","last_undegraded":"2024-04-19T02:21:20.460150+0000","last_fullsized":"2024-04-19T02:21:20.460150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":910,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461582+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:20.461582+0000","last_peered":"2024-04-19T02:21:20.461582+0000","last_clean":"2024-04-19T02:21:20.461582+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:20.461582+0000","last_undegraded":"2024-04-19T02:21:20.461582+0000","last_fullsized":"2024-04-19T02:21:20.461582+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":130,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341978+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.341978+0000","last_peered":"2024-04-19T02:21:21.341978+0000","last_clean":"2024-04-19T02:21:21.341978+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.341978+0000","last_undegraded":"2024-04-19T02:21:21.341978+0000","last_fullsized":"2024-04-19T02:21:21.341978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:38.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":245,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.320439+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.320439+0000","last_peered":"2024-04-19T02:21:21.320439+0000","last_clean":"2024-04-19T02:21:21.320439+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.320439+0000","last_undegraded":"2024-04-19T02:21:21.320439+0000","last_fullsized":"2024-04-19T02:21:21.320439+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:12.736548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":895,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459571+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.459571+0000","last_peered":"2024-04-19T02:21:20.459571+0000","last_clean":"2024-04-19T02:21:20.459571+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.459571+0000","last_undegraded":"2024-04-19T02:21:20.459571+0000","last_fullsized":"2024-04-19T02:21:20.459571+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463759+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.463759+0000","last_peered":"2024-04-19T02:21:20.463759+0000","last_clean":"2024-04-19T02:21:20.463759+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.463759+0000","last_undegraded":"2024-04-19T02:21:20.463759+0000","last_fullsized":"2024-04-19T02:21:20.463759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459688+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.459688+0000","last_peered":"2024-04-19T02:21:20.459688+0000","last_clean":"2024-04-19T02:21:20.459688+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.459688+0000","last_undegraded":"2024-04-19T02:21:20.459688+0000","last_fullsized":"2024-04-19T02:21:20.459688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":674,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.339398+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.339398+0000","last_peered":"2024-04-19T02:21:21.339398+0000","last_clean":"2024-04-19T02:21:21.339398+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.339398+0000","last_undegraded":"2024-04-19T02:21:21.339398+0000","last_fullsized":"2024-04-19T02:21:21.339398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:50.683246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":491,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.327562+0000","last_change":"2024-04-19T02:21:21.327562+0000","last_active":"2024-04-19T02:21:21.327562+0000","last_peered":"2024-04-19T02:21:21.327562+0000","last_clean":"2024-04-19T02:21:21.327562+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:21.327562+0000","last_undegraded":"2024-04-19T02:21:21.327562+0000","last_fullsized":"2024-04-19T02:21:21.327562+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:00:27.273002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":121,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.304724+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.304724+0000","last_peered":"2024-04-19T02:21:21.304724+0000","last_clean":"2024-04-19T02:21:21.304724+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.304724+0000","last_undegraded":"2024-04-19T02:21:21.304724+0000","last_fullsized":"2024-04-19T02:21:21.304724+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:58.461641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1082,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463986+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:20.463986+0000","last_peered":"2024-04-19T02:21:20.463986+0000","last_clean":"2024-04-19T02:21:20.463986+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:20.463986+0000","last_undegraded":"2024-04-19T02:21:20.463986+0000","last_fullsized":"2024-04-19T02:21:20.463986+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.468359+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:20.468359+0000","last_peered":"2024-04-19T02:21:20.468359+0000","last_clean":"2024-04-19T02:21:20.468359+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:20.468359+0000","last_undegraded":"2024-04-19T02:21:20.468359+0000","last_fullsized":"2024-04-19T02:21:20.468359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323437+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.323437+0000","last_peered":"2024-04-19T02:21:21.323437+0000","last_clean":"2024-04-19T02:21:21.323437+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.323437+0000","last_undegraded":"2024-04-19T02:21:21.323437+0000","last_fullsized":"2024-04-19T02:21:21.323437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:15.338811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323460+0000","last_change":"2024-04-19T02:21:21.323460+0000","last_active":"2024-04-19T02:21:21.323460+0000","last_peered":"2024-04-19T02:21:21.323460+0000","last_clean":"2024-04-19T02:21:21.323460+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:21.323460+0000","last_undegraded":"2024-04-19T02:21:21.323460+0000","last_fullsized":"2024-04-19T02:21:21.323460+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":583,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344252+0000","last_change":"2024-04-19T02:21:21.344252+0000","last_active":"2024-04-19T02:21:21.344252+0000","last_peered":"2024-04-19T02:21:21.344252+0000","last_clean":"2024-04-19T02:21:21.344252+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:21:21.344252+0000","last_undegraded":"2024-04-19T02:21:21.344252+0000","last_fullsized":"2024-04-19T02:21:21.344252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:47.406900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460409+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.460409+0000","last_peered":"2024-04-19T02:21:20.460409+0000","last_clean":"2024-04-19T02:21:20.460409+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.460409+0000","last_undegraded":"2024-04-19T02:21:20.460409+0000","last_fullsized":"2024-04-19T02:21:20.460409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":450,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.319032+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.319032+0000","last_peered":"2024-04-19T02:21:21.319032+0000","last_clean":"2024-04-19T02:21:21.319032+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.319032+0000","last_undegraded":"2024-04-19T02:21:21.319032+0000","last_fullsized":"2024-04-19T02:21:21.319032+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:03.038712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":502,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459835+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.459835+0000","last_peered":"2024-04-19T02:21:20.459835+0000","last_clean":"2024-04-19T02:21:20.459835+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.459835+0000","last_undegraded":"2024-04-19T02:21:20.459835+0000","last_fullsized":"2024-04-19T02:21:20.459835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":531,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462045+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:20.462045+0000","last_peered":"2024-04-19T02:21:20.462045+0000","last_clean":"2024-04-19T02:21:20.462045+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:20.462045+0000","last_undegraded":"2024-04-19T02:21:20.462045+0000","last_fullsized":"2024-04-19T02:21:20.462045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341047+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.341047+0000","last_peered":"2024-04-19T02:21:21.341047+0000","last_clean":"2024-04-19T02:21:21.341047+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.341047+0000","last_undegraded":"2024-04-19T02:21:21.341047+0000","last_fullsized":"2024-04-19T02:21:21.341047+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:30.201443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334723+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.334723+0000","last_peered":"2024-04-19T02:21:21.334723+0000","last_clean":"2024-04-19T02:21:21.334723+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.334723+0000","last_undegraded":"2024-04-19T02:21:21.334723+0000","last_fullsized":"2024-04-19T02:21:21.334723+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":873,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466035+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:20.466035+0000","last_peered":"2024-04-19T02:21:20.466035+0000","last_clean":"2024-04-19T02:21:20.466035+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:20.466035+0000","last_undegraded":"2024-04-19T02:21:20.466035+0000","last_fullsized":"2024-04-19T02:21:20.466035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346189+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.346189+0000","last_peered":"2024-04-19T02:21:21.346189+0000","last_clean":"2024-04-19T02:21:21.346189+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.346189+0000","last_undegraded":"2024-04-19T02:21:21.346189+0000","last_fullsized":"2024-04-19T02:21:21.346189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:25.982675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342225+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.342225+0000","last_peered":"2024-04-19T02:21:21.342225+0000","last_clean":"2024-04-19T02:21:21.342225+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.342225+0000","last_undegraded":"2024-04-19T02:21:21.342225+0000","last_fullsized":"2024-04-19T02:21:21.342225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:40.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":310,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461829+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:20.461829+0000","last_peered":"2024-04-19T02:21:20.461829+0000","last_clean":"2024-04-19T02:21:20.461829+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:20.461829+0000","last_undegraded":"2024-04-19T02:21:20.461829+0000","last_fullsized":"2024-04-19T02:21:20.461829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":556,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463696+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.463696+0000","last_peered":"2024-04-19T02:21:20.463696+0000","last_clean":"2024-04-19T02:21:20.463696+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.463696+0000","last_undegraded":"2024-04-19T02:21:20.463696+0000","last_fullsized":"2024-04-19T02:21:20.463696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462303+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:20.462303+0000","last_peered":"2024-04-19T02:21:20.462303+0000","last_clean":"2024-04-19T02:21:20.462303+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:20.462303+0000","last_undegraded":"2024-04-19T02:21:20.462303+0000","last_fullsized":"2024-04-19T02:21:20.462303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":523,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460080+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.460080+0000","last_peered":"2024-04-19T02:21:20.460080+0000","last_clean":"2024-04-19T02:21:20.460080+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.460080+0000","last_undegraded":"2024-04-19T02:21:20.460080+0000","last_fullsized":"2024-04-19T02:21:20.460080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":468,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462571+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:20.462571+0000","last_peered":"2024-04-19T02:21:20.462571+0000","last_clean":"2024-04-19T02:21:20.462571+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:20.462571+0000","last_undegraded":"2024-04-19T02:21:20.462571+0000","last_fullsized":"2024-04-19T02:21:20.462571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323975+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.323975+0000","last_peered":"2024-04-19T02:21:21.323975+0000","last_clean":"2024-04-19T02:21:21.323975+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.323975+0000","last_undegraded":"2024-04-19T02:21:21.323975+0000","last_fullsized":"2024-04-19T02:21:21.323975+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:35.319733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":136,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334181+0000","last_change":"2024-04-19T02:21:21.334181+0000","last_active":"2024-04-19T02:21:21.334181+0000","last_peered":"2024-04-19T02:21:21.334181+0000","last_clean":"2024-04-19T02:21:21.334181+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:21.334181+0000","last_undegraded":"2024-04-19T02:21:21.334181+0000","last_fullsized":"2024-04-19T02:21:21.334181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463012+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:20.463012+0000","last_peered":"2024-04-19T02:21:20.463012+0000","last_clean":"2024-04-19T02:21:20.463012+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:20.463012+0000","last_undegraded":"2024-04-19T02:21:20.463012+0000","last_fullsized":"2024-04-19T02:21:20.463012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317369+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.317369+0000","last_peered":"2024-04-19T02:21:21.317369+0000","last_clean":"2024-04-19T02:21:21.317369+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.317369+0000","last_undegraded":"2024-04-19T02:21:21.317369+0000","last_fullsized":"2024-04-19T02:21:21.317369+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466694+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:20.466694+0000","last_peered":"2024-04-19T02:21:20.466694+0000","last_clean":"2024-04-19T02:21:20.466694+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:20.466694+0000","last_undegraded":"2024-04-19T02:21:20.466694+0000","last_fullsized":"2024-04-19T02:21:20.466694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":857,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462444+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.462444+0000","last_peered":"2024-04-19T02:21:20.462444+0000","last_clean":"2024-04-19T02:21:20.462444+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.462444+0000","last_undegraded":"2024-04-19T02:21:20.462444+0000","last_fullsized":"2024-04-19T02:21:20.462444+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":167,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466454+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:20.466454+0000","last_peered":"2024-04-19T02:21:20.466454+0000","last_clean":"2024-04-19T02:21:20.466454+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:20.466454+0000","last_undegraded":"2024-04-19T02:21:20.466454+0000","last_fullsized":"2024-04-19T02:21:20.466454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":115,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467210+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.467210+0000","last_peered":"2024-04-19T02:21:20.467210+0000","last_clean":"2024-04-19T02:21:20.467210+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.467210+0000","last_undegraded":"2024-04-19T02:21:20.467210+0000","last_fullsized":"2024-04-19T02:21:20.467210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":974,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463297+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.463297+0000","last_peered":"2024-04-19T02:21:20.463297+0000","last_clean":"2024-04-19T02:21:20.463297+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.463297+0000","last_undegraded":"2024-04-19T02:21:20.463297+0000","last_fullsized":"2024-04-19T02:21:20.463297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463479+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:20.463479+0000","last_peered":"2024-04-19T02:21:20.463479+0000","last_clean":"2024-04-19T02:21:20.463479+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:20.463479+0000","last_undegraded":"2024-04-19T02:21:20.463479+0000","last_fullsized":"2024-04-19T02:21:20.463479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466709+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:20.466709+0000","last_peered":"2024-04-19T02:21:20.466709+0000","last_clean":"2024-04-19T02:21:20.466709+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:20.466709+0000","last_undegraded":"2024-04-19T02:21:20.466709+0000","last_fullsized":"2024-04-19T02:21:20.466709+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":951,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466559+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:20.466559+0000","last_peered":"2024-04-19T02:21:20.466559+0000","last_clean":"2024-04-19T02:21:20.466559+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:20.466559+0000","last_undegraded":"2024-04-19T02:21:20.466559+0000","last_fullsized":"2024-04-19T02:21:20.466559+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464664+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:20.464664+0000","last_peered":"2024-04-19T02:21:20.464664+0000","last_clean":"2024-04-19T02:21:20.464664+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:20.464664+0000","last_undegraded":"2024-04-19T02:21:20.464664+0000","last_fullsized":"2024-04-19T02:21:20.464664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307515+0000","last_change":"2024-04-19T02:21:21.307515+0000","last_active":"2024-04-19T02:21:21.307515+0000","last_peered":"2024-04-19T02:21:21.307515+0000","last_clean":"2024-04-19T02:21:21.307515+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:21.307515+0000","last_undegraded":"2024-04-19T02:21:21.307515+0000","last_fullsized":"2024-04-19T02:21:21.307515+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":577,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.458922+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:20.458922+0000","last_peered":"2024-04-19T02:21:20.458922+0000","last_clean":"2024-04-19T02:21:20.458922+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:20.458922+0000","last_undegraded":"2024-04-19T02:21:20.458922+0000","last_fullsized":"2024-04-19T02:21:20.458922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":501,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343149+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.343149+0000","last_peered":"2024-04-19T02:21:21.343149+0000","last_clean":"2024-04-19T02:21:21.343149+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.343149+0000","last_undegraded":"2024-04-19T02:21:21.343149+0000","last_fullsized":"2024-04-19T02:21:21.343149+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:38.509822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342574+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.342574+0000","last_peered":"2024-04-19T02:21:21.342574+0000","last_clean":"2024-04-19T02:21:21.342574+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.342574+0000","last_undegraded":"2024-04-19T02:21:21.342574+0000","last_fullsized":"2024-04-19T02:21:21.342574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":555,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459154+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:20.459154+0000","last_peered":"2024-04-19T02:21:20.459154+0000","last_clean":"2024-04-19T02:21:20.459154+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:20.459154+0000","last_undegraded":"2024-04-19T02:21:20.459154+0000","last_fullsized":"2024-04-19T02:21:20.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466348+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.466348+0000","last_peered":"2024-04-19T02:21:20.466348+0000","last_clean":"2024-04-19T02:21:20.466348+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.466348+0000","last_undegraded":"2024-04-19T02:21:20.466348+0000","last_fullsized":"2024-04-19T02:21:20.466348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":392,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307675+0000","last_change":"2024-04-19T02:21:21.307675+0000","last_active":"2024-04-19T02:21:21.307675+0000","last_peered":"2024-04-19T02:21:21.307675+0000","last_clean":"2024-04-19T02:21:21.307675+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:21.307675+0000","last_undegraded":"2024-04-19T02:21:21.307675+0000","last_fullsized":"2024-04-19T02:21:21.307675+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:47:29.710039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1019,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459723+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:20.459723+0000","last_peered":"2024-04-19T02:21:20.459723+0000","last_clean":"2024-04-19T02:21:20.459723+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:20.459723+0000","last_undegraded":"2024-04-19T02:21:20.459723+0000","last_fullsized":"2024-04-19T02:21:20.459723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463263+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:20.463263+0000","last_peered":"2024-04-19T02:21:20.463263+0000","last_clean":"2024-04-19T02:21:20.463263+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:20.463263+0000","last_undegraded":"2024-04-19T02:21:20.463263+0000","last_fullsized":"2024-04-19T02:21:20.463263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":629,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466275+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:20.466275+0000","last_peered":"2024-04-19T02:21:20.466275+0000","last_clean":"2024-04-19T02:21:20.466275+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:20.466275+0000","last_undegraded":"2024-04-19T02:21:20.466275+0000","last_fullsized":"2024-04-19T02:21:20.466275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":918,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463835+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.463835+0000","last_peered":"2024-04-19T02:21:20.463835+0000","last_clean":"2024-04-19T02:21:20.463835+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.463835+0000","last_undegraded":"2024-04-19T02:21:20.463835+0000","last_fullsized":"2024-04-19T02:21:20.463835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":683,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467179+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:20.467179+0000","last_peered":"2024-04-19T02:21:20.467179+0000","last_clean":"2024-04-19T02:21:20.467179+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:20.467179+0000","last_undegraded":"2024-04-19T02:21:20.467179+0000","last_fullsized":"2024-04-19T02:21:20.467179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":943,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461566+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:20.461566+0000","last_peered":"2024-04-19T02:21:20.461566+0000","last_clean":"2024-04-19T02:21:20.461566+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:20.461566+0000","last_undegraded":"2024-04-19T02:21:20.461566+0000","last_fullsized":"2024-04-19T02:21:20.461566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":461,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461576+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:20.461576+0000","last_peered":"2024-04-19T02:21:20.461576+0000","last_clean":"2024-04-19T02:21:20.461576+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:20.461576+0000","last_undegraded":"2024-04-19T02:21:20.461576+0000","last_fullsized":"2024-04-19T02:21:20.461576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":861,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474998+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:21.474998+0000","last_peered":"2024-04-19T02:21:21.474998+0000","last_clean":"2024-04-19T02:21:21.474998+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:21.474998+0000","last_undegraded":"2024-04-19T02:21:21.474998+0000","last_fullsized":"2024-04-19T02:21:21.474998+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":608,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.226780+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.226780+0000","last_peered":"2024-04-19T02:21:21.226780+0000","last_clean":"2024-04-19T02:21:21.226780+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.226780+0000","last_undegraded":"2024-04-19T02:21:21.226780+0000","last_fullsized":"2024-04-19T02:21:21.226780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474745+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:21.474745+0000","last_peered":"2024-04-19T02:21:21.474745+0000","last_clean":"2024-04-19T02:21:21.474745+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:21.474745+0000","last_undegraded":"2024-04-19T02:21:21.474745+0000","last_fullsized":"2024-04-19T02:21:21.474745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":188,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474193+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:21.474193+0000","last_peered":"2024-04-19T02:21:21.474193+0000","last_clean":"2024-04-19T02:21:21.474193+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:21.474193+0000","last_undegraded":"2024-04-19T02:21:21.474193+0000","last_fullsized":"2024-04-19T02:21:21.474193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342619+0000","last_change":"2024-04-19T02:21:21.342619+0000","last_active":"2024-04-19T02:21:21.342619+0000","last_peered":"2024-04-19T02:21:21.342619+0000","last_clean":"2024-04-19T02:21:21.342619+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:21.342619+0000","last_undegraded":"2024-04-19T02:21:21.342619+0000","last_fullsized":"2024-04-19T02:21:21.342619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:44.328651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":403,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.336126+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.336126+0000","last_peered":"2024-04-19T02:21:21.336126+0000","last_clean":"2024-04-19T02:21:21.336126+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.336126+0000","last_undegraded":"2024-04-19T02:21:21.336126+0000","last_fullsized":"2024-04-19T02:21:21.336126+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":495,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.328166+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.328166+0000","last_peered":"2024-04-19T02:21:21.328166+0000","last_clean":"2024-04-19T02:21:21.328166+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.328166+0000","last_undegraded":"2024-04-19T02:21:21.328166+0000","last_fullsized":"2024-04-19T02:21:21.328166+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:04.798376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475446+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:21.475446+0000","last_peered":"2024-04-19T02:21:21.475446+0000","last_clean":"2024-04-19T02:21:21.475446+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:21.475446+0000","last_undegraded":"2024-04-19T02:21:21.475446+0000","last_fullsized":"2024-04-19T02:21:21.475446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":633,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460698+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.460698+0000","last_peered":"2024-04-19T02:21:20.460698+0000","last_clean":"2024-04-19T02:21:20.460698+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.460698+0000","last_undegraded":"2024-04-19T02:21:20.460698+0000","last_fullsized":"2024-04-19T02:21:20.460698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464155+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:20.464155+0000","last_peered":"2024-04-19T02:21:20.464155+0000","last_clean":"2024-04-19T02:21:20.464155+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:20.464155+0000","last_undegraded":"2024-04-19T02:21:20.464155+0000","last_fullsized":"2024-04-19T02:21:20.464155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":558,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.338347+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.338347+0000","last_peered":"2024-04-19T02:21:21.338347+0000","last_clean":"2024-04-19T02:21:21.338347+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.338347+0000","last_undegraded":"2024-04-19T02:21:21.338347+0000","last_fullsized":"2024-04-19T02:21:21.338347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:19.012981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462736+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:20.462736+0000","last_peered":"2024-04-19T02:21:20.462736+0000","last_clean":"2024-04-19T02:21:20.462736+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:20.462736+0000","last_undegraded":"2024-04-19T02:21:20.462736+0000","last_fullsized":"2024-04-19T02:21:20.462736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126656,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245184,"statfs":{"total":96636764160,"available":96507068416,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":78,"seq":335007449101,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66136,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305704,"statfs":{"total":96636764160,"available":96569040896,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139616,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232224,"statfs":{"total":96636764160,"available":96493797376,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.499,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94499999999999995,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:28.755 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T02:21:28.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:29.094 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-19T02:21:28.310505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332408,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783112,"statfs":{"total":289910292480,"available":289569906688,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3934,"num_bytes_recovered":-43241477,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003125"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464171+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.464171+0000","last_peered":"2024-04-19T02:21:20.464171+0000","last_clean":"2024-04-19T02:21:20.464171+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.464171+0000","last_undegraded":"2024-04-19T02:21:20.464171+0000","last_fullsized":"2024-04-19T02:21:20.464171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":593,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463448+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.463448+0000","last_peered":"2024-04-19T02:21:20.463448+0000","last_clean":"2024-04-19T02:21:20.463448+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.463448+0000","last_undegraded":"2024-04-19T02:21:20.463448+0000","last_fullsized":"2024-04-19T02:21:20.463448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":483,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343830+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.343830+0000","last_peered":"2024-04-19T02:21:21.343830+0000","last_clean":"2024-04-19T02:21:21.343830+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.343830+0000","last_undegraded":"2024-04-19T02:21:21.343830+0000","last_fullsized":"2024-04-19T02:21:21.343830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:49.457654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":465,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342642+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.342642+0000","last_peered":"2024-04-19T02:21:21.342642+0000","last_clean":"2024-04-19T02:21:21.342642+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.342642+0000","last_undegraded":"2024-04-19T02:21:21.342642+0000","last_fullsized":"2024-04-19T02:21:21.342642+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:28.873039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:21.474108+0000","last_peered":"2024-04-19T02:21:21.474108+0000","last_clean":"2024-04-19T02:21:21.474108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:21.474108+0000","last_undegraded":"2024-04-19T02:21:21.474108+0000","last_fullsized":"2024-04-19T02:21:21.474108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":535,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348147+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348147+0000","last_peered":"2024-04-19T02:21:21.348147+0000","last_clean":"2024-04-19T02:21:21.348147+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348147+0000","last_undegraded":"2024-04-19T02:21:21.348147+0000","last_fullsized":"2024-04-19T02:21:21.348147+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:44.275063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":518,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.311849+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.311849+0000","last_peered":"2024-04-19T02:21:21.311849+0000","last_clean":"2024-04-19T02:21:21.311849+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.311849+0000","last_undegraded":"2024-04-19T02:21:21.311849+0000","last_fullsized":"2024-04-19T02:21:21.311849+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:51.111106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340703+0000","last_change":"2024-04-19T02:21:21.340703+0000","last_active":"2024-04-19T02:21:21.340703+0000","last_peered":"2024-04-19T02:21:21.340703+0000","last_clean":"2024-04-19T02:21:21.340703+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:21.340703+0000","last_undegraded":"2024-04-19T02:21:21.340703+0000","last_fullsized":"2024-04-19T02:21:21.340703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:48:22.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":563,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461341+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:20.461341+0000","last_peered":"2024-04-19T02:21:20.461341+0000","last_clean":"2024-04-19T02:21:20.461341+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:20.461341+0000","last_undegraded":"2024-04-19T02:21:20.461341+0000","last_fullsized":"2024-04-19T02:21:20.461341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":554,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462529+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.462529+0000","last_peered":"2024-04-19T02:21:20.462529+0000","last_clean":"2024-04-19T02:21:20.462529+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.462529+0000","last_undegraded":"2024-04-19T02:21:20.462529+0000","last_fullsized":"2024-04-19T02:21:20.462529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317186+0000","last_change":"2024-04-19T02:21:21.317186+0000","last_active":"2024-04-19T02:21:21.317186+0000","last_peered":"2024-04-19T02:21:21.317186+0000","last_clean":"2024-04-19T02:21:21.317186+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:21.317186+0000","last_undegraded":"2024-04-19T02:21:21.317186+0000","last_fullsized":"2024-04-19T02:21:21.317186+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:23.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":911,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460461+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.460461+0000","last_peered":"2024-04-19T02:21:20.460461+0000","last_clean":"2024-04-19T02:21:20.460461+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.460461+0000","last_undegraded":"2024-04-19T02:21:20.460461+0000","last_fullsized":"2024-04-19T02:21:20.460461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460799+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.460799+0000","last_peered":"2024-04-19T02:21:20.460799+0000","last_clean":"2024-04-19T02:21:20.460799+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.460799+0000","last_undegraded":"2024-04-19T02:21:20.460799+0000","last_fullsized":"2024-04-19T02:21:20.460799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341036+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.341036+0000","last_peered":"2024-04-19T02:21:21.341036+0000","last_clean":"2024-04-19T02:21:21.341036+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.341036+0000","last_undegraded":"2024-04-19T02:21:21.341036+0000","last_fullsized":"2024-04-19T02:21:21.341036+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:35.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330764+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.330764+0000","last_peered":"2024-04-19T02:21:21.330764+0000","last_clean":"2024-04-19T02:21:21.330764+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.330764+0000","last_undegraded":"2024-04-19T02:21:21.330764+0000","last_fullsized":"2024-04-19T02:21:21.330764+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:28.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":576,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.337686+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.337686+0000","last_peered":"2024-04-19T02:21:21.337686+0000","last_clean":"2024-04-19T02:21:21.337686+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.337686+0000","last_undegraded":"2024-04-19T02:21:21.337686+0000","last_fullsized":"2024-04-19T02:21:21.337686+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:03.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":561,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463208+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:20.463208+0000","last_peered":"2024-04-19T02:21:20.463208+0000","last_clean":"2024-04-19T02:21:20.463208+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:20.463208+0000","last_undegraded":"2024-04-19T02:21:20.463208+0000","last_fullsized":"2024-04-19T02:21:20.463208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463438+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.463438+0000","last_peered":"2024-04-19T02:21:20.463438+0000","last_clean":"2024-04-19T02:21:20.463438+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.463438+0000","last_undegraded":"2024-04-19T02:21:20.463438+0000","last_fullsized":"2024-04-19T02:21:20.463438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":649,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460217+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:20.460217+0000","last_peered":"2024-04-19T02:21:20.460217+0000","last_clean":"2024-04-19T02:21:20.460217+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:20.460217+0000","last_undegraded":"2024-04-19T02:21:20.460217+0000","last_fullsized":"2024-04-19T02:21:20.460217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":511,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341981+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.341981+0000","last_peered":"2024-04-19T02:21:21.341981+0000","last_clean":"2024-04-19T02:21:21.341981+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.341981+0000","last_undegraded":"2024-04-19T02:21:21.341981+0000","last_fullsized":"2024-04-19T02:21:21.341981+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:37.611409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.321511+0000","last_change":"2024-04-19T02:21:21.321511+0000","last_active":"2024-04-19T02:21:21.321511+0000","last_peered":"2024-04-19T02:21:21.321511+0000","last_clean":"2024-04-19T02:21:21.321511+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:21.321511+0000","last_undegraded":"2024-04-19T02:21:21.321511+0000","last_fullsized":"2024-04-19T02:21:21.321511+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:01.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1122,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462258+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.462258+0000","last_peered":"2024-04-19T02:21:20.462258+0000","last_clean":"2024-04-19T02:21:20.462258+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.462258+0000","last_undegraded":"2024-04-19T02:21:20.462258+0000","last_fullsized":"2024-04-19T02:21:20.462258+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":900,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459195+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:20.459195+0000","last_peered":"2024-04-19T02:21:20.459195+0000","last_clean":"2024-04-19T02:21:20.459195+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:20.459195+0000","last_undegraded":"2024-04-19T02:21:20.459195+0000","last_fullsized":"2024-04-19T02:21:20.459195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459306+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.459306+0000","last_peered":"2024-04-19T02:21:20.459306+0000","last_clean":"2024-04-19T02:21:20.459306+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.459306+0000","last_undegraded":"2024-04-19T02:21:20.459306+0000","last_fullsized":"2024-04-19T02:21:20.459306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":950,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463490+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.463490+0000","last_peered":"2024-04-19T02:21:20.463490+0000","last_clean":"2024-04-19T02:21:20.463490+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.463490+0000","last_undegraded":"2024-04-19T02:21:20.463490+0000","last_fullsized":"2024-04-19T02:21:20.463490+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462020+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:20.462020+0000","last_peered":"2024-04-19T02:21:20.462020+0000","last_clean":"2024-04-19T02:21:20.462020+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:20.462020+0000","last_undegraded":"2024-04-19T02:21:20.462020+0000","last_fullsized":"2024-04-19T02:21:20.462020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346297+0000","last_change":"2024-04-19T02:21:21.346297+0000","last_active":"2024-04-19T02:21:21.346297+0000","last_peered":"2024-04-19T02:21:21.346297+0000","last_clean":"2024-04-19T02:21:21.346297+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:21.346297+0000","last_undegraded":"2024-04-19T02:21:21.346297+0000","last_fullsized":"2024-04-19T02:21:21.346297+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:35.018270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":816,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462465+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.462465+0000","last_peered":"2024-04-19T02:21:20.462465+0000","last_clean":"2024-04-19T02:21:20.462465+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.462465+0000","last_undegraded":"2024-04-19T02:21:20.462465+0000","last_fullsized":"2024-04-19T02:21:20.462465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":539,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466063+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:20.466063+0000","last_peered":"2024-04-19T02:21:20.466063+0000","last_clean":"2024-04-19T02:21:20.466063+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:20.466063+0000","last_undegraded":"2024-04-19T02:21:20.466063+0000","last_fullsized":"2024-04-19T02:21:20.466063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1077,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":616,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459476+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:20.459476+0000","last_peered":"2024-04-19T02:21:20.459476+0000","last_clean":"2024-04-19T02:21:20.459476+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:20.459476+0000","last_undegraded":"2024-04-19T02:21:20.459476+0000","last_fullsized":"2024-04-19T02:21:20.459476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341631+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.341631+0000","last_peered":"2024-04-19T02:21:21.341631+0000","last_clean":"2024-04-19T02:21:21.341631+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.341631+0000","last_undegraded":"2024-04-19T02:21:21.341631+0000","last_fullsized":"2024-04-19T02:21:21.341631+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:57.921400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":498,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462207+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.462207+0000","last_peered":"2024-04-19T02:21:20.462207+0000","last_clean":"2024-04-19T02:21:20.462207+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.462207+0000","last_undegraded":"2024-04-19T02:21:20.462207+0000","last_fullsized":"2024-04-19T02:21:20.462207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330108+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.330108+0000","last_peered":"2024-04-19T02:21:21.330108+0000","last_clean":"2024-04-19T02:21:21.330108+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.330108+0000","last_undegraded":"2024-04-19T02:21:21.330108+0000","last_fullsized":"2024-04-19T02:21:21.330108+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:26.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":547,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.465527+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.465527+0000","last_peered":"2024-04-19T02:21:20.465527+0000","last_clean":"2024-04-19T02:21:20.465527+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.465527+0000","last_undegraded":"2024-04-19T02:21:20.465527+0000","last_fullsized":"2024-04-19T02:21:20.465527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1021,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464416+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:20.464416+0000","last_peered":"2024-04-19T02:21:20.464416+0000","last_clean":"2024-04-19T02:21:20.464416+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:20.464416+0000","last_undegraded":"2024-04-19T02:21:20.464416+0000","last_fullsized":"2024-04-19T02:21:20.464416+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460150+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.460150+0000","last_peered":"2024-04-19T02:21:20.460150+0000","last_clean":"2024-04-19T02:21:20.460150+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.460150+0000","last_undegraded":"2024-04-19T02:21:20.460150+0000","last_fullsized":"2024-04-19T02:21:20.460150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":910,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461582+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:20.461582+0000","last_peered":"2024-04-19T02:21:20.461582+0000","last_clean":"2024-04-19T02:21:20.461582+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:20.461582+0000","last_undegraded":"2024-04-19T02:21:20.461582+0000","last_fullsized":"2024-04-19T02:21:20.461582+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":130,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341978+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.341978+0000","last_peered":"2024-04-19T02:21:21.341978+0000","last_clean":"2024-04-19T02:21:21.341978+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.341978+0000","last_undegraded":"2024-04-19T02:21:21.341978+0000","last_fullsized":"2024-04-19T02:21:21.341978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:38.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":245,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.320439+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.320439+0000","last_peered":"2024-04-19T02:21:21.320439+0000","last_clean":"2024-04-19T02:21:21.320439+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.320439+0000","last_undegraded":"2024-04-19T02:21:21.320439+0000","last_fullsized":"2024-04-19T02:21:21.320439+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:12.736548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":895,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459571+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.459571+0000","last_peered":"2024-04-19T02:21:20.459571+0000","last_clean":"2024-04-19T02:21:20.459571+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.459571+0000","last_undegraded":"2024-04-19T02:21:20.459571+0000","last_fullsized":"2024-04-19T02:21:20.459571+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463759+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.463759+0000","last_peered":"2024-04-19T02:21:20.463759+0000","last_clean":"2024-04-19T02:21:20.463759+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.463759+0000","last_undegraded":"2024-04-19T02:21:20.463759+0000","last_fullsized":"2024-04-19T02:21:20.463759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459688+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.459688+0000","last_peered":"2024-04-19T02:21:20.459688+0000","last_clean":"2024-04-19T02:21:20.459688+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.459688+0000","last_undegraded":"2024-04-19T02:21:20.459688+0000","last_fullsized":"2024-04-19T02:21:20.459688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":674,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.339398+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.339398+0000","last_peered":"2024-04-19T02:21:21.339398+0000","last_clean":"2024-04-19T02:21:21.339398+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.339398+0000","last_undegraded":"2024-04-19T02:21:21.339398+0000","last_fullsized":"2024-04-19T02:21:21.339398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:50.683246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":491,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.327562+0000","last_change":"2024-04-19T02:21:21.327562+0000","last_active":"2024-04-19T02:21:21.327562+0000","last_peered":"2024-04-19T02:21:21.327562+0000","last_clean":"2024-04-19T02:21:21.327562+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:21.327562+0000","last_undegraded":"2024-04-19T02:21:21.327562+0000","last_fullsized":"2024-04-19T02:21:21.327562+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:00:27.273002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":121,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.304724+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.304724+0000","last_peered":"2024-04-19T02:21:21.304724+0000","last_clean":"2024-04-19T02:21:21.304724+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.304724+0000","last_undegraded":"2024-04-19T02:21:21.304724+0000","last_fullsized":"2024-04-19T02:21:21.304724+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:58.461641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1082,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463986+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:20.463986+0000","last_peered":"2024-04-19T02:21:20.463986+0000","last_clean":"2024-04-19T02:21:20.463986+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:20.463986+0000","last_undegraded":"2024-04-19T02:21:20.463986+0000","last_fullsized":"2024-04-19T02:21:20.463986+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.468359+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:20.468359+0000","last_peered":"2024-04-19T02:21:20.468359+0000","last_clean":"2024-04-19T02:21:20.468359+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:20.468359+0000","last_undegraded":"2024-04-19T02:21:20.468359+0000","last_fullsized":"2024-04-19T02:21:20.468359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323437+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.323437+0000","last_peered":"2024-04-19T02:21:21.323437+0000","last_clean":"2024-04-19T02:21:21.323437+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.323437+0000","last_undegraded":"2024-04-19T02:21:21.323437+0000","last_fullsized":"2024-04-19T02:21:21.323437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:15.338811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323460+0000","last_change":"2024-04-19T02:21:21.323460+0000","last_active":"2024-04-19T02:21:21.323460+0000","last_peered":"2024-04-19T02:21:21.323460+0000","last_clean":"2024-04-19T02:21:21.323460+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:21.323460+0000","last_undegraded":"2024-04-19T02:21:21.323460+0000","last_fullsized":"2024-04-19T02:21:21.323460+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":583,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344252+0000","last_change":"2024-04-19T02:21:21.344252+0000","last_active":"2024-04-19T02:21:21.344252+0000","last_peered":"2024-04-19T02:21:21.344252+0000","last_clean":"2024-04-19T02:21:21.344252+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:21:21.344252+0000","last_undegraded":"2024-04-19T02:21:21.344252+0000","last_fullsized":"2024-04-19T02:21:21.344252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:47.406900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460409+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.460409+0000","last_peered":"2024-04-19T02:21:20.460409+0000","last_clean":"2024-04-19T02:21:20.460409+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.460409+0000","last_undegraded":"2024-04-19T02:21:20.460409+0000","last_fullsized":"2024-04-19T02:21:20.460409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":450,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.319032+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.319032+0000","last_peered":"2024-04-19T02:21:21.319032+0000","last_clean":"2024-04-19T02:21:21.319032+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.319032+0000","last_undegraded":"2024-04-19T02:21:21.319032+0000","last_fullsized":"2024-04-19T02:21:21.319032+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:03.038712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":502,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459835+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.459835+0000","last_peered":"2024-04-19T02:21:20.459835+0000","last_clean":"2024-04-19T02:21:20.459835+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.459835+0000","last_undegraded":"2024-04-19T02:21:20.459835+0000","last_fullsized":"2024-04-19T02:21:20.459835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":531,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462045+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:20.462045+0000","last_peered":"2024-04-19T02:21:20.462045+0000","last_clean":"2024-04-19T02:21:20.462045+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:20.462045+0000","last_undegraded":"2024-04-19T02:21:20.462045+0000","last_fullsized":"2024-04-19T02:21:20.462045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341047+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.341047+0000","last_peered":"2024-04-19T02:21:21.341047+0000","last_clean":"2024-04-19T02:21:21.341047+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.341047+0000","last_undegraded":"2024-04-19T02:21:21.341047+0000","last_fullsized":"2024-04-19T02:21:21.341047+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:30.201443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334723+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.334723+0000","last_peered":"2024-04-19T02:21:21.334723+0000","last_clean":"2024-04-19T02:21:21.334723+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.334723+0000","last_undegraded":"2024-04-19T02:21:21.334723+0000","last_fullsized":"2024-04-19T02:21:21.334723+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":873,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466035+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:20.466035+0000","last_peered":"2024-04-19T02:21:20.466035+0000","last_clean":"2024-04-19T02:21:20.466035+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:20.466035+0000","last_undegraded":"2024-04-19T02:21:20.466035+0000","last_fullsized":"2024-04-19T02:21:20.466035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346189+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.346189+0000","last_peered":"2024-04-19T02:21:21.346189+0000","last_clean":"2024-04-19T02:21:21.346189+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.346189+0000","last_undegraded":"2024-04-19T02:21:21.346189+0000","last_fullsized":"2024-04-19T02:21:21.346189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:25.982675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342225+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.342225+0000","last_peered":"2024-04-19T02:21:21.342225+0000","last_clean":"2024-04-19T02:21:21.342225+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.342225+0000","last_undegraded":"2024-04-19T02:21:21.342225+0000","last_fullsized":"2024-04-19T02:21:21.342225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:40.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":310,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461829+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:20.461829+0000","last_peered":"2024-04-19T02:21:20.461829+0000","last_clean":"2024-04-19T02:21:20.461829+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:20.461829+0000","last_undegraded":"2024-04-19T02:21:20.461829+0000","last_fullsized":"2024-04-19T02:21:20.461829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":556,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463696+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.463696+0000","last_peered":"2024-04-19T02:21:20.463696+0000","last_clean":"2024-04-19T02:21:20.463696+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.463696+0000","last_undegraded":"2024-04-19T02:21:20.463696+0000","last_fullsized":"2024-04-19T02:21:20.463696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462303+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:20.462303+0000","last_peered":"2024-04-19T02:21:20.462303+0000","last_clean":"2024-04-19T02:21:20.462303+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:20.462303+0000","last_undegraded":"2024-04-19T02:21:20.462303+0000","last_fullsized":"2024-04-19T02:21:20.462303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":523,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460080+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.460080+0000","last_peered":"2024-04-19T02:21:20.460080+0000","last_clean":"2024-04-19T02:21:20.460080+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.460080+0000","last_undegraded":"2024-04-19T02:21:20.460080+0000","last_fullsized":"2024-04-19T02:21:20.460080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":468,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462571+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:20.462571+0000","last_peered":"2024-04-19T02:21:20.462571+0000","last_clean":"2024-04-19T02:21:20.462571+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:20.462571+0000","last_undegraded":"2024-04-19T02:21:20.462571+0000","last_fullsized":"2024-04-19T02:21:20.462571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323975+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.323975+0000","last_peered":"2024-04-19T02:21:21.323975+0000","last_clean":"2024-04-19T02:21:21.323975+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.323975+0000","last_undegraded":"2024-04-19T02:21:21.323975+0000","last_fullsized":"2024-04-19T02:21:21.323975+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:35.319733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":136,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334181+0000","last_change":"2024-04-19T02:21:21.334181+0000","last_active":"2024-04-19T02:21:21.334181+0000","last_peered":"2024-04-19T02:21:21.334181+0000","last_clean":"2024-04-19T02:21:21.334181+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:21.334181+0000","last_undegraded":"2024-04-19T02:21:21.334181+0000","last_fullsized":"2024-04-19T02:21:21.334181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463012+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:20.463012+0000","last_peered":"2024-04-19T02:21:20.463012+0000","last_clean":"2024-04-19T02:21:20.463012+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:20.463012+0000","last_undegraded":"2024-04-19T02:21:20.463012+0000","last_fullsized":"2024-04-19T02:21:20.463012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317369+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.317369+0000","last_peered":"2024-04-19T02:21:21.317369+0000","last_clean":"2024-04-19T02:21:21.317369+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.317369+0000","last_undegraded":"2024-04-19T02:21:21.317369+0000","last_fullsized":"2024-04-19T02:21:21.317369+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466694+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:20.466694+0000","last_peered":"2024-04-19T02:21:20.466694+0000","last_clean":"2024-04-19T02:21:20.466694+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:20.466694+0000","last_undegraded":"2024-04-19T02:21:20.466694+0000","last_fullsized":"2024-04-19T02:21:20.466694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":857,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462444+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.462444+0000","last_peered":"2024-04-19T02:21:20.462444+0000","last_clean":"2024-04-19T02:21:20.462444+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.462444+0000","last_undegraded":"2024-04-19T02:21:20.462444+0000","last_fullsized":"2024-04-19T02:21:20.462444+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":167,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466454+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:20.466454+0000","last_peered":"2024-04-19T02:21:20.466454+0000","last_clean":"2024-04-19T02:21:20.466454+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:20.466454+0000","last_undegraded":"2024-04-19T02:21:20.466454+0000","last_fullsized":"2024-04-19T02:21:20.466454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":115,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467210+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.467210+0000","last_peered":"2024-04-19T02:21:20.467210+0000","last_clean":"2024-04-19T02:21:20.467210+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.467210+0000","last_undegraded":"2024-04-19T02:21:20.467210+0000","last_fullsized":"2024-04-19T02:21:20.467210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":974,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463297+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.463297+0000","last_peered":"2024-04-19T02:21:20.463297+0000","last_clean":"2024-04-19T02:21:20.463297+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.463297+0000","last_undegraded":"2024-04-19T02:21:20.463297+0000","last_fullsized":"2024-04-19T02:21:20.463297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463479+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:20.463479+0000","last_peered":"2024-04-19T02:21:20.463479+0000","last_clean":"2024-04-19T02:21:20.463479+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:20.463479+0000","last_undegraded":"2024-04-19T02:21:20.463479+0000","last_fullsized":"2024-04-19T02:21:20.463479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466709+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:20.466709+0000","last_peered":"2024-04-19T02:21:20.466709+0000","last_clean":"2024-04-19T02:21:20.466709+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:20.466709+0000","last_undegraded":"2024-04-19T02:21:20.466709+0000","last_fullsized":"2024-04-19T02:21:20.466709+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":951,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466559+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:20.466559+0000","last_peered":"2024-04-19T02:21:20.466559+0000","last_clean":"2024-04-19T02:21:20.466559+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:20.466559+0000","last_undegraded":"2024-04-19T02:21:20.466559+0000","last_fullsized":"2024-04-19T02:21:20.466559+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464664+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:20.464664+0000","last_peered":"2024-04-19T02:21:20.464664+0000","last_clean":"2024-04-19T02:21:20.464664+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:20.464664+0000","last_undegraded":"2024-04-19T02:21:20.464664+0000","last_fullsized":"2024-04-19T02:21:20.464664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307515+0000","last_change":"2024-04-19T02:21:21.307515+0000","last_active":"2024-04-19T02:21:21.307515+0000","last_peered":"2024-04-19T02:21:21.307515+0000","last_clean":"2024-04-19T02:21:21.307515+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:21.307515+0000","last_undegraded":"2024-04-19T02:21:21.307515+0000","last_fullsized":"2024-04-19T02:21:21.307515+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":577,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.458922+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:20.458922+0000","last_peered":"2024-04-19T02:21:20.458922+0000","last_clean":"2024-04-19T02:21:20.458922+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:20.458922+0000","last_undegraded":"2024-04-19T02:21:20.458922+0000","last_fullsized":"2024-04-19T02:21:20.458922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":501,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343149+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.343149+0000","last_peered":"2024-04-19T02:21:21.343149+0000","last_clean":"2024-04-19T02:21:21.343149+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.343149+0000","last_undegraded":"2024-04-19T02:21:21.343149+0000","last_fullsized":"2024-04-19T02:21:21.343149+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:38.509822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342574+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.342574+0000","last_peered":"2024-04-19T02:21:21.342574+0000","last_clean":"2024-04-19T02:21:21.342574+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.342574+0000","last_undegraded":"2024-04-19T02:21:21.342574+0000","last_fullsized":"2024-04-19T02:21:21.342574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":555,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459154+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:20.459154+0000","last_peered":"2024-04-19T02:21:20.459154+0000","last_clean":"2024-04-19T02:21:20.459154+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:20.459154+0000","last_undegraded":"2024-04-19T02:21:20.459154+0000","last_fullsized":"2024-04-19T02:21:20.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466348+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.466348+0000","last_peered":"2024-04-19T02:21:20.466348+0000","last_clean":"2024-04-19T02:21:20.466348+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.466348+0000","last_undegraded":"2024-04-19T02:21:20.466348+0000","last_fullsized":"2024-04-19T02:21:20.466348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":392,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307675+0000","last_change":"2024-04-19T02:21:21.307675+0000","last_active":"2024-04-19T02:21:21.307675+0000","last_peered":"2024-04-19T02:21:21.307675+0000","last_clean":"2024-04-19T02:21:21.307675+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:21.307675+0000","last_undegraded":"2024-04-19T02:21:21.307675+0000","last_fullsized":"2024-04-19T02:21:21.307675+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:47:29.710039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1019,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459723+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:20.459723+0000","last_peered":"2024-04-19T02:21:20.459723+0000","last_clean":"2024-04-19T02:21:20.459723+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:20.459723+0000","last_undegraded":"2024-04-19T02:21:20.459723+0000","last_fullsized":"2024-04-19T02:21:20.459723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463263+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:20.463263+0000","last_peered":"2024-04-19T02:21:20.463263+0000","last_clean":"2024-04-19T02:21:20.463263+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:20.463263+0000","last_undegraded":"2024-04-19T02:21:20.463263+0000","last_fullsized":"2024-04-19T02:21:20.463263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":629,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466275+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:20.466275+0000","last_peered":"2024-04-19T02:21:20.466275+0000","last_clean":"2024-04-19T02:21:20.466275+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:20.466275+0000","last_undegraded":"2024-04-19T02:21:20.466275+0000","last_fullsized":"2024-04-19T02:21:20.466275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":918,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463835+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.463835+0000","last_peered":"2024-04-19T02:21:20.463835+0000","last_clean":"2024-04-19T02:21:20.463835+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.463835+0000","last_undegraded":"2024-04-19T02:21:20.463835+0000","last_fullsized":"2024-04-19T02:21:20.463835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":683,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467179+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:20.467179+0000","last_peered":"2024-04-19T02:21:20.467179+0000","last_clean":"2024-04-19T02:21:20.467179+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:20.467179+0000","last_undegraded":"2024-04-19T02:21:20.467179+0000","last_fullsized":"2024-04-19T02:21:20.467179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":943,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461566+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:20.461566+0000","last_peered":"2024-04-19T02:21:20.461566+0000","last_clean":"2024-04-19T02:21:20.461566+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:20.461566+0000","last_undegraded":"2024-04-19T02:21:20.461566+0000","last_fullsized":"2024-04-19T02:21:20.461566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":461,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461576+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:20.461576+0000","last_peered":"2024-04-19T02:21:20.461576+0000","last_clean":"2024-04-19T02:21:20.461576+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:20.461576+0000","last_undegraded":"2024-04-19T02:21:20.461576+0000","last_fullsized":"2024-04-19T02:21:20.461576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":861,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474998+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:21.474998+0000","last_peered":"2024-04-19T02:21:21.474998+0000","last_clean":"2024-04-19T02:21:21.474998+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:21.474998+0000","last_undegraded":"2024-04-19T02:21:21.474998+0000","last_fullsized":"2024-04-19T02:21:21.474998+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":608,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.226780+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.226780+0000","last_peered":"2024-04-19T02:21:21.226780+0000","last_clean":"2024-04-19T02:21:21.226780+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.226780+0000","last_undegraded":"2024-04-19T02:21:21.226780+0000","last_fullsized":"2024-04-19T02:21:21.226780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474745+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:21.474745+0000","last_peered":"2024-04-19T02:21:21.474745+0000","last_clean":"2024-04-19T02:21:21.474745+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:21.474745+0000","last_undegraded":"2024-04-19T02:21:21.474745+0000","last_fullsized":"2024-04-19T02:21:21.474745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":188,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474193+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:21.474193+0000","last_peered":"2024-04-19T02:21:21.474193+0000","last_clean":"2024-04-19T02:21:21.474193+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:21.474193+0000","last_undegraded":"2024-04-19T02:21:21.474193+0000","last_fullsized":"2024-04-19T02:21:21.474193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342619+0000","last_change":"2024-04-19T02:21:21.342619+0000","last_active":"2024-04-19T02:21:21.342619+0000","last_peered":"2024-04-19T02:21:21.342619+0000","last_clean":"2024-04-19T02:21:21.342619+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:21.342619+0000","last_undegraded":"2024-04-19T02:21:21.342619+0000","last_fullsized":"2024-04-19T02:21:21.342619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:44.328651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":403,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.336126+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.336126+0000","last_peered":"2024-04-19T02:21:21.336126+0000","last_clean":"2024-04-19T02:21:21.336126+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.336126+0000","last_undegraded":"2024-04-19T02:21:21.336126+0000","last_fullsized":"2024-04-19T02:21:21.336126+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":495,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.328166+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.328166+0000","last_peered":"2024-04-19T02:21:21.328166+0000","last_clean":"2024-04-19T02:21:21.328166+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.328166+0000","last_undegraded":"2024-04-19T02:21:21.328166+0000","last_fullsized":"2024-04-19T02:21:21.328166+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:04.798376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475446+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:21.475446+0000","last_peered":"2024-04-19T02:21:21.475446+0000","last_clean":"2024-04-19T02:21:21.475446+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:21.475446+0000","last_undegraded":"2024-04-19T02:21:21.475446+0000","last_fullsized":"2024-04-19T02:21:21.475446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":633,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460698+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.460698+0000","last_peered":"2024-04-19T02:21:20.460698+0000","last_clean":"2024-04-19T02:21:20.460698+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.460698+0000","last_undegraded":"2024-04-19T02:21:20.460698+0000","last_fullsized":"2024-04-19T02:21:20.460698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464155+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:20.464155+0000","last_peered":"2024-04-19T02:21:20.464155+0000","last_clean":"2024-04-19T02:21:20.464155+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:20.464155+0000","last_undegraded":"2024-04-19T02:21:20.464155+0000","last_fullsized":"2024-04-19T02:21:20.464155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":558,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.338347+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.338347+0000","last_peered":"2024-04-19T02:21:21.338347+0000","last_clean":"2024-04-19T02:21:21.338347+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.338347+0000","last_undegraded":"2024-04-19T02:21:21.338347+0000","last_fullsized":"2024-04-19T02:21:21.338347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:19.012981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462736+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:20.462736+0000","last_peered":"2024-04-19T02:21:20.462736+0000","last_clean":"2024-04-19T02:21:20.462736+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:20.462736+0000","last_undegraded":"2024-04-19T02:21:20.462736+0000","last_fullsized":"2024-04-19T02:21:20.462736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126656,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245184,"statfs":{"total":96636764160,"available":96507068416,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.55200000000000005,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.83099999999999996,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58799999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.77100000000000002,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":78,"seq":335007449101,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66136,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305704,"statfs":{"total":96636764160,"available":96569040896,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139616,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232224,"statfs":{"total":96636764160,"available":96493797376,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.499,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94499999999999995,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:29.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:21:29.428 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:29.428 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":117,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:21:21.462529+0000","last_up_change":"2024-04-19T02:20:29.461222+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":78,"up_thru":116,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1526},{"type":"v1","addr":"172.21.15.136:6801","nonce":1526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1526},{"type":"v1","addr":"172.21.15.136:6803","nonce":1526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1526},{"type":"v1","addr":"172.21.15.136:6807","nonce":1526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1526},{"type":"v1","addr":"172.21.15.136:6805","nonce":1526}]},"public_addr":"172.21.15.136:6801/1526","cluster_addr":"172.21.15.136:6803/1526","heartbeat_back_addr":"172.21.15.136:6807/1526","heartbeat_front_addr":"172.21.15.136:6805/1526","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":30},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1","osds":[2,0]},{"pgid":"4.3a","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:21:30.447 INFO:tasks.ceph:Scrubbing osd.0 2024-04-19T02:21:30.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-19T02:21:30.606 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:21:30.606 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T02:21:30.606 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:21:30.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-19T02:21:30.881 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-04-19T02:21:30.899 INFO:tasks.ceph:Scrubbing osd.1 2024-04-19T02:21:30.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-19T02:21:31.031 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:21:31.031 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-19T02:21:31.032 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:21:31.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-19T02:21:31.324 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-04-19T02:21:31.343 INFO:tasks.ceph:Scrubbing osd.2 2024-04-19T02:21:31.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-19T02:21:31.484 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-19T02:21:31.485 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T02:21:31.485 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-19T02:21:31.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-19T02:21:31.760 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-04-19T02:21:31.778 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:32.056 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:32.058 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:32.073 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-04-19T02:21:30.310947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34426,"ondisk_log_size":34426,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332408,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783112,"statfs":{"total":289910292480,"available":289569906688,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3934,"num_bytes_recovered":-43241477,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.854703"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464171+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:20.464171+0000","last_peered":"2024-04-19T02:21:20.464171+0000","last_clean":"2024-04-19T02:21:20.464171+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:20.464171+0000","last_undegraded":"2024-04-19T02:21:20.464171+0000","last_fullsized":"2024-04-19T02:21:20.464171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":593,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463448+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:20.463448+0000","last_peered":"2024-04-19T02:21:20.463448+0000","last_clean":"2024-04-19T02:21:20.463448+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:20.463448+0000","last_undegraded":"2024-04-19T02:21:20.463448+0000","last_fullsized":"2024-04-19T02:21:20.463448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":483,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343830+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.343830+0000","last_peered":"2024-04-19T02:21:21.343830+0000","last_clean":"2024-04-19T02:21:21.343830+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.343830+0000","last_undegraded":"2024-04-19T02:21:21.343830+0000","last_fullsized":"2024-04-19T02:21:21.343830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:49.457654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":465,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342642+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.342642+0000","last_peered":"2024-04-19T02:21:21.342642+0000","last_clean":"2024-04-19T02:21:21.342642+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.342642+0000","last_undegraded":"2024-04-19T02:21:21.342642+0000","last_fullsized":"2024-04-19T02:21:21.342642+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:28.873039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474108+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:21.474108+0000","last_peered":"2024-04-19T02:21:21.474108+0000","last_clean":"2024-04-19T02:21:21.474108+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:21.474108+0000","last_undegraded":"2024-04-19T02:21:21.474108+0000","last_fullsized":"2024-04-19T02:21:21.474108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":535,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348147+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348147+0000","last_peered":"2024-04-19T02:21:21.348147+0000","last_clean":"2024-04-19T02:21:21.348147+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348147+0000","last_undegraded":"2024-04-19T02:21:21.348147+0000","last_fullsized":"2024-04-19T02:21:21.348147+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:44.275063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":518,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.311849+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.311849+0000","last_peered":"2024-04-19T02:21:21.311849+0000","last_clean":"2024-04-19T02:21:21.311849+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.311849+0000","last_undegraded":"2024-04-19T02:21:21.311849+0000","last_fullsized":"2024-04-19T02:21:21.311849+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:51.111106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340703+0000","last_change":"2024-04-19T02:21:21.340703+0000","last_active":"2024-04-19T02:21:21.340703+0000","last_peered":"2024-04-19T02:21:21.340703+0000","last_clean":"2024-04-19T02:21:21.340703+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:21.340703+0000","last_undegraded":"2024-04-19T02:21:21.340703+0000","last_fullsized":"2024-04-19T02:21:21.340703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:48:22.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":563,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461341+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:20.461341+0000","last_peered":"2024-04-19T02:21:20.461341+0000","last_clean":"2024-04-19T02:21:20.461341+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:20.461341+0000","last_undegraded":"2024-04-19T02:21:20.461341+0000","last_fullsized":"2024-04-19T02:21:20.461341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:35.260163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":554,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462529+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:20.462529+0000","last_peered":"2024-04-19T02:21:20.462529+0000","last_clean":"2024-04-19T02:21:20.462529+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:20.462529+0000","last_undegraded":"2024-04-19T02:21:20.462529+0000","last_fullsized":"2024-04-19T02:21:20.462529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317186+0000","last_change":"2024-04-19T02:21:21.317186+0000","last_active":"2024-04-19T02:21:21.317186+0000","last_peered":"2024-04-19T02:21:21.317186+0000","last_clean":"2024-04-19T02:21:21.317186+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:21.317186+0000","last_undegraded":"2024-04-19T02:21:21.317186+0000","last_fullsized":"2024-04-19T02:21:21.317186+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:23.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":911,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460461+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:20.460461+0000","last_peered":"2024-04-19T02:21:20.460461+0000","last_clean":"2024-04-19T02:21:20.460461+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:20.460461+0000","last_undegraded":"2024-04-19T02:21:20.460461+0000","last_fullsized":"2024-04-19T02:21:20.460461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:25:17.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460799+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:20.460799+0000","last_peered":"2024-04-19T02:21:20.460799+0000","last_clean":"2024-04-19T02:21:20.460799+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:20.460799+0000","last_undegraded":"2024-04-19T02:21:20.460799+0000","last_fullsized":"2024-04-19T02:21:20.460799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:31.681014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341036+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.341036+0000","last_peered":"2024-04-19T02:21:21.341036+0000","last_clean":"2024-04-19T02:21:21.341036+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.341036+0000","last_undegraded":"2024-04-19T02:21:21.341036+0000","last_fullsized":"2024-04-19T02:21:21.341036+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:35.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330764+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.330764+0000","last_peered":"2024-04-19T02:21:21.330764+0000","last_clean":"2024-04-19T02:21:21.330764+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.330764+0000","last_undegraded":"2024-04-19T02:21:21.330764+0000","last_fullsized":"2024-04-19T02:21:21.330764+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:28.921216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":576,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.337686+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.337686+0000","last_peered":"2024-04-19T02:21:21.337686+0000","last_clean":"2024-04-19T02:21:21.337686+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.337686+0000","last_undegraded":"2024-04-19T02:21:21.337686+0000","last_fullsized":"2024-04-19T02:21:21.337686+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:03.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":561,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463208+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:20.463208+0000","last_peered":"2024-04-19T02:21:20.463208+0000","last_clean":"2024-04-19T02:21:20.463208+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:20.463208+0000","last_undegraded":"2024-04-19T02:21:20.463208+0000","last_fullsized":"2024-04-19T02:21:20.463208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:18.057764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":538,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463438+0000","last_change":"2024-04-19T02:16:24.511471+0000","last_active":"2024-04-19T02:21:20.463438+0000","last_peered":"2024-04-19T02:21:20.463438+0000","last_clean":"2024-04-19T02:21:20.463438+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:20.463438+0000","last_undegraded":"2024-04-19T02:21:20.463438+0000","last_fullsized":"2024-04-19T02:21:20.463438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:59.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":649,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460217+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:20.460217+0000","last_peered":"2024-04-19T02:21:20.460217+0000","last_clean":"2024-04-19T02:21:20.460217+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:20.460217+0000","last_undegraded":"2024-04-19T02:21:20.460217+0000","last_fullsized":"2024-04-19T02:21:20.460217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:18:22.449532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":511,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341981+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.341981+0000","last_peered":"2024-04-19T02:21:21.341981+0000","last_clean":"2024-04-19T02:21:21.341981+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.341981+0000","last_undegraded":"2024-04-19T02:21:21.341981+0000","last_fullsized":"2024-04-19T02:21:21.341981+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:37.611409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.321511+0000","last_change":"2024-04-19T02:21:21.321511+0000","last_active":"2024-04-19T02:21:21.321511+0000","last_peered":"2024-04-19T02:21:21.321511+0000","last_clean":"2024-04-19T02:21:21.321511+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:21.321511+0000","last_undegraded":"2024-04-19T02:21:21.321511+0000","last_fullsized":"2024-04-19T02:21:21.321511+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:01.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1122,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462258+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:20.462258+0000","last_peered":"2024-04-19T02:21:20.462258+0000","last_clean":"2024-04-19T02:21:20.462258+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:20.462258+0000","last_undegraded":"2024-04-19T02:21:20.462258+0000","last_fullsized":"2024-04-19T02:21:20.462258+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:49.833369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":900,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459195+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:20.459195+0000","last_peered":"2024-04-19T02:21:20.459195+0000","last_clean":"2024-04-19T02:21:20.459195+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:20.459195+0000","last_undegraded":"2024-04-19T02:21:20.459195+0000","last_fullsized":"2024-04-19T02:21:20.459195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:20.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459306+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:20.459306+0000","last_peered":"2024-04-19T02:21:20.459306+0000","last_clean":"2024-04-19T02:21:20.459306+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:20.459306+0000","last_undegraded":"2024-04-19T02:21:20.459306+0000","last_fullsized":"2024-04-19T02:21:20.459306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:58.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":950,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463490+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:20.463490+0000","last_peered":"2024-04-19T02:21:20.463490+0000","last_clean":"2024-04-19T02:21:20.463490+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:20.463490+0000","last_undegraded":"2024-04-19T02:21:20.463490+0000","last_fullsized":"2024-04-19T02:21:20.463490+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:33:16.133534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462020+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:20.462020+0000","last_peered":"2024-04-19T02:21:20.462020+0000","last_clean":"2024-04-19T02:21:20.462020+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:20.462020+0000","last_undegraded":"2024-04-19T02:21:20.462020+0000","last_fullsized":"2024-04-19T02:21:20.462020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:20.860673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346297+0000","last_change":"2024-04-19T02:21:21.346297+0000","last_active":"2024-04-19T02:21:21.346297+0000","last_peered":"2024-04-19T02:21:21.346297+0000","last_clean":"2024-04-19T02:21:21.346297+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:21.346297+0000","last_undegraded":"2024-04-19T02:21:21.346297+0000","last_fullsized":"2024-04-19T02:21:21.346297+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:35.018270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":816,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462465+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:20.462465+0000","last_peered":"2024-04-19T02:21:20.462465+0000","last_clean":"2024-04-19T02:21:20.462465+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:20.462465+0000","last_undegraded":"2024-04-19T02:21:20.462465+0000","last_fullsized":"2024-04-19T02:21:20.462465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:41.592544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":539,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466063+0000","last_change":"2024-04-19T02:16:24.510854+0000","last_active":"2024-04-19T02:21:20.466063+0000","last_peered":"2024-04-19T02:21:20.466063+0000","last_clean":"2024-04-19T02:21:20.466063+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:20.466063+0000","last_undegraded":"2024-04-19T02:21:20.466063+0000","last_fullsized":"2024-04-19T02:21:20.466063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:25:07.899519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1077,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:56.225044+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:59.616532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":616,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459476+0000","last_change":"2024-04-19T02:16:24.510286+0000","last_active":"2024-04-19T02:21:20.459476+0000","last_peered":"2024-04-19T02:21:20.459476+0000","last_clean":"2024-04-19T02:21:20.459476+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:20.459476+0000","last_undegraded":"2024-04-19T02:21:20.459476+0000","last_fullsized":"2024-04-19T02:21:20.459476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:03.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341631+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.341631+0000","last_peered":"2024-04-19T02:21:21.341631+0000","last_clean":"2024-04-19T02:21:21.341631+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.341631+0000","last_undegraded":"2024-04-19T02:21:21.341631+0000","last_fullsized":"2024-04-19T02:21:21.341631+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:57.921400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":498,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462207+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:20.462207+0000","last_peered":"2024-04-19T02:21:20.462207+0000","last_clean":"2024-04-19T02:21:20.462207+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:20.462207+0000","last_undegraded":"2024-04-19T02:21:20.462207+0000","last_fullsized":"2024-04-19T02:21:20.462207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:29.763322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":457,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330108+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.330108+0000","last_peered":"2024-04-19T02:21:21.330108+0000","last_clean":"2024-04-19T02:21:21.330108+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.330108+0000","last_undegraded":"2024-04-19T02:21:21.330108+0000","last_fullsized":"2024-04-19T02:21:21.330108+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:26.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":547,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.465527+0000","last_change":"2024-04-19T02:16:24.515088+0000","last_active":"2024-04-19T02:21:20.465527+0000","last_peered":"2024-04-19T02:21:20.465527+0000","last_clean":"2024-04-19T02:21:20.465527+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:20.465527+0000","last_undegraded":"2024-04-19T02:21:20.465527+0000","last_fullsized":"2024-04-19T02:21:20.465527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:10.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462485+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:20.462485+0000","last_peered":"2024-04-19T02:21:20.462485+0000","last_clean":"2024-04-19T02:21:20.462485+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:20.462485+0000","last_undegraded":"2024-04-19T02:21:20.462485+0000","last_fullsized":"2024-04-19T02:21:20.462485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:35:01.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1021,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464416+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:20.464416+0000","last_peered":"2024-04-19T02:21:20.464416+0000","last_clean":"2024-04-19T02:21:20.464416+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:20.464416+0000","last_undegraded":"2024-04-19T02:21:20.464416+0000","last_fullsized":"2024-04-19T02:21:20.464416+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:44.036089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460150+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:20.460150+0000","last_peered":"2024-04-19T02:21:20.460150+0000","last_clean":"2024-04-19T02:21:20.460150+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:20.460150+0000","last_undegraded":"2024-04-19T02:21:20.460150+0000","last_fullsized":"2024-04-19T02:21:20.460150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:54:14.913588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":910,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461582+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:20.461582+0000","last_peered":"2024-04-19T02:21:20.461582+0000","last_clean":"2024-04-19T02:21:20.461582+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:20.461582+0000","last_undegraded":"2024-04-19T02:21:20.461582+0000","last_fullsized":"2024-04-19T02:21:20.461582+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:08.276962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":130,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341978+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.341978+0000","last_peered":"2024-04-19T02:21:21.341978+0000","last_clean":"2024-04-19T02:21:21.341978+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.341978+0000","last_undegraded":"2024-04-19T02:21:21.341978+0000","last_fullsized":"2024-04-19T02:21:21.341978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:38.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":245,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.320439+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.320439+0000","last_peered":"2024-04-19T02:21:21.320439+0000","last_clean":"2024-04-19T02:21:21.320439+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.320439+0000","last_undegraded":"2024-04-19T02:21:21.320439+0000","last_fullsized":"2024-04-19T02:21:21.320439+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:12.736548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":895,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459571+0000","last_change":"2024-04-19T02:20:41.201938+0000","last_active":"2024-04-19T02:21:20.459571+0000","last_peered":"2024-04-19T02:21:20.459571+0000","last_clean":"2024-04-19T02:21:20.459571+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:20.459571+0000","last_undegraded":"2024-04-19T02:21:20.459571+0000","last_fullsized":"2024-04-19T02:21:20.459571+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:50.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463759+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:20.463759+0000","last_peered":"2024-04-19T02:21:20.463759+0000","last_clean":"2024-04-19T02:21:20.463759+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:20.463759+0000","last_undegraded":"2024-04-19T02:21:20.463759+0000","last_fullsized":"2024-04-19T02:21:20.463759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:08.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":567,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459688+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:20.459688+0000","last_peered":"2024-04-19T02:21:20.459688+0000","last_clean":"2024-04-19T02:21:20.459688+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:20.459688+0000","last_undegraded":"2024-04-19T02:21:20.459688+0000","last_fullsized":"2024-04-19T02:21:20.459688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:18.731831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":674,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.339398+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.339398+0000","last_peered":"2024-04-19T02:21:21.339398+0000","last_clean":"2024-04-19T02:21:21.339398+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.339398+0000","last_undegraded":"2024-04-19T02:21:21.339398+0000","last_fullsized":"2024-04-19T02:21:21.339398+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:50.683246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":491,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.327562+0000","last_change":"2024-04-19T02:21:21.327562+0000","last_active":"2024-04-19T02:21:21.327562+0000","last_peered":"2024-04-19T02:21:21.327562+0000","last_clean":"2024-04-19T02:21:21.327562+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:21.327562+0000","last_undegraded":"2024-04-19T02:21:21.327562+0000","last_fullsized":"2024-04-19T02:21:21.327562+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:00:27.273002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":121,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.304724+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.304724+0000","last_peered":"2024-04-19T02:21:21.304724+0000","last_clean":"2024-04-19T02:21:21.304724+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.304724+0000","last_undegraded":"2024-04-19T02:21:21.304724+0000","last_fullsized":"2024-04-19T02:21:21.304724+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:58.461641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1082,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463986+0000","last_change":"2024-04-19T02:20:59.197928+0000","last_active":"2024-04-19T02:21:20.463986+0000","last_peered":"2024-04-19T02:21:20.463986+0000","last_clean":"2024-04-19T02:21:20.463986+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:20.463986+0000","last_undegraded":"2024-04-19T02:21:20.463986+0000","last_fullsized":"2024-04-19T02:21:20.463986+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:26.883222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.468359+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:20.468359+0000","last_peered":"2024-04-19T02:21:20.468359+0000","last_clean":"2024-04-19T02:21:20.468359+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:20.468359+0000","last_undegraded":"2024-04-19T02:21:20.468359+0000","last_fullsized":"2024-04-19T02:21:20.468359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.356340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323437+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.323437+0000","last_peered":"2024-04-19T02:21:21.323437+0000","last_clean":"2024-04-19T02:21:21.323437+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.323437+0000","last_undegraded":"2024-04-19T02:21:21.323437+0000","last_fullsized":"2024-04-19T02:21:21.323437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:15.338811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"71'207","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323460+0000","last_change":"2024-04-19T02:21:21.323460+0000","last_active":"2024-04-19T02:21:21.323460+0000","last_peered":"2024-04-19T02:21:21.323460+0000","last_clean":"2024-04-19T02:21:21.323460+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:21.323460+0000","last_undegraded":"2024-04-19T02:21:21.323460+0000","last_fullsized":"2024-04-19T02:21:21.323460+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:01:12.540077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":583,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344252+0000","last_change":"2024-04-19T02:21:21.344252+0000","last_active":"2024-04-19T02:21:21.344252+0000","last_peered":"2024-04-19T02:21:21.344252+0000","last_clean":"2024-04-19T02:21:21.344252+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:21:21.344252+0000","last_undegraded":"2024-04-19T02:21:21.344252+0000","last_fullsized":"2024-04-19T02:21:21.344252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:47.406900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460409+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:20.460409+0000","last_peered":"2024-04-19T02:21:20.460409+0000","last_clean":"2024-04-19T02:21:20.460409+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:20.460409+0000","last_undegraded":"2024-04-19T02:21:20.460409+0000","last_fullsized":"2024-04-19T02:21:20.460409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:37.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":450,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.319032+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.319032+0000","last_peered":"2024-04-19T02:21:21.319032+0000","last_clean":"2024-04-19T02:21:21.319032+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.319032+0000","last_undegraded":"2024-04-19T02:21:21.319032+0000","last_fullsized":"2024-04-19T02:21:21.319032+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:03.038712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":502,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459835+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:20.459835+0000","last_peered":"2024-04-19T02:21:20.459835+0000","last_clean":"2024-04-19T02:21:20.459835+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:20.459835+0000","last_undegraded":"2024-04-19T02:21:20.459835+0000","last_fullsized":"2024-04-19T02:21:20.459835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:27.846470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":531,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462045+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:20.462045+0000","last_peered":"2024-04-19T02:21:20.462045+0000","last_clean":"2024-04-19T02:21:20.462045+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:20.462045+0000","last_undegraded":"2024-04-19T02:21:20.462045+0000","last_fullsized":"2024-04-19T02:21:20.462045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:02.631020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":215,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341047+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.341047+0000","last_peered":"2024-04-19T02:21:21.341047+0000","last_clean":"2024-04-19T02:21:21.341047+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.341047+0000","last_undegraded":"2024-04-19T02:21:21.341047+0000","last_fullsized":"2024-04-19T02:21:21.341047+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:30.201443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334723+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.334723+0000","last_peered":"2024-04-19T02:21:21.334723+0000","last_clean":"2024-04-19T02:21:21.334723+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.334723+0000","last_undegraded":"2024-04-19T02:21:21.334723+0000","last_fullsized":"2024-04-19T02:21:21.334723+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:17.111421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":873,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466035+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:20.466035+0000","last_peered":"2024-04-19T02:21:20.466035+0000","last_clean":"2024-04-19T02:21:20.466035+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:20.466035+0000","last_undegraded":"2024-04-19T02:21:20.466035+0000","last_fullsized":"2024-04-19T02:21:20.466035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:22.770545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346189+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.346189+0000","last_peered":"2024-04-19T02:21:21.346189+0000","last_clean":"2024-04-19T02:21:21.346189+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.346189+0000","last_undegraded":"2024-04-19T02:21:21.346189+0000","last_fullsized":"2024-04-19T02:21:21.346189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:25.982675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342225+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.342225+0000","last_peered":"2024-04-19T02:21:21.342225+0000","last_clean":"2024-04-19T02:21:21.342225+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.342225+0000","last_undegraded":"2024-04-19T02:21:21.342225+0000","last_fullsized":"2024-04-19T02:21:21.342225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:40.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":310,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461829+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:20.461829+0000","last_peered":"2024-04-19T02:21:20.461829+0000","last_clean":"2024-04-19T02:21:20.461829+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:20.461829+0000","last_undegraded":"2024-04-19T02:21:20.461829+0000","last_fullsized":"2024-04-19T02:21:20.461829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:51.381918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":556,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463696+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:20.463696+0000","last_peered":"2024-04-19T02:21:20.463696+0000","last_clean":"2024-04-19T02:21:20.463696+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:20.463696+0000","last_undegraded":"2024-04-19T02:21:20.463696+0000","last_fullsized":"2024-04-19T02:21:20.463696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:29.566796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462303+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:20.462303+0000","last_peered":"2024-04-19T02:21:20.462303+0000","last_clean":"2024-04-19T02:21:20.462303+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:20.462303+0000","last_undegraded":"2024-04-19T02:21:20.462303+0000","last_fullsized":"2024-04-19T02:21:20.462303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:37.062856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":523,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460080+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:20.460080+0000","last_peered":"2024-04-19T02:21:20.460080+0000","last_clean":"2024-04-19T02:21:20.460080+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:20.460080+0000","last_undegraded":"2024-04-19T02:21:20.460080+0000","last_fullsized":"2024-04-19T02:21:20.460080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:39.583426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":468,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462571+0000","last_change":"2024-04-19T02:16:24.513245+0000","last_active":"2024-04-19T02:21:20.462571+0000","last_peered":"2024-04-19T02:21:20.462571+0000","last_clean":"2024-04-19T02:21:20.462571+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:20.462571+0000","last_undegraded":"2024-04-19T02:21:20.462571+0000","last_fullsized":"2024-04-19T02:21:20.462571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323975+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.323975+0000","last_peered":"2024-04-19T02:21:21.323975+0000","last_clean":"2024-04-19T02:21:21.323975+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.323975+0000","last_undegraded":"2024-04-19T02:21:21.323975+0000","last_fullsized":"2024-04-19T02:21:21.323975+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:35.319733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":136,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.334181+0000","last_change":"2024-04-19T02:21:21.334181+0000","last_active":"2024-04-19T02:21:21.334181+0000","last_peered":"2024-04-19T02:21:21.334181+0000","last_clean":"2024-04-19T02:21:21.334181+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:21.334181+0000","last_undegraded":"2024-04-19T02:21:21.334181+0000","last_fullsized":"2024-04-19T02:21:21.334181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:37.400138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":569,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463012+0000","last_change":"2024-04-19T02:16:24.511649+0000","last_active":"2024-04-19T02:21:20.463012+0000","last_peered":"2024-04-19T02:21:20.463012+0000","last_clean":"2024-04-19T02:21:20.463012+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:20.463012+0000","last_undegraded":"2024-04-19T02:21:20.463012+0000","last_fullsized":"2024-04-19T02:21:20.463012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:42.156021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":529,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.317369+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.317369+0000","last_peered":"2024-04-19T02:21:21.317369+0000","last_clean":"2024-04-19T02:21:21.317369+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.317369+0000","last_undegraded":"2024-04-19T02:21:21.317369+0000","last_fullsized":"2024-04-19T02:21:21.317369+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:41.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466694+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:20.466694+0000","last_peered":"2024-04-19T02:21:20.466694+0000","last_clean":"2024-04-19T02:21:20.466694+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:20.466694+0000","last_undegraded":"2024-04-19T02:21:20.466694+0000","last_fullsized":"2024-04-19T02:21:20.466694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:20.536093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":857,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462444+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:20.462444+0000","last_peered":"2024-04-19T02:21:20.462444+0000","last_clean":"2024-04-19T02:21:20.462444+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:20.462444+0000","last_undegraded":"2024-04-19T02:21:20.462444+0000","last_fullsized":"2024-04-19T02:21:20.462444+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:12.611288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":167,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466454+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:20.466454+0000","last_peered":"2024-04-19T02:21:20.466454+0000","last_clean":"2024-04-19T02:21:20.466454+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:20.466454+0000","last_undegraded":"2024-04-19T02:21:20.466454+0000","last_fullsized":"2024-04-19T02:21:20.466454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:15.182357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":115,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467210+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:20.467210+0000","last_peered":"2024-04-19T02:21:20.467210+0000","last_clean":"2024-04-19T02:21:20.467210+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:20.467210+0000","last_undegraded":"2024-04-19T02:21:20.467210+0000","last_fullsized":"2024-04-19T02:21:20.467210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":974,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463297+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:20.463297+0000","last_peered":"2024-04-19T02:21:20.463297+0000","last_clean":"2024-04-19T02:21:20.463297+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:20.463297+0000","last_undegraded":"2024-04-19T02:21:20.463297+0000","last_fullsized":"2024-04-19T02:21:20.463297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:21.532179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463479+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:20.463479+0000","last_peered":"2024-04-19T02:21:20.463479+0000","last_clean":"2024-04-19T02:21:20.463479+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:20.463479+0000","last_undegraded":"2024-04-19T02:21:20.463479+0000","last_fullsized":"2024-04-19T02:21:20.463479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:36.043795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466709+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:20.466709+0000","last_peered":"2024-04-19T02:21:20.466709+0000","last_clean":"2024-04-19T02:21:20.466709+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:20.466709+0000","last_undegraded":"2024-04-19T02:21:20.466709+0000","last_fullsized":"2024-04-19T02:21:20.466709+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:49.902689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":951,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466559+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:20.466559+0000","last_peered":"2024-04-19T02:21:20.466559+0000","last_clean":"2024-04-19T02:21:20.466559+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:20.466559+0000","last_undegraded":"2024-04-19T02:21:20.466559+0000","last_fullsized":"2024-04-19T02:21:20.466559+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:41.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464664+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:20.464664+0000","last_peered":"2024-04-19T02:21:20.464664+0000","last_clean":"2024-04-19T02:21:20.464664+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:20.464664+0000","last_undegraded":"2024-04-19T02:21:20.464664+0000","last_fullsized":"2024-04-19T02:21:20.464664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:40.905545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307515+0000","last_change":"2024-04-19T02:21:21.307515+0000","last_active":"2024-04-19T02:21:21.307515+0000","last_peered":"2024-04-19T02:21:21.307515+0000","last_clean":"2024-04-19T02:21:21.307515+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:21.307515+0000","last_undegraded":"2024-04-19T02:21:21.307515+0000","last_fullsized":"2024-04-19T02:21:21.307515+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:26.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":577,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.458922+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:20.458922+0000","last_peered":"2024-04-19T02:21:20.458922+0000","last_clean":"2024-04-19T02:21:20.458922+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:20.458922+0000","last_undegraded":"2024-04-19T02:21:20.458922+0000","last_fullsized":"2024-04-19T02:21:20.458922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:28.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":501,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343149+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.343149+0000","last_peered":"2024-04-19T02:21:21.343149+0000","last_clean":"2024-04-19T02:21:21.343149+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.343149+0000","last_undegraded":"2024-04-19T02:21:21.343149+0000","last_fullsized":"2024-04-19T02:21:21.343149+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:01:38.509822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342574+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.342574+0000","last_peered":"2024-04-19T02:21:21.342574+0000","last_clean":"2024-04-19T02:21:21.342574+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.342574+0000","last_undegraded":"2024-04-19T02:21:21.342574+0000","last_fullsized":"2024-04-19T02:21:21.342574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:41.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":555,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459154+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:20.459154+0000","last_peered":"2024-04-19T02:21:20.459154+0000","last_clean":"2024-04-19T02:21:20.459154+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:20.459154+0000","last_undegraded":"2024-04-19T02:21:20.459154+0000","last_fullsized":"2024-04-19T02:21:20.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:57.871965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466348+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:20.466348+0000","last_peered":"2024-04-19T02:21:20.466348+0000","last_clean":"2024-04-19T02:21:20.466348+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:20.466348+0000","last_undegraded":"2024-04-19T02:21:20.466348+0000","last_fullsized":"2024-04-19T02:21:20.466348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:36.542265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'324","reported_seq":392,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.307675+0000","last_change":"2024-04-19T02:21:21.307675+0000","last_active":"2024-04-19T02:21:21.307675+0000","last_peered":"2024-04-19T02:21:21.307675+0000","last_clean":"2024-04-19T02:21:21.307675+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:21.307675+0000","last_undegraded":"2024-04-19T02:21:21.307675+0000","last_fullsized":"2024-04-19T02:21:21.307675+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:47:29.710039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1019,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.459723+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:20.459723+0000","last_peered":"2024-04-19T02:21:20.459723+0000","last_clean":"2024-04-19T02:21:20.459723+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:20.459723+0000","last_undegraded":"2024-04-19T02:21:20.459723+0000","last_fullsized":"2024-04-19T02:21:20.459723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:50.586437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463263+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:20.463263+0000","last_peered":"2024-04-19T02:21:20.463263+0000","last_clean":"2024-04-19T02:21:20.463263+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:20.463263+0000","last_undegraded":"2024-04-19T02:21:20.463263+0000","last_fullsized":"2024-04-19T02:21:20.463263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:28.251582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":629,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.466275+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:20.466275+0000","last_peered":"2024-04-19T02:21:20.466275+0000","last_clean":"2024-04-19T02:21:20.466275+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:20.466275+0000","last_undegraded":"2024-04-19T02:21:20.466275+0000","last_fullsized":"2024-04-19T02:21:20.466275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:26.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":918,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.463835+0000","last_change":"2024-04-19T02:20:40.192310+0000","last_active":"2024-04-19T02:21:20.463835+0000","last_peered":"2024-04-19T02:21:20.463835+0000","last_clean":"2024-04-19T02:21:20.463835+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:20.463835+0000","last_undegraded":"2024-04-19T02:21:20.463835+0000","last_fullsized":"2024-04-19T02:21:20.463835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:37.459254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":683,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.467179+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:20.467179+0000","last_peered":"2024-04-19T02:21:20.467179+0000","last_clean":"2024-04-19T02:21:20.467179+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:20.467179+0000","last_undegraded":"2024-04-19T02:21:20.467179+0000","last_fullsized":"2024-04-19T02:21:20.467179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.068070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":943,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461566+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:20.461566+0000","last_peered":"2024-04-19T02:21:20.461566+0000","last_clean":"2024-04-19T02:21:20.461566+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:20.461566+0000","last_undegraded":"2024-04-19T02:21:20.461566+0000","last_fullsized":"2024-04-19T02:21:20.461566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:50.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":461,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.461576+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:20.461576+0000","last_peered":"2024-04-19T02:21:20.461576+0000","last_clean":"2024-04-19T02:21:20.461576+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:20.461576+0000","last_undegraded":"2024-04-19T02:21:20.461576+0000","last_fullsized":"2024-04-19T02:21:20.461576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:15:07.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":861,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474998+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:21.474998+0000","last_peered":"2024-04-19T02:21:21.474998+0000","last_clean":"2024-04-19T02:21:21.474998+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:21.474998+0000","last_undegraded":"2024-04-19T02:21:21.474998+0000","last_fullsized":"2024-04-19T02:21:21.474998+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:02.677388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":608,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.226780+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.226780+0000","last_peered":"2024-04-19T02:21:21.226780+0000","last_clean":"2024-04-19T02:21:21.226780+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.226780+0000","last_undegraded":"2024-04-19T02:21:21.226780+0000","last_fullsized":"2024-04-19T02:21:21.226780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:22.898106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474745+0000","last_change":"2024-04-19T02:16:24.515287+0000","last_active":"2024-04-19T02:21:21.474745+0000","last_peered":"2024-04-19T02:21:21.474745+0000","last_clean":"2024-04-19T02:21:21.474745+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:21.474745+0000","last_undegraded":"2024-04-19T02:21:21.474745+0000","last_fullsized":"2024-04-19T02:21:21.474745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:13.979972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":188,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474193+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:21.474193+0000","last_peered":"2024-04-19T02:21:21.474193+0000","last_clean":"2024-04-19T02:21:21.474193+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:21.474193+0000","last_undegraded":"2024-04-19T02:21:21.474193+0000","last_fullsized":"2024-04-19T02:21:21.474193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:57.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342619+0000","last_change":"2024-04-19T02:21:21.342619+0000","last_active":"2024-04-19T02:21:21.342619+0000","last_peered":"2024-04-19T02:21:21.342619+0000","last_clean":"2024-04-19T02:21:21.342619+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:21.342619+0000","last_undegraded":"2024-04-19T02:21:21.342619+0000","last_fullsized":"2024-04-19T02:21:21.342619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:44.328651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":403,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.336126+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.336126+0000","last_peered":"2024-04-19T02:21:21.336126+0000","last_clean":"2024-04-19T02:21:21.336126+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.336126+0000","last_undegraded":"2024-04-19T02:21:21.336126+0000","last_fullsized":"2024-04-19T02:21:21.336126+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:47.217054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":495,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.328166+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.328166+0000","last_peered":"2024-04-19T02:21:21.328166+0000","last_clean":"2024-04-19T02:21:21.328166+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.328166+0000","last_undegraded":"2024-04-19T02:21:21.328166+0000","last_fullsized":"2024-04-19T02:21:21.328166+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:04.798376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475446+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:21.475446+0000","last_peered":"2024-04-19T02:21:21.475446+0000","last_clean":"2024-04-19T02:21:21.475446+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:21.475446+0000","last_undegraded":"2024-04-19T02:21:21.475446+0000","last_fullsized":"2024-04-19T02:21:21.475446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:03.559238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":633,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.460698+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:20.460698+0000","last_peered":"2024-04-19T02:21:20.460698+0000","last_clean":"2024-04-19T02:21:20.460698+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:20.460698+0000","last_undegraded":"2024-04-19T02:21:20.460698+0000","last_fullsized":"2024-04-19T02:21:20.460698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:23:12.586686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.464155+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:20.464155+0000","last_peered":"2024-04-19T02:21:20.464155+0000","last_clean":"2024-04-19T02:21:20.464155+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:20.464155+0000","last_undegraded":"2024-04-19T02:21:20.464155+0000","last_fullsized":"2024-04-19T02:21:20.464155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:08:54.044638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":558,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.338347+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.338347+0000","last_peered":"2024-04-19T02:21:21.338347+0000","last_clean":"2024-04-19T02:21:21.338347+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.338347+0000","last_undegraded":"2024-04-19T02:21:21.338347+0000","last_fullsized":"2024-04-19T02:21:21.338347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:50:19.012981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.462736+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:20.462736+0000","last_peered":"2024-04-19T02:21:20.462736+0000","last_clean":"2024-04-19T02:21:20.462736+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:20.462736+0000","last_undegraded":"2024-04-19T02:21:20.462736+0000","last_fullsized":"2024-04-19T02:21:20.462736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:44.595405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126656,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245184,"statfs":{"total":96636764160,"available":96507068416,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.51900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.78500000000000003,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.56599999999999995,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.026,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":1,"up_from":78,"seq":335007449102,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66136,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305704,"statfs":{"total":96636764160,"available":96569040896,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139616,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232224,"statfs":{"total":96636764160,"available":96493797376,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Apr 19 02:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.499,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94499999999999995,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:32.085 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.085 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.085 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.085 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.085 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.085 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.086 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.087 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.088 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.088 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.088 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.089 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.089 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.089 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.089 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.090 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.091 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.092 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:16:14.984576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.093 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.094 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.095 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.096 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.097 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.098 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.098 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.098 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.098 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.098 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.098 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:32.098 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:21:52.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:52.420 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:21:52.423 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:21:52.437 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-04-19T02:21:52.319580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34428,"ondisk_log_size":34428,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332372,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783148,"statfs":{"total":289910292480,"available":289569943552,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004779"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475931+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:21.475931+0000","last_peered":"2024-04-19T02:21:21.475931+0000","last_clean":"2024-04-19T02:21:21.475931+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:21.475931+0000","last_undegraded":"2024-04-19T02:21:21.475931+0000","last_fullsized":"2024-04-19T02:21:21.475931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":594,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475245+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:21.475245+0000","last_peered":"2024-04-19T02:21:21.475245+0000","last_clean":"2024-04-19T02:21:21.475245+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:21.475245+0000","last_undegraded":"2024-04-19T02:21:21.475245+0000","last_fullsized":"2024-04-19T02:21:21.475245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":484,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346455+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.346455+0000","last_peered":"2024-04-19T02:21:21.346455+0000","last_clean":"2024-04-19T02:21:21.346455+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.346455+0000","last_undegraded":"2024-04-19T02:21:21.346455+0000","last_fullsized":"2024-04-19T02:21:21.346455+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344425+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.344425+0000","last_peered":"2024-04-19T02:21:21.344425+0000","last_clean":"2024-04-19T02:21:21.344425+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.344425+0000","last_undegraded":"2024-04-19T02:21:21.344425+0000","last_fullsized":"2024-04-19T02:21:21.344425+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443245+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:24.443245+0000","last_peered":"2024-04-19T02:21:24.443245+0000","last_clean":"2024-04-19T02:21:24.443245+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:24.443245+0000","last_undegraded":"2024-04-19T02:21:24.443245+0000","last_fullsized":"2024-04-19T02:21:24.443245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":536,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348874+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348874+0000","last_peered":"2024-04-19T02:21:21.348874+0000","last_clean":"2024-04-19T02:21:21.348874+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348874+0000","last_undegraded":"2024-04-19T02:21:21.348874+0000","last_fullsized":"2024-04-19T02:21:21.348874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":519,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330614+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.330614+0000","last_peered":"2024-04-19T02:21:21.330614+0000","last_clean":"2024-04-19T02:21:21.330614+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.330614+0000","last_undegraded":"2024-04-19T02:21:21.330614+0000","last_fullsized":"2024-04-19T02:21:21.330614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":583,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344126+0000","last_change":"2024-04-19T02:21:21.340703+0000","last_active":"2024-04-19T02:21:21.344126+0000","last_peered":"2024-04-19T02:21:21.344126+0000","last_clean":"2024-04-19T02:21:21.344126+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:21.344126+0000","last_undegraded":"2024-04-19T02:21:21.344126+0000","last_fullsized":"2024-04-19T02:21:21.344126+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":564,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471113+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:21.471113+0000","last_peered":"2024-04-19T02:21:21.471113+0000","last_clean":"2024-04-19T02:21:21.471113+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:21.471113+0000","last_undegraded":"2024-04-19T02:21:21.471113+0000","last_fullsized":"2024-04-19T02:21:21.471113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475297+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:21.475297+0000","last_peered":"2024-04-19T02:21:21.475297+0000","last_clean":"2024-04-19T02:21:21.475297+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:21.475297+0000","last_undegraded":"2024-04-19T02:21:21.475297+0000","last_fullsized":"2024-04-19T02:21:21.475297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":469,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.464992+0000","last_change":"2024-04-19T02:21:34.465225+0000","last_active":"2024-04-19T02:21:34.464992+0000","last_peered":"2024-04-19T02:21:34.464992+0000","last_clean":"2024-04-19T02:21:34.464992+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:34.464992+0000","last_undegraded":"2024-04-19T02:21:34.464992+0000","last_fullsized":"2024-04-19T02:21:34.464992+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.464937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:54.461710+0000","scrub_duration":0.004016393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":912,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474499+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:21.474499+0000","last_peered":"2024-04-19T02:21:21.474499+0000","last_clean":"2024-04-19T02:21:21.474499+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:21.474499+0000","last_undegraded":"2024-04-19T02:21:21.474499+0000","last_fullsized":"2024-04-19T02:21:21.474499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":539,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473843+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:21.473843+0000","last_peered":"2024-04-19T02:21:21.473843+0000","last_clean":"2024-04-19T02:21:21.473843+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:21.473843+0000","last_undegraded":"2024-04-19T02:21:21.473843+0000","last_fullsized":"2024-04-19T02:21:21.473843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348157+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.348157+0000","last_peered":"2024-04-19T02:21:21.348157+0000","last_clean":"2024-04-19T02:21:21.348157+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.348157+0000","last_undegraded":"2024-04-19T02:21:21.348157+0000","last_fullsized":"2024-04-19T02:21:21.348157+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":530,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.332850+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.332850+0000","last_peered":"2024-04-19T02:21:21.332850+0000","last_clean":"2024-04-19T02:21:21.332850+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.332850+0000","last_undegraded":"2024-04-19T02:21:21.332850+0000","last_fullsized":"2024-04-19T02:21:21.332850+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":577,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340715+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.340715+0000","last_peered":"2024-04-19T02:21:21.340715+0000","last_clean":"2024-04-19T02:21:21.340715+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.340715+0000","last_undegraded":"2024-04-19T02:21:21.340715+0000","last_fullsized":"2024-04-19T02:21:21.340715+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471892+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:21.471892+0000","last_peered":"2024-04-19T02:21:21.471892+0000","last_clean":"2024-04-19T02:21:21.471892+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:21.471892+0000","last_undegraded":"2024-04-19T02:21:21.471892+0000","last_fullsized":"2024-04-19T02:21:21.471892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.467028+0000","last_change":"2024-04-19T02:21:33.467243+0000","last_active":"2024-04-19T02:21:33.467028+0000","last_peered":"2024-04-19T02:21:33.467028+0000","last_clean":"2024-04-19T02:21:33.467028+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:33.467028+0000","last_undegraded":"2024-04-19T02:21:33.467028+0000","last_fullsized":"2024-04-19T02:21:33.467028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.466973+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:47.589455+0000","scrub_duration":0.0049157790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":650,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470162+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:21.470162+0000","last_peered":"2024-04-19T02:21:21.470162+0000","last_clean":"2024-04-19T02:21:21.470162+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:21.470162+0000","last_undegraded":"2024-04-19T02:21:21.470162+0000","last_fullsized":"2024-04-19T02:21:21.470162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":512,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344283+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.344283+0000","last_peered":"2024-04-19T02:21:21.344283+0000","last_clean":"2024-04-19T02:21:21.344283+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.344283+0000","last_undegraded":"2024-04-19T02:21:21.344283+0000","last_fullsized":"2024-04-19T02:21:21.344283+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":556,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.476453+0000","last_change":"2024-04-19T02:21:41.476717+0000","last_active":"2024-04-19T02:21:41.476453+0000","last_peered":"2024-04-19T02:21:41.476453+0000","last_clean":"2024-04-19T02:21:41.476453+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:41.476453+0000","last_undegraded":"2024-04-19T02:21:41.476453+0000","last_fullsized":"2024-04-19T02:21:41.476453+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.476396+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:05:52.160962+0000","scrub_duration":0.0037331780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1123,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474064+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:21.474064+0000","last_peered":"2024-04-19T02:21:21.474064+0000","last_clean":"2024-04-19T02:21:21.474064+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:21.474064+0000","last_undegraded":"2024-04-19T02:21:21.474064+0000","last_fullsized":"2024-04-19T02:21:21.474064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":901,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468624+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:21.468624+0000","last_peered":"2024-04-19T02:21:21.468624+0000","last_clean":"2024-04-19T02:21:21.468624+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:21.468624+0000","last_undegraded":"2024-04-19T02:21:21.468624+0000","last_fullsized":"2024-04-19T02:21:21.468624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":570,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.472878+0000","last_change":"2024-04-19T02:16:24.510757+0000","last_active":"2024-04-19T02:21:21.472878+0000","last_peered":"2024-04-19T02:21:21.472878+0000","last_clean":"2024-04-19T02:21:21.472878+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:21:21.472878+0000","last_undegraded":"2024-04-19T02:21:21.472878+0000","last_fullsized":"2024-04-19T02:21:21.472878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":951,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.476065+0000","last_change":"2024-04-19T02:20:59.197999+0000","last_active":"2024-04-19T02:21:21.476065+0000","last_peered":"2024-04-19T02:21:21.476065+0000","last_clean":"2024-04-19T02:21:21.476065+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:21.476065+0000","last_undegraded":"2024-04-19T02:21:21.476065+0000","last_fullsized":"2024-04-19T02:21:21.476065+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1175,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471138+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:21.471138+0000","last_peered":"2024-04-19T02:21:21.471138+0000","last_clean":"2024-04-19T02:21:21.471138+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:21.471138+0000","last_undegraded":"2024-04-19T02:21:21.471138+0000","last_fullsized":"2024-04-19T02:21:21.471138+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":567,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.412900+0000","last_change":"2024-04-19T02:21:39.413150+0000","last_active":"2024-04-19T02:21:39.412900+0000","last_peered":"2024-04-19T02:21:39.412900+0000","last_clean":"2024-04-19T02:21:39.412900+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:39.412900+0000","last_undegraded":"2024-04-19T02:21:39.412900+0000","last_fullsized":"2024-04-19T02:21:39.412900+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.412846+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:49.572797+0000","scrub_duration":0.0040928559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":817,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474991+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:21.474991+0000","last_peered":"2024-04-19T02:21:21.474991+0000","last_clean":"2024-04-19T02:21:21.474991+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:21.474991+0000","last_undegraded":"2024-04-19T02:21:21.474991+0000","last_fullsized":"2024-04-19T02:21:21.474991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":551,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.418588+0000","last_change":"2024-04-19T02:21:32.418818+0000","last_active":"2024-04-19T02:21:32.418588+0000","last_peered":"2024-04-19T02:21:32.418588+0000","last_clean":"2024-04-19T02:21:32.418588+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:32.418588+0000","last_undegraded":"2024-04-19T02:21:32.418588+0000","last_fullsized":"2024-04-19T02:21:32.418588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'382","last_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_deep_scrub":"71'382","last_deep_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.418531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.300626+0000","scrub_duration":0.0048622070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1089,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.427431+0000","last_change":"2024-04-19T02:21:35.427651+0000","last_active":"2024-04-19T02:21:35.427431+0000","last_peered":"2024-04-19T02:21:35.427431+0000","last_clean":"2024-04-19T02:21:35.427431+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:35.427431+0000","last_undegraded":"2024-04-19T02:21:35.427431+0000","last_fullsized":"2024-04-19T02:21:35.427431+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.427379+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:58.566016+0000","scrub_duration":0.0038844489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":628,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.392107+0000","last_change":"2024-04-19T02:21:38.392319+0000","last_active":"2024-04-19T02:21:38.392107+0000","last_peered":"2024-04-19T02:21:38.392107+0000","last_clean":"2024-04-19T02:21:38.392107+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:38.392107+0000","last_undegraded":"2024-04-19T02:21:38.392107+0000","last_fullsized":"2024-04-19T02:21:38.392107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'460","last_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_deep_scrub":"71'460","last_deep_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.392049+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:54.270848+0000","scrub_duration":0.0042770439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":525,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344242+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.344242+0000","last_peered":"2024-04-19T02:21:21.344242+0000","last_clean":"2024-04-19T02:21:21.344242+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.344242+0000","last_undegraded":"2024-04-19T02:21:21.344242+0000","last_fullsized":"2024-04-19T02:21:21.344242+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":499,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474902+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:21.474902+0000","last_peered":"2024-04-19T02:21:21.474902+0000","last_clean":"2024-04-19T02:21:21.474902+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:21.474902+0000","last_undegraded":"2024-04-19T02:21:21.474902+0000","last_fullsized":"2024-04-19T02:21:21.474902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":458,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343372+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.343372+0000","last_peered":"2024-04-19T02:21:21.343372+0000","last_clean":"2024-04-19T02:21:21.343372+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.343372+0000","last_undegraded":"2024-04-19T02:21:21.343372+0000","last_fullsized":"2024-04-19T02:21:21.343372+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.484417+0000","last_change":"2024-04-19T02:21:38.484643+0000","last_active":"2024-04-19T02:21:38.484417+0000","last_peered":"2024-04-19T02:21:38.484417+0000","last_clean":"2024-04-19T02:21:38.484417+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:38.484417+0000","last_undegraded":"2024-04-19T02:21:38.484417+0000","last_fullsized":"2024-04-19T02:21:38.484417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.484360+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:33.481985+0000","scrub_duration":0.0046311950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":189,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468968+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:21.468968+0000","last_peered":"2024-04-19T02:21:21.468968+0000","last_clean":"2024-04-19T02:21:21.468968+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:21.468968+0000","last_undegraded":"2024-04-19T02:21:21.468968+0000","last_fullsized":"2024-04-19T02:21:21.468968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1022,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471411+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:21.471411+0000","last_peered":"2024-04-19T02:21:21.471411+0000","last_clean":"2024-04-19T02:21:21.471411+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:21.471411+0000","last_undegraded":"2024-04-19T02:21:21.471411+0000","last_fullsized":"2024-04-19T02:21:21.471411+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":195,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473754+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:21.473754+0000","last_peered":"2024-04-19T02:21:21.473754+0000","last_clean":"2024-04-19T02:21:21.473754+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:21.473754+0000","last_undegraded":"2024-04-19T02:21:21.473754+0000","last_fullsized":"2024-04-19T02:21:21.473754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":911,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471155+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:21.471155+0000","last_peered":"2024-04-19T02:21:21.471155+0000","last_clean":"2024-04-19T02:21:21.471155+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:21.471155+0000","last_undegraded":"2024-04-19T02:21:21.471155+0000","last_fullsized":"2024-04-19T02:21:21.471155+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":131,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344487+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.344487+0000","last_peered":"2024-04-19T02:21:21.344487+0000","last_clean":"2024-04-19T02:21:21.344487+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.344487+0000","last_undegraded":"2024-04-19T02:21:21.344487+0000","last_fullsized":"2024-04-19T02:21:21.344487+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":246,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.322738+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.322738+0000","last_peered":"2024-04-19T02:21:21.322738+0000","last_clean":"2024-04-19T02:21:21.322738+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.322738+0000","last_undegraded":"2024-04-19T02:21:21.322738+0000","last_fullsized":"2024-04-19T02:21:21.322738+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":907,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.502979+0000","last_change":"2024-04-19T02:21:46.503221+0000","last_active":"2024-04-19T02:21:46.502979+0000","last_peered":"2024-04-19T02:21:46.502979+0000","last_clean":"2024-04-19T02:21:46.502979+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:46.502979+0000","last_undegraded":"2024-04-19T02:21:46.502979+0000","last_fullsized":"2024-04-19T02:21:46.502979+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.502927+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:48.122985+0000","scrub_duration":0.0039232249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":431,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475684+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:21.475684+0000","last_peered":"2024-04-19T02:21:21.475684+0000","last_clean":"2024-04-19T02:21:21.475684+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:21.475684+0000","last_undegraded":"2024-04-19T02:21:21.475684+0000","last_fullsized":"2024-04-19T02:21:21.475684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473619+0000","last_change":"2024-04-19T02:16:24.513075+0000","last_active":"2024-04-19T02:21:21.473619+0000","last_peered":"2024-04-19T02:21:21.473619+0000","last_clean":"2024-04-19T02:21:21.473619+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:21.473619+0000","last_undegraded":"2024-04-19T02:21:21.473619+0000","last_fullsized":"2024-04-19T02:21:21.473619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":675,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343667+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.343667+0000","last_peered":"2024-04-19T02:21:21.343667+0000","last_clean":"2024-04-19T02:21:21.343667+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.343667+0000","last_undegraded":"2024-04-19T02:21:21.343667+0000","last_fullsized":"2024-04-19T02:21:21.343667+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.572418+0000","last_change":"2024-04-19T02:21:31.572652+0000","last_active":"2024-04-19T02:21:31.572418+0000","last_peered":"2024-04-19T02:21:31.572418+0000","last_clean":"2024-04-19T02:21:31.572418+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:31.572418+0000","last_undegraded":"2024-04-19T02:21:31.572418+0000","last_fullsized":"2024-04-19T02:21:31.572418+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.572365+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:18.167461+0000","scrub_duration":0.0042499950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":122,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.322488+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.322488+0000","last_peered":"2024-04-19T02:21:21.322488+0000","last_clean":"2024-04-19T02:21:21.322488+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.322488+0000","last_undegraded":"2024-04-19T02:21:21.322488+0000","last_fullsized":"2024-04-19T02:21:21.322488+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1094,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:49.460647+0000","last_change":"2024-04-19T02:21:49.460884+0000","last_active":"2024-04-19T02:21:49.460647+0000","last_peered":"2024-04-19T02:21:49.460647+0000","last_clean":"2024-04-19T02:21:49.460647+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:49.460647+0000","last_undegraded":"2024-04-19T02:21:49.460647+0000","last_fullsized":"2024-04-19T02:21:49.460647+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'491","last_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_deep_scrub":"71'491","last_deep_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_clean_scrub_stamp":"2024-04-19T02:21:49.460592+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:18.752338+0000","scrub_duration":0.0043248339999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":271,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470483+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:21.470483+0000","last_peered":"2024-04-19T02:21:21.470483+0000","last_clean":"2024-04-19T02:21:21.470483+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:21.470483+0000","last_undegraded":"2024-04-19T02:21:21.470483+0000","last_fullsized":"2024-04-19T02:21:21.470483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342243+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.342243+0000","last_peered":"2024-04-19T02:21:21.342243+0000","last_clean":"2024-04-19T02:21:21.342243+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.342243+0000","last_undegraded":"2024-04-19T02:21:21.342243+0000","last_fullsized":"2024-04-19T02:21:21.342243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"117'208","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.448417+0000","last_change":"2024-04-19T02:21:45.448731+0000","last_active":"2024-04-19T02:21:45.448417+0000","last_peered":"2024-04-19T02:21:45.448417+0000","last_clean":"2024-04-19T02:21:45.448417+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:45.448417+0000","last_undegraded":"2024-04-19T02:21:45.448417+0000","last_fullsized":"2024-04-19T02:21:45.448417+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'208","last_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_deep_scrub":"117'208","last_deep_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.448363+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:14.018739+0000","scrub_duration":0.041956280999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":584,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346477+0000","last_change":"2024-04-19T02:21:21.344252+0000","last_active":"2024-04-19T02:21:21.346477+0000","last_peered":"2024-04-19T02:21:21.346477+0000","last_clean":"2024-04-19T02:21:21.346477+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:21:21.346477+0000","last_undegraded":"2024-04-19T02:21:21.346477+0000","last_fullsized":"2024-04-19T02:21:21.346477+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":179,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473928+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:21.473928+0000","last_peered":"2024-04-19T02:21:21.473928+0000","last_clean":"2024-04-19T02:21:21.473928+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:21.473928+0000","last_undegraded":"2024-04-19T02:21:21.473928+0000","last_fullsized":"2024-04-19T02:21:21.473928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":451,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323059+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.323059+0000","last_peered":"2024-04-19T02:21:21.323059+0000","last_clean":"2024-04-19T02:21:21.323059+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.323059+0000","last_undegraded":"2024-04-19T02:21:21.323059+0000","last_fullsized":"2024-04-19T02:21:21.323059+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473380+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:21.473380+0000","last_peered":"2024-04-19T02:21:21.473380+0000","last_clean":"2024-04-19T02:21:21.473380+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:21.473380+0000","last_undegraded":"2024-04-19T02:21:21.473380+0000","last_fullsized":"2024-04-19T02:21:21.473380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471366+0000","last_change":"2024-04-19T02:16:24.513233+0000","last_active":"2024-04-19T02:21:21.471366+0000","last_peered":"2024-04-19T02:21:21.471366+0000","last_clean":"2024-04-19T02:21:21.471366+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:21:21.471366+0000","last_undegraded":"2024-04-19T02:21:21.471366+0000","last_fullsized":"2024-04-19T02:21:21.471366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344188+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.344188+0000","last_peered":"2024-04-19T02:21:21.344188+0000","last_clean":"2024-04-19T02:21:21.344188+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.344188+0000","last_undegraded":"2024-04-19T02:21:21.344188+0000","last_fullsized":"2024-04-19T02:21:21.344188+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343474+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.343474+0000","last_peered":"2024-04-19T02:21:21.343474+0000","last_clean":"2024-04-19T02:21:21.343474+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.343474+0000","last_undegraded":"2024-04-19T02:21:21.343474+0000","last_fullsized":"2024-04-19T02:21:21.343474+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":874,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470012+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:21.470012+0000","last_peered":"2024-04-19T02:21:21.470012+0000","last_clean":"2024-04-19T02:21:21.470012+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:21.470012+0000","last_undegraded":"2024-04-19T02:21:21.470012+0000","last_fullsized":"2024-04-19T02:21:21.470012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":569,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348015+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.348015+0000","last_peered":"2024-04-19T02:21:21.348015+0000","last_clean":"2024-04-19T02:21:21.348015+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.348015+0000","last_undegraded":"2024-04-19T02:21:21.348015+0000","last_fullsized":"2024-04-19T02:21:21.348015+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344291+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.344291+0000","last_peered":"2024-04-19T02:21:21.344291+0000","last_clean":"2024-04-19T02:21:21.344291+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.344291+0000","last_undegraded":"2024-04-19T02:21:21.344291+0000","last_fullsized":"2024-04-19T02:21:21.344291+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":311,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469426+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:21.469426+0000","last_peered":"2024-04-19T02:21:21.469426+0000","last_clean":"2024-04-19T02:21:21.469426+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:21.469426+0000","last_undegraded":"2024-04-19T02:21:21.469426+0000","last_fullsized":"2024-04-19T02:21:21.469426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":557,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475530+0000","last_change":"2024-04-19T02:16:24.511499+0000","last_active":"2024-04-19T02:21:21.475530+0000","last_peered":"2024-04-19T02:21:21.475530+0000","last_clean":"2024-04-19T02:21:21.475530+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:21.475530+0000","last_undegraded":"2024-04-19T02:21:21.475530+0000","last_fullsized":"2024-04-19T02:21:21.475530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469819+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:21.469819+0000","last_peered":"2024-04-19T02:21:21.469819+0000","last_clean":"2024-04-19T02:21:21.469819+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:21.469819+0000","last_undegraded":"2024-04-19T02:21:21.469819+0000","last_fullsized":"2024-04-19T02:21:21.469819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474002+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:21.474002+0000","last_peered":"2024-04-19T02:21:21.474002+0000","last_clean":"2024-04-19T02:21:21.474002+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:21.474002+0000","last_undegraded":"2024-04-19T02:21:21.474002+0000","last_fullsized":"2024-04-19T02:21:21.474002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":480,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.417845+0000","last_change":"2024-04-19T02:21:47.418067+0000","last_active":"2024-04-19T02:21:47.417845+0000","last_peered":"2024-04-19T02:21:47.417845+0000","last_clean":"2024-04-19T02:21:47.417845+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:47.417845+0000","last_undegraded":"2024-04-19T02:21:47.417845+0000","last_fullsized":"2024-04-19T02:21:47.417845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'345","last_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_deep_scrub":"71'345","last_deep_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.417790+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:30.129614+0000","scrub_duration":0.0046618750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348022+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.348022+0000","last_peered":"2024-04-19T02:21:21.348022+0000","last_clean":"2024-04-19T02:21:21.348022+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.348022+0000","last_undegraded":"2024-04-19T02:21:21.348022+0000","last_fullsized":"2024-04-19T02:21:21.348022+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":137,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343425+0000","last_change":"2024-04-19T02:21:21.334181+0000","last_active":"2024-04-19T02:21:21.343425+0000","last_peered":"2024-04-19T02:21:21.343425+0000","last_clean":"2024-04-19T02:21:21.343425+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:21.343425+0000","last_undegraded":"2024-04-19T02:21:21.343425+0000","last_fullsized":"2024-04-19T02:21:21.343425+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.419495+0000","last_change":"2024-04-19T02:21:40.419740+0000","last_active":"2024-04-19T02:21:40.419495+0000","last_peered":"2024-04-19T02:21:40.419495+0000","last_clean":"2024-04-19T02:21:40.419495+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:40.419495+0000","last_undegraded":"2024-04-19T02:21:40.419495+0000","last_fullsized":"2024-04-19T02:21:40.419495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'403","last_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_deep_scrub":"71'403","last_deep_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.419437+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:29.109984+0000","scrub_duration":0.0046038880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":530,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343592+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.343592+0000","last_peered":"2024-04-19T02:21:21.343592+0000","last_clean":"2024-04-19T02:21:21.343592+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.343592+0000","last_undegraded":"2024-04-19T02:21:21.343592+0000","last_fullsized":"2024-04-19T02:21:21.343592+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470603+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:21.470603+0000","last_peered":"2024-04-19T02:21:21.470603+0000","last_clean":"2024-04-19T02:21:21.470603+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:21.470603+0000","last_undegraded":"2024-04-19T02:21:21.470603+0000","last_fullsized":"2024-04-19T02:21:21.470603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":858,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474317+0000","last_change":"2024-04-19T02:20:44.195104+0000","last_active":"2024-04-19T02:21:21.474317+0000","last_peered":"2024-04-19T02:21:21.474317+0000","last_clean":"2024-04-19T02:21:21.474317+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:21:21.474317+0000","last_undegraded":"2024-04-19T02:21:21.474317+0000","last_fullsized":"2024-04-19T02:21:21.474317+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":168,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470522+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:21.470522+0000","last_peered":"2024-04-19T02:21:21.470522+0000","last_clean":"2024-04-19T02:21:21.470522+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:21.470522+0000","last_undegraded":"2024-04-19T02:21:21.470522+0000","last_fullsized":"2024-04-19T02:21:21.470522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475910+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:21.475910+0000","last_peered":"2024-04-19T02:21:21.475910+0000","last_clean":"2024-04-19T02:21:21.475910+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:21.475910+0000","last_undegraded":"2024-04-19T02:21:21.475910+0000","last_fullsized":"2024-04-19T02:21:21.475910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":975,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473905+0000","last_change":"2024-04-19T02:20:42.206559+0000","last_active":"2024-04-19T02:21:21.473905+0000","last_peered":"2024-04-19T02:21:21.473905+0000","last_clean":"2024-04-19T02:21:21.473905+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:21.473905+0000","last_undegraded":"2024-04-19T02:21:21.473905+0000","last_fullsized":"2024-04-19T02:21:21.473905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":178,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.472059+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:21.472059+0000","last_peered":"2024-04-19T02:21:21.472059+0000","last_clean":"2024-04-19T02:21:21.472059+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:21.472059+0000","last_undegraded":"2024-04-19T02:21:21.472059+0000","last_fullsized":"2024-04-19T02:21:21.472059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471573+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:21.471573+0000","last_peered":"2024-04-19T02:21:21.471573+0000","last_clean":"2024-04-19T02:21:21.471573+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:21.471573+0000","last_undegraded":"2024-04-19T02:21:21.471573+0000","last_fullsized":"2024-04-19T02:21:21.471573+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":952,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469355+0000","last_change":"2024-04-19T02:21:00.197896+0000","last_active":"2024-04-19T02:21:21.469355+0000","last_peered":"2024-04-19T02:21:21.469355+0000","last_clean":"2024-04-19T02:21:21.469355+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:21.469355+0000","last_undegraded":"2024-04-19T02:21:21.469355+0000","last_fullsized":"2024-04-19T02:21:21.469355+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":205,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471534+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:21.471534+0000","last_peered":"2024-04-19T02:21:21.471534+0000","last_clean":"2024-04-19T02:21:21.471534+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:21.471534+0000","last_undegraded":"2024-04-19T02:21:21.471534+0000","last_fullsized":"2024-04-19T02:21:21.471534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.382614+0000","last_change":"2024-04-19T02:21:47.382834+0000","last_active":"2024-04-19T02:21:47.382614+0000","last_peered":"2024-04-19T02:21:47.382614+0000","last_clean":"2024-04-19T02:21:47.382614+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:47.382614+0000","last_undegraded":"2024-04-19T02:21:47.382614+0000","last_fullsized":"2024-04-19T02:21:47.382614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.382567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:21.368852+0000","scrub_duration":0.0033623530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763606+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:31.763606+0000","last_peered":"2024-04-19T02:21:31.763606+0000","last_clean":"2024-04-19T02:21:31.763606+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:31.763606+0000","last_undegraded":"2024-04-19T02:21:31.763606+0000","last_fullsized":"2024-04-19T02:21:31.763606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":502,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.345073+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.345073+0000","last_peered":"2024-04-19T02:21:21.345073+0000","last_clean":"2024-04-19T02:21:21.345073+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.345073+0000","last_undegraded":"2024-04-19T02:21:21.345073+0000","last_fullsized":"2024-04-19T02:21:21.345073+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":533,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344342+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.344342+0000","last_peered":"2024-04-19T02:21:21.344342+0000","last_clean":"2024-04-19T02:21:21.344342+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.344342+0000","last_undegraded":"2024-04-19T02:21:21.344342+0000","last_fullsized":"2024-04-19T02:21:21.344342+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":556,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468644+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:21.468644+0000","last_peered":"2024-04-19T02:21:21.468644+0000","last_clean":"2024-04-19T02:21:21.468644+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:21.468644+0000","last_undegraded":"2024-04-19T02:21:21.468644+0000","last_fullsized":"2024-04-19T02:21:21.468644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":217,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475613+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:21.475613+0000","last_peered":"2024-04-19T02:21:21.475613+0000","last_clean":"2024-04-19T02:21:21.475613+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:21.475613+0000","last_undegraded":"2024-04-19T02:21:21.475613+0000","last_fullsized":"2024-04-19T02:21:21.475613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"117'325","reported_seq":405,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.418193+0000","last_change":"2024-04-19T02:21:46.418450+0000","last_active":"2024-04-19T02:21:46.418193+0000","last_peered":"2024-04-19T02:21:46.418193+0000","last_clean":"2024-04-19T02:21:46.418193+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:46.418193+0000","last_undegraded":"2024-04-19T02:21:46.418193+0000","last_fullsized":"2024-04-19T02:21:46.418193+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'325","last_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_deep_scrub":"117'325","last_deep_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.418135+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:23.243009+0000","scrub_duration":0.037437605999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1020,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469717+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:21.469717+0000","last_peered":"2024-04-19T02:21:21.469717+0000","last_clean":"2024-04-19T02:21:21.469717+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:21.469717+0000","last_undegraded":"2024-04-19T02:21:21.469717+0000","last_fullsized":"2024-04-19T02:21:21.469717+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":179,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471890+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:21.471890+0000","last_peered":"2024-04-19T02:21:21.471890+0000","last_clean":"2024-04-19T02:21:21.471890+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:21.471890+0000","last_undegraded":"2024-04-19T02:21:21.471890+0000","last_fullsized":"2024-04-19T02:21:21.471890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":630,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469109+0000","last_change":"2024-04-19T02:16:24.509924+0000","last_active":"2024-04-19T02:21:21.469109+0000","last_peered":"2024-04-19T02:21:21.469109+0000","last_clean":"2024-04-19T02:21:21.469109+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:21:21.469109+0000","last_undegraded":"2024-04-19T02:21:21.469109+0000","last_fullsized":"2024-04-19T02:21:21.469109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":930,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.477588+0000","last_change":"2024-04-19T02:21:36.477808+0000","last_active":"2024-04-19T02:21:36.477588+0000","last_peered":"2024-04-19T02:21:36.477588+0000","last_clean":"2024-04-19T02:21:36.477588+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:36.477588+0000","last_undegraded":"2024-04-19T02:21:36.477588+0000","last_fullsized":"2024-04-19T02:21:36.477588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.477536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:19.549278+0000","scrub_duration":0.0037289060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":684,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469346+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:21.469346+0000","last_peered":"2024-04-19T02:21:21.469346+0000","last_clean":"2024-04-19T02:21:21.469346+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:21.469346+0000","last_undegraded":"2024-04-19T02:21:21.469346+0000","last_fullsized":"2024-04-19T02:21:21.469346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":944,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471000+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:21.471000+0000","last_peered":"2024-04-19T02:21:21.471000+0000","last_clean":"2024-04-19T02:21:21.471000+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:21.471000+0000","last_undegraded":"2024-04-19T02:21:21.471000+0000","last_fullsized":"2024-04-19T02:21:21.471000+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":462,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469168+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:21.469168+0000","last_peered":"2024-04-19T02:21:21.469168+0000","last_clean":"2024-04-19T02:21:21.469168+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:21.469168+0000","last_undegraded":"2024-04-19T02:21:21.469168+0000","last_fullsized":"2024-04-19T02:21:21.469168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":862,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443364+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:24.443364+0000","last_peered":"2024-04-19T02:21:24.443364+0000","last_clean":"2024-04-19T02:21:24.443364+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:24.443364+0000","last_undegraded":"2024-04-19T02:21:24.443364+0000","last_fullsized":"2024-04-19T02:21:24.443364+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":609,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474594+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.474594+0000","last_peered":"2024-04-19T02:21:21.474594+0000","last_clean":"2024-04-19T02:21:21.474594+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.474594+0000","last_undegraded":"2024-04-19T02:21:21.474594+0000","last_fullsized":"2024-04-19T02:21:21.474594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:42.467422+0000","last_change":"2024-04-19T02:21:42.467663+0000","last_active":"2024-04-19T02:21:42.467422+0000","last_peered":"2024-04-19T02:21:42.467422+0000","last_clean":"2024-04-19T02:21:42.467422+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:42.467422+0000","last_undegraded":"2024-04-19T02:21:42.467422+0000","last_fullsized":"2024-04-19T02:21:42.467422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:42.467368+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:21.867316+0000","scrub_duration":0.0048531720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":189,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443272+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:24.443272+0000","last_peered":"2024-04-19T02:21:24.443272+0000","last_clean":"2024-04-19T02:21:24.443272+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:24.443272+0000","last_undegraded":"2024-04-19T02:21:24.443272+0000","last_fullsized":"2024-04-19T02:21:24.443272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":478,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.431655+0000","last_change":"2024-04-19T02:21:40.431879+0000","last_active":"2024-04-19T02:21:40.431655+0000","last_peered":"2024-04-19T02:21:40.431655+0000","last_clean":"2024-04-19T02:21:40.431655+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:40.431655+0000","last_undegraded":"2024-04-19T02:21:40.431655+0000","last_fullsized":"2024-04-19T02:21:40.431655+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.431601+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:34.613519+0000","scrub_duration":0.0040029599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":404,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342300+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.342300+0000","last_peered":"2024-04-19T02:21:21.342300+0000","last_clean":"2024-04-19T02:21:21.342300+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.342300+0000","last_undegraded":"2024-04-19T02:21:21.342300+0000","last_fullsized":"2024-04-19T02:21:21.342300+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":496,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348113+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.348113+0000","last_peered":"2024-04-19T02:21:21.348113+0000","last_clean":"2024-04-19T02:21:21.348113+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.348113+0000","last_undegraded":"2024-04-19T02:21:21.348113+0000","last_fullsized":"2024-04-19T02:21:21.348113+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":509,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443402+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:24.443402+0000","last_peered":"2024-04-19T02:21:24.443402+0000","last_clean":"2024-04-19T02:21:24.443402+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:24.443402+0000","last_undegraded":"2024-04-19T02:21:24.443402+0000","last_fullsized":"2024-04-19T02:21:24.443402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":634,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474035+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:21.474035+0000","last_peered":"2024-04-19T02:21:21.474035+0000","last_clean":"2024-04-19T02:21:21.474035+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:21.474035+0000","last_undegraded":"2024-04-19T02:21:21.474035+0000","last_fullsized":"2024-04-19T02:21:21.474035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":180,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471330+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:21.471330+0000","last_peered":"2024-04-19T02:21:21.471330+0000","last_clean":"2024-04-19T02:21:21.471330+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:21.471330+0000","last_undegraded":"2024-04-19T02:21:21.471330+0000","last_fullsized":"2024-04-19T02:21:21.471330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341348+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.341348+0000","last_peered":"2024-04-19T02:21:21.341348+0000","last_clean":"2024-04-19T02:21:21.341348+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.341348+0000","last_undegraded":"2024-04-19T02:21:21.341348+0000","last_fullsized":"2024-04-19T02:21:21.341348+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'52","reported_seq":182,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471637+0000","last_change":"2024-04-19T02:20:30.840435+0000","last_active":"2024-04-19T02:21:21.471637+0000","last_peered":"2024-04-19T02:21:21.471637+0000","last_clean":"2024-04-19T02:21:21.471637+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:21:21.471637+0000","last_undegraded":"2024-04-19T02:21:21.471637+0000","last_fullsized":"2024-04-19T02:21:21.471637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7634,"ondisk_log_size":7634,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126648,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245192,"statfs":{"total":96636764160,"available":96507076608,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.51900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.78500000000000003,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.56599999999999995,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.026,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Fri Apr 19 02:21:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63600000000000001}]}]},{"osd":1,"up_from":78,"seq":335007449106,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66120,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305720,"statfs":{"total":96636764160,"available":96569057280,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.62}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139604,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232236,"statfs":{"total":96636764160,"available":96493809664,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:21:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.499,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94499999999999995,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.749}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:52.444 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.445 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.446 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.446 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.446 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.447 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.448 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.448 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.448 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.448 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.448 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.448 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.449 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.450 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:16:14.984576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.451 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.452 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.452 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.452 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.452 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.453 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.454 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.454 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.454 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.454 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.454 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.455 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.456 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.456 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.456 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.456 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.456 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:52.456 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:22:12.457 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:22:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:22:12.789 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-04-19T02:22:12.326352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34431,"ondisk_log_size":34431,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332372,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783148,"statfs":{"total":289910292480,"available":289569943552,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004431"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475931+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:21.475931+0000","last_peered":"2024-04-19T02:21:21.475931+0000","last_clean":"2024-04-19T02:21:21.475931+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:21.475931+0000","last_undegraded":"2024-04-19T02:21:21.475931+0000","last_fullsized":"2024-04-19T02:21:21.475931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":594,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475245+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:21.475245+0000","last_peered":"2024-04-19T02:21:21.475245+0000","last_clean":"2024-04-19T02:21:21.475245+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:21.475245+0000","last_undegraded":"2024-04-19T02:21:21.475245+0000","last_fullsized":"2024-04-19T02:21:21.475245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":484,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346455+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.346455+0000","last_peered":"2024-04-19T02:21:21.346455+0000","last_clean":"2024-04-19T02:21:21.346455+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.346455+0000","last_undegraded":"2024-04-19T02:21:21.346455+0000","last_fullsized":"2024-04-19T02:21:21.346455+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":466,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344425+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:21.344425+0000","last_peered":"2024-04-19T02:21:21.344425+0000","last_clean":"2024-04-19T02:21:21.344425+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:21.344425+0000","last_undegraded":"2024-04-19T02:21:21.344425+0000","last_fullsized":"2024-04-19T02:21:21.344425+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443245+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:24.443245+0000","last_peered":"2024-04-19T02:21:24.443245+0000","last_clean":"2024-04-19T02:21:24.443245+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:24.443245+0000","last_undegraded":"2024-04-19T02:21:24.443245+0000","last_fullsized":"2024-04-19T02:21:24.443245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":536,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348874+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348874+0000","last_peered":"2024-04-19T02:21:21.348874+0000","last_clean":"2024-04-19T02:21:21.348874+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348874+0000","last_undegraded":"2024-04-19T02:21:21.348874+0000","last_fullsized":"2024-04-19T02:21:21.348874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":519,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330614+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.330614+0000","last_peered":"2024-04-19T02:21:21.330614+0000","last_clean":"2024-04-19T02:21:21.330614+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.330614+0000","last_undegraded":"2024-04-19T02:21:21.330614+0000","last_fullsized":"2024-04-19T02:21:21.330614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":594,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.358188+0000","last_change":"2024-04-19T02:21:50.358451+0000","last_active":"2024-04-19T02:21:50.358188+0000","last_peered":"2024-04-19T02:21:50.358188+0000","last_clean":"2024-04-19T02:21:50.358188+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:50.358188+0000","last_undegraded":"2024-04-19T02:21:50.358188+0000","last_fullsized":"2024-04-19T02:21:50.358188+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.358123+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:30.347256+0000","scrub_duration":0.0040337430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":564,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471113+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:21.471113+0000","last_peered":"2024-04-19T02:21:21.471113+0000","last_clean":"2024-04-19T02:21:21.471113+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:21.471113+0000","last_undegraded":"2024-04-19T02:21:21.471113+0000","last_fullsized":"2024-04-19T02:21:21.471113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475297+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:21.475297+0000","last_peered":"2024-04-19T02:21:21.475297+0000","last_clean":"2024-04-19T02:21:21.475297+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:21.475297+0000","last_undegraded":"2024-04-19T02:21:21.475297+0000","last_fullsized":"2024-04-19T02:21:21.475297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":469,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.464992+0000","last_change":"2024-04-19T02:21:34.465225+0000","last_active":"2024-04-19T02:21:34.464992+0000","last_peered":"2024-04-19T02:21:34.464992+0000","last_clean":"2024-04-19T02:21:34.464992+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:34.464992+0000","last_undegraded":"2024-04-19T02:21:34.464992+0000","last_fullsized":"2024-04-19T02:21:34.464992+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.464937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:54.461710+0000","scrub_duration":0.004016393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":912,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474499+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:21.474499+0000","last_peered":"2024-04-19T02:21:21.474499+0000","last_clean":"2024-04-19T02:21:21.474499+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:21.474499+0000","last_undegraded":"2024-04-19T02:21:21.474499+0000","last_fullsized":"2024-04-19T02:21:21.474499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":539,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473843+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:21.473843+0000","last_peered":"2024-04-19T02:21:21.473843+0000","last_clean":"2024-04-19T02:21:21.473843+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:21.473843+0000","last_undegraded":"2024-04-19T02:21:21.473843+0000","last_fullsized":"2024-04-19T02:21:21.473843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348157+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.348157+0000","last_peered":"2024-04-19T02:21:21.348157+0000","last_clean":"2024-04-19T02:21:21.348157+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.348157+0000","last_undegraded":"2024-04-19T02:21:21.348157+0000","last_fullsized":"2024-04-19T02:21:21.348157+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":530,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.332850+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.332850+0000","last_peered":"2024-04-19T02:21:21.332850+0000","last_clean":"2024-04-19T02:21:21.332850+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.332850+0000","last_undegraded":"2024-04-19T02:21:21.332850+0000","last_fullsized":"2024-04-19T02:21:21.332850+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":577,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340715+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.340715+0000","last_peered":"2024-04-19T02:21:21.340715+0000","last_clean":"2024-04-19T02:21:21.340715+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.340715+0000","last_undegraded":"2024-04-19T02:21:21.340715+0000","last_fullsized":"2024-04-19T02:21:21.340715+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471892+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:21.471892+0000","last_peered":"2024-04-19T02:21:21.471892+0000","last_clean":"2024-04-19T02:21:21.471892+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:21.471892+0000","last_undegraded":"2024-04-19T02:21:21.471892+0000","last_fullsized":"2024-04-19T02:21:21.471892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.467028+0000","last_change":"2024-04-19T02:21:33.467243+0000","last_active":"2024-04-19T02:21:33.467028+0000","last_peered":"2024-04-19T02:21:33.467028+0000","last_clean":"2024-04-19T02:21:33.467028+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:33.467028+0000","last_undegraded":"2024-04-19T02:21:33.467028+0000","last_fullsized":"2024-04-19T02:21:33.467028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.466973+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:47.589455+0000","scrub_duration":0.0049157790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":650,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470162+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:21.470162+0000","last_peered":"2024-04-19T02:21:21.470162+0000","last_clean":"2024-04-19T02:21:21.470162+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:21.470162+0000","last_undegraded":"2024-04-19T02:21:21.470162+0000","last_fullsized":"2024-04-19T02:21:21.470162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":512,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344283+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.344283+0000","last_peered":"2024-04-19T02:21:21.344283+0000","last_clean":"2024-04-19T02:21:21.344283+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.344283+0000","last_undegraded":"2024-04-19T02:21:21.344283+0000","last_fullsized":"2024-04-19T02:21:21.344283+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":556,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.476453+0000","last_change":"2024-04-19T02:21:41.476717+0000","last_active":"2024-04-19T02:21:41.476453+0000","last_peered":"2024-04-19T02:21:41.476453+0000","last_clean":"2024-04-19T02:21:41.476453+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:41.476453+0000","last_undegraded":"2024-04-19T02:21:41.476453+0000","last_fullsized":"2024-04-19T02:21:41.476453+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.476396+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:05:52.160962+0000","scrub_duration":0.0037331780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1123,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474064+0000","last_change":"2024-04-19T02:20:46.205636+0000","last_active":"2024-04-19T02:21:21.474064+0000","last_peered":"2024-04-19T02:21:21.474064+0000","last_clean":"2024-04-19T02:21:21.474064+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:21:21.474064+0000","last_undegraded":"2024-04-19T02:21:21.474064+0000","last_fullsized":"2024-04-19T02:21:21.474064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":901,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468624+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:21.468624+0000","last_peered":"2024-04-19T02:21:21.468624+0000","last_clean":"2024-04-19T02:21:21.468624+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:21.468624+0000","last_undegraded":"2024-04-19T02:21:21.468624+0000","last_fullsized":"2024-04-19T02:21:21.468624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.568397+0000","last_change":"2024-04-19T02:22:08.568618+0000","last_active":"2024-04-19T02:22:08.568397+0000","last_peered":"2024-04-19T02:22:08.568397+0000","last_clean":"2024-04-19T02:22:08.568397+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:22:08.568397+0000","last_undegraded":"2024-04-19T02:22:08.568397+0000","last_fullsized":"2024-04-19T02:22:08.568397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.568338+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:51.280163+0000","scrub_duration":0.0042660390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":962,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:59.650243+0000","last_change":"2024-04-19T02:21:59.650456+0000","last_active":"2024-04-19T02:21:59.650243+0000","last_peered":"2024-04-19T02:21:59.650243+0000","last_clean":"2024-04-19T02:21:59.650243+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:59.650243+0000","last_undegraded":"2024-04-19T02:21:59.650243+0000","last_fullsized":"2024-04-19T02:21:59.650243+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_clean_scrub_stamp":"2024-04-19T02:21:59.650190+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:15.528989+0000","scrub_duration":0.0039580250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1175,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471138+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:21.471138+0000","last_peered":"2024-04-19T02:21:21.471138+0000","last_clean":"2024-04-19T02:21:21.471138+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:21.471138+0000","last_undegraded":"2024-04-19T02:21:21.471138+0000","last_fullsized":"2024-04-19T02:21:21.471138+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":567,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.412900+0000","last_change":"2024-04-19T02:21:39.413150+0000","last_active":"2024-04-19T02:21:39.412900+0000","last_peered":"2024-04-19T02:21:39.412900+0000","last_clean":"2024-04-19T02:21:39.412900+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:39.412900+0000","last_undegraded":"2024-04-19T02:21:39.412900+0000","last_fullsized":"2024-04-19T02:21:39.412900+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.412846+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:49.572797+0000","scrub_duration":0.0040928559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":817,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474991+0000","last_change":"2024-04-19T02:20:37.202936+0000","last_active":"2024-04-19T02:21:21.474991+0000","last_peered":"2024-04-19T02:21:21.474991+0000","last_clean":"2024-04-19T02:21:21.474991+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:21:21.474991+0000","last_undegraded":"2024-04-19T02:21:21.474991+0000","last_fullsized":"2024-04-19T02:21:21.474991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":551,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.418588+0000","last_change":"2024-04-19T02:21:32.418818+0000","last_active":"2024-04-19T02:21:32.418588+0000","last_peered":"2024-04-19T02:21:32.418588+0000","last_clean":"2024-04-19T02:21:32.418588+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:32.418588+0000","last_undegraded":"2024-04-19T02:21:32.418588+0000","last_fullsized":"2024-04-19T02:21:32.418588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'382","last_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_deep_scrub":"71'382","last_deep_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.418531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.300626+0000","scrub_duration":0.0048622070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1089,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.427431+0000","last_change":"2024-04-19T02:21:35.427651+0000","last_active":"2024-04-19T02:21:35.427431+0000","last_peered":"2024-04-19T02:21:35.427431+0000","last_clean":"2024-04-19T02:21:35.427431+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:35.427431+0000","last_undegraded":"2024-04-19T02:21:35.427431+0000","last_fullsized":"2024-04-19T02:21:35.427431+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.427379+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:58.566016+0000","scrub_duration":0.0038844489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":628,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.392107+0000","last_change":"2024-04-19T02:21:38.392319+0000","last_active":"2024-04-19T02:21:38.392107+0000","last_peered":"2024-04-19T02:21:38.392107+0000","last_clean":"2024-04-19T02:21:38.392107+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:38.392107+0000","last_undegraded":"2024-04-19T02:21:38.392107+0000","last_fullsized":"2024-04-19T02:21:38.392107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'460","last_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_deep_scrub":"71'460","last_deep_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.392049+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:54.270848+0000","scrub_duration":0.0042770439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":525,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344242+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.344242+0000","last_peered":"2024-04-19T02:21:21.344242+0000","last_clean":"2024-04-19T02:21:21.344242+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.344242+0000","last_undegraded":"2024-04-19T02:21:21.344242+0000","last_fullsized":"2024-04-19T02:21:21.344242+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":499,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474902+0000","last_change":"2024-04-19T02:16:24.510618+0000","last_active":"2024-04-19T02:21:21.474902+0000","last_peered":"2024-04-19T02:21:21.474902+0000","last_clean":"2024-04-19T02:21:21.474902+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:21:21.474902+0000","last_undegraded":"2024-04-19T02:21:21.474902+0000","last_fullsized":"2024-04-19T02:21:21.474902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"70'381","reported_seq":458,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343372+0000","last_change":"2024-04-19T02:21:21.330108+0000","last_active":"2024-04-19T02:21:21.343372+0000","last_peered":"2024-04-19T02:21:21.343372+0000","last_clean":"2024-04-19T02:21:21.343372+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:21:21.343372+0000","last_undegraded":"2024-04-19T02:21:21.343372+0000","last_fullsized":"2024-04-19T02:21:21.343372+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.484417+0000","last_change":"2024-04-19T02:21:38.484643+0000","last_active":"2024-04-19T02:21:38.484417+0000","last_peered":"2024-04-19T02:21:38.484417+0000","last_clean":"2024-04-19T02:21:38.484417+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:38.484417+0000","last_undegraded":"2024-04-19T02:21:38.484417+0000","last_fullsized":"2024-04-19T02:21:38.484417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.484360+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:33.481985+0000","scrub_duration":0.0046311950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":189,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468968+0000","last_change":"2024-04-19T02:20:30.537423+0000","last_active":"2024-04-19T02:21:21.468968+0000","last_peered":"2024-04-19T02:21:21.468968+0000","last_clean":"2024-04-19T02:21:21.468968+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:21:21.468968+0000","last_undegraded":"2024-04-19T02:21:21.468968+0000","last_fullsized":"2024-04-19T02:21:21.468968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1022,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471411+0000","last_change":"2024-04-19T02:20:56.225294+0000","last_active":"2024-04-19T02:21:21.471411+0000","last_peered":"2024-04-19T02:21:21.471411+0000","last_clean":"2024-04-19T02:21:21.471411+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:21:21.471411+0000","last_undegraded":"2024-04-19T02:21:21.471411+0000","last_fullsized":"2024-04-19T02:21:21.471411+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":195,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473754+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:21.473754+0000","last_peered":"2024-04-19T02:21:21.473754+0000","last_clean":"2024-04-19T02:21:21.473754+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:21.473754+0000","last_undegraded":"2024-04-19T02:21:21.473754+0000","last_fullsized":"2024-04-19T02:21:21.473754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":911,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471155+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:21.471155+0000","last_peered":"2024-04-19T02:21:21.471155+0000","last_clean":"2024-04-19T02:21:21.471155+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:21.471155+0000","last_undegraded":"2024-04-19T02:21:21.471155+0000","last_fullsized":"2024-04-19T02:21:21.471155+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":131,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344487+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.344487+0000","last_peered":"2024-04-19T02:21:21.344487+0000","last_clean":"2024-04-19T02:21:21.344487+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.344487+0000","last_undegraded":"2024-04-19T02:21:21.344487+0000","last_fullsized":"2024-04-19T02:21:21.344487+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"71'168","reported_seq":246,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.322738+0000","last_change":"2024-04-19T02:21:21.320439+0000","last_active":"2024-04-19T02:21:21.322738+0000","last_peered":"2024-04-19T02:21:21.322738+0000","last_clean":"2024-04-19T02:21:21.322738+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:21:21.322738+0000","last_undegraded":"2024-04-19T02:21:21.322738+0000","last_fullsized":"2024-04-19T02:21:21.322738+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":907,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.502979+0000","last_change":"2024-04-19T02:21:46.503221+0000","last_active":"2024-04-19T02:21:46.502979+0000","last_peered":"2024-04-19T02:21:46.502979+0000","last_clean":"2024-04-19T02:21:46.502979+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:46.502979+0000","last_undegraded":"2024-04-19T02:21:46.502979+0000","last_fullsized":"2024-04-19T02:21:46.502979+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.502927+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:48.122985+0000","scrub_duration":0.0039232249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":431,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475684+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:21.475684+0000","last_peered":"2024-04-19T02:21:21.475684+0000","last_clean":"2024-04-19T02:21:21.475684+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:21.475684+0000","last_undegraded":"2024-04-19T02:21:21.475684+0000","last_fullsized":"2024-04-19T02:21:21.475684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.534204+0000","last_change":"2024-04-19T02:21:52.534416+0000","last_active":"2024-04-19T02:21:52.534204+0000","last_peered":"2024-04-19T02:21:52.534204+0000","last_clean":"2024-04-19T02:21:52.534204+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:52.534204+0000","last_undegraded":"2024-04-19T02:21:52.534204+0000","last_fullsized":"2024-04-19T02:21:52.534204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'443","last_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_deep_scrub":"71'443","last_deep_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.534152+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:28.134492+0000","scrub_duration":0.0046536420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":675,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343667+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.343667+0000","last_peered":"2024-04-19T02:21:21.343667+0000","last_clean":"2024-04-19T02:21:21.343667+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.343667+0000","last_undegraded":"2024-04-19T02:21:21.343667+0000","last_fullsized":"2024-04-19T02:21:21.343667+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.572418+0000","last_change":"2024-04-19T02:21:31.572652+0000","last_active":"2024-04-19T02:21:31.572418+0000","last_peered":"2024-04-19T02:21:31.572418+0000","last_clean":"2024-04-19T02:21:31.572418+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:31.572418+0000","last_undegraded":"2024-04-19T02:21:31.572418+0000","last_fullsized":"2024-04-19T02:21:31.572418+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.572365+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:18.167461+0000","scrub_duration":0.0042499950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":122,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.322488+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.322488+0000","last_peered":"2024-04-19T02:21:21.322488+0000","last_clean":"2024-04-19T02:21:21.322488+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.322488+0000","last_undegraded":"2024-04-19T02:21:21.322488+0000","last_fullsized":"2024-04-19T02:21:21.322488+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1094,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:49.460647+0000","last_change":"2024-04-19T02:21:49.460884+0000","last_active":"2024-04-19T02:21:49.460647+0000","last_peered":"2024-04-19T02:21:49.460647+0000","last_clean":"2024-04-19T02:21:49.460647+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:49.460647+0000","last_undegraded":"2024-04-19T02:21:49.460647+0000","last_fullsized":"2024-04-19T02:21:49.460647+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'491","last_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_deep_scrub":"71'491","last_deep_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_clean_scrub_stamp":"2024-04-19T02:21:49.460592+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:18.752338+0000","scrub_duration":0.0043248339999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":271,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470483+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:21.470483+0000","last_peered":"2024-04-19T02:21:21.470483+0000","last_clean":"2024-04-19T02:21:21.470483+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:21.470483+0000","last_undegraded":"2024-04-19T02:21:21.470483+0000","last_fullsized":"2024-04-19T02:21:21.470483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342243+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.342243+0000","last_peered":"2024-04-19T02:21:21.342243+0000","last_clean":"2024-04-19T02:21:21.342243+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.342243+0000","last_undegraded":"2024-04-19T02:21:21.342243+0000","last_fullsized":"2024-04-19T02:21:21.342243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"117'208","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.448417+0000","last_change":"2024-04-19T02:21:45.448731+0000","last_active":"2024-04-19T02:21:45.448417+0000","last_peered":"2024-04-19T02:21:45.448417+0000","last_clean":"2024-04-19T02:21:45.448417+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:45.448417+0000","last_undegraded":"2024-04-19T02:21:45.448417+0000","last_fullsized":"2024-04-19T02:21:45.448417+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'208","last_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_deep_scrub":"117'208","last_deep_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.448363+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:14.018739+0000","scrub_duration":0.041956280999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":595,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.414005+0000","last_change":"2024-04-19T02:22:06.414317+0000","last_active":"2024-04-19T02:22:06.414005+0000","last_peered":"2024-04-19T02:22:06.414005+0000","last_clean":"2024-04-19T02:22:06.414005+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:22:06.414005+0000","last_undegraded":"2024-04-19T02:22:06.414005+0000","last_fullsized":"2024-04-19T02:22:06.414005+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'428","last_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_deep_scrub":"71'428","last_deep_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.413898+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:34.571146+0000","scrub_duration":0.0043639839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":179,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473928+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:21.473928+0000","last_peered":"2024-04-19T02:21:21.473928+0000","last_clean":"2024-04-19T02:21:21.473928+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:21.473928+0000","last_undegraded":"2024-04-19T02:21:21.473928+0000","last_fullsized":"2024-04-19T02:21:21.473928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":451,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323059+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.323059+0000","last_peered":"2024-04-19T02:21:21.323059+0000","last_clean":"2024-04-19T02:21:21.323059+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.323059+0000","last_undegraded":"2024-04-19T02:21:21.323059+0000","last_fullsized":"2024-04-19T02:21:21.323059+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473380+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:21.473380+0000","last_peered":"2024-04-19T02:21:21.473380+0000","last_clean":"2024-04-19T02:21:21.473380+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:21.473380+0000","last_undegraded":"2024-04-19T02:21:21.473380+0000","last_fullsized":"2024-04-19T02:21:21.473380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.216164+0000","last_change":"2024-04-19T02:22:06.216395+0000","last_active":"2024-04-19T02:22:06.216164+0000","last_peered":"2024-04-19T02:22:06.216164+0000","last_clean":"2024-04-19T02:22:06.216164+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:22:06.216164+0000","last_undegraded":"2024-04-19T02:22:06.216164+0000","last_fullsized":"2024-04-19T02:22:06.216164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'395","last_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_deep_scrub":"71'395","last_deep_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.216111+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:41.161541+0000","scrub_duration":0.0046009639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344188+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:21.344188+0000","last_peered":"2024-04-19T02:21:21.344188+0000","last_clean":"2024-04-19T02:21:21.344188+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:21.344188+0000","last_undegraded":"2024-04-19T02:21:21.344188+0000","last_fullsized":"2024-04-19T02:21:21.344188+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343474+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.343474+0000","last_peered":"2024-04-19T02:21:21.343474+0000","last_clean":"2024-04-19T02:21:21.343474+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.343474+0000","last_undegraded":"2024-04-19T02:21:21.343474+0000","last_fullsized":"2024-04-19T02:21:21.343474+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":874,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470012+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:21.470012+0000","last_peered":"2024-04-19T02:21:21.470012+0000","last_clean":"2024-04-19T02:21:21.470012+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:21.470012+0000","last_undegraded":"2024-04-19T02:21:21.470012+0000","last_fullsized":"2024-04-19T02:21:21.470012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":569,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348015+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.348015+0000","last_peered":"2024-04-19T02:21:21.348015+0000","last_clean":"2024-04-19T02:21:21.348015+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.348015+0000","last_undegraded":"2024-04-19T02:21:21.348015+0000","last_fullsized":"2024-04-19T02:21:21.348015+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344291+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:21.344291+0000","last_peered":"2024-04-19T02:21:21.344291+0000","last_clean":"2024-04-19T02:21:21.344291+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:21.344291+0000","last_undegraded":"2024-04-19T02:21:21.344291+0000","last_fullsized":"2024-04-19T02:21:21.344291+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":311,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469426+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:21.469426+0000","last_peered":"2024-04-19T02:21:21.469426+0000","last_clean":"2024-04-19T02:21:21.469426+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:21.469426+0000","last_undegraded":"2024-04-19T02:21:21.469426+0000","last_fullsized":"2024-04-19T02:21:21.469426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.500697+0000","last_change":"2024-04-19T02:21:50.500920+0000","last_active":"2024-04-19T02:21:50.500697+0000","last_peered":"2024-04-19T02:21:50.500697+0000","last_clean":"2024-04-19T02:21:50.500697+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:50.500697+0000","last_undegraded":"2024-04-19T02:21:50.500697+0000","last_fullsized":"2024-04-19T02:21:50.500697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.500643+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:19:06.685542+0000","scrub_duration":0.0044626199999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469819+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:21.469819+0000","last_peered":"2024-04-19T02:21:21.469819+0000","last_clean":"2024-04-19T02:21:21.469819+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:21.469819+0000","last_undegraded":"2024-04-19T02:21:21.469819+0000","last_fullsized":"2024-04-19T02:21:21.469819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474002+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:21.474002+0000","last_peered":"2024-04-19T02:21:21.474002+0000","last_clean":"2024-04-19T02:21:21.474002+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:21.474002+0000","last_undegraded":"2024-04-19T02:21:21.474002+0000","last_fullsized":"2024-04-19T02:21:21.474002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":480,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.417845+0000","last_change":"2024-04-19T02:21:47.418067+0000","last_active":"2024-04-19T02:21:47.417845+0000","last_peered":"2024-04-19T02:21:47.417845+0000","last_clean":"2024-04-19T02:21:47.417845+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:47.417845+0000","last_undegraded":"2024-04-19T02:21:47.417845+0000","last_fullsized":"2024-04-19T02:21:47.417845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'345","last_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_deep_scrub":"71'345","last_deep_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.417790+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:30.129614+0000","scrub_duration":0.0046618750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348022+0000","last_change":"2024-04-19T02:21:21.323975+0000","last_active":"2024-04-19T02:21:21.348022+0000","last_peered":"2024-04-19T02:21:21.348022+0000","last_clean":"2024-04-19T02:21:21.348022+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:21:21.348022+0000","last_undegraded":"2024-04-19T02:21:21.348022+0000","last_fullsized":"2024-04-19T02:21:21.348022+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":148,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.379540+0000","last_change":"2024-04-19T02:21:54.379775+0000","last_active":"2024-04-19T02:21:54.379540+0000","last_peered":"2024-04-19T02:21:54.379540+0000","last_clean":"2024-04-19T02:21:54.379540+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:54.379540+0000","last_undegraded":"2024-04-19T02:21:54.379540+0000","last_fullsized":"2024-04-19T02:21:54.379540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.379480+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:14.495728+0000","scrub_duration":0.0033461229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.419495+0000","last_change":"2024-04-19T02:21:40.419740+0000","last_active":"2024-04-19T02:21:40.419495+0000","last_peered":"2024-04-19T02:21:40.419495+0000","last_clean":"2024-04-19T02:21:40.419495+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:40.419495+0000","last_undegraded":"2024-04-19T02:21:40.419495+0000","last_fullsized":"2024-04-19T02:21:40.419495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'403","last_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_deep_scrub":"71'403","last_deep_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.419437+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:29.109984+0000","scrub_duration":0.0046038880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":530,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343592+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.343592+0000","last_peered":"2024-04-19T02:21:21.343592+0000","last_clean":"2024-04-19T02:21:21.343592+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.343592+0000","last_undegraded":"2024-04-19T02:21:21.343592+0000","last_fullsized":"2024-04-19T02:21:21.343592+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470603+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:21.470603+0000","last_peered":"2024-04-19T02:21:21.470603+0000","last_clean":"2024-04-19T02:21:21.470603+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:21.470603+0000","last_undegraded":"2024-04-19T02:21:21.470603+0000","last_fullsized":"2024-04-19T02:21:21.470603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":869,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:01.585893+0000","last_change":"2024-04-19T02:22:01.586120+0000","last_active":"2024-04-19T02:22:01.585893+0000","last_peered":"2024-04-19T02:22:01.585893+0000","last_clean":"2024-04-19T02:22:01.585893+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:22:01.585893+0000","last_undegraded":"2024-04-19T02:22:01.585893+0000","last_fullsized":"2024-04-19T02:22:01.585893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'383","last_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_deep_scrub":"71'383","last_deep_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_clean_scrub_stamp":"2024-04-19T02:22:01.585841+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:50.276388+0000","scrub_duration":0.0039878709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":168,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470522+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:21.470522+0000","last_peered":"2024-04-19T02:21:21.470522+0000","last_clean":"2024-04-19T02:21:21.470522+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:21.470522+0000","last_undegraded":"2024-04-19T02:21:21.470522+0000","last_fullsized":"2024-04-19T02:21:21.470522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475910+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:21.475910+0000","last_peered":"2024-04-19T02:21:21.475910+0000","last_clean":"2024-04-19T02:21:21.475910+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:21.475910+0000","last_undegraded":"2024-04-19T02:21:21.475910+0000","last_fullsized":"2024-04-19T02:21:21.475910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":986,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:53.548468+0000","last_change":"2024-04-19T02:21:53.548677+0000","last_active":"2024-04-19T02:21:53.548468+0000","last_peered":"2024-04-19T02:21:53.548468+0000","last_clean":"2024-04-19T02:21:53.548468+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:53.548468+0000","last_undegraded":"2024-04-19T02:21:53.548468+0000","last_fullsized":"2024-04-19T02:21:53.548468+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_clean_scrub_stamp":"2024-04-19T02:21:53.548415+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:32.430509+0000","scrub_duration":0.003797426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":178,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.472059+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:21.472059+0000","last_peered":"2024-04-19T02:21:21.472059+0000","last_clean":"2024-04-19T02:21:21.472059+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:21.472059+0000","last_undegraded":"2024-04-19T02:21:21.472059+0000","last_fullsized":"2024-04-19T02:21:21.472059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471573+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:21.471573+0000","last_peered":"2024-04-19T02:21:21.471573+0000","last_clean":"2024-04-19T02:21:21.471573+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:21.471573+0000","last_undegraded":"2024-04-19T02:21:21.471573+0000","last_fullsized":"2024-04-19T02:21:21.471573+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":963,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:51.371949+0000","last_change":"2024-04-19T02:21:51.372189+0000","last_active":"2024-04-19T02:21:51.371949+0000","last_peered":"2024-04-19T02:21:51.371949+0000","last_clean":"2024-04-19T02:21:51.371949+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:51.371949+0000","last_undegraded":"2024-04-19T02:21:51.371949+0000","last_fullsized":"2024-04-19T02:21:51.371949+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_clean_scrub_stamp":"2024-04-19T02:21:51.371896+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.379349+0000","scrub_duration":0.0039386960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":205,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471534+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:21.471534+0000","last_peered":"2024-04-19T02:21:21.471534+0000","last_clean":"2024-04-19T02:21:21.471534+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:21.471534+0000","last_undegraded":"2024-04-19T02:21:21.471534+0000","last_fullsized":"2024-04-19T02:21:21.471534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.382614+0000","last_change":"2024-04-19T02:21:47.382834+0000","last_active":"2024-04-19T02:21:47.382614+0000","last_peered":"2024-04-19T02:21:47.382614+0000","last_clean":"2024-04-19T02:21:47.382614+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:47.382614+0000","last_undegraded":"2024-04-19T02:21:47.382614+0000","last_fullsized":"2024-04-19T02:21:47.382614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.382567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:21.368852+0000","scrub_duration":0.0033623530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763606+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:31.763606+0000","last_peered":"2024-04-19T02:21:31.763606+0000","last_clean":"2024-04-19T02:21:31.763606+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:31.763606+0000","last_undegraded":"2024-04-19T02:21:31.763606+0000","last_fullsized":"2024-04-19T02:21:31.763606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":502,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.345073+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.345073+0000","last_peered":"2024-04-19T02:21:21.345073+0000","last_clean":"2024-04-19T02:21:21.345073+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.345073+0000","last_undegraded":"2024-04-19T02:21:21.345073+0000","last_fullsized":"2024-04-19T02:21:21.345073+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":533,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344342+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.344342+0000","last_peered":"2024-04-19T02:21:21.344342+0000","last_clean":"2024-04-19T02:21:21.344342+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.344342+0000","last_undegraded":"2024-04-19T02:21:21.344342+0000","last_fullsized":"2024-04-19T02:21:21.344342+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":556,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468644+0000","last_change":"2024-04-19T02:16:24.512208+0000","last_active":"2024-04-19T02:21:21.468644+0000","last_peered":"2024-04-19T02:21:21.468644+0000","last_clean":"2024-04-19T02:21:21.468644+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:21:21.468644+0000","last_undegraded":"2024-04-19T02:21:21.468644+0000","last_fullsized":"2024-04-19T02:21:21.468644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":217,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475613+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:21.475613+0000","last_peered":"2024-04-19T02:21:21.475613+0000","last_clean":"2024-04-19T02:21:21.475613+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:21.475613+0000","last_undegraded":"2024-04-19T02:21:21.475613+0000","last_fullsized":"2024-04-19T02:21:21.475613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"117'325","reported_seq":405,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.418193+0000","last_change":"2024-04-19T02:21:46.418450+0000","last_active":"2024-04-19T02:21:46.418193+0000","last_peered":"2024-04-19T02:21:46.418193+0000","last_clean":"2024-04-19T02:21:46.418193+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:46.418193+0000","last_undegraded":"2024-04-19T02:21:46.418193+0000","last_fullsized":"2024-04-19T02:21:46.418193+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'325","last_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_deep_scrub":"117'325","last_deep_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.418135+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:23.243009+0000","scrub_duration":0.037437605999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1020,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469717+0000","last_change":"2024-04-19T02:20:58.190494+0000","last_active":"2024-04-19T02:21:21.469717+0000","last_peered":"2024-04-19T02:21:21.469717+0000","last_clean":"2024-04-19T02:21:21.469717+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:21:21.469717+0000","last_undegraded":"2024-04-19T02:21:21.469717+0000","last_fullsized":"2024-04-19T02:21:21.469717+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":179,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471890+0000","last_change":"2024-04-19T02:20:30.533668+0000","last_active":"2024-04-19T02:21:21.471890+0000","last_peered":"2024-04-19T02:21:21.471890+0000","last_clean":"2024-04-19T02:21:21.471890+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:21:21.471890+0000","last_undegraded":"2024-04-19T02:21:21.471890+0000","last_fullsized":"2024-04-19T02:21:21.471890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":641,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.239538+0000","last_change":"2024-04-19T02:22:08.239786+0000","last_active":"2024-04-19T02:22:08.239538+0000","last_peered":"2024-04-19T02:22:08.239538+0000","last_clean":"2024-04-19T02:22:08.239538+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:22:08.239538+0000","last_undegraded":"2024-04-19T02:22:08.239538+0000","last_fullsized":"2024-04-19T02:22:08.239538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'459","last_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_deep_scrub":"71'459","last_deep_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.239485+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:14.140941+0000","scrub_duration":0.004519805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":930,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.477588+0000","last_change":"2024-04-19T02:21:36.477808+0000","last_active":"2024-04-19T02:21:36.477588+0000","last_peered":"2024-04-19T02:21:36.477588+0000","last_clean":"2024-04-19T02:21:36.477588+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:36.477588+0000","last_undegraded":"2024-04-19T02:21:36.477588+0000","last_fullsized":"2024-04-19T02:21:36.477588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.477536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:19.549278+0000","scrub_duration":0.0037289060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":684,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469346+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:21.469346+0000","last_peered":"2024-04-19T02:21:21.469346+0000","last_clean":"2024-04-19T02:21:21.469346+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:21.469346+0000","last_undegraded":"2024-04-19T02:21:21.469346+0000","last_fullsized":"2024-04-19T02:21:21.469346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":944,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471000+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:21.471000+0000","last_peered":"2024-04-19T02:21:21.471000+0000","last_clean":"2024-04-19T02:21:21.471000+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:21.471000+0000","last_undegraded":"2024-04-19T02:21:21.471000+0000","last_fullsized":"2024-04-19T02:21:21.471000+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":462,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469168+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:21.469168+0000","last_peered":"2024-04-19T02:21:21.469168+0000","last_clean":"2024-04-19T02:21:21.469168+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:21.469168+0000","last_undegraded":"2024-04-19T02:21:21.469168+0000","last_fullsized":"2024-04-19T02:21:21.469168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":862,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443364+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:24.443364+0000","last_peered":"2024-04-19T02:21:24.443364+0000","last_clean":"2024-04-19T02:21:24.443364+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:24.443364+0000","last_undegraded":"2024-04-19T02:21:24.443364+0000","last_fullsized":"2024-04-19T02:21:24.443364+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":609,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474594+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.474594+0000","last_peered":"2024-04-19T02:21:21.474594+0000","last_clean":"2024-04-19T02:21:21.474594+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.474594+0000","last_undegraded":"2024-04-19T02:21:21.474594+0000","last_fullsized":"2024-04-19T02:21:21.474594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:42.467422+0000","last_change":"2024-04-19T02:21:42.467663+0000","last_active":"2024-04-19T02:21:42.467422+0000","last_peered":"2024-04-19T02:21:42.467422+0000","last_clean":"2024-04-19T02:21:42.467422+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:42.467422+0000","last_undegraded":"2024-04-19T02:21:42.467422+0000","last_fullsized":"2024-04-19T02:21:42.467422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:42.467368+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:21.867316+0000","scrub_duration":0.0048531720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":189,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443272+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:24.443272+0000","last_peered":"2024-04-19T02:21:24.443272+0000","last_clean":"2024-04-19T02:21:24.443272+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:24.443272+0000","last_undegraded":"2024-04-19T02:21:24.443272+0000","last_fullsized":"2024-04-19T02:21:24.443272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":478,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.431655+0000","last_change":"2024-04-19T02:21:40.431879+0000","last_active":"2024-04-19T02:21:40.431655+0000","last_peered":"2024-04-19T02:21:40.431655+0000","last_clean":"2024-04-19T02:21:40.431655+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:40.431655+0000","last_undegraded":"2024-04-19T02:21:40.431655+0000","last_fullsized":"2024-04-19T02:21:40.431655+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.431601+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:34.613519+0000","scrub_duration":0.0040029599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":404,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342300+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.342300+0000","last_peered":"2024-04-19T02:21:21.342300+0000","last_clean":"2024-04-19T02:21:21.342300+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.342300+0000","last_undegraded":"2024-04-19T02:21:21.342300+0000","last_fullsized":"2024-04-19T02:21:21.342300+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":496,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348113+0000","last_change":"2024-04-19T02:21:21.328166+0000","last_active":"2024-04-19T02:21:21.348113+0000","last_peered":"2024-04-19T02:21:21.348113+0000","last_clean":"2024-04-19T02:21:21.348113+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:21:21.348113+0000","last_undegraded":"2024-04-19T02:21:21.348113+0000","last_fullsized":"2024-04-19T02:21:21.348113+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'367","reported_seq":509,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443402+0000","last_change":"2024-04-19T02:20:35.197537+0000","last_active":"2024-04-19T02:21:24.443402+0000","last_peered":"2024-04-19T02:21:24.443402+0000","last_clean":"2024-04-19T02:21:24.443402+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:21:24.443402+0000","last_undegraded":"2024-04-19T02:21:24.443402+0000","last_fullsized":"2024-04-19T02:21:24.443402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":634,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474035+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:21.474035+0000","last_peered":"2024-04-19T02:21:21.474035+0000","last_clean":"2024-04-19T02:21:21.474035+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:21.474035+0000","last_undegraded":"2024-04-19T02:21:21.474035+0000","last_fullsized":"2024-04-19T02:21:21.474035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'68","reported_seq":180,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471330+0000","last_change":"2024-04-19T02:16:24.136766+0000","last_active":"2024-04-19T02:21:21.471330+0000","last_peered":"2024-04-19T02:21:21.471330+0000","last_clean":"2024-04-19T02:21:21.471330+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:21:21.471330+0000","last_undegraded":"2024-04-19T02:21:21.471330+0000","last_fullsized":"2024-04-19T02:21:21.471330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341348+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.341348+0000","last_peered":"2024-04-19T02:21:21.341348+0000","last_clean":"2024-04-19T02:21:21.341348+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.341348+0000","last_undegraded":"2024-04-19T02:21:21.341348+0000","last_fullsized":"2024-04-19T02:21:21.341348+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"117'55","reported_seq":196,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:07.253532+0000","last_change":"2024-04-19T02:22:07.253769+0000","last_active":"2024-04-19T02:22:07.253532+0000","last_peered":"2024-04-19T02:22:07.253532+0000","last_clean":"2024-04-19T02:22:07.253532+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:22:07.253532+0000","last_undegraded":"2024-04-19T02:22:07.253532+0000","last_fullsized":"2024-04-19T02:22:07.253532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'55","last_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_deep_scrub":"117'55","last_deep_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_clean_scrub_stamp":"2024-04-19T02:22:07.253481+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:15.508809+0000","scrub_duration":0.035080496000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7637,"ondisk_log_size":7637,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738445,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126648,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245192,"statfs":{"total":96636764160,"available":96507076608,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.51900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.78500000000000003,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.56599999999999995,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.026,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.627}]},{"osd":1,"last update":"Fri Apr 19 02:21:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72299999999999998}]}]},{"osd":1,"up_from":78,"seq":335007449110,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66120,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305720,"statfs":{"total":96636764160,"available":96569057280,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.73399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139604,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232236,"statfs":{"total":96636764160,"available":96493809664,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:21:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.629},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.499,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94499999999999995,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:22:12.795 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.795 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.796 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.796 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.796 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.796 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.797 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.798 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.798 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.798 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.798 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.798 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.798 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.799 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.799 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.799 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.799 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.799 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.799 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.799 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.800 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.800 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.800 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.800 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.800 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.800 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.800 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.801 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.801 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.801 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.801 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.801 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:16:14.984576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.801 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.801 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.802 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.802 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.802 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.802 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.802 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.802 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.802 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.803 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.803 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.803 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.803 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.803 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.803 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.803 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.804 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.804 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.805 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.805 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.805 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.805 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.805 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.805 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.805 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.806 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.806 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.806 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.806 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.806 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.807 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.807 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.807 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.807 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:12.807 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:22:32.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:22:33.127 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:22:33.129 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:22:33.147 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-04-19T02:22:32.333258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34442,"ondisk_log_size":34442,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332372,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783148,"statfs":{"total":289910292480,"available":289569943552,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004383"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475931+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:21.475931+0000","last_peered":"2024-04-19T02:21:21.475931+0000","last_clean":"2024-04-19T02:21:21.475931+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:21.475931+0000","last_undegraded":"2024-04-19T02:21:21.475931+0000","last_fullsized":"2024-04-19T02:21:21.475931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":594,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475245+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:21.475245+0000","last_peered":"2024-04-19T02:21:21.475245+0000","last_clean":"2024-04-19T02:21:21.475245+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:21.475245+0000","last_undegraded":"2024-04-19T02:21:21.475245+0000","last_fullsized":"2024-04-19T02:21:21.475245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":484,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.346455+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:21.346455+0000","last_peered":"2024-04-19T02:21:21.346455+0000","last_clean":"2024-04-19T02:21:21.346455+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:21.346455+0000","last_undegraded":"2024-04-19T02:21:21.346455+0000","last_fullsized":"2024-04-19T02:21:21.346455+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":467,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145849+0000","last_change":"2024-04-19T02:21:21.342642+0000","last_active":"2024-04-19T02:21:31.145849+0000","last_peered":"2024-04-19T02:21:31.145849+0000","last_clean":"2024-04-19T02:21:31.145849+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:21:31.145849+0000","last_undegraded":"2024-04-19T02:21:31.145849+0000","last_fullsized":"2024-04-19T02:21:31.145849+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443245+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:24.443245+0000","last_peered":"2024-04-19T02:21:24.443245+0000","last_clean":"2024-04-19T02:21:24.443245+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:24.443245+0000","last_undegraded":"2024-04-19T02:21:24.443245+0000","last_fullsized":"2024-04-19T02:21:24.443245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":536,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348874+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348874+0000","last_peered":"2024-04-19T02:21:21.348874+0000","last_clean":"2024-04-19T02:21:21.348874+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348874+0000","last_undegraded":"2024-04-19T02:21:21.348874+0000","last_fullsized":"2024-04-19T02:21:21.348874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":519,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330614+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.330614+0000","last_peered":"2024-04-19T02:21:21.330614+0000","last_clean":"2024-04-19T02:21:21.330614+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.330614+0000","last_undegraded":"2024-04-19T02:21:21.330614+0000","last_fullsized":"2024-04-19T02:21:21.330614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":594,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.358188+0000","last_change":"2024-04-19T02:21:50.358451+0000","last_active":"2024-04-19T02:21:50.358188+0000","last_peered":"2024-04-19T02:21:50.358188+0000","last_clean":"2024-04-19T02:21:50.358188+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:50.358188+0000","last_undegraded":"2024-04-19T02:21:50.358188+0000","last_fullsized":"2024-04-19T02:21:50.358188+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.358123+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:30.347256+0000","scrub_duration":0.0040337430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":564,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471113+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:21.471113+0000","last_peered":"2024-04-19T02:21:21.471113+0000","last_clean":"2024-04-19T02:21:21.471113+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:21.471113+0000","last_undegraded":"2024-04-19T02:21:21.471113+0000","last_fullsized":"2024-04-19T02:21:21.471113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475297+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:21.475297+0000","last_peered":"2024-04-19T02:21:21.475297+0000","last_clean":"2024-04-19T02:21:21.475297+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:21.475297+0000","last_undegraded":"2024-04-19T02:21:21.475297+0000","last_fullsized":"2024-04-19T02:21:21.475297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":469,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.464992+0000","last_change":"2024-04-19T02:21:34.465225+0000","last_active":"2024-04-19T02:21:34.464992+0000","last_peered":"2024-04-19T02:21:34.464992+0000","last_clean":"2024-04-19T02:21:34.464992+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:34.464992+0000","last_undegraded":"2024-04-19T02:21:34.464992+0000","last_fullsized":"2024-04-19T02:21:34.464992+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.464937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:54.461710+0000","scrub_duration":0.004016393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":912,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474499+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:21.474499+0000","last_peered":"2024-04-19T02:21:21.474499+0000","last_clean":"2024-04-19T02:21:21.474499+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:21.474499+0000","last_undegraded":"2024-04-19T02:21:21.474499+0000","last_fullsized":"2024-04-19T02:21:21.474499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":539,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473843+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:21.473843+0000","last_peered":"2024-04-19T02:21:21.473843+0000","last_clean":"2024-04-19T02:21:21.473843+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:21.473843+0000","last_undegraded":"2024-04-19T02:21:21.473843+0000","last_fullsized":"2024-04-19T02:21:21.473843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348157+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:21.348157+0000","last_peered":"2024-04-19T02:21:21.348157+0000","last_clean":"2024-04-19T02:21:21.348157+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:21.348157+0000","last_undegraded":"2024-04-19T02:21:21.348157+0000","last_fullsized":"2024-04-19T02:21:21.348157+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":530,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.332850+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:21.332850+0000","last_peered":"2024-04-19T02:21:21.332850+0000","last_clean":"2024-04-19T02:21:21.332850+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:21.332850+0000","last_undegraded":"2024-04-19T02:21:21.332850+0000","last_fullsized":"2024-04-19T02:21:21.332850+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":577,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.340715+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:21.340715+0000","last_peered":"2024-04-19T02:21:21.340715+0000","last_clean":"2024-04-19T02:21:21.340715+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:21.340715+0000","last_undegraded":"2024-04-19T02:21:21.340715+0000","last_fullsized":"2024-04-19T02:21:21.340715+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471892+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:21.471892+0000","last_peered":"2024-04-19T02:21:21.471892+0000","last_clean":"2024-04-19T02:21:21.471892+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:21.471892+0000","last_undegraded":"2024-04-19T02:21:21.471892+0000","last_fullsized":"2024-04-19T02:21:21.471892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.467028+0000","last_change":"2024-04-19T02:21:33.467243+0000","last_active":"2024-04-19T02:21:33.467028+0000","last_peered":"2024-04-19T02:21:33.467028+0000","last_clean":"2024-04-19T02:21:33.467028+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:33.467028+0000","last_undegraded":"2024-04-19T02:21:33.467028+0000","last_fullsized":"2024-04-19T02:21:33.467028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.466973+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:47.589455+0000","scrub_duration":0.0049157790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":650,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470162+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:21.470162+0000","last_peered":"2024-04-19T02:21:21.470162+0000","last_clean":"2024-04-19T02:21:21.470162+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:21.470162+0000","last_undegraded":"2024-04-19T02:21:21.470162+0000","last_fullsized":"2024-04-19T02:21:21.470162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":512,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344283+0000","last_change":"2024-04-19T02:21:21.341981+0000","last_active":"2024-04-19T02:21:21.344283+0000","last_peered":"2024-04-19T02:21:21.344283+0000","last_clean":"2024-04-19T02:21:21.344283+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:21:21.344283+0000","last_undegraded":"2024-04-19T02:21:21.344283+0000","last_fullsized":"2024-04-19T02:21:21.344283+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":556,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.476453+0000","last_change":"2024-04-19T02:21:41.476717+0000","last_active":"2024-04-19T02:21:41.476453+0000","last_peered":"2024-04-19T02:21:41.476453+0000","last_clean":"2024-04-19T02:21:41.476453+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:41.476453+0000","last_undegraded":"2024-04-19T02:21:41.476453+0000","last_fullsized":"2024-04-19T02:21:41.476453+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.476396+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:05:52.160962+0000","scrub_duration":0.0037331780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1134,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.591818+0000","last_change":"2024-04-19T02:22:12.592031+0000","last_active":"2024-04-19T02:22:12.591818+0000","last_peered":"2024-04-19T02:22:12.591818+0000","last_clean":"2024-04-19T02:22:12.591818+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:22:12.591818+0000","last_undegraded":"2024-04-19T02:22:12.591818+0000","last_fullsized":"2024-04-19T02:22:12.591818+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'464","last_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_deep_scrub":"71'464","last_deep_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.591764+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:14.599217+0000","scrub_duration":0.0039062849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":901,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468624+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:21.468624+0000","last_peered":"2024-04-19T02:21:21.468624+0000","last_clean":"2024-04-19T02:21:21.468624+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:21.468624+0000","last_undegraded":"2024-04-19T02:21:21.468624+0000","last_fullsized":"2024-04-19T02:21:21.468624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.568397+0000","last_change":"2024-04-19T02:22:08.568618+0000","last_active":"2024-04-19T02:22:08.568397+0000","last_peered":"2024-04-19T02:22:08.568397+0000","last_clean":"2024-04-19T02:22:08.568397+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:22:08.568397+0000","last_undegraded":"2024-04-19T02:22:08.568397+0000","last_fullsized":"2024-04-19T02:22:08.568397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.568338+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:51.280163+0000","scrub_duration":0.0042660390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":962,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:59.650243+0000","last_change":"2024-04-19T02:21:59.650456+0000","last_active":"2024-04-19T02:21:59.650243+0000","last_peered":"2024-04-19T02:21:59.650243+0000","last_clean":"2024-04-19T02:21:59.650243+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:59.650243+0000","last_undegraded":"2024-04-19T02:21:59.650243+0000","last_fullsized":"2024-04-19T02:21:59.650243+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_clean_scrub_stamp":"2024-04-19T02:21:59.650190+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:15.528989+0000","scrub_duration":0.0039580250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1175,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471138+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:21.471138+0000","last_peered":"2024-04-19T02:21:21.471138+0000","last_clean":"2024-04-19T02:21:21.471138+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:21.471138+0000","last_undegraded":"2024-04-19T02:21:21.471138+0000","last_fullsized":"2024-04-19T02:21:21.471138+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":567,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.412900+0000","last_change":"2024-04-19T02:21:39.413150+0000","last_active":"2024-04-19T02:21:39.412900+0000","last_peered":"2024-04-19T02:21:39.412900+0000","last_clean":"2024-04-19T02:21:39.412900+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:39.412900+0000","last_undegraded":"2024-04-19T02:21:39.412900+0000","last_fullsized":"2024-04-19T02:21:39.412900+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.412846+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:49.572797+0000","scrub_duration":0.0040928559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":828,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:28.539844+0000","last_change":"2024-04-19T02:22:28.540096+0000","last_active":"2024-04-19T02:22:28.539844+0000","last_peered":"2024-04-19T02:22:28.539844+0000","last_clean":"2024-04-19T02:22:28.539844+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:22:28.539844+0000","last_undegraded":"2024-04-19T02:22:28.539844+0000","last_fullsized":"2024-04-19T02:22:28.539844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_clean_scrub_stamp":"2024-04-19T02:22:28.539790+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:36.795119+0000","scrub_duration":0.0039321119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":551,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.418588+0000","last_change":"2024-04-19T02:21:32.418818+0000","last_active":"2024-04-19T02:21:32.418588+0000","last_peered":"2024-04-19T02:21:32.418588+0000","last_clean":"2024-04-19T02:21:32.418588+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:32.418588+0000","last_undegraded":"2024-04-19T02:21:32.418588+0000","last_fullsized":"2024-04-19T02:21:32.418588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'382","last_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_deep_scrub":"71'382","last_deep_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.418531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.300626+0000","scrub_duration":0.0048622070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1089,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.427431+0000","last_change":"2024-04-19T02:21:35.427651+0000","last_active":"2024-04-19T02:21:35.427431+0000","last_peered":"2024-04-19T02:21:35.427431+0000","last_clean":"2024-04-19T02:21:35.427431+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:35.427431+0000","last_undegraded":"2024-04-19T02:21:35.427431+0000","last_fullsized":"2024-04-19T02:21:35.427431+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.427379+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:58.566016+0000","scrub_duration":0.0038844489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":628,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.392107+0000","last_change":"2024-04-19T02:21:38.392319+0000","last_active":"2024-04-19T02:21:38.392107+0000","last_peered":"2024-04-19T02:21:38.392107+0000","last_clean":"2024-04-19T02:21:38.392107+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:38.392107+0000","last_undegraded":"2024-04-19T02:21:38.392107+0000","last_fullsized":"2024-04-19T02:21:38.392107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'460","last_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_deep_scrub":"71'460","last_deep_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.392049+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:54.270848+0000","scrub_duration":0.0042770439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":525,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344242+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:21.344242+0000","last_peered":"2024-04-19T02:21:21.344242+0000","last_clean":"2024-04-19T02:21:21.344242+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:21.344242+0000","last_undegraded":"2024-04-19T02:21:21.344242+0000","last_fullsized":"2024-04-19T02:21:21.344242+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":510,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:10.553978+0000","last_change":"2024-04-19T02:22:10.554193+0000","last_active":"2024-04-19T02:22:10.553978+0000","last_peered":"2024-04-19T02:22:10.553978+0000","last_clean":"2024-04-19T02:22:10.553978+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:22:10.553978+0000","last_undegraded":"2024-04-19T02:22:10.553978+0000","last_fullsized":"2024-04-19T02:22:10.553978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_clean_scrub_stamp":"2024-04-19T02:22:10.553922+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:39.845669+0000","scrub_duration":0.0045096329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"117'385","reported_seq":474,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:23.444030+0000","last_change":"2024-04-19T02:22:23.444279+0000","last_active":"2024-04-19T02:22:23.444030+0000","last_peered":"2024-04-19T02:22:23.444030+0000","last_clean":"2024-04-19T02:22:23.444030+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:22:23.444030+0000","last_undegraded":"2024-04-19T02:22:23.444030+0000","last_fullsized":"2024-04-19T02:22:23.444030+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'385","last_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_deep_scrub":"117'385","last_deep_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_clean_scrub_stamp":"2024-04-19T02:22:23.443970+0000","objects_scrubbed":4,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:42:37.382290+0000","scrub_duration":0.067762446000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.484417+0000","last_change":"2024-04-19T02:21:38.484643+0000","last_active":"2024-04-19T02:21:38.484417+0000","last_peered":"2024-04-19T02:21:38.484417+0000","last_clean":"2024-04-19T02:21:38.484417+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:38.484417+0000","last_undegraded":"2024-04-19T02:21:38.484417+0000","last_fullsized":"2024-04-19T02:21:38.484417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.484360+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:33.481985+0000","scrub_duration":0.0046311950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":200,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.350646+0000","last_change":"2024-04-19T02:22:27.350863+0000","last_active":"2024-04-19T02:22:27.350646+0000","last_peered":"2024-04-19T02:22:27.350646+0000","last_clean":"2024-04-19T02:22:27.350646+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:22:27.350646+0000","last_undegraded":"2024-04-19T02:22:27.350646+0000","last_fullsized":"2024-04-19T02:22:27.350646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.350592+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:53.591039+0000","scrub_duration":0.0034193769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1033,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:29.383247+0000","last_change":"2024-04-19T02:22:29.383500+0000","last_active":"2024-04-19T02:22:29.383247+0000","last_peered":"2024-04-19T02:22:29.383247+0000","last_clean":"2024-04-19T02:22:29.383247+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:22:29.383247+0000","last_undegraded":"2024-04-19T02:22:29.383247+0000","last_fullsized":"2024-04-19T02:22:29.383247+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_clean_scrub_stamp":"2024-04-19T02:22:29.383196+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:08.112873+0000","scrub_duration":0.0037375350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":195,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473754+0000","last_change":"2024-04-19T02:20:30.536763+0000","last_active":"2024-04-19T02:21:21.473754+0000","last_peered":"2024-04-19T02:21:21.473754+0000","last_clean":"2024-04-19T02:21:21.473754+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:21:21.473754+0000","last_undegraded":"2024-04-19T02:21:21.473754+0000","last_fullsized":"2024-04-19T02:21:21.473754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":911,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471155+0000","last_change":"2024-04-19T02:21:01.206349+0000","last_active":"2024-04-19T02:21:21.471155+0000","last_peered":"2024-04-19T02:21:21.471155+0000","last_clean":"2024-04-19T02:21:21.471155+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:21:21.471155+0000","last_undegraded":"2024-04-19T02:21:21.471155+0000","last_fullsized":"2024-04-19T02:21:21.471155+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":131,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344487+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:21.344487+0000","last_peered":"2024-04-19T02:21:21.344487+0000","last_clean":"2024-04-19T02:21:21.344487+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:21.344487+0000","last_undegraded":"2024-04-19T02:21:21.344487+0000","last_fullsized":"2024-04-19T02:21:21.344487+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"117'170","reported_seq":259,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:20.436135+0000","last_change":"2024-04-19T02:22:20.436373+0000","last_active":"2024-04-19T02:22:20.436135+0000","last_peered":"2024-04-19T02:22:20.436135+0000","last_clean":"2024-04-19T02:22:20.436135+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:22:20.436135+0000","last_undegraded":"2024-04-19T02:22:20.436135+0000","last_fullsized":"2024-04-19T02:22:20.436135+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'170","last_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_deep_scrub":"117'170","last_deep_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_clean_scrub_stamp":"2024-04-19T02:22:20.436079+0000","objects_scrubbed":2,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:49.310358+0000","scrub_duration":0.036011089000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":907,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.502979+0000","last_change":"2024-04-19T02:21:46.503221+0000","last_active":"2024-04-19T02:21:46.502979+0000","last_peered":"2024-04-19T02:21:46.502979+0000","last_clean":"2024-04-19T02:21:46.502979+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:46.502979+0000","last_undegraded":"2024-04-19T02:21:46.502979+0000","last_fullsized":"2024-04-19T02:21:46.502979+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.502927+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:48.122985+0000","scrub_duration":0.0039232249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":431,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475684+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:21.475684+0000","last_peered":"2024-04-19T02:21:21.475684+0000","last_clean":"2024-04-19T02:21:21.475684+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:21.475684+0000","last_undegraded":"2024-04-19T02:21:21.475684+0000","last_fullsized":"2024-04-19T02:21:21.475684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.534204+0000","last_change":"2024-04-19T02:21:52.534416+0000","last_active":"2024-04-19T02:21:52.534204+0000","last_peered":"2024-04-19T02:21:52.534204+0000","last_clean":"2024-04-19T02:21:52.534204+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:52.534204+0000","last_undegraded":"2024-04-19T02:21:52.534204+0000","last_fullsized":"2024-04-19T02:21:52.534204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'443","last_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_deep_scrub":"71'443","last_deep_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.534152+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:28.134492+0000","scrub_duration":0.0046536420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":675,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343667+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:21.343667+0000","last_peered":"2024-04-19T02:21:21.343667+0000","last_clean":"2024-04-19T02:21:21.343667+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:21.343667+0000","last_undegraded":"2024-04-19T02:21:21.343667+0000","last_fullsized":"2024-04-19T02:21:21.343667+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.572418+0000","last_change":"2024-04-19T02:21:31.572652+0000","last_active":"2024-04-19T02:21:31.572418+0000","last_peered":"2024-04-19T02:21:31.572418+0000","last_clean":"2024-04-19T02:21:31.572418+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:31.572418+0000","last_undegraded":"2024-04-19T02:21:31.572418+0000","last_fullsized":"2024-04-19T02:21:31.572418+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.572365+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:18.167461+0000","scrub_duration":0.0042499950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":122,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.322488+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:21.322488+0000","last_peered":"2024-04-19T02:21:21.322488+0000","last_clean":"2024-04-19T02:21:21.322488+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:21.322488+0000","last_undegraded":"2024-04-19T02:21:21.322488+0000","last_fullsized":"2024-04-19T02:21:21.322488+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1094,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:49.460647+0000","last_change":"2024-04-19T02:21:49.460884+0000","last_active":"2024-04-19T02:21:49.460647+0000","last_peered":"2024-04-19T02:21:49.460647+0000","last_clean":"2024-04-19T02:21:49.460647+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:49.460647+0000","last_undegraded":"2024-04-19T02:21:49.460647+0000","last_fullsized":"2024-04-19T02:21:49.460647+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'491","last_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_deep_scrub":"71'491","last_deep_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_clean_scrub_stamp":"2024-04-19T02:21:49.460592+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:18.752338+0000","scrub_duration":0.0043248339999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":271,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470483+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:21.470483+0000","last_peered":"2024-04-19T02:21:21.470483+0000","last_clean":"2024-04-19T02:21:21.470483+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:21.470483+0000","last_undegraded":"2024-04-19T02:21:21.470483+0000","last_fullsized":"2024-04-19T02:21:21.470483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":532,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342243+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:21.342243+0000","last_peered":"2024-04-19T02:21:21.342243+0000","last_clean":"2024-04-19T02:21:21.342243+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:21.342243+0000","last_undegraded":"2024-04-19T02:21:21.342243+0000","last_fullsized":"2024-04-19T02:21:21.342243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"117'208","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.448417+0000","last_change":"2024-04-19T02:21:45.448731+0000","last_active":"2024-04-19T02:21:45.448417+0000","last_peered":"2024-04-19T02:21:45.448417+0000","last_clean":"2024-04-19T02:21:45.448417+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:45.448417+0000","last_undegraded":"2024-04-19T02:21:45.448417+0000","last_fullsized":"2024-04-19T02:21:45.448417+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'208","last_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_deep_scrub":"117'208","last_deep_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.448363+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:14.018739+0000","scrub_duration":0.041956280999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":595,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.414005+0000","last_change":"2024-04-19T02:22:06.414317+0000","last_active":"2024-04-19T02:22:06.414005+0000","last_peered":"2024-04-19T02:22:06.414005+0000","last_clean":"2024-04-19T02:22:06.414005+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:22:06.414005+0000","last_undegraded":"2024-04-19T02:22:06.414005+0000","last_fullsized":"2024-04-19T02:22:06.414005+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'428","last_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_deep_scrub":"71'428","last_deep_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.413898+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:34.571146+0000","scrub_duration":0.0043639839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":179,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473928+0000","last_change":"2024-04-19T02:20:30.536764+0000","last_active":"2024-04-19T02:21:21.473928+0000","last_peered":"2024-04-19T02:21:21.473928+0000","last_clean":"2024-04-19T02:21:21.473928+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:21:21.473928+0000","last_undegraded":"2024-04-19T02:21:21.473928+0000","last_fullsized":"2024-04-19T02:21:21.473928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":451,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.323059+0000","last_change":"2024-04-19T02:21:21.319032+0000","last_active":"2024-04-19T02:21:21.323059+0000","last_peered":"2024-04-19T02:21:21.323059+0000","last_clean":"2024-04-19T02:21:21.323059+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:21:21.323059+0000","last_undegraded":"2024-04-19T02:21:21.323059+0000","last_fullsized":"2024-04-19T02:21:21.323059+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473380+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:21.473380+0000","last_peered":"2024-04-19T02:21:21.473380+0000","last_clean":"2024-04-19T02:21:21.473380+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:21.473380+0000","last_undegraded":"2024-04-19T02:21:21.473380+0000","last_fullsized":"2024-04-19T02:21:21.473380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.216164+0000","last_change":"2024-04-19T02:22:06.216395+0000","last_active":"2024-04-19T02:22:06.216164+0000","last_peered":"2024-04-19T02:22:06.216164+0000","last_clean":"2024-04-19T02:22:06.216164+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:22:06.216164+0000","last_undegraded":"2024-04-19T02:22:06.216164+0000","last_fullsized":"2024-04-19T02:22:06.216164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'395","last_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_deep_scrub":"71'395","last_deep_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.216111+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:41.161541+0000","scrub_duration":0.0046009639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":217,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.144629+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:31.144629+0000","last_peered":"2024-04-19T02:21:31.144629+0000","last_clean":"2024-04-19T02:21:31.144629+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:31.144629+0000","last_undegraded":"2024-04-19T02:21:31.144629+0000","last_fullsized":"2024-04-19T02:21:31.144629+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343474+0000","last_change":"2024-04-19T02:21:21.334723+0000","last_active":"2024-04-19T02:21:21.343474+0000","last_peered":"2024-04-19T02:21:21.343474+0000","last_clean":"2024-04-19T02:21:21.343474+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:21:21.343474+0000","last_undegraded":"2024-04-19T02:21:21.343474+0000","last_fullsized":"2024-04-19T02:21:21.343474+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":874,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470012+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:21.470012+0000","last_peered":"2024-04-19T02:21:21.470012+0000","last_clean":"2024-04-19T02:21:21.470012+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:21.470012+0000","last_undegraded":"2024-04-19T02:21:21.470012+0000","last_fullsized":"2024-04-19T02:21:21.470012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":569,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348015+0000","last_change":"2024-04-19T02:21:21.346189+0000","last_active":"2024-04-19T02:21:21.348015+0000","last_peered":"2024-04-19T02:21:21.348015+0000","last_clean":"2024-04-19T02:21:21.348015+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:21:21.348015+0000","last_undegraded":"2024-04-19T02:21:21.348015+0000","last_fullsized":"2024-04-19T02:21:21.348015+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.144750+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:31.144750+0000","last_peered":"2024-04-19T02:21:31.144750+0000","last_clean":"2024-04-19T02:21:31.144750+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:31.144750+0000","last_undegraded":"2024-04-19T02:21:31.144750+0000","last_fullsized":"2024-04-19T02:21:31.144750+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"72'114","reported_seq":311,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469426+0000","last_change":"2024-04-19T02:20:36.196892+0000","last_active":"2024-04-19T02:21:21.469426+0000","last_peered":"2024-04-19T02:21:21.469426+0000","last_clean":"2024-04-19T02:21:21.469426+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:21:21.469426+0000","last_undegraded":"2024-04-19T02:21:21.469426+0000","last_fullsized":"2024-04-19T02:21:21.469426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.500697+0000","last_change":"2024-04-19T02:21:50.500920+0000","last_active":"2024-04-19T02:21:50.500697+0000","last_peered":"2024-04-19T02:21:50.500697+0000","last_clean":"2024-04-19T02:21:50.500697+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:50.500697+0000","last_undegraded":"2024-04-19T02:21:50.500697+0000","last_fullsized":"2024-04-19T02:21:50.500697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.500643+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:19:06.685542+0000","scrub_duration":0.0044626199999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469819+0000","last_change":"2024-04-19T02:16:20.087249+0000","last_active":"2024-04-19T02:21:21.469819+0000","last_peered":"2024-04-19T02:21:21.469819+0000","last_clean":"2024-04-19T02:21:21.469819+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:21:21.469819+0000","last_undegraded":"2024-04-19T02:21:21.469819+0000","last_fullsized":"2024-04-19T02:21:21.469819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'385","reported_seq":525,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.883788+0000","last_change":"2024-04-19T02:20:34.186887+0000","last_active":"2024-04-19T02:21:30.883788+0000","last_peered":"2024-04-19T02:21:30.883788+0000","last_clean":"2024-04-19T02:21:30.883788+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:21:30.883788+0000","last_undegraded":"2024-04-19T02:21:30.883788+0000","last_fullsized":"2024-04-19T02:21:30.883788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":480,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.417845+0000","last_change":"2024-04-19T02:21:47.418067+0000","last_active":"2024-04-19T02:21:47.417845+0000","last_peered":"2024-04-19T02:21:47.417845+0000","last_clean":"2024-04-19T02:21:47.417845+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:47.417845+0000","last_undegraded":"2024-04-19T02:21:47.417845+0000","last_fullsized":"2024-04-19T02:21:47.417845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'345","last_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_deep_scrub":"71'345","last_deep_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.417790+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:30.129614+0000","scrub_duration":0.0046618750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.409872+0000","last_change":"2024-04-19T02:22:08.410078+0000","last_active":"2024-04-19T02:22:08.409872+0000","last_peered":"2024-04-19T02:22:08.409872+0000","last_clean":"2024-04-19T02:22:08.409872+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:22:08.409872+0000","last_undegraded":"2024-04-19T02:22:08.409872+0000","last_fullsized":"2024-04-19T02:22:08.409872+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.409824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:12.416405+0000","scrub_duration":0.0032298549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":148,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.379540+0000","last_change":"2024-04-19T02:21:54.379775+0000","last_active":"2024-04-19T02:21:54.379540+0000","last_peered":"2024-04-19T02:21:54.379540+0000","last_clean":"2024-04-19T02:21:54.379540+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:54.379540+0000","last_undegraded":"2024-04-19T02:21:54.379540+0000","last_fullsized":"2024-04-19T02:21:54.379540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.379480+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:14.495728+0000","scrub_duration":0.0033461229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.419495+0000","last_change":"2024-04-19T02:21:40.419740+0000","last_active":"2024-04-19T02:21:40.419495+0000","last_peered":"2024-04-19T02:21:40.419495+0000","last_clean":"2024-04-19T02:21:40.419495+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:40.419495+0000","last_undegraded":"2024-04-19T02:21:40.419495+0000","last_fullsized":"2024-04-19T02:21:40.419495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'403","last_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_deep_scrub":"71'403","last_deep_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.419437+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:29.109984+0000","scrub_duration":0.0046038880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":530,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343592+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.343592+0000","last_peered":"2024-04-19T02:21:21.343592+0000","last_clean":"2024-04-19T02:21:21.343592+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.343592+0000","last_undegraded":"2024-04-19T02:21:21.343592+0000","last_fullsized":"2024-04-19T02:21:21.343592+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470603+0000","last_change":"2024-04-19T02:16:20.087219+0000","last_active":"2024-04-19T02:21:21.470603+0000","last_peered":"2024-04-19T02:21:21.470603+0000","last_clean":"2024-04-19T02:21:21.470603+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:21:21.470603+0000","last_undegraded":"2024-04-19T02:21:21.470603+0000","last_fullsized":"2024-04-19T02:21:21.470603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":869,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:01.585893+0000","last_change":"2024-04-19T02:22:01.586120+0000","last_active":"2024-04-19T02:22:01.585893+0000","last_peered":"2024-04-19T02:22:01.585893+0000","last_clean":"2024-04-19T02:22:01.585893+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:22:01.585893+0000","last_undegraded":"2024-04-19T02:22:01.585893+0000","last_fullsized":"2024-04-19T02:22:01.585893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'383","last_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_deep_scrub":"71'383","last_deep_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_clean_scrub_stamp":"2024-04-19T02:22:01.585841+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:50.276388+0000","scrub_duration":0.0039878709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":168,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470522+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:21.470522+0000","last_peered":"2024-04-19T02:21:21.470522+0000","last_clean":"2024-04-19T02:21:21.470522+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:21.470522+0000","last_undegraded":"2024-04-19T02:21:21.470522+0000","last_fullsized":"2024-04-19T02:21:21.470522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475910+0000","last_change":"2024-04-19T02:16:20.082749+0000","last_active":"2024-04-19T02:21:21.475910+0000","last_peered":"2024-04-19T02:21:21.475910+0000","last_clean":"2024-04-19T02:21:21.475910+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:21:21.475910+0000","last_undegraded":"2024-04-19T02:21:21.475910+0000","last_fullsized":"2024-04-19T02:21:21.475910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":986,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:53.548468+0000","last_change":"2024-04-19T02:21:53.548677+0000","last_active":"2024-04-19T02:21:53.548468+0000","last_peered":"2024-04-19T02:21:53.548468+0000","last_clean":"2024-04-19T02:21:53.548468+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:53.548468+0000","last_undegraded":"2024-04-19T02:21:53.548468+0000","last_fullsized":"2024-04-19T02:21:53.548468+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_clean_scrub_stamp":"2024-04-19T02:21:53.548415+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:32.430509+0000","scrub_duration":0.003797426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":178,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.472059+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:21.472059+0000","last_peered":"2024-04-19T02:21:21.472059+0000","last_clean":"2024-04-19T02:21:21.472059+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:21.472059+0000","last_undegraded":"2024-04-19T02:21:21.472059+0000","last_fullsized":"2024-04-19T02:21:21.472059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471573+0000","last_change":"2024-04-19T02:16:20.087073+0000","last_active":"2024-04-19T02:21:21.471573+0000","last_peered":"2024-04-19T02:21:21.471573+0000","last_clean":"2024-04-19T02:21:21.471573+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:21:21.471573+0000","last_undegraded":"2024-04-19T02:21:21.471573+0000","last_fullsized":"2024-04-19T02:21:21.471573+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":964,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:51.372189+0000","last_change":"2024-04-19T02:21:51.372189+0000","last_active":"2024-04-19T02:21:51.372189+0000","last_peered":"2024-04-19T02:21:51.372189+0000","last_clean":"2024-04-19T02:21:51.372189+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:51.372189+0000","last_undegraded":"2024-04-19T02:21:51.372189+0000","last_fullsized":"2024-04-19T02:21:51.372189+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_clean_scrub_stamp":"2024-04-19T02:21:51.371896+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.379349+0000","scrub_duration":0.0039386960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'75","reported_seq":205,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471534+0000","last_change":"2024-04-19T02:20:30.559726+0000","last_active":"2024-04-19T02:21:21.471534+0000","last_peered":"2024-04-19T02:21:21.471534+0000","last_clean":"2024-04-19T02:21:21.471534+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:21:21.471534+0000","last_undegraded":"2024-04-19T02:21:21.471534+0000","last_fullsized":"2024-04-19T02:21:21.471534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.382614+0000","last_change":"2024-04-19T02:21:47.382834+0000","last_active":"2024-04-19T02:21:47.382614+0000","last_peered":"2024-04-19T02:21:47.382614+0000","last_clean":"2024-04-19T02:21:47.382614+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:47.382614+0000","last_undegraded":"2024-04-19T02:21:47.382614+0000","last_fullsized":"2024-04-19T02:21:47.382614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.382567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:21.368852+0000","scrub_duration":0.0033623530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763606+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:31.763606+0000","last_peered":"2024-04-19T02:21:31.763606+0000","last_clean":"2024-04-19T02:21:31.763606+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:31.763606+0000","last_undegraded":"2024-04-19T02:21:31.763606+0000","last_fullsized":"2024-04-19T02:21:31.763606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":502,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.345073+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:21.345073+0000","last_peered":"2024-04-19T02:21:21.345073+0000","last_clean":"2024-04-19T02:21:21.345073+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:21.345073+0000","last_undegraded":"2024-04-19T02:21:21.345073+0000","last_fullsized":"2024-04-19T02:21:21.345073+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"73'447","reported_seq":533,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.344342+0000","last_change":"2024-04-19T02:21:21.342574+0000","last_active":"2024-04-19T02:21:21.344342+0000","last_peered":"2024-04-19T02:21:21.344342+0000","last_clean":"2024-04-19T02:21:21.344342+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:21:21.344342+0000","last_undegraded":"2024-04-19T02:21:21.344342+0000","last_fullsized":"2024-04-19T02:21:21.344342+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":567,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:14.293529+0000","last_change":"2024-04-19T02:22:14.293826+0000","last_active":"2024-04-19T02:22:14.293529+0000","last_peered":"2024-04-19T02:22:14.293529+0000","last_clean":"2024-04-19T02:22:14.293529+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:22:14.293529+0000","last_undegraded":"2024-04-19T02:22:14.293529+0000","last_fullsized":"2024-04-19T02:22:14.293529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'407","last_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_deep_scrub":"71'407","last_deep_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_clean_scrub_stamp":"2024-04-19T02:22:14.293476+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:01:56.491750+0000","scrub_duration":0.0053162419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'86","reported_seq":217,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475613+0000","last_change":"2024-04-19T02:20:30.845177+0000","last_active":"2024-04-19T02:21:21.475613+0000","last_peered":"2024-04-19T02:21:21.475613+0000","last_clean":"2024-04-19T02:21:21.475613+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:21:21.475613+0000","last_undegraded":"2024-04-19T02:21:21.475613+0000","last_fullsized":"2024-04-19T02:21:21.475613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"117'325","reported_seq":405,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.418193+0000","last_change":"2024-04-19T02:21:46.418450+0000","last_active":"2024-04-19T02:21:46.418193+0000","last_peered":"2024-04-19T02:21:46.418193+0000","last_clean":"2024-04-19T02:21:46.418193+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:46.418193+0000","last_undegraded":"2024-04-19T02:21:46.418193+0000","last_fullsized":"2024-04-19T02:21:46.418193+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'325","last_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_deep_scrub":"117'325","last_deep_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.418135+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:23.243009+0000","scrub_duration":0.037437605999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1031,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:25.306188+0000","last_change":"2024-04-19T02:22:25.306412+0000","last_active":"2024-04-19T02:22:25.306188+0000","last_peered":"2024-04-19T02:22:25.306188+0000","last_clean":"2024-04-19T02:22:25.306188+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:22:25.306188+0000","last_undegraded":"2024-04-19T02:22:25.306188+0000","last_fullsized":"2024-04-19T02:22:25.306188+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'441","last_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_deep_scrub":"71'441","last_deep_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_clean_scrub_stamp":"2024-04-19T02:22:25.306128+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:33.739156+0000","scrub_duration":0.0038746840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:21.140582+0000","last_change":"2024-04-19T02:22:21.140820+0000","last_active":"2024-04-19T02:22:21.140582+0000","last_peered":"2024-04-19T02:22:21.140582+0000","last_clean":"2024-04-19T02:22:21.140582+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:22:21.140582+0000","last_undegraded":"2024-04-19T02:22:21.140582+0000","last_fullsized":"2024-04-19T02:22:21.140582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'54","last_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_deep_scrub":"71'54","last_deep_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_clean_scrub_stamp":"2024-04-19T02:22:21.140527+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:01.892166+0000","scrub_duration":0.0033383610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":641,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.239538+0000","last_change":"2024-04-19T02:22:08.239786+0000","last_active":"2024-04-19T02:22:08.239538+0000","last_peered":"2024-04-19T02:22:08.239538+0000","last_clean":"2024-04-19T02:22:08.239538+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:22:08.239538+0000","last_undegraded":"2024-04-19T02:22:08.239538+0000","last_fullsized":"2024-04-19T02:22:08.239538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'459","last_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_deep_scrub":"71'459","last_deep_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.239485+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:14.140941+0000","scrub_duration":0.004519805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":930,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.477588+0000","last_change":"2024-04-19T02:21:36.477808+0000","last_active":"2024-04-19T02:21:36.477588+0000","last_peered":"2024-04-19T02:21:36.477588+0000","last_clean":"2024-04-19T02:21:36.477588+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:36.477588+0000","last_undegraded":"2024-04-19T02:21:36.477588+0000","last_fullsized":"2024-04-19T02:21:36.477588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.477536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:19.549278+0000","scrub_duration":0.0037289060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":684,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469346+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:21.469346+0000","last_peered":"2024-04-19T02:21:21.469346+0000","last_clean":"2024-04-19T02:21:21.469346+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:21.469346+0000","last_undegraded":"2024-04-19T02:21:21.469346+0000","last_fullsized":"2024-04-19T02:21:21.469346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":945,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763822+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:31.763822+0000","last_peered":"2024-04-19T02:21:31.763822+0000","last_clean":"2024-04-19T02:21:31.763822+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:31.763822+0000","last_undegraded":"2024-04-19T02:21:31.763822+0000","last_fullsized":"2024-04-19T02:21:31.763822+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'326","reported_seq":462,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469168+0000","last_change":"2024-04-19T02:20:36.195547+0000","last_active":"2024-04-19T02:21:21.469168+0000","last_peered":"2024-04-19T02:21:21.469168+0000","last_clean":"2024-04-19T02:21:21.469168+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:21:21.469168+0000","last_undegraded":"2024-04-19T02:21:21.469168+0000","last_fullsized":"2024-04-19T02:21:21.469168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":862,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443364+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:24.443364+0000","last_peered":"2024-04-19T02:21:24.443364+0000","last_clean":"2024-04-19T02:21:24.443364+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:24.443364+0000","last_undegraded":"2024-04-19T02:21:24.443364+0000","last_fullsized":"2024-04-19T02:21:24.443364+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":609,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474594+0000","last_change":"2024-04-19T02:16:24.131727+0000","last_active":"2024-04-19T02:21:21.474594+0000","last_peered":"2024-04-19T02:21:21.474594+0000","last_clean":"2024-04-19T02:21:21.474594+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:21:21.474594+0000","last_undegraded":"2024-04-19T02:21:21.474594+0000","last_fullsized":"2024-04-19T02:21:21.474594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:42.467422+0000","last_change":"2024-04-19T02:21:42.467663+0000","last_active":"2024-04-19T02:21:42.467422+0000","last_peered":"2024-04-19T02:21:42.467422+0000","last_clean":"2024-04-19T02:21:42.467422+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:42.467422+0000","last_undegraded":"2024-04-19T02:21:42.467422+0000","last_fullsized":"2024-04-19T02:21:42.467422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:42.467368+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:21.867316+0000","scrub_duration":0.0048531720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":189,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443272+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:24.443272+0000","last_peered":"2024-04-19T02:21:24.443272+0000","last_clean":"2024-04-19T02:21:24.443272+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:24.443272+0000","last_undegraded":"2024-04-19T02:21:24.443272+0000","last_fullsized":"2024-04-19T02:21:24.443272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":478,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.431655+0000","last_change":"2024-04-19T02:21:40.431879+0000","last_active":"2024-04-19T02:21:40.431655+0000","last_peered":"2024-04-19T02:21:40.431655+0000","last_clean":"2024-04-19T02:21:40.431655+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:40.431655+0000","last_undegraded":"2024-04-19T02:21:40.431655+0000","last_fullsized":"2024-04-19T02:21:40.431655+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.431601+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:34.613519+0000","scrub_duration":0.0040029599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":404,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342300+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.342300+0000","last_peered":"2024-04-19T02:21:21.342300+0000","last_clean":"2024-04-19T02:21:21.342300+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.342300+0000","last_undegraded":"2024-04-19T02:21:21.342300+0000","last_fullsized":"2024-04-19T02:21:21.342300+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:22.373712+0000","last_change":"2024-04-19T02:22:22.373931+0000","last_active":"2024-04-19T02:22:22.373712+0000","last_peered":"2024-04-19T02:22:22.373712+0000","last_clean":"2024-04-19T02:22:22.373712+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:22:22.373712+0000","last_undegraded":"2024-04-19T02:22:22.373712+0000","last_fullsized":"2024-04-19T02:22:22.373712+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_clean_scrub_stamp":"2024-04-19T02:22:22.373659+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:42.141017+0000","scrub_duration":0.004280603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"117'371","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.613687+0000","last_change":"2024-04-19T02:22:27.613926+0000","last_active":"2024-04-19T02:22:27.613687+0000","last_peered":"2024-04-19T02:22:27.613687+0000","last_clean":"2024-04-19T02:22:27.613687+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:22:27.613687+0000","last_undegraded":"2024-04-19T02:22:27.613687+0000","last_fullsized":"2024-04-19T02:22:27.613687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'371","last_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_deep_scrub":"117'371","last_deep_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.613626+0000","objects_scrubbed":4,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:02.559056+0000","scrub_duration":0.093301011000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":634,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474035+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:21.474035+0000","last_peered":"2024-04-19T02:21:21.474035+0000","last_clean":"2024-04-19T02:21:21.474035+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:21.474035+0000","last_undegraded":"2024-04-19T02:21:21.474035+0000","last_fullsized":"2024-04-19T02:21:21.474035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"117'69","reported_seq":193,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.346715+0000","last_change":"2024-04-19T02:22:12.346715+0000","last_active":"2024-04-19T02:22:12.346715+0000","last_peered":"2024-04-19T02:22:12.346715+0000","last_clean":"2024-04-19T02:22:12.346715+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:22:12.346715+0000","last_undegraded":"2024-04-19T02:22:12.346715+0000","last_fullsized":"2024-04-19T02:22:12.346715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'69","last_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_deep_scrub":"117'69","last_deep_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.346440+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:18.563061+0000","scrub_duration":0.030517280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341348+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.341348+0000","last_peered":"2024-04-19T02:21:21.341348+0000","last_clean":"2024-04-19T02:21:21.341348+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.341348+0000","last_undegraded":"2024-04-19T02:21:21.341348+0000","last_fullsized":"2024-04-19T02:21:21.341348+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"117'55","reported_seq":196,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:07.253532+0000","last_change":"2024-04-19T02:22:07.253769+0000","last_active":"2024-04-19T02:22:07.253532+0000","last_peered":"2024-04-19T02:22:07.253532+0000","last_clean":"2024-04-19T02:22:07.253532+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:22:07.253532+0000","last_undegraded":"2024-04-19T02:22:07.253532+0000","last_fullsized":"2024-04-19T02:22:07.253532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'55","last_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_deep_scrub":"117'55","last_deep_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_clean_scrub_stamp":"2024-04-19T02:22:07.253481+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:15.508809+0000","scrub_duration":0.035080496000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7648,"ondisk_log_size":7648,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738449,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126648,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245192,"statfs":{"total":96636764160,"available":96507076608,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:22:27 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.65900000000000003},"min":{"1min":0.50700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76100000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71299999999999997,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Apr 19 02:21:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72899999999999998}]}]},{"osd":1,"up_from":78,"seq":335007449114,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66120,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305720,"statfs":{"total":96636764160,"available":96569057280,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.5},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55900000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139604,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232236,"statfs":{"total":96636764160,"available":96493809664,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:21:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Apr 19 02:22:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.59199999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.73099999999999998,"5min":0.81399999999999995,"15min":0.91900000000000004},"last":0.624},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.624,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77100000000000002,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:22:33.152 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.153 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.153 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.153 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.153 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.153 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.154 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.155 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.155 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.155 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.155 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.156 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.156 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.156 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.156 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.156 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.156 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.156 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:16:14.984576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.157 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.158 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.159 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.160 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.160 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.160 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.160 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.160 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.161 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.161 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.161 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:33.161 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:22:53.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:22:53.475 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:22:53.478 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:22:53.491 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-04-19T02:22:52.340196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34455,"ondisk_log_size":34455,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332372,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783148,"statfs":{"total":289910292480,"available":289569943552,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004356"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":569,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.884920+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:30.884920+0000","last_peered":"2024-04-19T02:21:30.884920+0000","last_clean":"2024-04-19T02:21:30.884920+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:30.884920+0000","last_undegraded":"2024-04-19T02:21:30.884920+0000","last_fullsized":"2024-04-19T02:21:30.884920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":595,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.885003+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:30.885003+0000","last_peered":"2024-04-19T02:21:30.885003+0000","last_clean":"2024-04-19T02:21:30.885003+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:30.885003+0000","last_undegraded":"2024-04-19T02:21:30.885003+0000","last_fullsized":"2024-04-19T02:21:30.885003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":485,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145877+0000","last_change":"2024-04-19T02:21:21.343830+0000","last_active":"2024-04-19T02:21:31.145877+0000","last_peered":"2024-04-19T02:21:31.145877+0000","last_clean":"2024-04-19T02:21:31.145877+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:21:31.145877+0000","last_undegraded":"2024-04-19T02:21:31.145877+0000","last_fullsized":"2024-04-19T02:21:31.145877+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":478,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:38.327119+0000","last_change":"2024-04-19T02:22:38.327334+0000","last_active":"2024-04-19T02:22:38.327119+0000","last_peered":"2024-04-19T02:22:38.327119+0000","last_clean":"2024-04-19T02:22:38.327119+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:22:38.327119+0000","last_undegraded":"2024-04-19T02:22:38.327119+0000","last_fullsized":"2024-04-19T02:22:38.327119+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'387","last_scrub_stamp":"2024-04-19T02:22:38.327067+0000","last_deep_scrub":"71'387","last_deep_scrub_stamp":"2024-04-19T02:22:38.327067+0000","last_clean_scrub_stamp":"2024-04-19T02:22:38.327067+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:01:33.906804+0000","scrub_duration":0.0041694389999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443245+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:24.443245+0000","last_peered":"2024-04-19T02:21:24.443245+0000","last_clean":"2024-04-19T02:21:24.443245+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:24.443245+0000","last_undegraded":"2024-04-19T02:21:24.443245+0000","last_fullsized":"2024-04-19T02:21:24.443245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":536,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.348874+0000","last_change":"2024-04-19T02:21:21.348147+0000","last_active":"2024-04-19T02:21:21.348874+0000","last_peered":"2024-04-19T02:21:21.348874+0000","last_clean":"2024-04-19T02:21:21.348874+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:21:21.348874+0000","last_undegraded":"2024-04-19T02:21:21.348874+0000","last_fullsized":"2024-04-19T02:21:21.348874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":519,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.330614+0000","last_change":"2024-04-19T02:21:21.311849+0000","last_active":"2024-04-19T02:21:21.330614+0000","last_peered":"2024-04-19T02:21:21.330614+0000","last_clean":"2024-04-19T02:21:21.330614+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:21:21.330614+0000","last_undegraded":"2024-04-19T02:21:21.330614+0000","last_fullsized":"2024-04-19T02:21:21.330614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":594,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.358188+0000","last_change":"2024-04-19T02:21:50.358451+0000","last_active":"2024-04-19T02:21:50.358188+0000","last_peered":"2024-04-19T02:21:50.358188+0000","last_clean":"2024-04-19T02:21:50.358188+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:50.358188+0000","last_undegraded":"2024-04-19T02:21:50.358188+0000","last_fullsized":"2024-04-19T02:21:50.358188+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.358123+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:30.347256+0000","scrub_duration":0.0040337430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":564,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471113+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:21.471113+0000","last_peered":"2024-04-19T02:21:21.471113+0000","last_clean":"2024-04-19T02:21:21.471113+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:21.471113+0000","last_undegraded":"2024-04-19T02:21:21.471113+0000","last_fullsized":"2024-04-19T02:21:21.471113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475297+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:21.475297+0000","last_peered":"2024-04-19T02:21:21.475297+0000","last_clean":"2024-04-19T02:21:21.475297+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:21.475297+0000","last_undegraded":"2024-04-19T02:21:21.475297+0000","last_fullsized":"2024-04-19T02:21:21.475297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":469,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.464992+0000","last_change":"2024-04-19T02:21:34.465225+0000","last_active":"2024-04-19T02:21:34.464992+0000","last_peered":"2024-04-19T02:21:34.464992+0000","last_clean":"2024-04-19T02:21:34.464992+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:34.464992+0000","last_undegraded":"2024-04-19T02:21:34.464992+0000","last_fullsized":"2024-04-19T02:21:34.464992+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.464937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:54.461710+0000","scrub_duration":0.004016393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":912,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474499+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:21.474499+0000","last_peered":"2024-04-19T02:21:21.474499+0000","last_clean":"2024-04-19T02:21:21.474499+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:21.474499+0000","last_undegraded":"2024-04-19T02:21:21.474499+0000","last_fullsized":"2024-04-19T02:21:21.474499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":539,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473843+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:21.473843+0000","last_peered":"2024-04-19T02:21:21.473843+0000","last_clean":"2024-04-19T02:21:21.473843+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:21.473843+0000","last_undegraded":"2024-04-19T02:21:21.473843+0000","last_fullsized":"2024-04-19T02:21:21.473843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":509,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145715+0000","last_change":"2024-04-19T02:21:21.341036+0000","last_active":"2024-04-19T02:21:31.145715+0000","last_peered":"2024-04-19T02:21:31.145715+0000","last_clean":"2024-04-19T02:21:31.145715+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:21:31.145715+0000","last_undegraded":"2024-04-19T02:21:31.145715+0000","last_fullsized":"2024-04-19T02:21:31.145715+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145575+0000","last_change":"2024-04-19T02:21:21.330764+0000","last_active":"2024-04-19T02:21:31.145575+0000","last_peered":"2024-04-19T02:21:31.145575+0000","last_clean":"2024-04-19T02:21:31.145575+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:21:31.145575+0000","last_undegraded":"2024-04-19T02:21:31.145575+0000","last_fullsized":"2024-04-19T02:21:31.145575+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":578,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145563+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:31.145563+0000","last_peered":"2024-04-19T02:21:31.145563+0000","last_clean":"2024-04-19T02:21:31.145563+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:31.145563+0000","last_undegraded":"2024-04-19T02:21:31.145563+0000","last_fullsized":"2024-04-19T02:21:31.145563+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471892+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:21.471892+0000","last_peered":"2024-04-19T02:21:21.471892+0000","last_clean":"2024-04-19T02:21:21.471892+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:21.471892+0000","last_undegraded":"2024-04-19T02:21:21.471892+0000","last_fullsized":"2024-04-19T02:21:21.471892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.467028+0000","last_change":"2024-04-19T02:21:33.467243+0000","last_active":"2024-04-19T02:21:33.467028+0000","last_peered":"2024-04-19T02:21:33.467028+0000","last_clean":"2024-04-19T02:21:33.467028+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:33.467028+0000","last_undegraded":"2024-04-19T02:21:33.467028+0000","last_fullsized":"2024-04-19T02:21:33.467028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.466973+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:47.589455+0000","scrub_duration":0.0049157790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":650,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470162+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:21.470162+0000","last_peered":"2024-04-19T02:21:21.470162+0000","last_clean":"2024-04-19T02:21:21.470162+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:21.470162+0000","last_undegraded":"2024-04-19T02:21:21.470162+0000","last_fullsized":"2024-04-19T02:21:21.470162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:42.243437+0000","last_change":"2024-04-19T02:22:42.243437+0000","last_active":"2024-04-19T02:22:42.243437+0000","last_peered":"2024-04-19T02:22:42.243437+0000","last_clean":"2024-04-19T02:22:42.243437+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:22:42.243437+0000","last_undegraded":"2024-04-19T02:22:42.243437+0000","last_fullsized":"2024-04-19T02:22:42.243437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-19T02:22:42.243127+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-19T02:22:42.243127+0000","last_clean_scrub_stamp":"2024-04-19T02:22:42.243127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:59.449065+0000","scrub_duration":0.0042836250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":557,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.476717+0000","last_change":"2024-04-19T02:21:41.476717+0000","last_active":"2024-04-19T02:21:41.476717+0000","last_peered":"2024-04-19T02:21:41.476717+0000","last_clean":"2024-04-19T02:21:41.476717+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:41.476717+0000","last_undegraded":"2024-04-19T02:21:41.476717+0000","last_fullsized":"2024-04-19T02:21:41.476717+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.476396+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:05:52.160962+0000","scrub_duration":0.0037331780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1134,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.591818+0000","last_change":"2024-04-19T02:22:12.592031+0000","last_active":"2024-04-19T02:22:12.591818+0000","last_peered":"2024-04-19T02:22:12.591818+0000","last_clean":"2024-04-19T02:22:12.591818+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:22:12.591818+0000","last_undegraded":"2024-04-19T02:22:12.591818+0000","last_fullsized":"2024-04-19T02:22:12.591818+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'464","last_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_deep_scrub":"71'464","last_deep_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.591764+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:14.599217+0000","scrub_duration":0.0039062849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":901,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.468624+0000","last_change":"2024-04-19T02:20:38.183942+0000","last_active":"2024-04-19T02:21:21.468624+0000","last_peered":"2024-04-19T02:21:21.468624+0000","last_clean":"2024-04-19T02:21:21.468624+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:21:21.468624+0000","last_undegraded":"2024-04-19T02:21:21.468624+0000","last_fullsized":"2024-04-19T02:21:21.468624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.568397+0000","last_change":"2024-04-19T02:22:08.568618+0000","last_active":"2024-04-19T02:22:08.568397+0000","last_peered":"2024-04-19T02:22:08.568397+0000","last_clean":"2024-04-19T02:22:08.568397+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:22:08.568397+0000","last_undegraded":"2024-04-19T02:22:08.568397+0000","last_fullsized":"2024-04-19T02:22:08.568397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.568338+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:51.280163+0000","scrub_duration":0.0042660390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":962,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:59.650243+0000","last_change":"2024-04-19T02:21:59.650456+0000","last_active":"2024-04-19T02:21:59.650243+0000","last_peered":"2024-04-19T02:21:59.650243+0000","last_clean":"2024-04-19T02:21:59.650243+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:59.650243+0000","last_undegraded":"2024-04-19T02:21:59.650243+0000","last_fullsized":"2024-04-19T02:21:59.650243+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_clean_scrub_stamp":"2024-04-19T02:21:59.650190+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:15.528989+0000","scrub_duration":0.0039580250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1175,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471138+0000","last_change":"2024-04-19T02:20:51.204463+0000","last_active":"2024-04-19T02:21:21.471138+0000","last_peered":"2024-04-19T02:21:21.471138+0000","last_clean":"2024-04-19T02:21:21.471138+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:21:21.471138+0000","last_undegraded":"2024-04-19T02:21:21.471138+0000","last_fullsized":"2024-04-19T02:21:21.471138+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.413150+0000","last_change":"2024-04-19T02:21:39.413150+0000","last_active":"2024-04-19T02:21:39.413150+0000","last_peered":"2024-04-19T02:21:39.413150+0000","last_clean":"2024-04-19T02:21:39.413150+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:39.413150+0000","last_undegraded":"2024-04-19T02:21:39.413150+0000","last_fullsized":"2024-04-19T02:21:39.413150+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.412846+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:49.572797+0000","scrub_duration":0.0040928559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":828,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:28.539844+0000","last_change":"2024-04-19T02:22:28.540096+0000","last_active":"2024-04-19T02:22:28.539844+0000","last_peered":"2024-04-19T02:22:28.539844+0000","last_clean":"2024-04-19T02:22:28.539844+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:22:28.539844+0000","last_undegraded":"2024-04-19T02:22:28.539844+0000","last_fullsized":"2024-04-19T02:22:28.539844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_clean_scrub_stamp":"2024-04-19T02:22:28.539790+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:36.795119+0000","scrub_duration":0.0039321119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":552,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.418818+0000","last_change":"2024-04-19T02:21:32.418818+0000","last_active":"2024-04-19T02:21:32.418818+0000","last_peered":"2024-04-19T02:21:32.418818+0000","last_clean":"2024-04-19T02:21:32.418818+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:32.418818+0000","last_undegraded":"2024-04-19T02:21:32.418818+0000","last_fullsized":"2024-04-19T02:21:32.418818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'382","last_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_deep_scrub":"71'382","last_deep_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.418531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.300626+0000","scrub_duration":0.0048622070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1090,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.427651+0000","last_change":"2024-04-19T02:21:35.427651+0000","last_active":"2024-04-19T02:21:35.427651+0000","last_peered":"2024-04-19T02:21:35.427651+0000","last_clean":"2024-04-19T02:21:35.427651+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:35.427651+0000","last_undegraded":"2024-04-19T02:21:35.427651+0000","last_fullsized":"2024-04-19T02:21:35.427651+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.427379+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:58.566016+0000","scrub_duration":0.0038844489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":629,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.392319+0000","last_change":"2024-04-19T02:21:38.392319+0000","last_active":"2024-04-19T02:21:38.392319+0000","last_peered":"2024-04-19T02:21:38.392319+0000","last_clean":"2024-04-19T02:21:38.392319+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:38.392319+0000","last_undegraded":"2024-04-19T02:21:38.392319+0000","last_fullsized":"2024-04-19T02:21:38.392319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'460","last_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_deep_scrub":"71'460","last_deep_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.392049+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:54.270848+0000","scrub_duration":0.0042770439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":526,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145612+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:31.145612+0000","last_peered":"2024-04-19T02:21:31.145612+0000","last_clean":"2024-04-19T02:21:31.145612+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:31.145612+0000","last_undegraded":"2024-04-19T02:21:31.145612+0000","last_fullsized":"2024-04-19T02:21:31.145612+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":510,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:10.553978+0000","last_change":"2024-04-19T02:22:10.554193+0000","last_active":"2024-04-19T02:22:10.553978+0000","last_peered":"2024-04-19T02:22:10.553978+0000","last_clean":"2024-04-19T02:22:10.553978+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:22:10.553978+0000","last_undegraded":"2024-04-19T02:22:10.553978+0000","last_fullsized":"2024-04-19T02:22:10.553978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_clean_scrub_stamp":"2024-04-19T02:22:10.553922+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:39.845669+0000","scrub_duration":0.0045096329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"117'385","reported_seq":474,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:23.444030+0000","last_change":"2024-04-19T02:22:23.444279+0000","last_active":"2024-04-19T02:22:23.444030+0000","last_peered":"2024-04-19T02:22:23.444030+0000","last_clean":"2024-04-19T02:22:23.444030+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:22:23.444030+0000","last_undegraded":"2024-04-19T02:22:23.444030+0000","last_fullsized":"2024-04-19T02:22:23.444030+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'385","last_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_deep_scrub":"117'385","last_deep_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_clean_scrub_stamp":"2024-04-19T02:22:23.443970+0000","objects_scrubbed":4,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:42:37.382290+0000","scrub_duration":0.067762446000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.484417+0000","last_change":"2024-04-19T02:21:38.484643+0000","last_active":"2024-04-19T02:21:38.484417+0000","last_peered":"2024-04-19T02:21:38.484417+0000","last_clean":"2024-04-19T02:21:38.484417+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:38.484417+0000","last_undegraded":"2024-04-19T02:21:38.484417+0000","last_fullsized":"2024-04-19T02:21:38.484417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.484360+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:33.481985+0000","scrub_duration":0.0046311950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":200,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.350646+0000","last_change":"2024-04-19T02:22:27.350863+0000","last_active":"2024-04-19T02:22:27.350646+0000","last_peered":"2024-04-19T02:22:27.350646+0000","last_clean":"2024-04-19T02:22:27.350646+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:22:27.350646+0000","last_undegraded":"2024-04-19T02:22:27.350646+0000","last_fullsized":"2024-04-19T02:22:27.350646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.350592+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:53.591039+0000","scrub_duration":0.0034193769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1033,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:29.383247+0000","last_change":"2024-04-19T02:22:29.383500+0000","last_active":"2024-04-19T02:22:29.383247+0000","last_peered":"2024-04-19T02:22:29.383247+0000","last_clean":"2024-04-19T02:22:29.383247+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:22:29.383247+0000","last_undegraded":"2024-04-19T02:22:29.383247+0000","last_fullsized":"2024-04-19T02:22:29.383247+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_clean_scrub_stamp":"2024-04-19T02:22:29.383196+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:08.112873+0000","scrub_duration":0.0037375350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":206,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:29.500100+0000","last_change":"2024-04-19T02:22:29.500311+0000","last_active":"2024-04-19T02:22:29.500100+0000","last_peered":"2024-04-19T02:22:29.500100+0000","last_clean":"2024-04-19T02:22:29.500100+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:22:29.500100+0000","last_undegraded":"2024-04-19T02:22:29.500100+0000","last_fullsized":"2024-04-19T02:22:29.500100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:22:29.500024+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:22:29.500024+0000","last_clean_scrub_stamp":"2024-04-19T02:22:29.500024+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:35.401480+0000","scrub_duration":0.003259418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":922,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:33.348309+0000","last_change":"2024-04-19T02:22:33.348533+0000","last_active":"2024-04-19T02:22:33.348309+0000","last_peered":"2024-04-19T02:22:33.348309+0000","last_clean":"2024-04-19T02:22:33.348309+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:22:33.348309+0000","last_undegraded":"2024-04-19T02:22:33.348309+0000","last_fullsized":"2024-04-19T02:22:33.348309+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:22:33.348255+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:22:33.348255+0000","last_clean_scrub_stamp":"2024-04-19T02:22:33.348255+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:00.348420+0000","scrub_duration":0.0037124419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"72'62","reported_seq":132,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145014+0000","last_change":"2024-04-19T02:21:21.341978+0000","last_active":"2024-04-19T02:21:31.145014+0000","last_peered":"2024-04-19T02:21:31.145014+0000","last_clean":"2024-04-19T02:21:31.145014+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:21:31.145014+0000","last_undegraded":"2024-04-19T02:21:31.145014+0000","last_fullsized":"2024-04-19T02:21:31.145014+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"117'170","reported_seq":260,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:20.436373+0000","last_change":"2024-04-19T02:22:20.436373+0000","last_active":"2024-04-19T02:22:20.436373+0000","last_peered":"2024-04-19T02:22:20.436373+0000","last_clean":"2024-04-19T02:22:20.436373+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:22:20.436373+0000","last_undegraded":"2024-04-19T02:22:20.436373+0000","last_fullsized":"2024-04-19T02:22:20.436373+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'170","last_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_deep_scrub":"117'170","last_deep_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_clean_scrub_stamp":"2024-04-19T02:22:20.436079+0000","objects_scrubbed":2,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:49.310358+0000","scrub_duration":0.036011089000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":907,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.502979+0000","last_change":"2024-04-19T02:21:46.503221+0000","last_active":"2024-04-19T02:21:46.502979+0000","last_peered":"2024-04-19T02:21:46.502979+0000","last_clean":"2024-04-19T02:21:46.502979+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:46.502979+0000","last_undegraded":"2024-04-19T02:21:46.502979+0000","last_fullsized":"2024-04-19T02:21:46.502979+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.502927+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:48.122985+0000","scrub_duration":0.0039232249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'293","reported_seq":431,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475684+0000","last_change":"2024-04-19T02:20:34.187216+0000","last_active":"2024-04-19T02:21:21.475684+0000","last_peered":"2024-04-19T02:21:21.475684+0000","last_clean":"2024-04-19T02:21:21.475684+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:21:21.475684+0000","last_undegraded":"2024-04-19T02:21:21.475684+0000","last_fullsized":"2024-04-19T02:21:21.475684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.534204+0000","last_change":"2024-04-19T02:21:52.534416+0000","last_active":"2024-04-19T02:21:52.534204+0000","last_peered":"2024-04-19T02:21:52.534204+0000","last_clean":"2024-04-19T02:21:52.534204+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:52.534204+0000","last_undegraded":"2024-04-19T02:21:52.534204+0000","last_fullsized":"2024-04-19T02:21:52.534204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'443","last_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_deep_scrub":"71'443","last_deep_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.534152+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:28.134492+0000","scrub_duration":0.0046536420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"71'597","reported_seq":676,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.144863+0000","last_change":"2024-04-19T02:21:21.339398+0000","last_active":"2024-04-19T02:21:31.144863+0000","last_peered":"2024-04-19T02:21:31.144863+0000","last_clean":"2024-04-19T02:21:31.144863+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:21:31.144863+0000","last_undegraded":"2024-04-19T02:21:31.144863+0000","last_fullsized":"2024-04-19T02:21:31.144863+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":504,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.572652+0000","last_change":"2024-04-19T02:21:31.572652+0000","last_active":"2024-04-19T02:21:31.572652+0000","last_peered":"2024-04-19T02:21:31.572652+0000","last_clean":"2024-04-19T02:21:31.572652+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:31.572652+0000","last_undegraded":"2024-04-19T02:21:31.572652+0000","last_fullsized":"2024-04-19T02:21:31.572652+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.572365+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:18.167461+0000","scrub_duration":0.0042499950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":123,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.144844+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:31.144844+0000","last_peered":"2024-04-19T02:21:31.144844+0000","last_clean":"2024-04-19T02:21:31.144844+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:31.144844+0000","last_undegraded":"2024-04-19T02:21:31.144844+0000","last_fullsized":"2024-04-19T02:21:31.144844+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1094,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:49.460647+0000","last_change":"2024-04-19T02:21:49.460884+0000","last_active":"2024-04-19T02:21:49.460647+0000","last_peered":"2024-04-19T02:21:49.460647+0000","last_clean":"2024-04-19T02:21:49.460647+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:49.460647+0000","last_undegraded":"2024-04-19T02:21:49.460647+0000","last_fullsized":"2024-04-19T02:21:49.460647+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'491","last_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_deep_scrub":"71'491","last_deep_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_clean_scrub_stamp":"2024-04-19T02:21:49.460592+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:18.752338+0000","scrub_duration":0.0043248339999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'132","reported_seq":271,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.470483+0000","last_change":"2024-04-19T02:20:36.196202+0000","last_active":"2024-04-19T02:21:21.470483+0000","last_peered":"2024-04-19T02:21:21.470483+0000","last_clean":"2024-04-19T02:21:21.470483+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:21:21.470483+0000","last_undegraded":"2024-04-19T02:21:21.470483+0000","last_fullsized":"2024-04-19T02:21:21.470483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":533,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145242+0000","last_change":"2024-04-19T02:21:21.323437+0000","last_active":"2024-04-19T02:21:31.145242+0000","last_peered":"2024-04-19T02:21:31.145242+0000","last_clean":"2024-04-19T02:21:31.145242+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:21:31.145242+0000","last_undegraded":"2024-04-19T02:21:31.145242+0000","last_fullsized":"2024-04-19T02:21:31.145242+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"117'208","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.448417+0000","last_change":"2024-04-19T02:21:45.448731+0000","last_active":"2024-04-19T02:21:45.448417+0000","last_peered":"2024-04-19T02:21:45.448417+0000","last_clean":"2024-04-19T02:21:45.448417+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:45.448417+0000","last_undegraded":"2024-04-19T02:21:45.448417+0000","last_fullsized":"2024-04-19T02:21:45.448417+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'208","last_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_deep_scrub":"117'208","last_deep_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.448363+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:14.018739+0000","scrub_duration":0.041956280999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":596,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.414317+0000","last_change":"2024-04-19T02:22:06.414317+0000","last_active":"2024-04-19T02:22:06.414317+0000","last_peered":"2024-04-19T02:22:06.414317+0000","last_clean":"2024-04-19T02:22:06.414317+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:22:06.414317+0000","last_undegraded":"2024-04-19T02:22:06.414317+0000","last_fullsized":"2024-04-19T02:22:06.414317+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'428","last_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_deep_scrub":"71'428","last_deep_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.413898+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:34.571146+0000","scrub_duration":0.0043639839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:44.492890+0000","last_change":"2024-04-19T02:22:44.493125+0000","last_active":"2024-04-19T02:22:44.492890+0000","last_peered":"2024-04-19T02:22:44.492890+0000","last_clean":"2024-04-19T02:22:44.492890+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:22:44.492890+0000","last_undegraded":"2024-04-19T02:22:44.492890+0000","last_fullsized":"2024-04-19T02:22:44.492890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'53","last_scrub_stamp":"2024-04-19T02:22:44.492835+0000","last_deep_scrub":"71'53","last_deep_scrub_stamp":"2024-04-19T02:22:44.492835+0000","last_clean_scrub_stamp":"2024-04-19T02:22:44.492835+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:58.181590+0000","scrub_duration":0.0033014379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":463,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:44.184221+0000","last_change":"2024-04-19T02:22:44.184463+0000","last_active":"2024-04-19T02:22:44.184221+0000","last_peered":"2024-04-19T02:22:44.184221+0000","last_clean":"2024-04-19T02:22:44.184221+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:22:44.184221+0000","last_undegraded":"2024-04-19T02:22:44.184221+0000","last_fullsized":"2024-04-19T02:22:44.184221+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'366","last_scrub_stamp":"2024-04-19T02:22:44.184169+0000","last_deep_scrub":"71'366","last_deep_scrub_stamp":"2024-04-19T02:22:44.184169+0000","last_clean_scrub_stamp":"2024-04-19T02:22:44.184169+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:22.184025+0000","scrub_duration":0.0041324120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"71'390","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473380+0000","last_change":"2024-04-19T02:16:24.133497+0000","last_active":"2024-04-19T02:21:21.473380+0000","last_peered":"2024-04-19T02:21:21.473380+0000","last_clean":"2024-04-19T02:21:21.473380+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:21:21.473380+0000","last_undegraded":"2024-04-19T02:21:21.473380+0000","last_fullsized":"2024-04-19T02:21:21.473380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.216164+0000","last_change":"2024-04-19T02:22:06.216395+0000","last_active":"2024-04-19T02:22:06.216164+0000","last_peered":"2024-04-19T02:22:06.216164+0000","last_clean":"2024-04-19T02:22:06.216164+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:22:06.216164+0000","last_undegraded":"2024-04-19T02:22:06.216164+0000","last_fullsized":"2024-04-19T02:22:06.216164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'395","last_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_deep_scrub":"71'395","last_deep_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.216111+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:41.161541+0000","scrub_duration":0.0046009639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":217,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.144629+0000","last_change":"2024-04-19T02:21:21.341047+0000","last_active":"2024-04-19T02:21:31.144629+0000","last_peered":"2024-04-19T02:21:31.144629+0000","last_clean":"2024-04-19T02:21:31.144629+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:21:31.144629+0000","last_undegraded":"2024-04-19T02:21:31.144629+0000","last_fullsized":"2024-04-19T02:21:31.144629+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:14.984576+0000","last_clean_scrub_stamp":"2024-04-19T02:16:14.984576+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.293874+0000","last_change":"2024-04-19T02:22:34.294074+0000","last_active":"2024-04-19T02:22:34.293874+0000","last_peered":"2024-04-19T02:22:34.293874+0000","last_clean":"2024-04-19T02:22:34.293874+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:22:34.293874+0000","last_undegraded":"2024-04-19T02:22:34.293874+0000","last_fullsized":"2024-04-19T02:22:34.293874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:34.293820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:34.293820+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.293820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:31:57.264337+0000","scrub_duration":0.003338344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'762","reported_seq":875,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763090+0000","last_change":"2024-04-19T02:16:24.136309+0000","last_active":"2024-04-19T02:21:31.763090+0000","last_peered":"2024-04-19T02:21:31.763090+0000","last_clean":"2024-04-19T02:21:31.763090+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:21:31.763090+0000","last_undegraded":"2024-04-19T02:21:31.763090+0000","last_fullsized":"2024-04-19T02:21:31.763090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:46.237540+0000","last_change":"2024-04-19T02:22:46.237748+0000","last_active":"2024-04-19T02:22:46.237540+0000","last_peered":"2024-04-19T02:22:46.237540+0000","last_clean":"2024-04-19T02:22:46.237540+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:22:46.237540+0000","last_undegraded":"2024-04-19T02:22:46.237540+0000","last_fullsized":"2024-04-19T02:22:46.237540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'435","last_scrub_stamp":"2024-04-19T02:22:46.237488+0000","last_deep_scrub":"71'435","last_deep_scrub_stamp":"2024-04-19T02:22:46.237488+0000","last_clean_scrub_stamp":"2024-04-19T02:22:46.237488+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:59.977357+0000","scrub_duration":0.0044347270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.144750+0000","last_change":"2024-04-19T02:21:21.342225+0000","last_active":"2024-04-19T02:21:31.144750+0000","last_peered":"2024-04-19T02:21:31.144750+0000","last_clean":"2024-04-19T02:21:31.144750+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:21:31.144750+0000","last_undegraded":"2024-04-19T02:21:31.144750+0000","last_fullsized":"2024-04-19T02:21:31.144750+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:19.062013+0000","last_clean_scrub_stamp":"2024-04-19T02:16:19.062013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"117'115","reported_seq":324,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:49.410089+0000","last_change":"2024-04-19T02:22:49.410296+0000","last_active":"2024-04-19T02:22:49.410089+0000","last_peered":"2024-04-19T02:22:49.410089+0000","last_clean":"2024-04-19T02:22:49.410089+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:22:49.410089+0000","last_undegraded":"2024-04-19T02:22:49.410089+0000","last_fullsized":"2024-04-19T02:22:49.410089+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'115","last_scrub_stamp":"2024-04-19T02:22:49.410036+0000","last_deep_scrub":"117'115","last_deep_scrub_stamp":"2024-04-19T02:22:49.410036+0000","last_clean_scrub_stamp":"2024-04-19T02:22:49.410036+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:53.945026+0000","scrub_duration":0.014947889000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.500697+0000","last_change":"2024-04-19T02:21:50.500920+0000","last_active":"2024-04-19T02:21:50.500697+0000","last_peered":"2024-04-19T02:21:50.500697+0000","last_clean":"2024-04-19T02:21:50.500697+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:50.500697+0000","last_undegraded":"2024-04-19T02:21:50.500697+0000","last_fullsized":"2024-04-19T02:21:50.500697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.500643+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:19:06.685542+0000","scrub_duration":0.0044626199999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:36.379494+0000","last_change":"2024-04-19T02:22:36.379699+0000","last_active":"2024-04-19T02:22:36.379494+0000","last_peered":"2024-04-19T02:22:36.379494+0000","last_clean":"2024-04-19T02:22:36.379494+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:22:36.379494+0000","last_undegraded":"2024-04-19T02:22:36.379494+0000","last_fullsized":"2024-04-19T02:22:36.379494+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:36.379438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:36.379438+0000","last_clean_scrub_stamp":"2024-04-19T02:22:36.379438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:52.044210+0000","scrub_duration":0.0032783790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"117'387","reported_seq":538,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:36.580396+0000","last_change":"2024-04-19T02:22:36.580619+0000","last_active":"2024-04-19T02:22:36.580396+0000","last_peered":"2024-04-19T02:22:36.580396+0000","last_clean":"2024-04-19T02:22:36.580396+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:22:36.580396+0000","last_undegraded":"2024-04-19T02:22:36.580396+0000","last_fullsized":"2024-04-19T02:22:36.580396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'387","last_scrub_stamp":"2024-04-19T02:22:36.580340+0000","last_deep_scrub":"117'387","last_deep_scrub_stamp":"2024-04-19T02:22:36.580340+0000","last_clean_scrub_stamp":"2024-04-19T02:22:36.580340+0000","objects_scrubbed":2,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:18.778615+0000","scrub_duration":0.066298640000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":480,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.417845+0000","last_change":"2024-04-19T02:21:47.418067+0000","last_active":"2024-04-19T02:21:47.417845+0000","last_peered":"2024-04-19T02:21:47.417845+0000","last_clean":"2024-04-19T02:21:47.417845+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:47.417845+0000","last_undegraded":"2024-04-19T02:21:47.417845+0000","last_fullsized":"2024-04-19T02:21:47.417845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'345","last_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_deep_scrub":"71'345","last_deep_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.417790+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:30.129614+0000","scrub_duration":0.0046618750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.410078+0000","last_change":"2024-04-19T02:22:08.410078+0000","last_active":"2024-04-19T02:22:08.410078+0000","last_peered":"2024-04-19T02:22:08.410078+0000","last_clean":"2024-04-19T02:22:08.410078+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:22:08.410078+0000","last_undegraded":"2024-04-19T02:22:08.410078+0000","last_fullsized":"2024-04-19T02:22:08.410078+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.409824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:12.416405+0000","scrub_duration":0.0032298549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":148,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.379540+0000","last_change":"2024-04-19T02:21:54.379775+0000","last_active":"2024-04-19T02:21:54.379540+0000","last_peered":"2024-04-19T02:21:54.379540+0000","last_clean":"2024-04-19T02:21:54.379540+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:54.379540+0000","last_undegraded":"2024-04-19T02:21:54.379540+0000","last_fullsized":"2024-04-19T02:21:54.379540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.379480+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:14.495728+0000","scrub_duration":0.0033461229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.419740+0000","last_change":"2024-04-19T02:21:40.419740+0000","last_active":"2024-04-19T02:21:40.419740+0000","last_peered":"2024-04-19T02:21:40.419740+0000","last_clean":"2024-04-19T02:21:40.419740+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:40.419740+0000","last_undegraded":"2024-04-19T02:21:40.419740+0000","last_fullsized":"2024-04-19T02:21:40.419740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'403","last_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_deep_scrub":"71'403","last_deep_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.419437+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:29.109984+0000","scrub_duration":0.0046038880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'460","reported_seq":530,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.343592+0000","last_change":"2024-04-19T02:21:21.317369+0000","last_active":"2024-04-19T02:21:21.343592+0000","last_peered":"2024-04-19T02:21:21.343592+0000","last_clean":"2024-04-19T02:21:21.343592+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:21:21.343592+0000","last_undegraded":"2024-04-19T02:21:21.343592+0000","last_fullsized":"2024-04-19T02:21:21.343592+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:46.401592+0000","last_change":"2024-04-19T02:22:46.401810+0000","last_active":"2024-04-19T02:22:46.401592+0000","last_peered":"2024-04-19T02:22:46.401592+0000","last_clean":"2024-04-19T02:22:46.401592+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:22:46.401592+0000","last_undegraded":"2024-04-19T02:22:46.401592+0000","last_fullsized":"2024-04-19T02:22:46.401592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:46.401543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:46.401543+0000","last_clean_scrub_stamp":"2024-04-19T02:22:46.401543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:54.137102+0000","scrub_duration":0.0032966150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":870,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:01.586120+0000","last_change":"2024-04-19T02:22:01.586120+0000","last_active":"2024-04-19T02:22:01.586120+0000","last_peered":"2024-04-19T02:22:01.586120+0000","last_clean":"2024-04-19T02:22:01.586120+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:22:01.586120+0000","last_undegraded":"2024-04-19T02:22:01.586120+0000","last_fullsized":"2024-04-19T02:22:01.586120+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'383","last_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_deep_scrub":"71'383","last_deep_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_clean_scrub_stamp":"2024-04-19T02:22:01.585841+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:50.276388+0000","scrub_duration":0.0039878709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":169,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763183+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:31.763183+0000","last_peered":"2024-04-19T02:21:31.763183+0000","last_clean":"2024-04-19T02:21:31.763183+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:31.763183+0000","last_undegraded":"2024-04-19T02:21:31.763183+0000","last_fullsized":"2024-04-19T02:21:31.763183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.534676+0000","last_change":"2024-04-19T02:22:34.534888+0000","last_active":"2024-04-19T02:22:34.534676+0000","last_peered":"2024-04-19T02:22:34.534676+0000","last_clean":"2024-04-19T02:22:34.534676+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:22:34.534676+0000","last_undegraded":"2024-04-19T02:22:34.534676+0000","last_fullsized":"2024-04-19T02:22:34.534676+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:34.534627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:34.534627+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.534627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:40.751248+0000","scrub_duration":0.0032596080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":987,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:53.548677+0000","last_change":"2024-04-19T02:21:53.548677+0000","last_active":"2024-04-19T02:21:53.548677+0000","last_peered":"2024-04-19T02:21:53.548677+0000","last_clean":"2024-04-19T02:21:53.548677+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:53.548677+0000","last_undegraded":"2024-04-19T02:21:53.548677+0000","last_fullsized":"2024-04-19T02:21:53.548677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_clean_scrub_stamp":"2024-04-19T02:21:53.548415+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:32.430509+0000","scrub_duration":0.003797426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"71'66","reported_seq":178,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.472059+0000","last_change":"2024-04-19T02:16:24.136749+0000","last_active":"2024-04-19T02:21:21.472059+0000","last_peered":"2024-04-19T02:21:21.472059+0000","last_clean":"2024-04-19T02:21:21.472059+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:21:21.472059+0000","last_undegraded":"2024-04-19T02:21:21.472059+0000","last_fullsized":"2024-04-19T02:21:21.472059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:47.381294+0000","last_change":"2024-04-19T02:22:47.381294+0000","last_active":"2024-04-19T02:22:47.381294+0000","last_peered":"2024-04-19T02:22:47.381294+0000","last_clean":"2024-04-19T02:22:47.381294+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:22:47.381294+0000","last_undegraded":"2024-04-19T02:22:47.381294+0000","last_fullsized":"2024-04-19T02:22:47.381294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:47.381024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:47.381024+0000","last_clean_scrub_stamp":"2024-04-19T02:22:47.381024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:18.712981+0000","scrub_duration":0.0031651090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":964,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:51.372189+0000","last_change":"2024-04-19T02:21:51.372189+0000","last_active":"2024-04-19T02:21:51.372189+0000","last_peered":"2024-04-19T02:21:51.372189+0000","last_clean":"2024-04-19T02:21:51.372189+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:51.372189+0000","last_undegraded":"2024-04-19T02:21:51.372189+0000","last_fullsized":"2024-04-19T02:21:51.372189+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_clean_scrub_stamp":"2024-04-19T02:21:51.371896+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.379349+0000","scrub_duration":0.0039386960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"117'76","reported_seq":217,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.405236+0000","last_change":"2024-04-19T02:22:34.405467+0000","last_active":"2024-04-19T02:22:34.405236+0000","last_peered":"2024-04-19T02:22:34.405236+0000","last_clean":"2024-04-19T02:22:34.405236+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:22:34.405236+0000","last_undegraded":"2024-04-19T02:22:34.405236+0000","last_fullsized":"2024-04-19T02:22:34.405236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'76","last_scrub_stamp":"2024-04-19T02:22:34.405184+0000","last_deep_scrub":"117'76","last_deep_scrub_stamp":"2024-04-19T02:22:34.405184+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.405184+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.978891+0000","scrub_duration":0.022685261000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.382614+0000","last_change":"2024-04-19T02:21:47.382834+0000","last_active":"2024-04-19T02:21:47.382614+0000","last_peered":"2024-04-19T02:21:47.382614+0000","last_clean":"2024-04-19T02:21:47.382614+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:47.382614+0000","last_undegraded":"2024-04-19T02:21:47.382614+0000","last_fullsized":"2024-04-19T02:21:47.382614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.382567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:21.368852+0000","scrub_duration":0.0033623530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763606+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:31.763606+0000","last_peered":"2024-04-19T02:21:31.763606+0000","last_clean":"2024-04-19T02:21:31.763606+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:31.763606+0000","last_undegraded":"2024-04-19T02:21:31.763606+0000","last_fullsized":"2024-04-19T02:21:31.763606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":503,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145300+0000","last_change":"2024-04-19T02:21:21.343149+0000","last_active":"2024-04-19T02:21:31.145300+0000","last_peered":"2024-04-19T02:21:31.145300+0000","last_clean":"2024-04-19T02:21:31.145300+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:21:31.145300+0000","last_undegraded":"2024-04-19T02:21:31.145300+0000","last_fullsized":"2024-04-19T02:21:31.145300+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"117'453","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:43.287797+0000","last_change":"2024-04-19T02:22:43.288098+0000","last_active":"2024-04-19T02:22:43.287797+0000","last_peered":"2024-04-19T02:22:43.287797+0000","last_clean":"2024-04-19T02:22:43.287797+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:22:43.287797+0000","last_undegraded":"2024-04-19T02:22:43.287797+0000","last_fullsized":"2024-04-19T02:22:43.287797+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'453","last_scrub_stamp":"2024-04-19T02:22:43.287744+0000","last_deep_scrub":"117'453","last_deep_scrub_stamp":"2024-04-19T02:22:43.287744+0000","last_clean_scrub_stamp":"2024-04-19T02:22:43.287744+0000","objects_scrubbed":6,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:38.525762+0000","scrub_duration":0.078508173000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":567,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:14.293529+0000","last_change":"2024-04-19T02:22:14.293826+0000","last_active":"2024-04-19T02:22:14.293529+0000","last_peered":"2024-04-19T02:22:14.293529+0000","last_clean":"2024-04-19T02:22:14.293529+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:22:14.293529+0000","last_undegraded":"2024-04-19T02:22:14.293529+0000","last_fullsized":"2024-04-19T02:22:14.293529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'407","last_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_deep_scrub":"71'407","last_deep_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_clean_scrub_stamp":"2024-04-19T02:22:14.293476+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:01:56.491750+0000","scrub_duration":0.0053162419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"117'88","reported_seq":230,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:48.485720+0000","last_change":"2024-04-19T02:22:48.486046+0000","last_active":"2024-04-19T02:22:48.485720+0000","last_peered":"2024-04-19T02:22:48.485720+0000","last_clean":"2024-04-19T02:22:48.485720+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:22:48.485720+0000","last_undegraded":"2024-04-19T02:22:48.485720+0000","last_fullsized":"2024-04-19T02:22:48.485720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'88","last_scrub_stamp":"2024-04-19T02:22:48.485666+0000","last_deep_scrub":"117'88","last_deep_scrub_stamp":"2024-04-19T02:22:48.485666+0000","last_clean_scrub_stamp":"2024-04-19T02:22:48.485666+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:08.570008+0000","scrub_duration":0.0072681860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"117'325","reported_seq":405,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.418193+0000","last_change":"2024-04-19T02:21:46.418450+0000","last_active":"2024-04-19T02:21:46.418193+0000","last_peered":"2024-04-19T02:21:46.418193+0000","last_clean":"2024-04-19T02:21:46.418193+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:46.418193+0000","last_undegraded":"2024-04-19T02:21:46.418193+0000","last_fullsized":"2024-04-19T02:21:46.418193+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'325","last_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_deep_scrub":"117'325","last_deep_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.418135+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:23.243009+0000","scrub_duration":0.037437605999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1031,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:25.306188+0000","last_change":"2024-04-19T02:22:25.306412+0000","last_active":"2024-04-19T02:22:25.306188+0000","last_peered":"2024-04-19T02:22:25.306188+0000","last_clean":"2024-04-19T02:22:25.306188+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:22:25.306188+0000","last_undegraded":"2024-04-19T02:22:25.306188+0000","last_fullsized":"2024-04-19T02:22:25.306188+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'441","last_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_deep_scrub":"71'441","last_deep_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_clean_scrub_stamp":"2024-04-19T02:22:25.306128+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:33.739156+0000","scrub_duration":0.0038746840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:21.140582+0000","last_change":"2024-04-19T02:22:21.140820+0000","last_active":"2024-04-19T02:22:21.140582+0000","last_peered":"2024-04-19T02:22:21.140582+0000","last_clean":"2024-04-19T02:22:21.140582+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:22:21.140582+0000","last_undegraded":"2024-04-19T02:22:21.140582+0000","last_fullsized":"2024-04-19T02:22:21.140582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'54","last_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_deep_scrub":"71'54","last_deep_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_clean_scrub_stamp":"2024-04-19T02:22:21.140527+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:01.892166+0000","scrub_duration":0.0033383610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":641,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.239538+0000","last_change":"2024-04-19T02:22:08.239786+0000","last_active":"2024-04-19T02:22:08.239538+0000","last_peered":"2024-04-19T02:22:08.239538+0000","last_clean":"2024-04-19T02:22:08.239538+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:22:08.239538+0000","last_undegraded":"2024-04-19T02:22:08.239538+0000","last_fullsized":"2024-04-19T02:22:08.239538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'459","last_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_deep_scrub":"71'459","last_deep_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.239485+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:14.140941+0000","scrub_duration":0.004519805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":931,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.477808+0000","last_change":"2024-04-19T02:21:36.477808+0000","last_active":"2024-04-19T02:21:36.477808+0000","last_peered":"2024-04-19T02:21:36.477808+0000","last_clean":"2024-04-19T02:21:36.477808+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:36.477808+0000","last_undegraded":"2024-04-19T02:21:36.477808+0000","last_fullsized":"2024-04-19T02:21:36.477808+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.477536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:19.549278+0000","scrub_duration":0.0037289060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'572","reported_seq":684,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.469346+0000","last_change":"2024-04-19T02:16:24.136734+0000","last_active":"2024-04-19T02:21:21.469346+0000","last_peered":"2024-04-19T02:21:21.469346+0000","last_clean":"2024-04-19T02:21:21.469346+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:21:21.469346+0000","last_undegraded":"2024-04-19T02:21:21.469346+0000","last_fullsized":"2024-04-19T02:21:21.469346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":945,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763822+0000","last_change":"2024-04-19T02:20:41.201599+0000","last_active":"2024-04-19T02:21:31.763822+0000","last_peered":"2024-04-19T02:21:31.763822+0000","last_clean":"2024-04-19T02:21:31.763822+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:21:31.763822+0000","last_undegraded":"2024-04-19T02:21:31.763822+0000","last_fullsized":"2024-04-19T02:21:31.763822+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"117'327","reported_seq":474,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:31.453784+0000","last_change":"2024-04-19T02:22:31.453992+0000","last_active":"2024-04-19T02:22:31.453784+0000","last_peered":"2024-04-19T02:22:31.453784+0000","last_clean":"2024-04-19T02:22:31.453784+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:22:31.453784+0000","last_undegraded":"2024-04-19T02:22:31.453784+0000","last_fullsized":"2024-04-19T02:22:31.453784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'327","last_scrub_stamp":"2024-04-19T02:22:31.453728+0000","last_deep_scrub":"117'327","last_deep_scrub_stamp":"2024-04-19T02:22:31.453728+0000","last_clean_scrub_stamp":"2024-04-19T02:22:31.453728+0000","objects_scrubbed":1,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:53.287501+0000","scrub_duration":0.037649608000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":862,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443364+0000","last_change":"2024-04-19T02:20:47.208474+0000","last_active":"2024-04-19T02:21:24.443364+0000","last_peered":"2024-04-19T02:21:24.443364+0000","last_clean":"2024-04-19T02:21:24.443364+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:21:24.443364+0000","last_undegraded":"2024-04-19T02:21:24.443364+0000","last_fullsized":"2024-04-19T02:21:24.443364+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"71'496","reported_seq":614,"reported_epoch":117,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-19T02:22:49.462031+0000","last_change":"2024-04-19T02:22:49.460626+0000","last_active":"2024-04-19T02:22:49.462031+0000","last_peered":"2024-04-19T02:22:49.462031+0000","last_clean":"2024-04-19T02:22:49.462031+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:22:49.462031+0000","last_undegraded":"2024-04-19T02:22:49.462031+0000","last_fullsized":"2024-04-19T02:22:49.462031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:42.467422+0000","last_change":"2024-04-19T02:21:42.467663+0000","last_active":"2024-04-19T02:21:42.467422+0000","last_peered":"2024-04-19T02:21:42.467422+0000","last_clean":"2024-04-19T02:21:42.467422+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:42.467422+0000","last_undegraded":"2024-04-19T02:21:42.467422+0000","last_fullsized":"2024-04-19T02:21:42.467422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:42.467368+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:21.867316+0000","scrub_duration":0.0048531720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'58","reported_seq":189,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443272+0000","last_change":"2024-04-19T02:20:30.705165+0000","last_active":"2024-04-19T02:21:24.443272+0000","last_peered":"2024-04-19T02:21:24.443272+0000","last_clean":"2024-04-19T02:21:24.443272+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:21:24.443272+0000","last_undegraded":"2024-04-19T02:21:24.443272+0000","last_fullsized":"2024-04-19T02:21:24.443272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":478,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.431655+0000","last_change":"2024-04-19T02:21:40.431879+0000","last_active":"2024-04-19T02:21:40.431655+0000","last_peered":"2024-04-19T02:21:40.431655+0000","last_clean":"2024-04-19T02:21:40.431655+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:40.431655+0000","last_undegraded":"2024-04-19T02:21:40.431655+0000","last_fullsized":"2024-04-19T02:21:40.431655+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.431601+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:34.613519+0000","scrub_duration":0.0040029599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'326","reported_seq":404,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.342300+0000","last_change":"2024-04-19T02:21:21.336126+0000","last_active":"2024-04-19T02:21:21.342300+0000","last_peered":"2024-04-19T02:21:21.342300+0000","last_clean":"2024-04-19T02:21:21.342300+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:21:21.342300+0000","last_undegraded":"2024-04-19T02:21:21.342300+0000","last_fullsized":"2024-04-19T02:21:21.342300+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":507,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:22.373712+0000","last_change":"2024-04-19T02:22:22.373931+0000","last_active":"2024-04-19T02:22:22.373712+0000","last_peered":"2024-04-19T02:22:22.373712+0000","last_clean":"2024-04-19T02:22:22.373712+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:22:22.373712+0000","last_undegraded":"2024-04-19T02:22:22.373712+0000","last_fullsized":"2024-04-19T02:22:22.373712+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_clean_scrub_stamp":"2024-04-19T02:22:22.373659+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:42.141017+0000","scrub_duration":0.004280603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"117'371","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.613687+0000","last_change":"2024-04-19T02:22:27.613926+0000","last_active":"2024-04-19T02:22:27.613687+0000","last_peered":"2024-04-19T02:22:27.613687+0000","last_clean":"2024-04-19T02:22:27.613687+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:22:27.613687+0000","last_undegraded":"2024-04-19T02:22:27.613687+0000","last_fullsized":"2024-04-19T02:22:27.613687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'371","last_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_deep_scrub":"117'371","last_deep_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.613626+0000","objects_scrubbed":4,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:02.559056+0000","scrub_duration":0.093301011000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":634,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474035+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:21.474035+0000","last_peered":"2024-04-19T02:21:21.474035+0000","last_clean":"2024-04-19T02:21:21.474035+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:21.474035+0000","last_undegraded":"2024-04-19T02:21:21.474035+0000","last_fullsized":"2024-04-19T02:21:21.474035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"117'69","reported_seq":193,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.346715+0000","last_change":"2024-04-19T02:22:12.346715+0000","last_active":"2024-04-19T02:22:12.346715+0000","last_peered":"2024-04-19T02:22:12.346715+0000","last_clean":"2024-04-19T02:22:12.346715+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:22:12.346715+0000","last_undegraded":"2024-04-19T02:22:12.346715+0000","last_fullsized":"2024-04-19T02:22:12.346715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'69","last_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_deep_scrub":"117'69","last_deep_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.346440+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:18.563061+0000","scrub_duration":0.030517280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.341348+0000","last_change":"2024-04-19T02:21:21.338347+0000","last_active":"2024-04-19T02:21:21.341348+0000","last_peered":"2024-04-19T02:21:21.341348+0000","last_clean":"2024-04-19T02:21:21.341348+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:21:21.341348+0000","last_undegraded":"2024-04-19T02:21:21.341348+0000","last_fullsized":"2024-04-19T02:21:21.341348+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"117'55","reported_seq":197,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:07.253769+0000","last_change":"2024-04-19T02:22:07.253769+0000","last_active":"2024-04-19T02:22:07.253769+0000","last_peered":"2024-04-19T02:22:07.253769+0000","last_clean":"2024-04-19T02:22:07.253769+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:22:07.253769+0000","last_undegraded":"2024-04-19T02:22:07.253769+0000","last_fullsized":"2024-04-19T02:22:07.253769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'55","last_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_deep_scrub":"117'55","last_deep_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_clean_scrub_stamp":"2024-04-19T02:22:07.253481+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:15.508809+0000","scrub_duration":0.035080496000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7661,"ondisk_log_size":7661,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738453,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126648,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245192,"statfs":{"total":96636764160,"available":96507076608,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:22:27 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.65900000000000003},"min":{"1min":0.50700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76100000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.624},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71299999999999997,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65800000000000003}]}]},{"osd":1,"up_from":78,"seq":335007449118,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66120,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305720,"statfs":{"total":96636764160,"available":96569057280,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.73999999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.752}]}]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139604,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232236,"statfs":{"total":96636764160,"available":96493809664,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:22:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Apr 19 02:22:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.59199999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.73099999999999998,"5min":0.81399999999999995,"15min":0.91900000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.624,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77100000000000002,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:22:53.498 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.498 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.498 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.498 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.498 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.498 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.498 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.499 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.500 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.500 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.500 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.500 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.500 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.500 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.500 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.501 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.501 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.501 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.501 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:16:14.984576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.501 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.501 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:16:19.062013+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=19, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.501 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.502 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.502 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.502 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.502 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.502 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.502 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.502 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.503 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.503 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.503 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.503 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.503 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:53.503 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:23:13.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:23:13.820 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:23:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:23:13.837 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-04-19T02:23:12.347112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34481,"ondisk_log_size":34481,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332372,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783148,"statfs":{"total":289910292480,"available":289569943552,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004379"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":569,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.884920+0000","last_change":"2024-04-19T02:16:24.514879+0000","last_active":"2024-04-19T02:21:30.884920+0000","last_peered":"2024-04-19T02:21:30.884920+0000","last_clean":"2024-04-19T02:21:30.884920+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:21:30.884920+0000","last_undegraded":"2024-04-19T02:21:30.884920+0000","last_fullsized":"2024-04-19T02:21:30.884920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":595,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.885003+0000","last_change":"2024-04-19T02:16:24.512548+0000","last_active":"2024-04-19T02:21:30.885003+0000","last_peered":"2024-04-19T02:21:30.885003+0000","last_clean":"2024-04-19T02:21:30.885003+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:21:30.885003+0000","last_undegraded":"2024-04-19T02:21:30.885003+0000","last_fullsized":"2024-04-19T02:21:30.885003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":496,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:04.013362+0000","last_change":"2024-04-19T02:23:04.013651+0000","last_active":"2024-04-19T02:23:04.013362+0000","last_peered":"2024-04-19T02:23:04.013362+0000","last_clean":"2024-04-19T02:23:04.013362+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:23:04.013362+0000","last_undegraded":"2024-04-19T02:23:04.013362+0000","last_fullsized":"2024-04-19T02:23:04.013362+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:23:04.013308+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:23:04.013308+0000","last_clean_scrub_stamp":"2024-04-19T02:23:04.013308+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:46.975762+0000","scrub_duration":0.0039283240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":478,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:38.327119+0000","last_change":"2024-04-19T02:22:38.327334+0000","last_active":"2024-04-19T02:22:38.327119+0000","last_peered":"2024-04-19T02:22:38.327119+0000","last_clean":"2024-04-19T02:22:38.327119+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:22:38.327119+0000","last_undegraded":"2024-04-19T02:22:38.327119+0000","last_fullsized":"2024-04-19T02:22:38.327119+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'387","last_scrub_stamp":"2024-04-19T02:22:38.327067+0000","last_deep_scrub":"71'387","last_deep_scrub_stamp":"2024-04-19T02:22:38.327067+0000","last_clean_scrub_stamp":"2024-04-19T02:22:38.327067+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:01:33.906804+0000","scrub_duration":0.0041694389999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.443245+0000","last_change":"2024-04-19T02:16:24.510893+0000","last_active":"2024-04-19T02:21:24.443245+0000","last_peered":"2024-04-19T02:21:24.443245+0000","last_clean":"2024-04-19T02:21:24.443245+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:21:24.443245+0000","last_undegraded":"2024-04-19T02:21:24.443245+0000","last_fullsized":"2024-04-19T02:21:24.443245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":548,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:56.014823+0000","last_change":"2024-04-19T02:22:56.014823+0000","last_active":"2024-04-19T02:22:56.014823+0000","last_peered":"2024-04-19T02:22:56.014823+0000","last_clean":"2024-04-19T02:22:56.014823+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:22:56.014823+0000","last_undegraded":"2024-04-19T02:22:56.014823+0000","last_fullsized":"2024-04-19T02:22:56.014823+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'418","last_scrub_stamp":"2024-04-19T02:22:56.014559+0000","last_deep_scrub":"71'418","last_deep_scrub_stamp":"2024-04-19T02:22:56.014559+0000","last_clean_scrub_stamp":"2024-04-19T02:22:56.014559+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:41.139679+0000","scrub_duration":0.0039438959999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:53.095795+0000","last_change":"2024-04-19T02:22:53.095795+0000","last_active":"2024-04-19T02:22:53.095795+0000","last_peered":"2024-04-19T02:22:53.095795+0000","last_clean":"2024-04-19T02:22:53.095795+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:22:53.095795+0000","last_undegraded":"2024-04-19T02:22:53.095795+0000","last_fullsized":"2024-04-19T02:22:53.095795+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-19T02:22:53.095537+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-19T02:22:53.095537+0000","last_clean_scrub_stamp":"2024-04-19T02:22:53.095537+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.282008+0000","scrub_duration":0.0044063469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":595,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.358451+0000","last_change":"2024-04-19T02:21:50.358451+0000","last_active":"2024-04-19T02:21:50.358451+0000","last_peered":"2024-04-19T02:21:50.358451+0000","last_clean":"2024-04-19T02:21:50.358451+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:50.358451+0000","last_undegraded":"2024-04-19T02:21:50.358451+0000","last_fullsized":"2024-04-19T02:21:50.358451+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.358123+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:30.347256+0000","scrub_duration":0.0040337430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":564,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471113+0000","last_change":"2024-04-19T02:16:24.511115+0000","last_active":"2024-04-19T02:21:21.471113+0000","last_peered":"2024-04-19T02:21:21.471113+0000","last_clean":"2024-04-19T02:21:21.471113+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:21:21.471113+0000","last_undegraded":"2024-04-19T02:21:21.471113+0000","last_fullsized":"2024-04-19T02:21:21.471113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":555,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.475297+0000","last_change":"2024-04-19T02:16:24.514867+0000","last_active":"2024-04-19T02:21:21.475297+0000","last_peered":"2024-04-19T02:21:21.475297+0000","last_clean":"2024-04-19T02:21:21.475297+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:21:21.475297+0000","last_undegraded":"2024-04-19T02:21:21.475297+0000","last_fullsized":"2024-04-19T02:21:21.475297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":470,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.465225+0000","last_change":"2024-04-19T02:21:34.465225+0000","last_active":"2024-04-19T02:21:34.465225+0000","last_peered":"2024-04-19T02:21:34.465225+0000","last_clean":"2024-04-19T02:21:34.465225+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:34.465225+0000","last_undegraded":"2024-04-19T02:21:34.465225+0000","last_fullsized":"2024-04-19T02:21:34.465225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.464937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:54.461710+0000","scrub_duration":0.004016393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":912,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474499+0000","last_change":"2024-04-19T02:20:49.198847+0000","last_active":"2024-04-19T02:21:21.474499+0000","last_peered":"2024-04-19T02:21:21.474499+0000","last_clean":"2024-04-19T02:21:21.474499+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:21:21.474499+0000","last_undegraded":"2024-04-19T02:21:21.474499+0000","last_fullsized":"2024-04-19T02:21:21.474499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":539,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.473843+0000","last_change":"2024-04-19T02:16:24.511776+0000","last_active":"2024-04-19T02:21:21.473843+0000","last_peered":"2024-04-19T02:21:21.473843+0000","last_clean":"2024-04-19T02:21:21.473843+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:21:21.473843+0000","last_undegraded":"2024-04-19T02:21:21.473843+0000","last_fullsized":"2024-04-19T02:21:21.473843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":520,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:57.929553+0000","last_change":"2024-04-19T02:22:57.929839+0000","last_active":"2024-04-19T02:22:57.929553+0000","last_peered":"2024-04-19T02:22:57.929553+0000","last_clean":"2024-04-19T02:22:57.929553+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:22:57.929553+0000","last_undegraded":"2024-04-19T02:22:57.929553+0000","last_fullsized":"2024-04-19T02:22:57.929553+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-19T02:22:57.929502+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-19T02:22:57.929502+0000","last_clean_scrub_stamp":"2024-04-19T02:22:57.929502+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:32:33.504877+0000","scrub_duration":0.0041056340000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:54.051830+0000","last_change":"2024-04-19T02:22:54.052070+0000","last_active":"2024-04-19T02:22:54.051830+0000","last_peered":"2024-04-19T02:22:54.051830+0000","last_clean":"2024-04-19T02:22:54.051830+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:22:54.051830+0000","last_undegraded":"2024-04-19T02:22:54.051830+0000","last_fullsized":"2024-04-19T02:22:54.051830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'422","last_scrub_stamp":"2024-04-19T02:22:54.051778+0000","last_deep_scrub":"71'422","last_deep_scrub_stamp":"2024-04-19T02:22:54.051778+0000","last_clean_scrub_stamp":"2024-04-19T02:22:54.051778+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:58.277198+0000","scrub_duration":0.0040325459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":578,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145563+0000","last_change":"2024-04-19T02:21:21.337686+0000","last_active":"2024-04-19T02:21:31.145563+0000","last_peered":"2024-04-19T02:21:31.145563+0000","last_clean":"2024-04-19T02:21:31.145563+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:21:31.145563+0000","last_undegraded":"2024-04-19T02:21:31.145563+0000","last_fullsized":"2024-04-19T02:21:31.145563+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.471892+0000","last_change":"2024-04-19T02:16:24.513744+0000","last_active":"2024-04-19T02:21:21.471892+0000","last_peered":"2024-04-19T02:21:21.471892+0000","last_clean":"2024-04-19T02:21:21.471892+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:21:21.471892+0000","last_undegraded":"2024-04-19T02:21:21.471892+0000","last_fullsized":"2024-04-19T02:21:21.471892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.467028+0000","last_change":"2024-04-19T02:21:33.467243+0000","last_active":"2024-04-19T02:21:33.467028+0000","last_peered":"2024-04-19T02:21:33.467028+0000","last_clean":"2024-04-19T02:21:33.467028+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:33.467028+0000","last_undegraded":"2024-04-19T02:21:33.467028+0000","last_fullsized":"2024-04-19T02:21:33.467028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.466973+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:47.589455+0000","scrub_duration":0.0049157790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":651,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763976+0000","last_change":"2024-04-19T02:16:24.512266+0000","last_active":"2024-04-19T02:21:31.763976+0000","last_peered":"2024-04-19T02:21:31.763976+0000","last_clean":"2024-04-19T02:21:31.763976+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:21:31.763976+0000","last_undegraded":"2024-04-19T02:21:31.763976+0000","last_fullsized":"2024-04-19T02:21:31.763976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:42.243437+0000","last_change":"2024-04-19T02:22:42.243437+0000","last_active":"2024-04-19T02:22:42.243437+0000","last_peered":"2024-04-19T02:22:42.243437+0000","last_clean":"2024-04-19T02:22:42.243437+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:22:42.243437+0000","last_undegraded":"2024-04-19T02:22:42.243437+0000","last_fullsized":"2024-04-19T02:22:42.243437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-19T02:22:42.243127+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-19T02:22:42.243127+0000","last_clean_scrub_stamp":"2024-04-19T02:22:42.243127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:59.449065+0000","scrub_duration":0.0042836250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":557,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.476717+0000","last_change":"2024-04-19T02:21:41.476717+0000","last_active":"2024-04-19T02:21:41.476717+0000","last_peered":"2024-04-19T02:21:41.476717+0000","last_clean":"2024-04-19T02:21:41.476717+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:41.476717+0000","last_undegraded":"2024-04-19T02:21:41.476717+0000","last_fullsized":"2024-04-19T02:21:41.476717+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.476396+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:05:52.160962+0000","scrub_duration":0.0037331780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1135,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.592031+0000","last_change":"2024-04-19T02:22:12.592031+0000","last_active":"2024-04-19T02:22:12.592031+0000","last_peered":"2024-04-19T02:22:12.592031+0000","last_clean":"2024-04-19T02:22:12.592031+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:22:12.592031+0000","last_undegraded":"2024-04-19T02:22:12.592031+0000","last_fullsized":"2024-04-19T02:22:12.592031+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'464","last_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_deep_scrub":"71'464","last_deep_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.591764+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:14.599217+0000","scrub_duration":0.0039062849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":913,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:09.109371+0000","last_change":"2024-04-19T02:23:09.109371+0000","last_active":"2024-04-19T02:23:09.109371+0000","last_peered":"2024-04-19T02:23:09.109371+0000","last_clean":"2024-04-19T02:23:09.109371+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:23:09.109371+0000","last_undegraded":"2024-04-19T02:23:09.109371+0000","last_fullsized":"2024-04-19T02:23:09.109371+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-19T02:23:09.109087+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-19T02:23:09.109087+0000","last_clean_scrub_stamp":"2024-04-19T02:23:09.109087+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:09:16.758677+0000","scrub_duration":0.0041038419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.568618+0000","last_change":"2024-04-19T02:22:08.568618+0000","last_active":"2024-04-19T02:22:08.568618+0000","last_peered":"2024-04-19T02:22:08.568618+0000","last_clean":"2024-04-19T02:22:08.568618+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:22:08.568618+0000","last_undegraded":"2024-04-19T02:22:08.568618+0000","last_fullsized":"2024-04-19T02:22:08.568618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.568338+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:51.280163+0000","scrub_duration":0.0042660390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":963,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:59.650456+0000","last_change":"2024-04-19T02:21:59.650456+0000","last_active":"2024-04-19T02:21:59.650456+0000","last_peered":"2024-04-19T02:21:59.650456+0000","last_clean":"2024-04-19T02:21:59.650456+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:59.650456+0000","last_undegraded":"2024-04-19T02:21:59.650456+0000","last_fullsized":"2024-04-19T02:21:59.650456+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_clean_scrub_stamp":"2024-04-19T02:21:59.650190+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:15.528989+0000","scrub_duration":0.0039580250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1187,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:07.149884+0000","last_change":"2024-04-19T02:23:07.150104+0000","last_active":"2024-04-19T02:23:07.149884+0000","last_peered":"2024-04-19T02:23:07.149884+0000","last_clean":"2024-04-19T02:23:07.149884+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:23:07.149884+0000","last_undegraded":"2024-04-19T02:23:07.149884+0000","last_fullsized":"2024-04-19T02:23:07.149884+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'520","last_scrub_stamp":"2024-04-19T02:23:07.149832+0000","last_deep_scrub":"71'520","last_deep_scrub_stamp":"2024-04-19T02:23:07.149832+0000","last_clean_scrub_stamp":"2024-04-19T02:23:07.149832+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:16.629049+0000","scrub_duration":0.0041642800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.413150+0000","last_change":"2024-04-19T02:21:39.413150+0000","last_active":"2024-04-19T02:21:39.413150+0000","last_peered":"2024-04-19T02:21:39.413150+0000","last_clean":"2024-04-19T02:21:39.413150+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:39.413150+0000","last_undegraded":"2024-04-19T02:21:39.413150+0000","last_fullsized":"2024-04-19T02:21:39.413150+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.412846+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:49.572797+0000","scrub_duration":0.0040928559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":829,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:28.540096+0000","last_change":"2024-04-19T02:22:28.540096+0000","last_active":"2024-04-19T02:22:28.540096+0000","last_peered":"2024-04-19T02:22:28.540096+0000","last_clean":"2024-04-19T02:22:28.540096+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:22:28.540096+0000","last_undegraded":"2024-04-19T02:22:28.540096+0000","last_fullsized":"2024-04-19T02:22:28.540096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_clean_scrub_stamp":"2024-04-19T02:22:28.539790+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:36.795119+0000","scrub_duration":0.0039321119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":552,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.418818+0000","last_change":"2024-04-19T02:21:32.418818+0000","last_active":"2024-04-19T02:21:32.418818+0000","last_peered":"2024-04-19T02:21:32.418818+0000","last_clean":"2024-04-19T02:21:32.418818+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:32.418818+0000","last_undegraded":"2024-04-19T02:21:32.418818+0000","last_fullsized":"2024-04-19T02:21:32.418818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'382","last_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_deep_scrub":"71'382","last_deep_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.418531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.300626+0000","scrub_duration":0.0048622070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1090,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.427651+0000","last_change":"2024-04-19T02:21:35.427651+0000","last_active":"2024-04-19T02:21:35.427651+0000","last_peered":"2024-04-19T02:21:35.427651+0000","last_clean":"2024-04-19T02:21:35.427651+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:35.427651+0000","last_undegraded":"2024-04-19T02:21:35.427651+0000","last_fullsized":"2024-04-19T02:21:35.427651+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.427379+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:58.566016+0000","scrub_duration":0.0038844489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":629,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.392319+0000","last_change":"2024-04-19T02:21:38.392319+0000","last_active":"2024-04-19T02:21:38.392319+0000","last_peered":"2024-04-19T02:21:38.392319+0000","last_clean":"2024-04-19T02:21:38.392319+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:38.392319+0000","last_undegraded":"2024-04-19T02:21:38.392319+0000","last_fullsized":"2024-04-19T02:21:38.392319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'460","last_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_deep_scrub":"71'460","last_deep_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.392049+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:54.270848+0000","scrub_duration":0.0042770439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":526,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.145612+0000","last_change":"2024-04-19T02:21:21.341631+0000","last_active":"2024-04-19T02:21:31.145612+0000","last_peered":"2024-04-19T02:21:31.145612+0000","last_clean":"2024-04-19T02:21:31.145612+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:21:31.145612+0000","last_undegraded":"2024-04-19T02:21:31.145612+0000","last_fullsized":"2024-04-19T02:21:31.145612+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":510,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:10.553978+0000","last_change":"2024-04-19T02:22:10.554193+0000","last_active":"2024-04-19T02:22:10.553978+0000","last_peered":"2024-04-19T02:22:10.553978+0000","last_clean":"2024-04-19T02:22:10.553978+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:22:10.553978+0000","last_undegraded":"2024-04-19T02:22:10.553978+0000","last_fullsized":"2024-04-19T02:22:10.553978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_clean_scrub_stamp":"2024-04-19T02:22:10.553922+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:39.845669+0000","scrub_duration":0.0045096329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"117'385","reported_seq":474,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:23.444030+0000","last_change":"2024-04-19T02:22:23.444279+0000","last_active":"2024-04-19T02:22:23.444030+0000","last_peered":"2024-04-19T02:22:23.444030+0000","last_clean":"2024-04-19T02:22:23.444030+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:22:23.444030+0000","last_undegraded":"2024-04-19T02:22:23.444030+0000","last_fullsized":"2024-04-19T02:22:23.444030+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'385","last_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_deep_scrub":"117'385","last_deep_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_clean_scrub_stamp":"2024-04-19T02:22:23.443970+0000","objects_scrubbed":4,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:42:37.382290+0000","scrub_duration":0.067762446000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.484417+0000","last_change":"2024-04-19T02:21:38.484643+0000","last_active":"2024-04-19T02:21:38.484417+0000","last_peered":"2024-04-19T02:21:38.484417+0000","last_clean":"2024-04-19T02:21:38.484417+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:38.484417+0000","last_undegraded":"2024-04-19T02:21:38.484417+0000","last_fullsized":"2024-04-19T02:21:38.484417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.484360+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:33.481985+0000","scrub_duration":0.0046311950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":200,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.350646+0000","last_change":"2024-04-19T02:22:27.350863+0000","last_active":"2024-04-19T02:22:27.350646+0000","last_peered":"2024-04-19T02:22:27.350646+0000","last_clean":"2024-04-19T02:22:27.350646+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:22:27.350646+0000","last_undegraded":"2024-04-19T02:22:27.350646+0000","last_fullsized":"2024-04-19T02:22:27.350646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.350592+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:53.591039+0000","scrub_duration":0.0034193769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1033,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:29.383247+0000","last_change":"2024-04-19T02:22:29.383500+0000","last_active":"2024-04-19T02:22:29.383247+0000","last_peered":"2024-04-19T02:22:29.383247+0000","last_clean":"2024-04-19T02:22:29.383247+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:22:29.383247+0000","last_undegraded":"2024-04-19T02:22:29.383247+0000","last_fullsized":"2024-04-19T02:22:29.383247+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_clean_scrub_stamp":"2024-04-19T02:22:29.383196+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:08.112873+0000","scrub_duration":0.0037375350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":206,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:29.500100+0000","last_change":"2024-04-19T02:22:29.500311+0000","last_active":"2024-04-19T02:22:29.500100+0000","last_peered":"2024-04-19T02:22:29.500100+0000","last_clean":"2024-04-19T02:22:29.500100+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:22:29.500100+0000","last_undegraded":"2024-04-19T02:22:29.500100+0000","last_fullsized":"2024-04-19T02:22:29.500100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:22:29.500024+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:22:29.500024+0000","last_clean_scrub_stamp":"2024-04-19T02:22:29.500024+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:35.401480+0000","scrub_duration":0.003259418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":922,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:33.348309+0000","last_change":"2024-04-19T02:22:33.348533+0000","last_active":"2024-04-19T02:22:33.348309+0000","last_peered":"2024-04-19T02:22:33.348309+0000","last_clean":"2024-04-19T02:22:33.348309+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:22:33.348309+0000","last_undegraded":"2024-04-19T02:22:33.348309+0000","last_fullsized":"2024-04-19T02:22:33.348309+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:22:33.348255+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:22:33.348255+0000","last_clean_scrub_stamp":"2024-04-19T02:22:33.348255+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:00.348420+0000","scrub_duration":0.0037124419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"117'66","reported_seq":147,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:03.012928+0000","last_change":"2024-04-19T02:23:03.013186+0000","last_active":"2024-04-19T02:23:03.012928+0000","last_peered":"2024-04-19T02:23:03.012928+0000","last_clean":"2024-04-19T02:23:03.012928+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:23:03.012928+0000","last_undegraded":"2024-04-19T02:23:03.012928+0000","last_fullsized":"2024-04-19T02:23:03.012928+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'66","last_scrub_stamp":"2024-04-19T02:23:03.012874+0000","last_deep_scrub":"117'66","last_deep_scrub_stamp":"2024-04-19T02:23:03.012874+0000","last_clean_scrub_stamp":"2024-04-19T02:23:03.012874+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:32.678301+0000","scrub_duration":0.0094532000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"117'170","reported_seq":260,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:20.436373+0000","last_change":"2024-04-19T02:22:20.436373+0000","last_active":"2024-04-19T02:22:20.436373+0000","last_peered":"2024-04-19T02:22:20.436373+0000","last_clean":"2024-04-19T02:22:20.436373+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:22:20.436373+0000","last_undegraded":"2024-04-19T02:22:20.436373+0000","last_fullsized":"2024-04-19T02:22:20.436373+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'170","last_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_deep_scrub":"117'170","last_deep_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_clean_scrub_stamp":"2024-04-19T02:22:20.436079+0000","objects_scrubbed":2,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:49.310358+0000","scrub_duration":0.036011089000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":908,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.503221+0000","last_change":"2024-04-19T02:21:46.503221+0000","last_active":"2024-04-19T02:21:46.503221+0000","last_peered":"2024-04-19T02:21:46.503221+0000","last_clean":"2024-04-19T02:21:46.503221+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:46.503221+0000","last_undegraded":"2024-04-19T02:21:46.503221+0000","last_fullsized":"2024-04-19T02:21:46.503221+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.502927+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:48.122985+0000","scrub_duration":0.0039232249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"117'295","reported_seq":445,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:51.473958+0000","last_change":"2024-04-19T02:22:51.473958+0000","last_active":"2024-04-19T02:22:51.473958+0000","last_peered":"2024-04-19T02:22:51.473958+0000","last_clean":"2024-04-19T02:22:51.473958+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:22:51.473958+0000","last_undegraded":"2024-04-19T02:22:51.473958+0000","last_fullsized":"2024-04-19T02:22:51.473958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'295","last_scrub_stamp":"2024-04-19T02:22:51.473630+0000","last_deep_scrub":"117'295","last_deep_scrub_stamp":"2024-04-19T02:22:51.473630+0000","last_clean_scrub_stamp":"2024-04-19T02:22:51.473630+0000","objects_scrubbed":2,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:26.681922+0000","scrub_duration":0.039376015,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":580,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.534416+0000","last_change":"2024-04-19T02:21:52.534416+0000","last_active":"2024-04-19T02:21:52.534416+0000","last_peered":"2024-04-19T02:21:52.534416+0000","last_clean":"2024-04-19T02:21:52.534416+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:52.534416+0000","last_undegraded":"2024-04-19T02:21:52.534416+0000","last_fullsized":"2024-04-19T02:21:52.534416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'443","last_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_deep_scrub":"71'443","last_deep_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.534152+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:28.134492+0000","scrub_duration":0.0046536420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"117'599","reported_seq":689,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:59.975707+0000","last_change":"2024-04-19T02:22:59.976040+0000","last_active":"2024-04-19T02:22:59.975707+0000","last_peered":"2024-04-19T02:22:59.975707+0000","last_clean":"2024-04-19T02:22:59.975707+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:22:59.975707+0000","last_undegraded":"2024-04-19T02:22:59.975707+0000","last_fullsized":"2024-04-19T02:22:59.975707+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'599","last_scrub_stamp":"2024-04-19T02:22:59.975650+0000","last_deep_scrub":"117'599","last_deep_scrub_stamp":"2024-04-19T02:22:59.975650+0000","last_clean_scrub_stamp":"2024-04-19T02:22:59.975650+0000","objects_scrubbed":2,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:09.470786+0000","scrub_duration":0.042147285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":504,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.572652+0000","last_change":"2024-04-19T02:21:31.572652+0000","last_active":"2024-04-19T02:21:31.572652+0000","last_peered":"2024-04-19T02:21:31.572652+0000","last_clean":"2024-04-19T02:21:31.572652+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:31.572652+0000","last_undegraded":"2024-04-19T02:21:31.572652+0000","last_fullsized":"2024-04-19T02:21:31.572652+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.572365+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:18.167461+0000","scrub_duration":0.0042499950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":123,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.144844+0000","last_change":"2024-04-19T02:21:21.304724+0000","last_active":"2024-04-19T02:21:31.144844+0000","last_peered":"2024-04-19T02:21:31.144844+0000","last_clean":"2024-04-19T02:21:31.144844+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:21:31.144844+0000","last_undegraded":"2024-04-19T02:21:31.144844+0000","last_fullsized":"2024-04-19T02:21:31.144844+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1095,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:49.460884+0000","last_change":"2024-04-19T02:21:49.460884+0000","last_active":"2024-04-19T02:21:49.460884+0000","last_peered":"2024-04-19T02:21:49.460884+0000","last_clean":"2024-04-19T02:21:49.460884+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:49.460884+0000","last_undegraded":"2024-04-19T02:21:49.460884+0000","last_fullsized":"2024-04-19T02:21:49.460884+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'491","last_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_deep_scrub":"71'491","last_deep_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_clean_scrub_stamp":"2024-04-19T02:21:49.460592+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:18.752338+0000","scrub_duration":0.0043248339999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"117'135","reported_seq":286,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:51.481277+0000","last_change":"2024-04-19T02:22:51.481277+0000","last_active":"2024-04-19T02:22:51.481277+0000","last_peered":"2024-04-19T02:22:51.481277+0000","last_clean":"2024-04-19T02:22:51.481277+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:22:51.481277+0000","last_undegraded":"2024-04-19T02:22:51.481277+0000","last_fullsized":"2024-04-19T02:22:51.481277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'135","last_scrub_stamp":"2024-04-19T02:22:51.480919+0000","last_deep_scrub":"117'135","last_deep_scrub_stamp":"2024-04-19T02:22:51.480919+0000","last_clean_scrub_stamp":"2024-04-19T02:22:51.480919+0000","objects_scrubbed":3,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:37:04.412065+0000","scrub_duration":0.058927439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:56.970065+0000","last_change":"2024-04-19T02:22:56.970279+0000","last_active":"2024-04-19T02:22:56.970065+0000","last_peered":"2024-04-19T02:22:56.970065+0000","last_clean":"2024-04-19T02:22:56.970065+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:22:56.970065+0000","last_undegraded":"2024-04-19T02:22:56.970065+0000","last_fullsized":"2024-04-19T02:22:56.970065+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:56.970013+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:56.970013+0000","last_clean_scrub_stamp":"2024-04-19T02:22:56.970013+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:55.835002+0000","scrub_duration":0.003871607,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"117'208","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.448417+0000","last_change":"2024-04-19T02:21:45.448731+0000","last_active":"2024-04-19T02:21:45.448417+0000","last_peered":"2024-04-19T02:21:45.448417+0000","last_clean":"2024-04-19T02:21:45.448417+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:45.448417+0000","last_undegraded":"2024-04-19T02:21:45.448417+0000","last_fullsized":"2024-04-19T02:21:45.448417+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'208","last_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_deep_scrub":"117'208","last_deep_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.448363+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:14.018739+0000","scrub_duration":0.041956280999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":596,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.414317+0000","last_change":"2024-04-19T02:22:06.414317+0000","last_active":"2024-04-19T02:22:06.414317+0000","last_peered":"2024-04-19T02:22:06.414317+0000","last_clean":"2024-04-19T02:22:06.414317+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:22:06.414317+0000","last_undegraded":"2024-04-19T02:22:06.414317+0000","last_fullsized":"2024-04-19T02:22:06.414317+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'428","last_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_deep_scrub":"71'428","last_deep_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.413898+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:34.571146+0000","scrub_duration":0.0043639839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":191,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:44.493125+0000","last_change":"2024-04-19T02:22:44.493125+0000","last_active":"2024-04-19T02:22:44.493125+0000","last_peered":"2024-04-19T02:22:44.493125+0000","last_clean":"2024-04-19T02:22:44.493125+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:22:44.493125+0000","last_undegraded":"2024-04-19T02:22:44.493125+0000","last_fullsized":"2024-04-19T02:22:44.493125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'53","last_scrub_stamp":"2024-04-19T02:22:44.492835+0000","last_deep_scrub":"71'53","last_deep_scrub_stamp":"2024-04-19T02:22:44.492835+0000","last_clean_scrub_stamp":"2024-04-19T02:22:44.492835+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:58.181590+0000","scrub_duration":0.0033014379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":463,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:44.184221+0000","last_change":"2024-04-19T02:22:44.184463+0000","last_active":"2024-04-19T02:22:44.184221+0000","last_peered":"2024-04-19T02:22:44.184221+0000","last_clean":"2024-04-19T02:22:44.184221+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:22:44.184221+0000","last_undegraded":"2024-04-19T02:22:44.184221+0000","last_fullsized":"2024-04-19T02:22:44.184221+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'366","last_scrub_stamp":"2024-04-19T02:22:44.184169+0000","last_deep_scrub":"71'366","last_deep_scrub_stamp":"2024-04-19T02:22:44.184169+0000","last_clean_scrub_stamp":"2024-04-19T02:22:44.184169+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:22.184025+0000","scrub_duration":0.0041324120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"117'391","reported_seq":516,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:55.516318+0000","last_change":"2024-04-19T02:22:55.516545+0000","last_active":"2024-04-19T02:22:55.516318+0000","last_peered":"2024-04-19T02:22:55.516318+0000","last_clean":"2024-04-19T02:22:55.516318+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:22:55.516318+0000","last_undegraded":"2024-04-19T02:22:55.516318+0000","last_fullsized":"2024-04-19T02:22:55.516318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'391","last_scrub_stamp":"2024-04-19T02:22:55.516264+0000","last_deep_scrub":"117'391","last_deep_scrub_stamp":"2024-04-19T02:22:55.516264+0000","last_clean_scrub_stamp":"2024-04-19T02:22:55.516264+0000","objects_scrubbed":1,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:06:56.283944+0000","scrub_duration":0.039503955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.216395+0000","last_change":"2024-04-19T02:22:06.216395+0000","last_active":"2024-04-19T02:22:06.216395+0000","last_peered":"2024-04-19T02:22:06.216395+0000","last_clean":"2024-04-19T02:22:06.216395+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:22:06.216395+0000","last_undegraded":"2024-04-19T02:22:06.216395+0000","last_fullsized":"2024-04-19T02:22:06.216395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'395","last_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_deep_scrub":"71'395","last_deep_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.216111+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:41.161541+0000","scrub_duration":0.0046009639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"117'159","reported_seq":230,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:05.001554+0000","last_change":"2024-04-19T02:23:05.001771+0000","last_active":"2024-04-19T02:23:05.001554+0000","last_peered":"2024-04-19T02:23:05.001554+0000","last_clean":"2024-04-19T02:23:05.001554+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:23:05.001554+0000","last_undegraded":"2024-04-19T02:23:05.001554+0000","last_fullsized":"2024-04-19T02:23:05.001554+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'159","last_scrub_stamp":"2024-04-19T02:23:05.001500+0000","last_deep_scrub":"117'159","last_deep_scrub_stamp":"2024-04-19T02:23:05.001500+0000","last_clean_scrub_stamp":"2024-04-19T02:23:05.001500+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:06.466425+0000","scrub_duration":0.011059131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.293874+0000","last_change":"2024-04-19T02:22:34.294074+0000","last_active":"2024-04-19T02:22:34.293874+0000","last_peered":"2024-04-19T02:22:34.293874+0000","last_clean":"2024-04-19T02:22:34.293874+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:22:34.293874+0000","last_undegraded":"2024-04-19T02:22:34.293874+0000","last_fullsized":"2024-04-19T02:22:34.293874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:34.293820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:34.293820+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.293820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:31:57.264337+0000","scrub_duration":0.003338344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"117'764","reported_seq":888,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:52.461545+0000","last_change":"2024-04-19T02:22:52.461765+0000","last_active":"2024-04-19T02:22:52.461545+0000","last_peered":"2024-04-19T02:22:52.461545+0000","last_clean":"2024-04-19T02:22:52.461545+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:22:52.461545+0000","last_undegraded":"2024-04-19T02:22:52.461545+0000","last_fullsized":"2024-04-19T02:22:52.461545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'764","last_scrub_stamp":"2024-04-19T02:22:52.461487+0000","last_deep_scrub":"117'764","last_deep_scrub_stamp":"2024-04-19T02:22:52.461487+0000","last_clean_scrub_stamp":"2024-04-19T02:22:52.461487+0000","objects_scrubbed":2,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:02.002974+0000","scrub_duration":0.073165514000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:46.237540+0000","last_change":"2024-04-19T02:22:46.237748+0000","last_active":"2024-04-19T02:22:46.237540+0000","last_peered":"2024-04-19T02:22:46.237540+0000","last_clean":"2024-04-19T02:22:46.237540+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:22:46.237540+0000","last_undegraded":"2024-04-19T02:22:46.237540+0000","last_fullsized":"2024-04-19T02:22:46.237540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'435","last_scrub_stamp":"2024-04-19T02:22:46.237488+0000","last_deep_scrub":"71'435","last_deep_scrub_stamp":"2024-04-19T02:22:46.237488+0000","last_clean_scrub_stamp":"2024-04-19T02:22:46.237488+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:59.977357+0000","scrub_duration":0.0044347270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:52.127411+0000","last_change":"2024-04-19T02:22:52.127688+0000","last_active":"2024-04-19T02:22:52.127411+0000","last_peered":"2024-04-19T02:22:52.127411+0000","last_clean":"2024-04-19T02:22:52.127411+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:22:52.127411+0000","last_undegraded":"2024-04-19T02:22:52.127411+0000","last_fullsized":"2024-04-19T02:22:52.127411+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:52.127364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:52.127364+0000","last_clean_scrub_stamp":"2024-04-19T02:22:52.127364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:11:21.031030+0000","scrub_duration":0.0035185220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"117'115","reported_seq":324,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:49.410089+0000","last_change":"2024-04-19T02:22:49.410296+0000","last_active":"2024-04-19T02:22:49.410089+0000","last_peered":"2024-04-19T02:22:49.410089+0000","last_clean":"2024-04-19T02:22:49.410089+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:22:49.410089+0000","last_undegraded":"2024-04-19T02:22:49.410089+0000","last_fullsized":"2024-04-19T02:22:49.410089+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'115","last_scrub_stamp":"2024-04-19T02:22:49.410036+0000","last_deep_scrub":"117'115","last_deep_scrub_stamp":"2024-04-19T02:22:49.410036+0000","last_clean_scrub_stamp":"2024-04-19T02:22:49.410036+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:53.945026+0000","scrub_duration":0.014947889000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":569,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.500920+0000","last_change":"2024-04-19T02:21:50.500920+0000","last_active":"2024-04-19T02:21:50.500920+0000","last_peered":"2024-04-19T02:21:50.500920+0000","last_clean":"2024-04-19T02:21:50.500920+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:50.500920+0000","last_undegraded":"2024-04-19T02:21:50.500920+0000","last_fullsized":"2024-04-19T02:21:50.500920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.500643+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:19:06.685542+0000","scrub_duration":0.0044626199999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:36.379494+0000","last_change":"2024-04-19T02:22:36.379699+0000","last_active":"2024-04-19T02:22:36.379494+0000","last_peered":"2024-04-19T02:22:36.379494+0000","last_clean":"2024-04-19T02:22:36.379494+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:22:36.379494+0000","last_undegraded":"2024-04-19T02:22:36.379494+0000","last_fullsized":"2024-04-19T02:22:36.379494+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:36.379438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:36.379438+0000","last_clean_scrub_stamp":"2024-04-19T02:22:36.379438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:52.044210+0000","scrub_duration":0.0032783790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"117'387","reported_seq":538,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:36.580396+0000","last_change":"2024-04-19T02:22:36.580619+0000","last_active":"2024-04-19T02:22:36.580396+0000","last_peered":"2024-04-19T02:22:36.580396+0000","last_clean":"2024-04-19T02:22:36.580396+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:22:36.580396+0000","last_undegraded":"2024-04-19T02:22:36.580396+0000","last_fullsized":"2024-04-19T02:22:36.580396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'387","last_scrub_stamp":"2024-04-19T02:22:36.580340+0000","last_deep_scrub":"117'387","last_deep_scrub_stamp":"2024-04-19T02:22:36.580340+0000","last_clean_scrub_stamp":"2024-04-19T02:22:36.580340+0000","objects_scrubbed":2,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:18.778615+0000","scrub_duration":0.066298640000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":481,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.418067+0000","last_change":"2024-04-19T02:21:47.418067+0000","last_active":"2024-04-19T02:21:47.418067+0000","last_peered":"2024-04-19T02:21:47.418067+0000","last_clean":"2024-04-19T02:21:47.418067+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:47.418067+0000","last_undegraded":"2024-04-19T02:21:47.418067+0000","last_fullsized":"2024-04-19T02:21:47.418067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'345","last_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_deep_scrub":"71'345","last_deep_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.417790+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:30.129614+0000","scrub_duration":0.0046618750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.410078+0000","last_change":"2024-04-19T02:22:08.410078+0000","last_active":"2024-04-19T02:22:08.410078+0000","last_peered":"2024-04-19T02:22:08.410078+0000","last_clean":"2024-04-19T02:22:08.410078+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:22:08.410078+0000","last_undegraded":"2024-04-19T02:22:08.410078+0000","last_fullsized":"2024-04-19T02:22:08.410078+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.409824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:12.416405+0000","scrub_duration":0.0032298549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":148,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.379540+0000","last_change":"2024-04-19T02:21:54.379775+0000","last_active":"2024-04-19T02:21:54.379540+0000","last_peered":"2024-04-19T02:21:54.379540+0000","last_clean":"2024-04-19T02:21:54.379540+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:54.379540+0000","last_undegraded":"2024-04-19T02:21:54.379540+0000","last_fullsized":"2024-04-19T02:21:54.379540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.379480+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:14.495728+0000","scrub_duration":0.0033461229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.419740+0000","last_change":"2024-04-19T02:21:40.419740+0000","last_active":"2024-04-19T02:21:40.419740+0000","last_peered":"2024-04-19T02:21:40.419740+0000","last_clean":"2024-04-19T02:21:40.419740+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:40.419740+0000","last_undegraded":"2024-04-19T02:21:40.419740+0000","last_fullsized":"2024-04-19T02:21:40.419740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'403","last_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_deep_scrub":"71'403","last_deep_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.419437+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:29.109984+0000","scrub_duration":0.0046038880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"117'461","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:50.207162+0000","last_change":"2024-04-19T02:22:50.207432+0000","last_active":"2024-04-19T02:22:50.207162+0000","last_peered":"2024-04-19T02:22:50.207162+0000","last_clean":"2024-04-19T02:22:50.207162+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:22:50.207162+0000","last_undegraded":"2024-04-19T02:22:50.207162+0000","last_fullsized":"2024-04-19T02:22:50.207162+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'461","last_scrub_stamp":"2024-04-19T02:22:50.207108+0000","last_deep_scrub":"117'461","last_deep_scrub_stamp":"2024-04-19T02:22:50.207108+0000","last_clean_scrub_stamp":"2024-04-19T02:22:50.207108+0000","objects_scrubbed":1,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:30.887522+0000","scrub_duration":0.038228984000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:46.401592+0000","last_change":"2024-04-19T02:22:46.401810+0000","last_active":"2024-04-19T02:22:46.401592+0000","last_peered":"2024-04-19T02:22:46.401592+0000","last_clean":"2024-04-19T02:22:46.401592+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:22:46.401592+0000","last_undegraded":"2024-04-19T02:22:46.401592+0000","last_fullsized":"2024-04-19T02:22:46.401592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:46.401543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:46.401543+0000","last_clean_scrub_stamp":"2024-04-19T02:22:46.401543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:54.137102+0000","scrub_duration":0.0032966150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":870,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:01.586120+0000","last_change":"2024-04-19T02:22:01.586120+0000","last_active":"2024-04-19T02:22:01.586120+0000","last_peered":"2024-04-19T02:22:01.586120+0000","last_clean":"2024-04-19T02:22:01.586120+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:22:01.586120+0000","last_undegraded":"2024-04-19T02:22:01.586120+0000","last_fullsized":"2024-04-19T02:22:01.586120+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'383","last_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_deep_scrub":"71'383","last_deep_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_clean_scrub_stamp":"2024-04-19T02:22:01.585841+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:50.276388+0000","scrub_duration":0.0039878709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":169,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763183+0000","last_change":"2024-04-19T02:16:58.382927+0000","last_active":"2024-04-19T02:21:31.763183+0000","last_peered":"2024-04-19T02:21:31.763183+0000","last_clean":"2024-04-19T02:21:31.763183+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:21:31.763183+0000","last_undegraded":"2024-04-19T02:21:31.763183+0000","last_fullsized":"2024-04-19T02:21:31.763183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:23.094612+0000","last_clean_scrub_stamp":"2024-04-19T02:16:23.094612+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.534676+0000","last_change":"2024-04-19T02:22:34.534888+0000","last_active":"2024-04-19T02:22:34.534676+0000","last_peered":"2024-04-19T02:22:34.534676+0000","last_clean":"2024-04-19T02:22:34.534676+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:22:34.534676+0000","last_undegraded":"2024-04-19T02:22:34.534676+0000","last_fullsized":"2024-04-19T02:22:34.534676+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:34.534627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:34.534627+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.534627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:40.751248+0000","scrub_duration":0.0032596080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":987,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:53.548677+0000","last_change":"2024-04-19T02:21:53.548677+0000","last_active":"2024-04-19T02:21:53.548677+0000","last_peered":"2024-04-19T02:21:53.548677+0000","last_clean":"2024-04-19T02:21:53.548677+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:53.548677+0000","last_undegraded":"2024-04-19T02:21:53.548677+0000","last_fullsized":"2024-04-19T02:21:53.548677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_clean_scrub_stamp":"2024-04-19T02:21:53.548415+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:32.430509+0000","scrub_duration":0.003797426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"117'67","reported_seq":191,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:58.294114+0000","last_change":"2024-04-19T02:22:58.294429+0000","last_active":"2024-04-19T02:22:58.294114+0000","last_peered":"2024-04-19T02:22:58.294114+0000","last_clean":"2024-04-19T02:22:58.294114+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:22:58.294114+0000","last_undegraded":"2024-04-19T02:22:58.294114+0000","last_fullsized":"2024-04-19T02:22:58.294114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'67","last_scrub_stamp":"2024-04-19T02:22:58.294055+0000","last_deep_scrub":"117'67","last_deep_scrub_stamp":"2024-04-19T02:22:58.294055+0000","last_clean_scrub_stamp":"2024-04-19T02:22:58.294055+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:08.487723+0000","scrub_duration":0.0065633660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:47.381294+0000","last_change":"2024-04-19T02:22:47.381294+0000","last_active":"2024-04-19T02:22:47.381294+0000","last_peered":"2024-04-19T02:22:47.381294+0000","last_clean":"2024-04-19T02:22:47.381294+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:22:47.381294+0000","last_undegraded":"2024-04-19T02:22:47.381294+0000","last_fullsized":"2024-04-19T02:22:47.381294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:47.381024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:47.381024+0000","last_clean_scrub_stamp":"2024-04-19T02:22:47.381024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:18.712981+0000","scrub_duration":0.0031651090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":964,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:51.372189+0000","last_change":"2024-04-19T02:21:51.372189+0000","last_active":"2024-04-19T02:21:51.372189+0000","last_peered":"2024-04-19T02:21:51.372189+0000","last_clean":"2024-04-19T02:21:51.372189+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:51.372189+0000","last_undegraded":"2024-04-19T02:21:51.372189+0000","last_fullsized":"2024-04-19T02:21:51.372189+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_clean_scrub_stamp":"2024-04-19T02:21:51.371896+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.379349+0000","scrub_duration":0.0039386960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"117'76","reported_seq":218,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.405467+0000","last_change":"2024-04-19T02:22:34.405467+0000","last_active":"2024-04-19T02:22:34.405467+0000","last_peered":"2024-04-19T02:22:34.405467+0000","last_clean":"2024-04-19T02:22:34.405467+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:22:34.405467+0000","last_undegraded":"2024-04-19T02:22:34.405467+0000","last_fullsized":"2024-04-19T02:22:34.405467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'76","last_scrub_stamp":"2024-04-19T02:22:34.405184+0000","last_deep_scrub":"117'76","last_deep_scrub_stamp":"2024-04-19T02:22:34.405184+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.405184+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.978891+0000","scrub_duration":0.022685261000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.382614+0000","last_change":"2024-04-19T02:21:47.382834+0000","last_active":"2024-04-19T02:21:47.382614+0000","last_peered":"2024-04-19T02:21:47.382614+0000","last_clean":"2024-04-19T02:21:47.382614+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:47.382614+0000","last_undegraded":"2024-04-19T02:21:47.382614+0000","last_fullsized":"2024-04-19T02:21:47.382614+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.382567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:21.368852+0000","scrub_duration":0.0033623530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":579,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.763606+0000","last_change":"2024-04-19T02:17:28.322494+0000","last_active":"2024-04-19T02:21:31.763606+0000","last_peered":"2024-04-19T02:21:31.763606+0000","last_clean":"2024-04-19T02:21:31.763606+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:21:31.763606+0000","last_undegraded":"2024-04-19T02:21:31.763606+0000","last_fullsized":"2024-04-19T02:21:31.763606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":514,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:58.918237+0000","last_change":"2024-04-19T02:22:58.918467+0000","last_active":"2024-04-19T02:22:58.918237+0000","last_peered":"2024-04-19T02:22:58.918237+0000","last_clean":"2024-04-19T02:22:58.918237+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:22:58.918237+0000","last_undegraded":"2024-04-19T02:22:58.918237+0000","last_fullsized":"2024-04-19T02:22:58.918237+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-19T02:22:58.918185+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-19T02:22:58.918185+0000","last_clean_scrub_stamp":"2024-04-19T02:22:58.918185+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:16.305340+0000","scrub_duration":0.0038846250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"117'453","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:43.287797+0000","last_change":"2024-04-19T02:22:43.288098+0000","last_active":"2024-04-19T02:22:43.287797+0000","last_peered":"2024-04-19T02:22:43.287797+0000","last_clean":"2024-04-19T02:22:43.287797+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:22:43.287797+0000","last_undegraded":"2024-04-19T02:22:43.287797+0000","last_fullsized":"2024-04-19T02:22:43.287797+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'453","last_scrub_stamp":"2024-04-19T02:22:43.287744+0000","last_deep_scrub":"117'453","last_deep_scrub_stamp":"2024-04-19T02:22:43.287744+0000","last_clean_scrub_stamp":"2024-04-19T02:22:43.287744+0000","objects_scrubbed":6,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:38.525762+0000","scrub_duration":0.078508173000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":567,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:14.293529+0000","last_change":"2024-04-19T02:22:14.293826+0000","last_active":"2024-04-19T02:22:14.293529+0000","last_peered":"2024-04-19T02:22:14.293529+0000","last_clean":"2024-04-19T02:22:14.293529+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:22:14.293529+0000","last_undegraded":"2024-04-19T02:22:14.293529+0000","last_fullsized":"2024-04-19T02:22:14.293529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'407","last_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_deep_scrub":"71'407","last_deep_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_clean_scrub_stamp":"2024-04-19T02:22:14.293476+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:01:56.491750+0000","scrub_duration":0.0053162419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"117'88","reported_seq":230,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:48.485720+0000","last_change":"2024-04-19T02:22:48.486046+0000","last_active":"2024-04-19T02:22:48.485720+0000","last_peered":"2024-04-19T02:22:48.485720+0000","last_clean":"2024-04-19T02:22:48.485720+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:22:48.485720+0000","last_undegraded":"2024-04-19T02:22:48.485720+0000","last_fullsized":"2024-04-19T02:22:48.485720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'88","last_scrub_stamp":"2024-04-19T02:22:48.485666+0000","last_deep_scrub":"117'88","last_deep_scrub_stamp":"2024-04-19T02:22:48.485666+0000","last_clean_scrub_stamp":"2024-04-19T02:22:48.485666+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:08.570008+0000","scrub_duration":0.0072681860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"117'325","reported_seq":406,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.418450+0000","last_change":"2024-04-19T02:21:46.418450+0000","last_active":"2024-04-19T02:21:46.418450+0000","last_peered":"2024-04-19T02:21:46.418450+0000","last_clean":"2024-04-19T02:21:46.418450+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:46.418450+0000","last_undegraded":"2024-04-19T02:21:46.418450+0000","last_fullsized":"2024-04-19T02:21:46.418450+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'325","last_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_deep_scrub":"117'325","last_deep_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.418135+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:23.243009+0000","scrub_duration":0.037437605999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1031,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:25.306188+0000","last_change":"2024-04-19T02:22:25.306412+0000","last_active":"2024-04-19T02:22:25.306188+0000","last_peered":"2024-04-19T02:22:25.306188+0000","last_clean":"2024-04-19T02:22:25.306188+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:22:25.306188+0000","last_undegraded":"2024-04-19T02:22:25.306188+0000","last_fullsized":"2024-04-19T02:22:25.306188+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'441","last_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_deep_scrub":"71'441","last_deep_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_clean_scrub_stamp":"2024-04-19T02:22:25.306128+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:33.739156+0000","scrub_duration":0.0038746840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:21.140582+0000","last_change":"2024-04-19T02:22:21.140820+0000","last_active":"2024-04-19T02:22:21.140582+0000","last_peered":"2024-04-19T02:22:21.140582+0000","last_clean":"2024-04-19T02:22:21.140582+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:22:21.140582+0000","last_undegraded":"2024-04-19T02:22:21.140582+0000","last_fullsized":"2024-04-19T02:22:21.140582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'54","last_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_deep_scrub":"71'54","last_deep_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_clean_scrub_stamp":"2024-04-19T02:22:21.140527+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:01.892166+0000","scrub_duration":0.0033383610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":641,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.239538+0000","last_change":"2024-04-19T02:22:08.239786+0000","last_active":"2024-04-19T02:22:08.239538+0000","last_peered":"2024-04-19T02:22:08.239538+0000","last_clean":"2024-04-19T02:22:08.239538+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:22:08.239538+0000","last_undegraded":"2024-04-19T02:22:08.239538+0000","last_fullsized":"2024-04-19T02:22:08.239538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'459","last_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_deep_scrub":"71'459","last_deep_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.239485+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:14.140941+0000","scrub_duration":0.004519805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":931,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.477808+0000","last_change":"2024-04-19T02:21:36.477808+0000","last_active":"2024-04-19T02:21:36.477808+0000","last_peered":"2024-04-19T02:21:36.477808+0000","last_clean":"2024-04-19T02:21:36.477808+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:36.477808+0000","last_undegraded":"2024-04-19T02:21:36.477808+0000","last_fullsized":"2024-04-19T02:21:36.477808+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.477536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:19.549278+0000","scrub_duration":0.0037289060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"117'574","reported_seq":697,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:55.367170+0000","last_change":"2024-04-19T02:22:55.367405+0000","last_active":"2024-04-19T02:22:55.367170+0000","last_peered":"2024-04-19T02:22:55.367170+0000","last_clean":"2024-04-19T02:22:55.367170+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:22:55.367170+0000","last_undegraded":"2024-04-19T02:22:55.367170+0000","last_fullsized":"2024-04-19T02:22:55.367170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'574","last_scrub_stamp":"2024-04-19T02:22:55.367117+0000","last_deep_scrub":"117'574","last_deep_scrub_stamp":"2024-04-19T02:22:55.367117+0000","last_clean_scrub_stamp":"2024-04-19T02:22:55.367117+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:37.598857+0000","scrub_duration":0.083286176000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":956,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:04.175397+0000","last_change":"2024-04-19T02:23:04.175735+0000","last_active":"2024-04-19T02:23:04.175397+0000","last_peered":"2024-04-19T02:23:04.175397+0000","last_clean":"2024-04-19T02:23:04.175397+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:23:04.175397+0000","last_undegraded":"2024-04-19T02:23:04.175397+0000","last_fullsized":"2024-04-19T02:23:04.175397+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'399","last_scrub_stamp":"2024-04-19T02:23:04.175284+0000","last_deep_scrub":"71'399","last_deep_scrub_stamp":"2024-04-19T02:23:04.175284+0000","last_clean_scrub_stamp":"2024-04-19T02:23:04.175284+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:53:22.010855+0000","scrub_duration":0.0047880470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"117'327","reported_seq":474,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:31.453784+0000","last_change":"2024-04-19T02:22:31.453992+0000","last_active":"2024-04-19T02:22:31.453784+0000","last_peered":"2024-04-19T02:22:31.453784+0000","last_clean":"2024-04-19T02:22:31.453784+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:22:31.453784+0000","last_undegraded":"2024-04-19T02:22:31.453784+0000","last_fullsized":"2024-04-19T02:22:31.453784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'327","last_scrub_stamp":"2024-04-19T02:22:31.453728+0000","last_deep_scrub":"117'327","last_deep_scrub_stamp":"2024-04-19T02:22:31.453728+0000","last_clean_scrub_stamp":"2024-04-19T02:22:31.453728+0000","objects_scrubbed":1,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:53.287501+0000","scrub_duration":0.037649608000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":873,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:01.507152+0000","last_change":"2024-04-19T02:23:01.507378+0000","last_active":"2024-04-19T02:23:01.507152+0000","last_peered":"2024-04-19T02:23:01.507152+0000","last_clean":"2024-04-19T02:23:01.507152+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:23:01.507152+0000","last_undegraded":"2024-04-19T02:23:01.507152+0000","last_fullsized":"2024-04-19T02:23:01.507152+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:23:01.507095+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:23:01.507095+0000","last_clean_scrub_stamp":"2024-04-19T02:23:01.507095+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:43.451357+0000","scrub_duration":0.0043105360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"117'499","reported_seq":624,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:49.553264+0000","last_change":"2024-04-19T02:22:49.553525+0000","last_active":"2024-04-19T02:22:49.553264+0000","last_peered":"2024-04-19T02:22:49.553264+0000","last_clean":"2024-04-19T02:22:49.553264+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:22:49.553264+0000","last_undegraded":"2024-04-19T02:22:49.553264+0000","last_fullsized":"2024-04-19T02:22:49.553264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'499","last_scrub_stamp":"2024-04-19T02:22:49.553205+0000","last_deep_scrub":"117'499","last_deep_scrub_stamp":"2024-04-19T02:22:49.553205+0000","last_clean_scrub_stamp":"2024-04-19T02:22:49.553205+0000","objects_scrubbed":3,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:11:23.089316+0000","scrub_duration":0.092222246999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:42.467422+0000","last_change":"2024-04-19T02:21:42.467663+0000","last_active":"2024-04-19T02:21:42.467422+0000","last_peered":"2024-04-19T02:21:42.467422+0000","last_clean":"2024-04-19T02:21:42.467422+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:42.467422+0000","last_undegraded":"2024-04-19T02:21:42.467422+0000","last_fullsized":"2024-04-19T02:21:42.467422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:42.467368+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:21.867316+0000","scrub_duration":0.0048531720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"117'59","reported_seq":201,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:54.468819+0000","last_change":"2024-04-19T02:22:54.469046+0000","last_active":"2024-04-19T02:22:54.468819+0000","last_peered":"2024-04-19T02:22:54.468819+0000","last_clean":"2024-04-19T02:22:54.468819+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:22:54.468819+0000","last_undegraded":"2024-04-19T02:22:54.468819+0000","last_fullsized":"2024-04-19T02:22:54.468819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'59","last_scrub_stamp":"2024-04-19T02:22:54.468762+0000","last_deep_scrub":"117'59","last_deep_scrub_stamp":"2024-04-19T02:22:54.468762+0000","last_clean_scrub_stamp":"2024-04-19T02:22:54.468762+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:15:16.302535+0000","scrub_duration":0.032450631000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":479,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.431879+0000","last_change":"2024-04-19T02:21:40.431879+0000","last_active":"2024-04-19T02:21:40.431879+0000","last_peered":"2024-04-19T02:21:40.431879+0000","last_clean":"2024-04-19T02:21:40.431879+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:40.431879+0000","last_undegraded":"2024-04-19T02:21:40.431879+0000","last_fullsized":"2024-04-19T02:21:40.431879+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.431601+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:34.613519+0000","scrub_duration":0.0040029599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"117'328","reported_seq":417,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:02.046232+0000","last_change":"2024-04-19T02:23:02.046503+0000","last_active":"2024-04-19T02:23:02.046232+0000","last_peered":"2024-04-19T02:23:02.046232+0000","last_clean":"2024-04-19T02:23:02.046232+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:23:02.046232+0000","last_undegraded":"2024-04-19T02:23:02.046232+0000","last_fullsized":"2024-04-19T02:23:02.046232+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'328","last_scrub_stamp":"2024-04-19T02:23:02.046172+0000","last_deep_scrub":"117'328","last_deep_scrub_stamp":"2024-04-19T02:23:02.046172+0000","last_clean_scrub_stamp":"2024-04-19T02:23:02.046172+0000","objects_scrubbed":2,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:49.525128+0000","scrub_duration":0.038848518999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:22.373931+0000","last_change":"2024-04-19T02:22:22.373931+0000","last_active":"2024-04-19T02:22:22.373931+0000","last_peered":"2024-04-19T02:22:22.373931+0000","last_clean":"2024-04-19T02:22:22.373931+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:22:22.373931+0000","last_undegraded":"2024-04-19T02:22:22.373931+0000","last_fullsized":"2024-04-19T02:22:22.373931+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_clean_scrub_stamp":"2024-04-19T02:22:22.373659+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:42.141017+0000","scrub_duration":0.004280603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"117'371","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.613687+0000","last_change":"2024-04-19T02:22:27.613926+0000","last_active":"2024-04-19T02:22:27.613687+0000","last_peered":"2024-04-19T02:22:27.613687+0000","last_clean":"2024-04-19T02:22:27.613687+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:22:27.613687+0000","last_undegraded":"2024-04-19T02:22:27.613687+0000","last_fullsized":"2024-04-19T02:22:27.613687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'371","last_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_deep_scrub":"117'371","last_deep_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.613626+0000","objects_scrubbed":4,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:02.559056+0000","scrub_duration":0.093301011000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":634,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.474035+0000","last_change":"2024-04-19T02:16:24.512785+0000","last_active":"2024-04-19T02:21:21.474035+0000","last_peered":"2024-04-19T02:21:21.474035+0000","last_clean":"2024-04-19T02:21:21.474035+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:21:21.474035+0000","last_undegraded":"2024-04-19T02:21:21.474035+0000","last_fullsized":"2024-04-19T02:21:21.474035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:16:24.102963+0000","last_clean_scrub_stamp":"2024-04-19T02:16:24.102963+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"117'69","reported_seq":193,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.346715+0000","last_change":"2024-04-19T02:22:12.346715+0000","last_active":"2024-04-19T02:22:12.346715+0000","last_peered":"2024-04-19T02:22:12.346715+0000","last_clean":"2024-04-19T02:22:12.346715+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:22:12.346715+0000","last_undegraded":"2024-04-19T02:22:12.346715+0000","last_fullsized":"2024-04-19T02:22:12.346715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'69","last_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_deep_scrub":"117'69","last_deep_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.346440+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:18.563061+0000","scrub_duration":0.030517280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":571,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:51.167051+0000","last_change":"2024-04-19T02:22:51.167051+0000","last_active":"2024-04-19T02:22:51.167051+0000","last_peered":"2024-04-19T02:22:51.167051+0000","last_clean":"2024-04-19T02:22:51.167051+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:22:51.167051+0000","last_undegraded":"2024-04-19T02:22:51.167051+0000","last_fullsized":"2024-04-19T02:22:51.167051+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:51.166776+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:51.166776+0000","last_clean_scrub_stamp":"2024-04-19T02:22:51.166776+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:27.426927+0000","scrub_duration":0.0039107209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"117'55","reported_seq":197,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:07.253769+0000","last_change":"2024-04-19T02:22:07.253769+0000","last_active":"2024-04-19T02:22:07.253769+0000","last_peered":"2024-04-19T02:22:07.253769+0000","last_clean":"2024-04-19T02:22:07.253769+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:22:07.253769+0000","last_undegraded":"2024-04-19T02:22:07.253769+0000","last_fullsized":"2024-04-19T02:22:07.253769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'55","last_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_deep_scrub":"117'55","last_deep_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_clean_scrub_stamp":"2024-04-19T02:22:07.253481+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:15.508809+0000","scrub_duration":0.035080496000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7685,"ondisk_log_size":7685,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738457,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126648,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245192,"statfs":{"total":96636764160,"available":96507076608,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:22:27 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.65900000000000003},"min":{"1min":0.50700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76100000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71299999999999997,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.82799999999999996}]},{"osd":1,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.748},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.625}]}]},{"osd":1,"up_from":78,"seq":335007449122,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66120,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305720,"statfs":{"total":96636764160,"available":96569057280,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.73999999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.623},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67900000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139604,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232236,"statfs":{"total":96636764160,"available":96493809664,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:22:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:22:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.59199999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.73099999999999998,"5min":0.81399999999999995,"15min":0.91900000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.624,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77100000000000002,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:23:13.842 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.842 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.843 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.844 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.844 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.845 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:16:23.094612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.845 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.845 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:16:24.102963+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:23:13.845 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:23:33.847 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:23:34.168 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:23:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-19T02:23:34.185 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-04-19T02:23:32.354065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129191761,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2867,"num_read_kb":1399068,"num_write":30506,"num_write_kb":4395543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3256,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34481,"ondisk_log_size":34481,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332372,"kb_used_data":68028,"kb_used_omap":10,"kb_used_meta":264309,"kb_avail":282783148,"statfs":{"total":289910292480,"available":289569943552,"internally_reserved":0,"allocated":69660672,"data_stored":259894514,"data_compressed":22023305,"data_compressed_allocated":33693696,"data_compressed_original":225738752,"omap_allocated":10357,"internal_metadata":270653323},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004443"},"pg_stats":[{"pgid":"4.3f","version":"71'411","reported_seq":580,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:24.452601+0000","last_change":"2024-04-19T02:23:24.452827+0000","last_active":"2024-04-19T02:23:24.452601+0000","last_peered":"2024-04-19T02:23:24.452601+0000","last_clean":"2024-04-19T02:23:24.452601+0000","last_became_active":"2024-04-19T02:16:24.514142+0000","last_became_peered":"2024-04-19T02:16:24.514142+0000","last_unstale":"2024-04-19T02:23:24.452601+0000","last_undegraded":"2024-04-19T02:23:24.452601+0000","last_fullsized":"2024-04-19T02:23:24.452601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-19T02:23:24.452549+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-19T02:23:24.452549+0000","last_clean_scrub_stamp":"2024-04-19T02:23:24.452549+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:15:53.657314+0000","scrub_duration":0.0038923669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22962,"num_write":378,"num_write_kb":67112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"71'423","reported_seq":606,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:29.351677+0000","last_change":"2024-04-19T02:23:29.351894+0000","last_active":"2024-04-19T02:23:29.351677+0000","last_peered":"2024-04-19T02:23:29.351677+0000","last_clean":"2024-04-19T02:23:29.351677+0000","last_became_active":"2024-04-19T02:16:24.511945+0000","last_became_peered":"2024-04-19T02:16:24.511945+0000","last_unstale":"2024-04-19T02:23:29.351677+0000","last_undegraded":"2024-04-19T02:23:29.351677+0000","last_fullsized":"2024-04-19T02:23:29.351677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'423","last_scrub_stamp":"2024-04-19T02:23:29.351626+0000","last_deep_scrub":"71'423","last_deep_scrub_stamp":"2024-04-19T02:23:29.351626+0000","last_clean_scrub_stamp":"2024-04-19T02:23:29.351626+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:53:47.187197+0000","scrub_duration":0.0050080970000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25792,"num_write":392,"num_write_kb":71387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"71'392","reported_seq":496,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:04.013362+0000","last_change":"2024-04-19T02:23:04.013651+0000","last_active":"2024-04-19T02:23:04.013362+0000","last_peered":"2024-04-19T02:23:04.013362+0000","last_clean":"2024-04-19T02:23:04.013362+0000","last_became_active":"2024-04-19T02:21:21.319789+0000","last_became_peered":"2024-04-19T02:21:21.319789+0000","last_unstale":"2024-04-19T02:23:04.013362+0000","last_undegraded":"2024-04-19T02:23:04.013362+0000","last_fullsized":"2024-04-19T02:23:04.013362+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:23:04.013308+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:23:04.013308+0000","last_clean_scrub_stamp":"2024-04-19T02:23:04.013308+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:46.975762+0000","scrub_duration":0.0039283240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13324,"num_write":366,"num_write_kb":75798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"71'387","reported_seq":478,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:38.327119+0000","last_change":"2024-04-19T02:22:38.327334+0000","last_active":"2024-04-19T02:22:38.327119+0000","last_peered":"2024-04-19T02:22:38.327119+0000","last_clean":"2024-04-19T02:22:38.327119+0000","last_became_active":"2024-04-19T02:21:21.327757+0000","last_became_peered":"2024-04-19T02:21:21.327757+0000","last_unstale":"2024-04-19T02:22:38.327119+0000","last_undegraded":"2024-04-19T02:22:38.327119+0000","last_fullsized":"2024-04-19T02:22:38.327119+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'387","last_scrub_stamp":"2024-04-19T02:22:38.327067+0000","last_deep_scrub":"71'387","last_deep_scrub_stamp":"2024-04-19T02:22:38.327067+0000","last_clean_scrub_stamp":"2024-04-19T02:22:38.327067+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:01:33.906804+0000","scrub_duration":0.0041694389999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5667,"num_write":350,"num_write_kb":50151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'413","reported_seq":554,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:20.424633+0000","last_change":"2024-04-19T02:23:20.424914+0000","last_active":"2024-04-19T02:23:20.424633+0000","last_peered":"2024-04-19T02:23:20.424633+0000","last_clean":"2024-04-19T02:23:20.424633+0000","last_became_active":"2024-04-19T02:16:24.509938+0000","last_became_peered":"2024-04-19T02:16:24.509938+0000","last_unstale":"2024-04-19T02:23:20.424633+0000","last_undegraded":"2024-04-19T02:23:20.424633+0000","last_fullsized":"2024-04-19T02:23:20.424633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'413","last_scrub_stamp":"2024-04-19T02:23:20.424577+0000","last_deep_scrub":"71'413","last_deep_scrub_stamp":"2024-04-19T02:23:20.424577+0000","last_clean_scrub_stamp":"2024-04-19T02:23:20.424577+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:27:02.656317+0000","scrub_duration":0.0048036620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8253,"num_write":377,"num_write_kb":47140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"71'418","reported_seq":548,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:56.014823+0000","last_change":"2024-04-19T02:22:56.014823+0000","last_active":"2024-04-19T02:22:56.014823+0000","last_peered":"2024-04-19T02:22:56.014823+0000","last_clean":"2024-04-19T02:22:56.014823+0000","last_became_active":"2024-04-19T02:21:21.341627+0000","last_became_peered":"2024-04-19T02:21:21.341627+0000","last_unstale":"2024-04-19T02:22:56.014823+0000","last_undegraded":"2024-04-19T02:22:56.014823+0000","last_fullsized":"2024-04-19T02:22:56.014823+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'418","last_scrub_stamp":"2024-04-19T02:22:56.014559+0000","last_deep_scrub":"71'418","last_deep_scrub_stamp":"2024-04-19T02:22:56.014559+0000","last_clean_scrub_stamp":"2024-04-19T02:22:56.014559+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:41.139679+0000","scrub_duration":0.0039438959999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":47598,"num_write":397,"num_write_kb":91174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'427","reported_seq":531,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:53.095795+0000","last_change":"2024-04-19T02:22:53.095795+0000","last_active":"2024-04-19T02:22:53.095795+0000","last_peered":"2024-04-19T02:22:53.095795+0000","last_clean":"2024-04-19T02:22:53.095795+0000","last_became_active":"2024-04-19T02:21:21.294282+0000","last_became_peered":"2024-04-19T02:21:21.294282+0000","last_unstale":"2024-04-19T02:22:53.095795+0000","last_undegraded":"2024-04-19T02:22:53.095795+0000","last_fullsized":"2024-04-19T02:22:53.095795+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-19T02:22:53.095537+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-19T02:22:53.095537+0000","last_clean_scrub_stamp":"2024-04-19T02:22:53.095537+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:35.282008+0000","scrub_duration":0.0044063469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12477,"num_write":393,"num_write_kb":84044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'404","reported_seq":595,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.358451+0000","last_change":"2024-04-19T02:21:50.358451+0000","last_active":"2024-04-19T02:21:50.358451+0000","last_peered":"2024-04-19T02:21:50.358451+0000","last_clean":"2024-04-19T02:21:50.358451+0000","last_became_active":"2024-04-19T02:21:21.324703+0000","last_became_peered":"2024-04-19T02:21:21.324703+0000","last_unstale":"2024-04-19T02:21:50.358451+0000","last_undegraded":"2024-04-19T02:21:50.358451+0000","last_fullsized":"2024-04-19T02:21:50.358451+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-19T02:21:50.358123+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.358123+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:30.347256+0000","scrub_duration":0.0040337430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59987,"num_write":367,"num_write_kb":109411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'421","reported_seq":575,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:15.200901+0000","last_change":"2024-04-19T02:23:15.201116+0000","last_active":"2024-04-19T02:23:15.200901+0000","last_peered":"2024-04-19T02:23:15.200901+0000","last_clean":"2024-04-19T02:23:15.200901+0000","last_became_active":"2024-04-19T02:16:24.510365+0000","last_became_peered":"2024-04-19T02:16:24.510365+0000","last_unstale":"2024-04-19T02:23:15.200901+0000","last_undegraded":"2024-04-19T02:23:15.200901+0000","last_fullsized":"2024-04-19T02:23:15.200901+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-19T02:23:15.200845+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-19T02:23:15.200845+0000","last_clean_scrub_stamp":"2024-04-19T02:23:15.200845+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:51:23.908962+0000","scrub_duration":0.0042352680000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21607,"num_write":383,"num_write_kb":42323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'392","reported_seq":566,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:17.428121+0000","last_change":"2024-04-19T02:23:17.428422+0000","last_active":"2024-04-19T02:23:17.428121+0000","last_peered":"2024-04-19T02:23:17.428121+0000","last_clean":"2024-04-19T02:23:17.428121+0000","last_became_active":"2024-04-19T02:16:24.514119+0000","last_became_peered":"2024-04-19T02:16:24.514119+0000","last_unstale":"2024-04-19T02:23:17.428121+0000","last_undegraded":"2024-04-19T02:23:17.428121+0000","last_fullsized":"2024-04-19T02:23:17.428121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:23:17.428070+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:23:17.428070+0000","last_clean_scrub_stamp":"2024-04-19T02:23:17.428070+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:11.304805+0000","scrub_duration":0.0045608139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29002,"num_write":357,"num_write_kb":63177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"71'374","reported_seq":470,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.465225+0000","last_change":"2024-04-19T02:21:34.465225+0000","last_active":"2024-04-19T02:21:34.465225+0000","last_peered":"2024-04-19T02:21:34.465225+0000","last_clean":"2024-04-19T02:21:34.465225+0000","last_became_active":"2024-04-19T02:21:21.302222+0000","last_became_peered":"2024-04-19T02:21:21.302222+0000","last_unstale":"2024-04-19T02:21:34.465225+0000","last_undegraded":"2024-04-19T02:21:34.465225+0000","last_fullsized":"2024-04-19T02:21:34.465225+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-19T02:21:34.464937+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.464937+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:54.461710+0000","scrub_duration":0.004016393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5331,"num_write":352,"num_write_kb":25758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'402","reported_seq":923,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:18.417193+0000","last_change":"2024-04-19T02:23:18.417417+0000","last_active":"2024-04-19T02:23:18.417193+0000","last_peered":"2024-04-19T02:23:18.417193+0000","last_clean":"2024-04-19T02:23:18.417193+0000","last_became_active":"2024-04-19T02:20:49.196063+0000","last_became_peered":"2024-04-19T02:20:49.196063+0000","last_unstale":"2024-04-19T02:23:18.417193+0000","last_undegraded":"2024-04-19T02:23:18.417193+0000","last_fullsized":"2024-04-19T02:23:18.417193+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'402","last_scrub_stamp":"2024-04-19T02:23:18.417143+0000","last_deep_scrub":"71'402","last_deep_scrub_stamp":"2024-04-19T02:23:18.417143+0000","last_clean_scrub_stamp":"2024-04-19T02:23:18.417143+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:27.958630+0000","scrub_duration":0.0042557159999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":23395,"num_write":377,"num_write_kb":113342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"71'402","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:14.359089+0000","last_change":"2024-04-19T02:23:14.359304+0000","last_active":"2024-04-19T02:23:14.359089+0000","last_peered":"2024-04-19T02:23:14.359089+0000","last_clean":"2024-04-19T02:23:14.359089+0000","last_became_active":"2024-04-19T02:16:24.510384+0000","last_became_peered":"2024-04-19T02:16:24.510384+0000","last_unstale":"2024-04-19T02:23:14.359089+0000","last_undegraded":"2024-04-19T02:23:14.359089+0000","last_fullsized":"2024-04-19T02:23:14.359089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'402","last_scrub_stamp":"2024-04-19T02:23:14.359037+0000","last_deep_scrub":"71'402","last_deep_scrub_stamp":"2024-04-19T02:23:14.359037+0000","last_clean_scrub_stamp":"2024-04-19T02:23:14.359037+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:40.874851+0000","scrub_duration":0.0048062649999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13287,"num_write":357,"num_write_kb":46853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'411","reported_seq":520,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:57.929553+0000","last_change":"2024-04-19T02:22:57.929839+0000","last_active":"2024-04-19T02:22:57.929553+0000","last_peered":"2024-04-19T02:22:57.929553+0000","last_clean":"2024-04-19T02:22:57.929553+0000","last_became_active":"2024-04-19T02:21:21.326306+0000","last_became_peered":"2024-04-19T02:21:21.326306+0000","last_unstale":"2024-04-19T02:22:57.929553+0000","last_undegraded":"2024-04-19T02:22:57.929553+0000","last_fullsized":"2024-04-19T02:22:57.929553+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-19T02:22:57.929502+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-19T02:22:57.929502+0000","last_clean_scrub_stamp":"2024-04-19T02:22:57.929502+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:32:33.504877+0000","scrub_duration":0.0041056340000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14370,"num_write":377,"num_write_kb":51103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'422","reported_seq":542,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:54.051830+0000","last_change":"2024-04-19T02:22:54.052070+0000","last_active":"2024-04-19T02:22:54.051830+0000","last_peered":"2024-04-19T02:22:54.051830+0000","last_clean":"2024-04-19T02:22:54.051830+0000","last_became_active":"2024-04-19T02:21:21.311873+0000","last_became_peered":"2024-04-19T02:21:21.311873+0000","last_unstale":"2024-04-19T02:22:54.051830+0000","last_undegraded":"2024-04-19T02:22:54.051830+0000","last_fullsized":"2024-04-19T02:22:54.051830+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'422","last_scrub_stamp":"2024-04-19T02:22:54.051778+0000","last_deep_scrub":"71'422","last_deep_scrub_stamp":"2024-04-19T02:22:54.051778+0000","last_clean_scrub_stamp":"2024-04-19T02:22:54.051778+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:58.277198+0000","scrub_duration":0.0040325459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17974,"num_write":383,"num_write_kb":79525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"71'463","reported_seq":589,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:16.826636+0000","last_change":"2024-04-19T02:23:16.826905+0000","last_active":"2024-04-19T02:23:16.826636+0000","last_peered":"2024-04-19T02:23:16.826636+0000","last_clean":"2024-04-19T02:23:16.826636+0000","last_became_active":"2024-04-19T02:21:21.303204+0000","last_became_peered":"2024-04-19T02:21:21.303204+0000","last_unstale":"2024-04-19T02:23:16.826636+0000","last_undegraded":"2024-04-19T02:23:16.826636+0000","last_fullsized":"2024-04-19T02:23:16.826636+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'463","last_scrub_stamp":"2024-04-19T02:23:16.826582+0000","last_deep_scrub":"71'463","last_deep_scrub_stamp":"2024-04-19T02:23:16.826582+0000","last_clean_scrub_stamp":"2024-04-19T02:23:16.826582+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:17.518157+0000","scrub_duration":0.004305115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":12903,"num_write":436,"num_write_kb":88624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'421","reported_seq":574,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:13.161939+0000","last_change":"2024-04-19T02:23:13.161939+0000","last_active":"2024-04-19T02:23:13.161939+0000","last_peered":"2024-04-19T02:23:13.161939+0000","last_clean":"2024-04-19T02:23:13.161939+0000","last_became_active":"2024-04-19T02:16:24.512416+0000","last_became_peered":"2024-04-19T02:16:24.512416+0000","last_unstale":"2024-04-19T02:23:13.161939+0000","last_undegraded":"2024-04-19T02:23:13.161939+0000","last_fullsized":"2024-04-19T02:23:13.161939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-19T02:23:13.161665+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-19T02:23:13.161665+0000","last_clean_scrub_stamp":"2024-04-19T02:23:13.161665+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:17.585358+0000","scrub_duration":0.0042348139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13397,"num_write":390,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'410","reported_seq":551,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.467243+0000","last_change":"2024-04-19T02:21:33.467243+0000","last_active":"2024-04-19T02:21:33.467243+0000","last_peered":"2024-04-19T02:21:33.467243+0000","last_clean":"2024-04-19T02:21:33.467243+0000","last_became_active":"2024-04-19T02:16:24.510625+0000","last_became_peered":"2024-04-19T02:16:24.510625+0000","last_unstale":"2024-04-19T02:21:33.467243+0000","last_undegraded":"2024-04-19T02:21:33.467243+0000","last_fullsized":"2024-04-19T02:21:33.467243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-19T02:21:33.466973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.466973+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:34:47.589455+0000","scrub_duration":0.0049157790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8530,"num_write":371,"num_write_kb":63053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"71'448","reported_seq":662,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:11.143562+0000","last_change":"2024-04-19T02:23:11.143840+0000","last_active":"2024-04-19T02:23:11.143562+0000","last_peered":"2024-04-19T02:23:11.143562+0000","last_clean":"2024-04-19T02:23:11.143562+0000","last_became_active":"2024-04-19T02:16:24.511409+0000","last_became_peered":"2024-04-19T02:16:24.511409+0000","last_unstale":"2024-04-19T02:23:11.143562+0000","last_undegraded":"2024-04-19T02:23:11.143562+0000","last_fullsized":"2024-04-19T02:23:11.143562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'448","last_scrub_stamp":"2024-04-19T02:23:11.143502+0000","last_deep_scrub":"71'448","last_deep_scrub_stamp":"2024-04-19T02:23:11.143502+0000","last_clean_scrub_stamp":"2024-04-19T02:23:11.143502+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:43.120143+0000","scrub_duration":0.0054073089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":50422,"num_write":413,"num_write_kb":97276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:42.243437+0000","last_change":"2024-04-19T02:22:42.243437+0000","last_active":"2024-04-19T02:22:42.243437+0000","last_peered":"2024-04-19T02:22:42.243437+0000","last_clean":"2024-04-19T02:22:42.243437+0000","last_became_active":"2024-04-19T02:21:21.321554+0000","last_became_peered":"2024-04-19T02:21:21.321554+0000","last_unstale":"2024-04-19T02:22:42.243437+0000","last_undegraded":"2024-04-19T02:22:42.243437+0000","last_fullsized":"2024-04-19T02:22:42.243437+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-19T02:22:42.243127+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-19T02:22:42.243127+0000","last_clean_scrub_stamp":"2024-04-19T02:22:42.243127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:59.449065+0000","scrub_duration":0.0042836250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2030,"num_write":395,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":557,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.476717+0000","last_change":"2024-04-19T02:21:41.476717+0000","last_active":"2024-04-19T02:21:41.476717+0000","last_peered":"2024-04-19T02:21:41.476717+0000","last_clean":"2024-04-19T02:21:41.476717+0000","last_became_active":"2024-04-19T02:21:21.300506+0000","last_became_peered":"2024-04-19T02:21:21.300506+0000","last_unstale":"2024-04-19T02:21:41.476717+0000","last_undegraded":"2024-04-19T02:21:41.476717+0000","last_fullsized":"2024-04-19T02:21:41.476717+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-19T02:21:41.476396+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.476396+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:05:52.160962+0000","scrub_duration":0.0037331780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24219,"num_write":401,"num_write_kb":100932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'464","reported_seq":1135,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.592031+0000","last_change":"2024-04-19T02:22:12.592031+0000","last_active":"2024-04-19T02:22:12.592031+0000","last_peered":"2024-04-19T02:22:12.592031+0000","last_clean":"2024-04-19T02:22:12.592031+0000","last_became_active":"2024-04-19T02:20:46.202182+0000","last_became_peered":"2024-04-19T02:20:46.202182+0000","last_unstale":"2024-04-19T02:22:12.592031+0000","last_undegraded":"2024-04-19T02:22:12.592031+0000","last_fullsized":"2024-04-19T02:22:12.592031+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'464","last_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_deep_scrub":"71'464","last_deep_scrub_stamp":"2024-04-19T02:22:12.591764+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.591764+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:14.599217+0000","scrub_duration":0.0039062849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":76622,"num_write":441,"num_write_kb":117670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":913,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:09.109371+0000","last_change":"2024-04-19T02:23:09.109371+0000","last_active":"2024-04-19T02:23:09.109371+0000","last_peered":"2024-04-19T02:23:09.109371+0000","last_clean":"2024-04-19T02:23:09.109371+0000","last_became_active":"2024-04-19T02:20:38.181194+0000","last_became_peered":"2024-04-19T02:20:38.181194+0000","last_unstale":"2024-04-19T02:23:09.109371+0000","last_undegraded":"2024-04-19T02:23:09.109371+0000","last_fullsized":"2024-04-19T02:23:09.109371+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-19T02:23:09.109087+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-19T02:23:09.109087+0000","last_clean_scrub_stamp":"2024-04-19T02:23:09.109087+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:09:16.758677+0000","scrub_duration":0.0041038419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5329,"num_write":368,"num_write_kb":59234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'431","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.568618+0000","last_change":"2024-04-19T02:22:08.568618+0000","last_active":"2024-04-19T02:22:08.568618+0000","last_peered":"2024-04-19T02:22:08.568618+0000","last_clean":"2024-04-19T02:22:08.568618+0000","last_became_active":"2024-04-19T02:16:24.509262+0000","last_became_peered":"2024-04-19T02:16:24.509262+0000","last_unstale":"2024-04-19T02:22:08.568618+0000","last_undegraded":"2024-04-19T02:22:08.568618+0000","last_fullsized":"2024-04-19T02:22:08.568618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-19T02:22:08.568338+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.568338+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:51.280163+0000","scrub_duration":0.0042660390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15519,"num_write":404,"num_write_kb":55336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'417","reported_seq":963,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:59.650456+0000","last_change":"2024-04-19T02:21:59.650456+0000","last_active":"2024-04-19T02:21:59.650456+0000","last_peered":"2024-04-19T02:21:59.650456+0000","last_clean":"2024-04-19T02:21:59.650456+0000","last_became_active":"2024-04-19T02:20:59.194816+0000","last_became_peered":"2024-04-19T02:20:59.194816+0000","last_unstale":"2024-04-19T02:21:59.650456+0000","last_undegraded":"2024-04-19T02:21:59.650456+0000","last_fullsized":"2024-04-19T02:21:59.650456+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:59.650190+0000","last_clean_scrub_stamp":"2024-04-19T02:21:59.650190+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:15.528989+0000","scrub_duration":0.0039580250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10015,"num_write":398,"num_write_kb":46262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"71'520","reported_seq":1187,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:07.149884+0000","last_change":"2024-04-19T02:23:07.150104+0000","last_active":"2024-04-19T02:23:07.149884+0000","last_peered":"2024-04-19T02:23:07.149884+0000","last_clean":"2024-04-19T02:23:07.149884+0000","last_became_active":"2024-04-19T02:20:51.200992+0000","last_became_peered":"2024-04-19T02:20:51.200992+0000","last_unstale":"2024-04-19T02:23:07.149884+0000","last_undegraded":"2024-04-19T02:23:07.149884+0000","last_fullsized":"2024-04-19T02:23:07.149884+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'520","last_scrub_stamp":"2024-04-19T02:23:07.149832+0000","last_deep_scrub":"71'520","last_deep_scrub_stamp":"2024-04-19T02:23:07.149832+0000","last_clean_scrub_stamp":"2024-04-19T02:23:07.149832+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:16.629049+0000","scrub_duration":0.0041642800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45741,"num_write":481,"num_write_kb":110878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.413150+0000","last_change":"2024-04-19T02:21:39.413150+0000","last_active":"2024-04-19T02:21:39.413150+0000","last_peered":"2024-04-19T02:21:39.413150+0000","last_clean":"2024-04-19T02:21:39.413150+0000","last_became_active":"2024-04-19T02:21:21.340841+0000","last_became_peered":"2024-04-19T02:21:21.340841+0000","last_unstale":"2024-04-19T02:21:39.413150+0000","last_undegraded":"2024-04-19T02:21:39.413150+0000","last_fullsized":"2024-04-19T02:21:39.413150+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-19T02:21:39.412846+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.412846+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:49.572797+0000","scrub_duration":0.0040928559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35005,"num_write":382,"num_write_kb":83857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":829,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:28.540096+0000","last_change":"2024-04-19T02:22:28.540096+0000","last_active":"2024-04-19T02:22:28.540096+0000","last_peered":"2024-04-19T02:22:28.540096+0000","last_clean":"2024-04-19T02:22:28.540096+0000","last_became_active":"2024-04-19T02:20:37.200045+0000","last_became_peered":"2024-04-19T02:20:37.200045+0000","last_unstale":"2024-04-19T02:22:28.540096+0000","last_undegraded":"2024-04-19T02:22:28.540096+0000","last_fullsized":"2024-04-19T02:22:28.540096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-19T02:22:28.539790+0000","last_clean_scrub_stamp":"2024-04-19T02:22:28.539790+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:36.795119+0000","scrub_duration":0.0039321119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4631,"num_write":325,"num_write_kb":22010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"71'382","reported_seq":552,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.418818+0000","last_change":"2024-04-19T02:21:32.418818+0000","last_active":"2024-04-19T02:21:32.418818+0000","last_peered":"2024-04-19T02:21:32.418818+0000","last_clean":"2024-04-19T02:21:32.418818+0000","last_became_active":"2024-04-19T02:16:24.509345+0000","last_became_peered":"2024-04-19T02:16:24.509345+0000","last_unstale":"2024-04-19T02:21:32.418818+0000","last_undegraded":"2024-04-19T02:21:32.418818+0000","last_fullsized":"2024-04-19T02:21:32.418818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'382","last_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_deep_scrub":"71'382","last_deep_scrub_stamp":"2024-04-19T02:21:32.418531+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.418531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:11.300626+0000","scrub_duration":0.0048622070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26373,"num_write":348,"num_write_kb":54658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'470","reported_seq":1090,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.427651+0000","last_change":"2024-04-19T02:21:35.427651+0000","last_active":"2024-04-19T02:21:35.427651+0000","last_peered":"2024-04-19T02:21:35.427651+0000","last_clean":"2024-04-19T02:21:35.427651+0000","last_became_active":"2024-04-19T02:20:56.221522+0000","last_became_peered":"2024-04-19T02:20:56.221522+0000","last_unstale":"2024-04-19T02:21:35.427651+0000","last_undegraded":"2024-04-19T02:21:35.427651+0000","last_fullsized":"2024-04-19T02:21:35.427651+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-19T02:21:35.427379+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.427379+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:58.566016+0000","scrub_duration":0.0038844489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37126,"num_write":437,"num_write_kb":71299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'460","reported_seq":629,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.392319+0000","last_change":"2024-04-19T02:21:38.392319+0000","last_active":"2024-04-19T02:21:38.392319+0000","last_peered":"2024-04-19T02:21:38.392319+0000","last_clean":"2024-04-19T02:21:38.392319+0000","last_became_active":"2024-04-19T02:16:24.509382+0000","last_became_peered":"2024-04-19T02:16:24.509382+0000","last_unstale":"2024-04-19T02:21:38.392319+0000","last_undegraded":"2024-04-19T02:21:38.392319+0000","last_fullsized":"2024-04-19T02:21:38.392319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'460","last_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_deep_scrub":"71'460","last_deep_scrub_stamp":"2024-04-19T02:21:38.392049+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.392049+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:54.270848+0000","scrub_duration":0.0042770439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20467,"num_write":428,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'419","reported_seq":537,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:14.854936+0000","last_change":"2024-04-19T02:23:14.855217+0000","last_active":"2024-04-19T02:23:14.854936+0000","last_peered":"2024-04-19T02:23:14.854936+0000","last_clean":"2024-04-19T02:23:14.854936+0000","last_became_active":"2024-04-19T02:21:21.323715+0000","last_became_peered":"2024-04-19T02:21:21.323715+0000","last_unstale":"2024-04-19T02:23:14.854936+0000","last_undegraded":"2024-04-19T02:23:14.854936+0000","last_fullsized":"2024-04-19T02:23:14.854936+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-19T02:23:14.854880+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-19T02:23:14.854880+0000","last_clean_scrub_stamp":"2024-04-19T02:23:14.854880+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:18.975422+0000","scrub_duration":0.0042217979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13361,"num_write":384,"num_write_kb":42464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'376","reported_seq":511,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:10.554193+0000","last_change":"2024-04-19T02:22:10.554193+0000","last_active":"2024-04-19T02:22:10.554193+0000","last_peered":"2024-04-19T02:22:10.554193+0000","last_clean":"2024-04-19T02:22:10.554193+0000","last_became_active":"2024-04-19T02:16:24.509690+0000","last_became_peered":"2024-04-19T02:16:24.509690+0000","last_unstale":"2024-04-19T02:22:10.554193+0000","last_undegraded":"2024-04-19T02:22:10.554193+0000","last_fullsized":"2024-04-19T02:22:10.554193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-19T02:22:10.553922+0000","last_clean_scrub_stamp":"2024-04-19T02:22:10.553922+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:39.845669+0000","scrub_duration":0.0045096329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5095,"num_write":338,"num_write_kb":38648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"117'385","reported_seq":474,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:23.444030+0000","last_change":"2024-04-19T02:22:23.444279+0000","last_active":"2024-04-19T02:22:23.444030+0000","last_peered":"2024-04-19T02:22:23.444030+0000","last_clean":"2024-04-19T02:22:23.444030+0000","last_became_active":"2024-04-19T02:21:21.323143+0000","last_became_peered":"2024-04-19T02:21:21.323143+0000","last_unstale":"2024-04-19T02:22:23.444030+0000","last_undegraded":"2024-04-19T02:22:23.444030+0000","last_fullsized":"2024-04-19T02:22:23.444030+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'385","last_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_deep_scrub":"117'385","last_deep_scrub_stamp":"2024-04-19T02:22:23.443970+0000","last_clean_scrub_stamp":"2024-04-19T02:22:23.443970+0000","objects_scrubbed":4,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:42:37.382290+0000","scrub_duration":0.067762446000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'400","reported_seq":559,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.484417+0000","last_change":"2024-04-19T02:21:38.484643+0000","last_active":"2024-04-19T02:21:38.484417+0000","last_peered":"2024-04-19T02:21:38.484417+0000","last_clean":"2024-04-19T02:21:38.484417+0000","last_became_active":"2024-04-19T02:16:24.514332+0000","last_became_peered":"2024-04-19T02:16:24.514332+0000","last_unstale":"2024-04-19T02:21:38.484417+0000","last_undegraded":"2024-04-19T02:21:38.484417+0000","last_fullsized":"2024-04-19T02:21:38.484417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-19T02:21:38.484360+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.484360+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:33.481985+0000","scrub_duration":0.0046311950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12949,"num_write":359,"num_write_kb":55709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"71'64","reported_seq":201,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.350863+0000","last_change":"2024-04-19T02:22:27.350863+0000","last_active":"2024-04-19T02:22:27.350863+0000","last_peered":"2024-04-19T02:22:27.350863+0000","last_clean":"2024-04-19T02:22:27.350863+0000","last_became_active":"2024-04-19T02:20:30.537013+0000","last_became_peered":"2024-04-19T02:20:30.537013+0000","last_unstale":"2024-04-19T02:22:27.350863+0000","last_undegraded":"2024-04-19T02:22:27.350863+0000","last_fullsized":"2024-04-19T02:22:27.350863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-19T02:22:27.350592+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.350592+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:53.591039+0000","scrub_duration":0.0034193769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'445","reported_seq":1033,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:29.383247+0000","last_change":"2024-04-19T02:22:29.383500+0000","last_active":"2024-04-19T02:22:29.383247+0000","last_peered":"2024-04-19T02:22:29.383247+0000","last_clean":"2024-04-19T02:22:29.383247+0000","last_became_active":"2024-04-19T02:20:56.221857+0000","last_became_peered":"2024-04-19T02:20:56.221857+0000","last_unstale":"2024-04-19T02:22:29.383247+0000","last_undegraded":"2024-04-19T02:22:29.383247+0000","last_fullsized":"2024-04-19T02:22:29.383247+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:29.383196+0000","last_clean_scrub_stamp":"2024-04-19T02:22:29.383196+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:08.112873+0000","scrub_duration":0.0037375350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":31754,"num_write":411,"num_write_kb":59645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'69","reported_seq":207,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:29.500311+0000","last_change":"2024-04-19T02:22:29.500311+0000","last_active":"2024-04-19T02:22:29.500311+0000","last_peered":"2024-04-19T02:22:29.500311+0000","last_clean":"2024-04-19T02:22:29.500311+0000","last_became_active":"2024-04-19T02:20:30.536045+0000","last_became_peered":"2024-04-19T02:20:30.536045+0000","last_unstale":"2024-04-19T02:22:29.500311+0000","last_undegraded":"2024-04-19T02:22:29.500311+0000","last_fullsized":"2024-04-19T02:22:29.500311+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:22:29.500024+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:22:29.500024+0000","last_clean_scrub_stamp":"2024-04-19T02:22:29.500024+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:35.401480+0000","scrub_duration":0.003259418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"71'390","reported_seq":922,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:33.348309+0000","last_change":"2024-04-19T02:22:33.348533+0000","last_active":"2024-04-19T02:22:33.348309+0000","last_peered":"2024-04-19T02:22:33.348309+0000","last_clean":"2024-04-19T02:22:33.348309+0000","last_became_active":"2024-04-19T02:21:01.203481+0000","last_became_peered":"2024-04-19T02:21:01.203481+0000","last_unstale":"2024-04-19T02:22:33.348309+0000","last_undegraded":"2024-04-19T02:22:33.348309+0000","last_fullsized":"2024-04-19T02:22:33.348309+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:22:33.348255+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:22:33.348255+0000","last_clean_scrub_stamp":"2024-04-19T02:22:33.348255+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:00.348420+0000","scrub_duration":0.0037124419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27648,"num_write":357,"num_write_kb":59502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"117'66","reported_seq":147,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:03.012928+0000","last_change":"2024-04-19T02:23:03.013186+0000","last_active":"2024-04-19T02:23:03.012928+0000","last_peered":"2024-04-19T02:23:03.012928+0000","last_clean":"2024-04-19T02:23:03.012928+0000","last_became_active":"2024-04-19T02:21:21.339335+0000","last_became_peered":"2024-04-19T02:21:21.339335+0000","last_unstale":"2024-04-19T02:23:03.012928+0000","last_undegraded":"2024-04-19T02:23:03.012928+0000","last_fullsized":"2024-04-19T02:23:03.012928+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'66","last_scrub_stamp":"2024-04-19T02:23:03.012874+0000","last_deep_scrub":"117'66","last_deep_scrub_stamp":"2024-04-19T02:23:03.012874+0000","last_clean_scrub_stamp":"2024-04-19T02:23:03.012874+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:32.678301+0000","scrub_duration":0.0094532000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"117'170","reported_seq":260,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:20.436373+0000","last_change":"2024-04-19T02:22:20.436373+0000","last_active":"2024-04-19T02:22:20.436373+0000","last_peered":"2024-04-19T02:22:20.436373+0000","last_clean":"2024-04-19T02:22:20.436373+0000","last_became_active":"2024-04-19T02:21:21.319448+0000","last_became_peered":"2024-04-19T02:21:21.319448+0000","last_unstale":"2024-04-19T02:22:20.436373+0000","last_undegraded":"2024-04-19T02:22:20.436373+0000","last_fullsized":"2024-04-19T02:22:20.436373+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'170","last_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_deep_scrub":"117'170","last_deep_scrub_stamp":"2024-04-19T02:22:20.436079+0000","last_clean_scrub_stamp":"2024-04-19T02:22:20.436079+0000","objects_scrubbed":2,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:49.310358+0000","scrub_duration":0.036011089000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"71'390","reported_seq":908,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.503221+0000","last_change":"2024-04-19T02:21:46.503221+0000","last_active":"2024-04-19T02:21:46.503221+0000","last_peered":"2024-04-19T02:21:46.503221+0000","last_clean":"2024-04-19T02:21:46.503221+0000","last_became_active":"2024-04-19T02:20:41.198732+0000","last_became_peered":"2024-04-19T02:20:41.198732+0000","last_unstale":"2024-04-19T02:21:46.503221+0000","last_undegraded":"2024-04-19T02:21:46.503221+0000","last_fullsized":"2024-04-19T02:21:46.503221+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'390","last_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_deep_scrub":"71'390","last_deep_scrub_stamp":"2024-04-19T02:21:46.502927+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.502927+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:48.122985+0000","scrub_duration":0.0039232249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9985,"num_write":355,"num_write_kb":34170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"117'295","reported_seq":445,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:51.473958+0000","last_change":"2024-04-19T02:22:51.473958+0000","last_active":"2024-04-19T02:22:51.473958+0000","last_peered":"2024-04-19T02:22:51.473958+0000","last_clean":"2024-04-19T02:22:51.473958+0000","last_became_active":"2024-04-19T02:20:34.186318+0000","last_became_peered":"2024-04-19T02:20:34.186318+0000","last_unstale":"2024-04-19T02:22:51.473958+0000","last_undegraded":"2024-04-19T02:22:51.473958+0000","last_fullsized":"2024-04-19T02:22:51.473958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'295","last_scrub_stamp":"2024-04-19T02:22:51.473630+0000","last_deep_scrub":"117'295","last_deep_scrub_stamp":"2024-04-19T02:22:51.473630+0000","last_clean_scrub_stamp":"2024-04-19T02:22:51.473630+0000","objects_scrubbed":2,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:26.681922+0000","scrub_duration":0.039376015,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"71'443","reported_seq":580,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.534416+0000","last_change":"2024-04-19T02:21:52.534416+0000","last_active":"2024-04-19T02:21:52.534416+0000","last_peered":"2024-04-19T02:21:52.534416+0000","last_clean":"2024-04-19T02:21:52.534416+0000","last_became_active":"2024-04-19T02:16:24.512247+0000","last_became_peered":"2024-04-19T02:16:24.512247+0000","last_unstale":"2024-04-19T02:21:52.534416+0000","last_undegraded":"2024-04-19T02:21:52.534416+0000","last_fullsized":"2024-04-19T02:21:52.534416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'443","last_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_deep_scrub":"71'443","last_deep_scrub_stamp":"2024-04-19T02:21:52.534152+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.534152+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:28.134492+0000","scrub_duration":0.0046536420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8244,"num_write":417,"num_write_kb":50391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"117'599","reported_seq":689,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:59.975707+0000","last_change":"2024-04-19T02:22:59.976040+0000","last_active":"2024-04-19T02:22:59.975707+0000","last_peered":"2024-04-19T02:22:59.975707+0000","last_clean":"2024-04-19T02:22:59.975707+0000","last_became_active":"2024-04-19T02:21:21.319787+0000","last_became_peered":"2024-04-19T02:21:21.319787+0000","last_unstale":"2024-04-19T02:22:59.975707+0000","last_undegraded":"2024-04-19T02:22:59.975707+0000","last_fullsized":"2024-04-19T02:22:59.975707+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'599","last_scrub_stamp":"2024-04-19T02:22:59.975650+0000","last_deep_scrub":"117'599","last_deep_scrub_stamp":"2024-04-19T02:22:59.975650+0000","last_clean_scrub_stamp":"2024-04-19T02:22:59.975650+0000","objects_scrubbed":2,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:09.470786+0000","scrub_duration":0.042147285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'420","reported_seq":504,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.572652+0000","last_change":"2024-04-19T02:21:31.572652+0000","last_active":"2024-04-19T02:21:31.572652+0000","last_peered":"2024-04-19T02:21:31.572652+0000","last_clean":"2024-04-19T02:21:31.572652+0000","last_became_active":"2024-04-19T02:21:21.306109+0000","last_became_peered":"2024-04-19T02:21:21.306109+0000","last_unstale":"2024-04-19T02:21:31.572652+0000","last_undegraded":"2024-04-19T02:21:31.572652+0000","last_fullsized":"2024-04-19T02:21:31.572652+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:31.572365+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.572365+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:18.167461+0000","scrub_duration":0.0042499950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4176,"num_write":379,"num_write_kb":42595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'55","reported_seq":134,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:11.961027+0000","last_change":"2024-04-19T02:23:11.961252+0000","last_active":"2024-04-19T02:23:11.961027+0000","last_peered":"2024-04-19T02:23:11.961027+0000","last_clean":"2024-04-19T02:23:11.961027+0000","last_became_active":"2024-04-19T02:21:21.302727+0000","last_became_peered":"2024-04-19T02:21:21.302727+0000","last_unstale":"2024-04-19T02:23:11.961027+0000","last_undegraded":"2024-04-19T02:23:11.961027+0000","last_fullsized":"2024-04-19T02:23:11.961027+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'55","last_scrub_stamp":"2024-04-19T02:23:11.960972+0000","last_deep_scrub":"71'55","last_deep_scrub_stamp":"2024-04-19T02:23:11.960972+0000","last_clean_scrub_stamp":"2024-04-19T02:23:11.960972+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:13.316143+0000","scrub_duration":0.0035085490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'491","reported_seq":1095,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:49.460884+0000","last_change":"2024-04-19T02:21:49.460884+0000","last_active":"2024-04-19T02:21:49.460884+0000","last_peered":"2024-04-19T02:21:49.460884+0000","last_clean":"2024-04-19T02:21:49.460884+0000","last_became_active":"2024-04-19T02:20:59.194665+0000","last_became_peered":"2024-04-19T02:20:59.194665+0000","last_unstale":"2024-04-19T02:21:49.460884+0000","last_undegraded":"2024-04-19T02:21:49.460884+0000","last_fullsized":"2024-04-19T02:21:49.460884+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'491","last_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_deep_scrub":"71'491","last_deep_scrub_stamp":"2024-04-19T02:21:49.460592+0000","last_clean_scrub_stamp":"2024-04-19T02:21:49.460592+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:18.752338+0000","scrub_duration":0.0043248339999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34018,"num_write":459,"num_write_kb":162719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"117'135","reported_seq":286,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:51.481277+0000","last_change":"2024-04-19T02:22:51.481277+0000","last_active":"2024-04-19T02:22:51.481277+0000","last_peered":"2024-04-19T02:22:51.481277+0000","last_clean":"2024-04-19T02:22:51.481277+0000","last_became_active":"2024-04-19T02:20:36.195520+0000","last_became_peered":"2024-04-19T02:20:36.195520+0000","last_unstale":"2024-04-19T02:22:51.481277+0000","last_undegraded":"2024-04-19T02:22:51.481277+0000","last_fullsized":"2024-04-19T02:22:51.481277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'135","last_scrub_stamp":"2024-04-19T02:22:51.480919+0000","last_deep_scrub":"117'135","last_deep_scrub_stamp":"2024-04-19T02:22:51.480919+0000","last_clean_scrub_stamp":"2024-04-19T02:22:51.480919+0000","objects_scrubbed":3,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:37:04.412065+0000","scrub_duration":0.058927439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:56.970065+0000","last_change":"2024-04-19T02:22:56.970279+0000","last_active":"2024-04-19T02:22:56.970065+0000","last_peered":"2024-04-19T02:22:56.970065+0000","last_clean":"2024-04-19T02:22:56.970065+0000","last_became_active":"2024-04-19T02:21:21.299584+0000","last_became_peered":"2024-04-19T02:21:21.299584+0000","last_unstale":"2024-04-19T02:22:56.970065+0000","last_undegraded":"2024-04-19T02:22:56.970065+0000","last_fullsized":"2024-04-19T02:22:56.970065+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:56.970013+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:56.970013+0000","last_clean_scrub_stamp":"2024-04-19T02:22:56.970013+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:55.835002+0000","scrub_duration":0.003871607,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8780,"num_write":407,"num_write_kb":59126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"117'208","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.448417+0000","last_change":"2024-04-19T02:21:45.448731+0000","last_active":"2024-04-19T02:21:45.448417+0000","last_peered":"2024-04-19T02:21:45.448417+0000","last_clean":"2024-04-19T02:21:45.448417+0000","last_became_active":"2024-04-19T02:21:21.307367+0000","last_became_peered":"2024-04-19T02:21:21.307367+0000","last_unstale":"2024-04-19T02:21:45.448417+0000","last_undegraded":"2024-04-19T02:21:45.448417+0000","last_fullsized":"2024-04-19T02:21:45.448417+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'208","last_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_deep_scrub":"117'208","last_deep_scrub_stamp":"2024-04-19T02:21:45.448363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.448363+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:14.018739+0000","scrub_duration":0.041956280999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'428","reported_seq":596,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.414317+0000","last_change":"2024-04-19T02:22:06.414317+0000","last_active":"2024-04-19T02:22:06.414317+0000","last_peered":"2024-04-19T02:22:06.414317+0000","last_clean":"2024-04-19T02:22:06.414317+0000","last_became_active":"2024-04-19T02:21:21.322552+0000","last_became_peered":"2024-04-19T02:21:21.322552+0000","last_unstale":"2024-04-19T02:22:06.414317+0000","last_undegraded":"2024-04-19T02:22:06.414317+0000","last_fullsized":"2024-04-19T02:22:06.414317+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'428","last_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_deep_scrub":"71'428","last_deep_scrub_stamp":"2024-04-19T02:22:06.413898+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.413898+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:34.571146+0000","scrub_duration":0.0043639839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":51403,"num_write":400,"num_write_kb":83990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"71'53","reported_seq":191,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:44.493125+0000","last_change":"2024-04-19T02:22:44.493125+0000","last_active":"2024-04-19T02:22:44.493125+0000","last_peered":"2024-04-19T02:22:44.493125+0000","last_clean":"2024-04-19T02:22:44.493125+0000","last_became_active":"2024-04-19T02:20:30.536188+0000","last_became_peered":"2024-04-19T02:20:30.536188+0000","last_unstale":"2024-04-19T02:22:44.493125+0000","last_undegraded":"2024-04-19T02:22:44.493125+0000","last_fullsized":"2024-04-19T02:22:44.493125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'53","last_scrub_stamp":"2024-04-19T02:22:44.492835+0000","last_deep_scrub":"71'53","last_deep_scrub_stamp":"2024-04-19T02:22:44.492835+0000","last_clean_scrub_stamp":"2024-04-19T02:22:44.492835+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:58.181590+0000","scrub_duration":0.0033014379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"71'366","reported_seq":463,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:44.184221+0000","last_change":"2024-04-19T02:22:44.184463+0000","last_active":"2024-04-19T02:22:44.184221+0000","last_peered":"2024-04-19T02:22:44.184221+0000","last_clean":"2024-04-19T02:22:44.184221+0000","last_became_active":"2024-04-19T02:21:21.308218+0000","last_became_peered":"2024-04-19T02:21:21.308218+0000","last_unstale":"2024-04-19T02:22:44.184221+0000","last_undegraded":"2024-04-19T02:22:44.184221+0000","last_fullsized":"2024-04-19T02:22:44.184221+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'366","last_scrub_stamp":"2024-04-19T02:22:44.184169+0000","last_deep_scrub":"71'366","last_deep_scrub_stamp":"2024-04-19T02:22:44.184169+0000","last_clean_scrub_stamp":"2024-04-19T02:22:44.184169+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:22.184025+0000","scrub_duration":0.0041324120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5546,"num_write":339,"num_write_kb":70761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"117'391","reported_seq":516,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:55.516318+0000","last_change":"2024-04-19T02:22:55.516545+0000","last_active":"2024-04-19T02:22:55.516318+0000","last_peered":"2024-04-19T02:22:55.516318+0000","last_clean":"2024-04-19T02:22:55.516318+0000","last_became_active":"2024-04-19T02:16:24.133068+0000","last_became_peered":"2024-04-19T02:16:24.133068+0000","last_unstale":"2024-04-19T02:22:55.516318+0000","last_undegraded":"2024-04-19T02:22:55.516318+0000","last_fullsized":"2024-04-19T02:22:55.516318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'391","last_scrub_stamp":"2024-04-19T02:22:55.516264+0000","last_deep_scrub":"117'391","last_deep_scrub_stamp":"2024-04-19T02:22:55.516264+0000","last_clean_scrub_stamp":"2024-04-19T02:22:55.516264+0000","objects_scrubbed":1,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:06:56.283944+0000","scrub_duration":0.039503955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"71'395","reported_seq":544,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:06.216395+0000","last_change":"2024-04-19T02:22:06.216395+0000","last_active":"2024-04-19T02:22:06.216395+0000","last_peered":"2024-04-19T02:22:06.216395+0000","last_clean":"2024-04-19T02:22:06.216395+0000","last_became_active":"2024-04-19T02:16:24.511245+0000","last_became_peered":"2024-04-19T02:16:24.511245+0000","last_unstale":"2024-04-19T02:22:06.216395+0000","last_undegraded":"2024-04-19T02:22:06.216395+0000","last_fullsized":"2024-04-19T02:22:06.216395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'395","last_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_deep_scrub":"71'395","last_deep_scrub_stamp":"2024-04-19T02:22:06.216111+0000","last_clean_scrub_stamp":"2024-04-19T02:22:06.216111+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:41.161541+0000","scrub_duration":0.0046009639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12664,"num_write":360,"num_write_kb":71392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"117'159","reported_seq":230,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:05.001554+0000","last_change":"2024-04-19T02:23:05.001771+0000","last_active":"2024-04-19T02:23:05.001554+0000","last_peered":"2024-04-19T02:23:05.001554+0000","last_clean":"2024-04-19T02:23:05.001554+0000","last_became_active":"2024-04-19T02:21:21.336213+0000","last_became_peered":"2024-04-19T02:21:21.336213+0000","last_unstale":"2024-04-19T02:23:05.001554+0000","last_undegraded":"2024-04-19T02:23:05.001554+0000","last_fullsized":"2024-04-19T02:23:05.001554+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'159","last_scrub_stamp":"2024-04-19T02:23:05.001500+0000","last_deep_scrub":"117'159","last_deep_scrub_stamp":"2024-04-19T02:23:05.001500+0000","last_clean_scrub_stamp":"2024-04-19T02:23:05.001500+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:06.466425+0000","scrub_duration":0.011059131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.294074+0000","last_change":"2024-04-19T02:22:34.294074+0000","last_active":"2024-04-19T02:22:34.294074+0000","last_peered":"2024-04-19T02:22:34.294074+0000","last_clean":"2024-04-19T02:22:34.294074+0000","last_became_active":"2024-04-19T02:21:21.330910+0000","last_became_peered":"2024-04-19T02:21:21.330910+0000","last_unstale":"2024-04-19T02:22:34.294074+0000","last_undegraded":"2024-04-19T02:22:34.294074+0000","last_fullsized":"2024-04-19T02:22:34.294074+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:34.293820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:34.293820+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.293820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:31:57.264337+0000","scrub_duration":0.003338344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"117'764","reported_seq":888,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:52.461545+0000","last_change":"2024-04-19T02:22:52.461765+0000","last_active":"2024-04-19T02:22:52.461545+0000","last_peered":"2024-04-19T02:22:52.461545+0000","last_clean":"2024-04-19T02:22:52.461545+0000","last_became_active":"2024-04-19T02:16:24.135355+0000","last_became_peered":"2024-04-19T02:16:24.135355+0000","last_unstale":"2024-04-19T02:22:52.461545+0000","last_undegraded":"2024-04-19T02:22:52.461545+0000","last_fullsized":"2024-04-19T02:22:52.461545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'764","last_scrub_stamp":"2024-04-19T02:22:52.461487+0000","last_deep_scrub":"117'764","last_deep_scrub_stamp":"2024-04-19T02:22:52.461487+0000","last_clean_scrub_stamp":"2024-04-19T02:22:52.461487+0000","objects_scrubbed":2,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:02.002974+0000","scrub_duration":0.073165514000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'435","reported_seq":581,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:46.237540+0000","last_change":"2024-04-19T02:22:46.237748+0000","last_active":"2024-04-19T02:22:46.237540+0000","last_peered":"2024-04-19T02:22:46.237540+0000","last_clean":"2024-04-19T02:22:46.237540+0000","last_became_active":"2024-04-19T02:21:21.335550+0000","last_became_peered":"2024-04-19T02:21:21.335550+0000","last_unstale":"2024-04-19T02:22:46.237540+0000","last_undegraded":"2024-04-19T02:22:46.237540+0000","last_fullsized":"2024-04-19T02:22:46.237540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'435","last_scrub_stamp":"2024-04-19T02:22:46.237488+0000","last_deep_scrub":"71'435","last_deep_scrub_stamp":"2024-04-19T02:22:46.237488+0000","last_clean_scrub_stamp":"2024-04-19T02:22:46.237488+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:59.977357+0000","scrub_duration":0.0044347270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28907,"num_write":392,"num_write_kb":71430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:52.127411+0000","last_change":"2024-04-19T02:22:52.127688+0000","last_active":"2024-04-19T02:22:52.127411+0000","last_peered":"2024-04-19T02:22:52.127411+0000","last_clean":"2024-04-19T02:22:52.127411+0000","last_became_active":"2024-04-19T02:21:21.340307+0000","last_became_peered":"2024-04-19T02:21:21.340307+0000","last_unstale":"2024-04-19T02:22:52.127411+0000","last_undegraded":"2024-04-19T02:22:52.127411+0000","last_fullsized":"2024-04-19T02:22:52.127411+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:52.127364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:52.127364+0000","last_clean_scrub_stamp":"2024-04-19T02:22:52.127364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:11:21.031030+0000","scrub_duration":0.0035185220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"117'115","reported_seq":324,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:49.410089+0000","last_change":"2024-04-19T02:22:49.410296+0000","last_active":"2024-04-19T02:22:49.410089+0000","last_peered":"2024-04-19T02:22:49.410089+0000","last_clean":"2024-04-19T02:22:49.410089+0000","last_became_active":"2024-04-19T02:20:36.196102+0000","last_became_peered":"2024-04-19T02:20:36.196102+0000","last_unstale":"2024-04-19T02:22:49.410089+0000","last_undegraded":"2024-04-19T02:22:49.410089+0000","last_fullsized":"2024-04-19T02:22:49.410089+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'115","last_scrub_stamp":"2024-04-19T02:22:49.410036+0000","last_deep_scrub":"117'115","last_deep_scrub_stamp":"2024-04-19T02:22:49.410036+0000","last_clean_scrub_stamp":"2024-04-19T02:22:49.410036+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:53.945026+0000","scrub_duration":0.014947889000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":61,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1466621,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'420","reported_seq":569,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:50.500920+0000","last_change":"2024-04-19T02:21:50.500920+0000","last_active":"2024-04-19T02:21:50.500920+0000","last_peered":"2024-04-19T02:21:50.500920+0000","last_clean":"2024-04-19T02:21:50.500920+0000","last_became_active":"2024-04-19T02:16:24.510470+0000","last_became_peered":"2024-04-19T02:16:24.510470+0000","last_unstale":"2024-04-19T02:21:50.500920+0000","last_undegraded":"2024-04-19T02:21:50.500920+0000","last_fullsized":"2024-04-19T02:21:50.500920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'420","last_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_deep_scrub":"71'420","last_deep_scrub_stamp":"2024-04-19T02:21:50.500643+0000","last_clean_scrub_stamp":"2024-04-19T02:21:50.500643+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:19:06.685542+0000","scrub_duration":0.0044626199999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16445,"num_write":381,"num_write_kb":34168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:36.379494+0000","last_change":"2024-04-19T02:22:36.379699+0000","last_active":"2024-04-19T02:22:36.379494+0000","last_peered":"2024-04-19T02:22:36.379494+0000","last_clean":"2024-04-19T02:22:36.379494+0000","last_became_active":"2024-04-19T02:16:20.086400+0000","last_became_peered":"2024-04-19T02:16:20.086400+0000","last_unstale":"2024-04-19T02:22:36.379494+0000","last_undegraded":"2024-04-19T02:22:36.379494+0000","last_fullsized":"2024-04-19T02:22:36.379494+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:36.379438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:36.379438+0000","last_clean_scrub_stamp":"2024-04-19T02:22:36.379438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:52.044210+0000","scrub_duration":0.0032783790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"117'387","reported_seq":538,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:36.580396+0000","last_change":"2024-04-19T02:22:36.580619+0000","last_active":"2024-04-19T02:22:36.580396+0000","last_peered":"2024-04-19T02:22:36.580396+0000","last_clean":"2024-04-19T02:22:36.580396+0000","last_became_active":"2024-04-19T02:20:34.186180+0000","last_became_peered":"2024-04-19T02:20:34.186180+0000","last_unstale":"2024-04-19T02:22:36.580396+0000","last_undegraded":"2024-04-19T02:22:36.580396+0000","last_fullsized":"2024-04-19T02:22:36.580396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'387","last_scrub_stamp":"2024-04-19T02:22:36.580340+0000","last_deep_scrub":"117'387","last_deep_scrub_stamp":"2024-04-19T02:22:36.580340+0000","last_clean_scrub_stamp":"2024-04-19T02:22:36.580340+0000","objects_scrubbed":2,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:18.778615+0000","scrub_duration":0.066298640000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"71'345","reported_seq":481,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.418067+0000","last_change":"2024-04-19T02:21:47.418067+0000","last_active":"2024-04-19T02:21:47.418067+0000","last_peered":"2024-04-19T02:21:47.418067+0000","last_clean":"2024-04-19T02:21:47.418067+0000","last_became_active":"2024-04-19T02:16:24.511969+0000","last_became_peered":"2024-04-19T02:16:24.511969+0000","last_unstale":"2024-04-19T02:21:47.418067+0000","last_undegraded":"2024-04-19T02:21:47.418067+0000","last_fullsized":"2024-04-19T02:21:47.418067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'345","last_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_deep_scrub":"71'345","last_deep_scrub_stamp":"2024-04-19T02:21:47.417790+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.417790+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:30.129614+0000","scrub_duration":0.0046618750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9031,"num_write":320,"num_write_kb":51293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.410078+0000","last_change":"2024-04-19T02:22:08.410078+0000","last_active":"2024-04-19T02:22:08.410078+0000","last_peered":"2024-04-19T02:22:08.410078+0000","last_clean":"2024-04-19T02:22:08.410078+0000","last_became_active":"2024-04-19T02:21:21.308901+0000","last_became_peered":"2024-04-19T02:21:21.308901+0000","last_unstale":"2024-04-19T02:22:08.410078+0000","last_undegraded":"2024-04-19T02:22:08.410078+0000","last_fullsized":"2024-04-19T02:22:08.410078+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:08.409824+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.409824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:12.416405+0000","scrub_duration":0.0032298549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'69","reported_seq":149,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.379775+0000","last_change":"2024-04-19T02:21:54.379775+0000","last_active":"2024-04-19T02:21:54.379775+0000","last_peered":"2024-04-19T02:21:54.379775+0000","last_clean":"2024-04-19T02:21:54.379775+0000","last_became_active":"2024-04-19T02:21:21.327105+0000","last_became_peered":"2024-04-19T02:21:21.327105+0000","last_unstale":"2024-04-19T02:21:54.379775+0000","last_undegraded":"2024-04-19T02:21:54.379775+0000","last_fullsized":"2024-04-19T02:21:54.379775+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'69","last_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_deep_scrub":"71'69","last_deep_scrub_stamp":"2024-04-19T02:21:54.379480+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.379480+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:14.495728+0000","scrub_duration":0.0033461229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'403","reported_seq":582,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.419740+0000","last_change":"2024-04-19T02:21:40.419740+0000","last_active":"2024-04-19T02:21:40.419740+0000","last_peered":"2024-04-19T02:21:40.419740+0000","last_clean":"2024-04-19T02:21:40.419740+0000","last_became_active":"2024-04-19T02:16:24.510719+0000","last_became_peered":"2024-04-19T02:16:24.510719+0000","last_unstale":"2024-04-19T02:21:40.419740+0000","last_undegraded":"2024-04-19T02:21:40.419740+0000","last_fullsized":"2024-04-19T02:21:40.419740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'403","last_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_deep_scrub":"71'403","last_deep_scrub_stamp":"2024-04-19T02:21:40.419437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.419437+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:29.109984+0000","scrub_duration":0.0046038880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32417,"num_write":360,"num_write_kb":71574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"117'461","reported_seq":543,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:50.207432+0000","last_change":"2024-04-19T02:22:50.207432+0000","last_active":"2024-04-19T02:22:50.207432+0000","last_peered":"2024-04-19T02:22:50.207432+0000","last_clean":"2024-04-19T02:22:50.207432+0000","last_became_active":"2024-04-19T02:21:21.307126+0000","last_became_peered":"2024-04-19T02:21:21.307126+0000","last_unstale":"2024-04-19T02:22:50.207432+0000","last_undegraded":"2024-04-19T02:22:50.207432+0000","last_fullsized":"2024-04-19T02:22:50.207432+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'461","last_scrub_stamp":"2024-04-19T02:22:50.207108+0000","last_deep_scrub":"117'461","last_deep_scrub_stamp":"2024-04-19T02:22:50.207108+0000","last_clean_scrub_stamp":"2024-04-19T02:22:50.207108+0000","objects_scrubbed":1,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:30.887522+0000","scrub_duration":0.038228984000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:46.401592+0000","last_change":"2024-04-19T02:22:46.401810+0000","last_active":"2024-04-19T02:22:46.401592+0000","last_peered":"2024-04-19T02:22:46.401592+0000","last_clean":"2024-04-19T02:22:46.401592+0000","last_became_active":"2024-04-19T02:16:20.086378+0000","last_became_peered":"2024-04-19T02:16:20.086378+0000","last_unstale":"2024-04-19T02:22:46.401592+0000","last_undegraded":"2024-04-19T02:22:46.401592+0000","last_fullsized":"2024-04-19T02:22:46.401592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:46.401543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:46.401543+0000","last_clean_scrub_stamp":"2024-04-19T02:22:46.401543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:54.137102+0000","scrub_duration":0.0032966150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'383","reported_seq":870,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:01.586120+0000","last_change":"2024-04-19T02:22:01.586120+0000","last_active":"2024-04-19T02:22:01.586120+0000","last_peered":"2024-04-19T02:22:01.586120+0000","last_clean":"2024-04-19T02:22:01.586120+0000","last_became_active":"2024-04-19T02:20:44.192281+0000","last_became_peered":"2024-04-19T02:20:44.192281+0000","last_unstale":"2024-04-19T02:22:01.586120+0000","last_undegraded":"2024-04-19T02:22:01.586120+0000","last_fullsized":"2024-04-19T02:22:01.586120+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'383","last_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_deep_scrub":"71'383","last_deep_scrub_stamp":"2024-04-19T02:22:01.585841+0000","last_clean_scrub_stamp":"2024-04-19T02:22:01.585841+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:50.276388+0000","scrub_duration":0.0039878709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12962,"num_write":348,"num_write_kb":38702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":180,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:17.227218+0000","last_change":"2024-04-19T02:23:17.227535+0000","last_active":"2024-04-19T02:23:17.227218+0000","last_peered":"2024-04-19T02:23:17.227218+0000","last_clean":"2024-04-19T02:23:17.227218+0000","last_became_active":"2024-04-19T02:16:58.382340+0000","last_became_peered":"2024-04-19T02:16:58.382340+0000","last_unstale":"2024-04-19T02:23:17.227218+0000","last_undegraded":"2024-04-19T02:23:17.227218+0000","last_fullsized":"2024-04-19T02:23:17.227218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'54","last_scrub_stamp":"2024-04-19T02:23:17.227166+0000","last_deep_scrub":"71'54","last_deep_scrub_stamp":"2024-04-19T02:23:17.227166+0000","last_clean_scrub_stamp":"2024-04-19T02:23:17.227166+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:26.214261+0000","scrub_duration":0.0035916350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.534676+0000","last_change":"2024-04-19T02:22:34.534888+0000","last_active":"2024-04-19T02:22:34.534676+0000","last_peered":"2024-04-19T02:22:34.534676+0000","last_clean":"2024-04-19T02:22:34.534676+0000","last_became_active":"2024-04-19T02:16:20.081946+0000","last_became_peered":"2024-04-19T02:16:20.081946+0000","last_unstale":"2024-04-19T02:22:34.534676+0000","last_undegraded":"2024-04-19T02:22:34.534676+0000","last_fullsized":"2024-04-19T02:22:34.534676+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:34.534627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:34.534627+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.534627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:40.751248+0000","scrub_duration":0.0032596080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"71'421","reported_seq":987,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:53.548677+0000","last_change":"2024-04-19T02:21:53.548677+0000","last_active":"2024-04-19T02:21:53.548677+0000","last_peered":"2024-04-19T02:21:53.548677+0000","last_clean":"2024-04-19T02:21:53.548677+0000","last_became_active":"2024-04-19T02:20:42.203259+0000","last_became_peered":"2024-04-19T02:20:42.203259+0000","last_unstale":"2024-04-19T02:21:53.548677+0000","last_undegraded":"2024-04-19T02:21:53.548677+0000","last_fullsized":"2024-04-19T02:21:53.548677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-19T02:21:53.548415+0000","last_clean_scrub_stamp":"2024-04-19T02:21:53.548415+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:32.430509+0000","scrub_duration":0.003797426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":30025,"num_write":388,"num_write_kb":64013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"117'67","reported_seq":191,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:58.294114+0000","last_change":"2024-04-19T02:22:58.294429+0000","last_active":"2024-04-19T02:22:58.294114+0000","last_peered":"2024-04-19T02:22:58.294114+0000","last_clean":"2024-04-19T02:22:58.294114+0000","last_became_active":"2024-04-19T02:16:24.135930+0000","last_became_peered":"2024-04-19T02:16:24.135930+0000","last_unstale":"2024-04-19T02:22:58.294114+0000","last_undegraded":"2024-04-19T02:22:58.294114+0000","last_fullsized":"2024-04-19T02:22:58.294114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'67","last_scrub_stamp":"2024-04-19T02:22:58.294055+0000","last_deep_scrub":"117'67","last_deep_scrub_stamp":"2024-04-19T02:22:58.294055+0000","last_clean_scrub_stamp":"2024-04-19T02:22:58.294055+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:30:08.487723+0000","scrub_duration":0.0065633660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:47.381294+0000","last_change":"2024-04-19T02:22:47.381294+0000","last_active":"2024-04-19T02:22:47.381294+0000","last_peered":"2024-04-19T02:22:47.381294+0000","last_clean":"2024-04-19T02:22:47.381294+0000","last_became_active":"2024-04-19T02:16:20.086433+0000","last_became_peered":"2024-04-19T02:16:20.086433+0000","last_unstale":"2024-04-19T02:22:47.381294+0000","last_undegraded":"2024-04-19T02:22:47.381294+0000","last_fullsized":"2024-04-19T02:22:47.381294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:47.381024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:47.381024+0000","last_clean_scrub_stamp":"2024-04-19T02:22:47.381024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:18.712981+0000","scrub_duration":0.0031651090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'419","reported_seq":964,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:51.372189+0000","last_change":"2024-04-19T02:21:51.372189+0000","last_active":"2024-04-19T02:21:51.372189+0000","last_peered":"2024-04-19T02:21:51.372189+0000","last_clean":"2024-04-19T02:21:51.372189+0000","last_became_active":"2024-04-19T02:21:00.194608+0000","last_became_peered":"2024-04-19T02:21:00.194608+0000","last_unstale":"2024-04-19T02:21:51.372189+0000","last_undegraded":"2024-04-19T02:21:51.372189+0000","last_fullsized":"2024-04-19T02:21:51.372189+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-19T02:21:51.371896+0000","last_clean_scrub_stamp":"2024-04-19T02:21:51.371896+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:47:53.379349+0000","scrub_duration":0.0039386960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16164,"num_write":384,"num_write_kb":42655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"117'76","reported_seq":218,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:34.405467+0000","last_change":"2024-04-19T02:22:34.405467+0000","last_active":"2024-04-19T02:22:34.405467+0000","last_peered":"2024-04-19T02:22:34.405467+0000","last_clean":"2024-04-19T02:22:34.405467+0000","last_became_active":"2024-04-19T02:20:30.532047+0000","last_became_peered":"2024-04-19T02:20:30.532047+0000","last_unstale":"2024-04-19T02:22:34.405467+0000","last_undegraded":"2024-04-19T02:22:34.405467+0000","last_fullsized":"2024-04-19T02:22:34.405467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'76","last_scrub_stamp":"2024-04-19T02:22:34.405184+0000","last_deep_scrub":"117'76","last_deep_scrub_stamp":"2024-04-19T02:22:34.405184+0000","last_clean_scrub_stamp":"2024-04-19T02:22:34.405184+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:16.978891+0000","scrub_duration":0.022685261000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.382834+0000","last_change":"2024-04-19T02:21:47.382834+0000","last_active":"2024-04-19T02:21:47.382834+0000","last_peered":"2024-04-19T02:21:47.382834+0000","last_clean":"2024-04-19T02:21:47.382834+0000","last_became_active":"2024-04-19T02:21:21.305458+0000","last_became_peered":"2024-04-19T02:21:21.305458+0000","last_unstale":"2024-04-19T02:21:47.382834+0000","last_undegraded":"2024-04-19T02:21:47.382834+0000","last_fullsized":"2024-04-19T02:21:47.382834+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.382567+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.382567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:21.368852+0000","scrub_duration":0.0033623530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'427","reported_seq":590,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:18.196037+0000","last_change":"2024-04-19T02:23:18.196287+0000","last_active":"2024-04-19T02:23:18.196037+0000","last_peered":"2024-04-19T02:23:18.196037+0000","last_clean":"2024-04-19T02:23:18.196037+0000","last_became_active":"2024-04-19T02:17:28.321860+0000","last_became_peered":"2024-04-19T02:17:28.321860+0000","last_unstale":"2024-04-19T02:23:18.196037+0000","last_undegraded":"2024-04-19T02:23:18.196037+0000","last_fullsized":"2024-04-19T02:23:18.196037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-19T02:23:18.195984+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-19T02:23:18.195984+0000","last_clean_scrub_stamp":"2024-04-19T02:23:18.195984+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:43.699486+0000","scrub_duration":0.004460795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":26582,"num_write":398,"num_write_kb":125588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'406","reported_seq":514,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:58.918237+0000","last_change":"2024-04-19T02:22:58.918467+0000","last_active":"2024-04-19T02:22:58.918237+0000","last_peered":"2024-04-19T02:22:58.918237+0000","last_clean":"2024-04-19T02:22:58.918237+0000","last_became_active":"2024-04-19T02:21:21.331888+0000","last_became_peered":"2024-04-19T02:21:21.331888+0000","last_unstale":"2024-04-19T02:22:58.918237+0000","last_undegraded":"2024-04-19T02:22:58.918237+0000","last_fullsized":"2024-04-19T02:22:58.918237+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-19T02:22:58.918185+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-19T02:22:58.918185+0000","last_clean_scrub_stamp":"2024-04-19T02:22:58.918185+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:16.305340+0000","scrub_duration":0.0038846250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13360,"num_write":368,"num_write_kb":69620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"117'453","reported_seq":550,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:43.287797+0000","last_change":"2024-04-19T02:22:43.288098+0000","last_active":"2024-04-19T02:22:43.287797+0000","last_peered":"2024-04-19T02:22:43.287797+0000","last_clean":"2024-04-19T02:22:43.287797+0000","last_became_active":"2024-04-19T02:21:21.334014+0000","last_became_peered":"2024-04-19T02:21:21.334014+0000","last_unstale":"2024-04-19T02:22:43.287797+0000","last_undegraded":"2024-04-19T02:22:43.287797+0000","last_fullsized":"2024-04-19T02:22:43.287797+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'453","last_scrub_stamp":"2024-04-19T02:22:43.287744+0000","last_deep_scrub":"117'453","last_deep_scrub_stamp":"2024-04-19T02:22:43.287744+0000","last_clean_scrub_stamp":"2024-04-19T02:22:43.287744+0000","objects_scrubbed":6,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:38.525762+0000","scrub_duration":0.078508173000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693462,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"71'407","reported_seq":568,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:14.293826+0000","last_change":"2024-04-19T02:22:14.293826+0000","last_active":"2024-04-19T02:22:14.293826+0000","last_peered":"2024-04-19T02:22:14.293826+0000","last_clean":"2024-04-19T02:22:14.293826+0000","last_became_active":"2024-04-19T02:16:24.510100+0000","last_became_peered":"2024-04-19T02:16:24.510100+0000","last_unstale":"2024-04-19T02:22:14.293826+0000","last_undegraded":"2024-04-19T02:22:14.293826+0000","last_fullsized":"2024-04-19T02:22:14.293826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'407","last_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_deep_scrub":"71'407","last_deep_scrub_stamp":"2024-04-19T02:22:14.293476+0000","last_clean_scrub_stamp":"2024-04-19T02:22:14.293476+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:01:56.491750+0000","scrub_duration":0.0053162419999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17253,"num_write":371,"num_write_kb":67165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"117'88","reported_seq":230,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:48.485720+0000","last_change":"2024-04-19T02:22:48.486046+0000","last_active":"2024-04-19T02:22:48.485720+0000","last_peered":"2024-04-19T02:22:48.485720+0000","last_clean":"2024-04-19T02:22:48.485720+0000","last_became_active":"2024-04-19T02:20:30.543870+0000","last_became_peered":"2024-04-19T02:20:30.543870+0000","last_unstale":"2024-04-19T02:22:48.485720+0000","last_undegraded":"2024-04-19T02:22:48.485720+0000","last_fullsized":"2024-04-19T02:22:48.485720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'88","last_scrub_stamp":"2024-04-19T02:22:48.485666+0000","last_deep_scrub":"117'88","last_deep_scrub_stamp":"2024-04-19T02:22:48.485666+0000","last_clean_scrub_stamp":"2024-04-19T02:22:48.485666+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:08.570008+0000","scrub_duration":0.0072681860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"117'325","reported_seq":406,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:46.418450+0000","last_change":"2024-04-19T02:21:46.418450+0000","last_active":"2024-04-19T02:21:46.418450+0000","last_peered":"2024-04-19T02:21:46.418450+0000","last_clean":"2024-04-19T02:21:46.418450+0000","last_became_active":"2024-04-19T02:21:21.305728+0000","last_became_peered":"2024-04-19T02:21:21.305728+0000","last_unstale":"2024-04-19T02:21:46.418450+0000","last_undegraded":"2024-04-19T02:21:46.418450+0000","last_fullsized":"2024-04-19T02:21:46.418450+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'325","last_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_deep_scrub":"117'325","last_deep_scrub_stamp":"2024-04-19T02:21:46.418135+0000","last_clean_scrub_stamp":"2024-04-19T02:21:46.418135+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:23.243009+0000","scrub_duration":0.037437605999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'441","reported_seq":1032,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:25.306412+0000","last_change":"2024-04-19T02:22:25.306412+0000","last_active":"2024-04-19T02:22:25.306412+0000","last_peered":"2024-04-19T02:22:25.306412+0000","last_clean":"2024-04-19T02:22:25.306412+0000","last_became_active":"2024-04-19T02:20:58.187282+0000","last_became_peered":"2024-04-19T02:20:58.187282+0000","last_unstale":"2024-04-19T02:22:25.306412+0000","last_undegraded":"2024-04-19T02:22:25.306412+0000","last_fullsized":"2024-04-19T02:22:25.306412+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'441","last_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_deep_scrub":"71'441","last_deep_scrub_stamp":"2024-04-19T02:22:25.306128+0000","last_clean_scrub_stamp":"2024-04-19T02:22:25.306128+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:33.739156+0000","scrub_duration":0.0038746840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22527,"num_write":410,"num_write_kb":30722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'54","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:21.140582+0000","last_change":"2024-04-19T02:22:21.140820+0000","last_active":"2024-04-19T02:22:21.140582+0000","last_peered":"2024-04-19T02:22:21.140582+0000","last_clean":"2024-04-19T02:22:21.140582+0000","last_became_active":"2024-04-19T02:20:30.532903+0000","last_became_peered":"2024-04-19T02:20:30.532903+0000","last_unstale":"2024-04-19T02:22:21.140582+0000","last_undegraded":"2024-04-19T02:22:21.140582+0000","last_fullsized":"2024-04-19T02:22:21.140582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'54","last_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_deep_scrub":"71'54","last_deep_scrub_stamp":"2024-04-19T02:22:21.140527+0000","last_clean_scrub_stamp":"2024-04-19T02:22:21.140527+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:01.892166+0000","scrub_duration":0.0033383610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'459","reported_seq":642,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:08.239786+0000","last_change":"2024-04-19T02:22:08.239786+0000","last_active":"2024-04-19T02:22:08.239786+0000","last_peered":"2024-04-19T02:22:08.239786+0000","last_clean":"2024-04-19T02:22:08.239786+0000","last_became_active":"2024-04-19T02:16:24.509113+0000","last_became_peered":"2024-04-19T02:16:24.509113+0000","last_unstale":"2024-04-19T02:22:08.239786+0000","last_undegraded":"2024-04-19T02:22:08.239786+0000","last_fullsized":"2024-04-19T02:22:08.239786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'459","last_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_deep_scrub":"71'459","last_deep_scrub_stamp":"2024-04-19T02:22:08.239485+0000","last_clean_scrub_stamp":"2024-04-19T02:22:08.239485+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:14.140941+0000","scrub_duration":0.004519805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39240,"num_write":428,"num_write_kb":68177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'392","reported_seq":931,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.477808+0000","last_change":"2024-04-19T02:21:36.477808+0000","last_active":"2024-04-19T02:21:36.477808+0000","last_peered":"2024-04-19T02:21:36.477808+0000","last_clean":"2024-04-19T02:21:36.477808+0000","last_became_active":"2024-04-19T02:20:40.189508+0000","last_became_peered":"2024-04-19T02:20:40.189508+0000","last_unstale":"2024-04-19T02:21:36.477808+0000","last_undegraded":"2024-04-19T02:21:36.477808+0000","last_fullsized":"2024-04-19T02:21:36.477808+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:21:36.477536+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.477536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:19.549278+0000","scrub_duration":0.0037289060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30031,"num_write":362,"num_write_kb":104497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"117'574","reported_seq":697,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:55.367170+0000","last_change":"2024-04-19T02:22:55.367405+0000","last_active":"2024-04-19T02:22:55.367170+0000","last_peered":"2024-04-19T02:22:55.367170+0000","last_clean":"2024-04-19T02:22:55.367170+0000","last_became_active":"2024-04-19T02:16:24.135691+0000","last_became_peered":"2024-04-19T02:16:24.135691+0000","last_unstale":"2024-04-19T02:22:55.367170+0000","last_undegraded":"2024-04-19T02:22:55.367170+0000","last_fullsized":"2024-04-19T02:22:55.367170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'574","last_scrub_stamp":"2024-04-19T02:22:55.367117+0000","last_deep_scrub":"117'574","last_deep_scrub_stamp":"2024-04-19T02:22:55.367117+0000","last_clean_scrub_stamp":"2024-04-19T02:22:55.367117+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:26:37.598857+0000","scrub_duration":0.083286176000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":8441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'399","reported_seq":956,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:04.175397+0000","last_change":"2024-04-19T02:23:04.175735+0000","last_active":"2024-04-19T02:23:04.175397+0000","last_peered":"2024-04-19T02:23:04.175397+0000","last_clean":"2024-04-19T02:23:04.175397+0000","last_became_active":"2024-04-19T02:20:41.198762+0000","last_became_peered":"2024-04-19T02:20:41.198762+0000","last_unstale":"2024-04-19T02:23:04.175397+0000","last_undegraded":"2024-04-19T02:23:04.175397+0000","last_fullsized":"2024-04-19T02:23:04.175397+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'399","last_scrub_stamp":"2024-04-19T02:23:04.175284+0000","last_deep_scrub":"71'399","last_deep_scrub_stamp":"2024-04-19T02:23:04.175284+0000","last_clean_scrub_stamp":"2024-04-19T02:23:04.175284+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:53:22.010855+0000","scrub_duration":0.0047880470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":30816,"num_write":377,"num_write_kb":44514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"117'327","reported_seq":474,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:31.453784+0000","last_change":"2024-04-19T02:22:31.453992+0000","last_active":"2024-04-19T02:22:31.453784+0000","last_peered":"2024-04-19T02:22:31.453784+0000","last_clean":"2024-04-19T02:22:31.453784+0000","last_became_active":"2024-04-19T02:20:36.193825+0000","last_became_peered":"2024-04-19T02:20:36.193825+0000","last_unstale":"2024-04-19T02:22:31.453784+0000","last_undegraded":"2024-04-19T02:22:31.453784+0000","last_fullsized":"2024-04-19T02:22:31.453784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'327","last_scrub_stamp":"2024-04-19T02:22:31.453728+0000","last_deep_scrub":"117'327","last_deep_scrub_stamp":"2024-04-19T02:22:31.453728+0000","last_clean_scrub_stamp":"2024-04-19T02:22:31.453728+0000","objects_scrubbed":1,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:53.287501+0000","scrub_duration":0.037649608000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'392","reported_seq":873,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:01.507152+0000","last_change":"2024-04-19T02:23:01.507378+0000","last_active":"2024-04-19T02:23:01.507152+0000","last_peered":"2024-04-19T02:23:01.507152+0000","last_clean":"2024-04-19T02:23:01.507152+0000","last_became_active":"2024-04-19T02:20:47.205880+0000","last_became_peered":"2024-04-19T02:20:47.205880+0000","last_unstale":"2024-04-19T02:23:01.507152+0000","last_undegraded":"2024-04-19T02:23:01.507152+0000","last_fullsized":"2024-04-19T02:23:01.507152+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-19T02:23:01.507095+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-19T02:23:01.507095+0000","last_clean_scrub_stamp":"2024-04-19T02:23:01.507095+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:43.451357+0000","scrub_duration":0.0043105360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":2212,"num_write":341,"num_write_kb":60565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"117'499","reported_seq":624,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:49.553264+0000","last_change":"2024-04-19T02:22:49.553525+0000","last_active":"2024-04-19T02:22:49.553264+0000","last_peered":"2024-04-19T02:22:49.553264+0000","last_clean":"2024-04-19T02:22:49.553264+0000","last_became_active":"2024-04-19T02:16:24.131119+0000","last_became_peered":"2024-04-19T02:16:24.131119+0000","last_unstale":"2024-04-19T02:22:49.553264+0000","last_undegraded":"2024-04-19T02:22:49.553264+0000","last_fullsized":"2024-04-19T02:22:49.553264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'499","last_scrub_stamp":"2024-04-19T02:22:49.553205+0000","last_deep_scrub":"117'499","last_deep_scrub_stamp":"2024-04-19T02:22:49.553205+0000","last_clean_scrub_stamp":"2024-04-19T02:22:49.553205+0000","objects_scrubbed":3,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:11:23.089316+0000","scrub_duration":0.092222246999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":12546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"71'391","reported_seq":562,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:42.467422+0000","last_change":"2024-04-19T02:21:42.467663+0000","last_active":"2024-04-19T02:21:42.467422+0000","last_peered":"2024-04-19T02:21:42.467422+0000","last_clean":"2024-04-19T02:21:42.467422+0000","last_became_active":"2024-04-19T02:16:24.514636+0000","last_became_peered":"2024-04-19T02:16:24.514636+0000","last_unstale":"2024-04-19T02:21:42.467422+0000","last_undegraded":"2024-04-19T02:21:42.467422+0000","last_fullsized":"2024-04-19T02:21:42.467422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-19T02:21:42.467368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:42.467368+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:21.867316+0000","scrub_duration":0.0048531720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":35261,"num_write":358,"num_write_kb":75688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"117'59","reported_seq":201,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:54.468819+0000","last_change":"2024-04-19T02:22:54.469046+0000","last_active":"2024-04-19T02:22:54.468819+0000","last_peered":"2024-04-19T02:22:54.468819+0000","last_clean":"2024-04-19T02:22:54.468819+0000","last_became_active":"2024-04-19T02:20:30.538927+0000","last_became_peered":"2024-04-19T02:20:30.538927+0000","last_unstale":"2024-04-19T02:22:54.468819+0000","last_undegraded":"2024-04-19T02:22:54.468819+0000","last_fullsized":"2024-04-19T02:22:54.468819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'59","last_scrub_stamp":"2024-04-19T02:22:54.468762+0000","last_deep_scrub":"117'59","last_deep_scrub_stamp":"2024-04-19T02:22:54.468762+0000","last_clean_scrub_stamp":"2024-04-19T02:22:54.468762+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:15:16.302535+0000","scrub_duration":0.032450631000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"71'369","reported_seq":479,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.431879+0000","last_change":"2024-04-19T02:21:40.431879+0000","last_active":"2024-04-19T02:21:40.431879+0000","last_peered":"2024-04-19T02:21:40.431879+0000","last_clean":"2024-04-19T02:21:40.431879+0000","last_became_active":"2024-04-19T02:21:21.322464+0000","last_became_peered":"2024-04-19T02:21:21.322464+0000","last_unstale":"2024-04-19T02:21:40.431879+0000","last_undegraded":"2024-04-19T02:21:40.431879+0000","last_fullsized":"2024-04-19T02:21:40.431879+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-19T02:21:40.431601+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.431601+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:34.613519+0000","scrub_duration":0.0040029599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11505,"num_write":340,"num_write_kb":29979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"117'328","reported_seq":417,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:02.046232+0000","last_change":"2024-04-19T02:23:02.046503+0000","last_active":"2024-04-19T02:23:02.046232+0000","last_peered":"2024-04-19T02:23:02.046232+0000","last_clean":"2024-04-19T02:23:02.046232+0000","last_became_active":"2024-04-19T02:21:21.324982+0000","last_became_peered":"2024-04-19T02:21:21.324982+0000","last_unstale":"2024-04-19T02:23:02.046232+0000","last_undegraded":"2024-04-19T02:23:02.046232+0000","last_fullsized":"2024-04-19T02:23:02.046232+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'328","last_scrub_stamp":"2024-04-19T02:23:02.046172+0000","last_deep_scrub":"117'328","last_deep_scrub_stamp":"2024-04-19T02:23:02.046172+0000","last_clean_scrub_stamp":"2024-04-19T02:23:02.046172+0000","objects_scrubbed":2,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:20:49.525128+0000","scrub_duration":0.038848518999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'398","reported_seq":508,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:22.373931+0000","last_change":"2024-04-19T02:22:22.373931+0000","last_active":"2024-04-19T02:22:22.373931+0000","last_peered":"2024-04-19T02:22:22.373931+0000","last_clean":"2024-04-19T02:22:22.373931+0000","last_became_active":"2024-04-19T02:21:21.312112+0000","last_became_peered":"2024-04-19T02:21:21.312112+0000","last_unstale":"2024-04-19T02:22:22.373931+0000","last_undegraded":"2024-04-19T02:22:22.373931+0000","last_fullsized":"2024-04-19T02:22:22.373931+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-19T02:22:22.373659+0000","last_clean_scrub_stamp":"2024-04-19T02:22:22.373659+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:42.141017+0000","scrub_duration":0.004280603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14071,"num_write":369,"num_write_kb":62821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"117'371","reported_seq":524,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:27.613687+0000","last_change":"2024-04-19T02:22:27.613926+0000","last_active":"2024-04-19T02:22:27.613687+0000","last_peered":"2024-04-19T02:22:27.613687+0000","last_clean":"2024-04-19T02:22:27.613687+0000","last_became_active":"2024-04-19T02:20:35.196318+0000","last_became_peered":"2024-04-19T02:20:35.196318+0000","last_unstale":"2024-04-19T02:22:27.613687+0000","last_undegraded":"2024-04-19T02:22:27.613687+0000","last_fullsized":"2024-04-19T02:22:27.613687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'371","last_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_deep_scrub":"117'371","last_deep_scrub_stamp":"2024-04-19T02:22:27.613626+0000","last_clean_scrub_stamp":"2024-04-19T02:22:27.613626+0000","objects_scrubbed":4,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:02.559056+0000","scrub_duration":0.093301011000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":12477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"71'449","reported_seq":645,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:23:16.418863+0000","last_change":"2024-04-19T02:23:16.419082+0000","last_active":"2024-04-19T02:23:16.418863+0000","last_peered":"2024-04-19T02:23:16.418863+0000","last_clean":"2024-04-19T02:23:16.418863+0000","last_became_active":"2024-04-19T02:16:24.512014+0000","last_became_peered":"2024-04-19T02:16:24.512014+0000","last_unstale":"2024-04-19T02:23:16.418863+0000","last_undegraded":"2024-04-19T02:23:16.418863+0000","last_fullsized":"2024-04-19T02:23:16.418863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'449","last_scrub_stamp":"2024-04-19T02:23:16.418809+0000","last_deep_scrub":"71'449","last_deep_scrub_stamp":"2024-04-19T02:23:16.418809+0000","last_clean_scrub_stamp":"2024-04-19T02:23:16.418809+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:31.229012+0000","scrub_duration":0.0054152899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44755,"num_write":410,"num_write_kb":96779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"117'69","reported_seq":193,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:12.346715+0000","last_change":"2024-04-19T02:22:12.346715+0000","last_active":"2024-04-19T02:22:12.346715+0000","last_peered":"2024-04-19T02:22:12.346715+0000","last_clean":"2024-04-19T02:22:12.346715+0000","last_became_active":"2024-04-19T02:16:24.136059+0000","last_became_peered":"2024-04-19T02:16:24.136059+0000","last_unstale":"2024-04-19T02:22:12.346715+0000","last_undegraded":"2024-04-19T02:22:12.346715+0000","last_fullsized":"2024-04-19T02:22:12.346715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'69","last_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_deep_scrub":"117'69","last_deep_scrub_stamp":"2024-04-19T02:22:12.346440+0000","last_clean_scrub_stamp":"2024-04-19T02:22:12.346440+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:18.563061+0000","scrub_duration":0.030517280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'445","reported_seq":571,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:51.167051+0000","last_change":"2024-04-19T02:22:51.167051+0000","last_active":"2024-04-19T02:22:51.167051+0000","last_peered":"2024-04-19T02:22:51.167051+0000","last_clean":"2024-04-19T02:22:51.167051+0000","last_became_active":"2024-04-19T02:21:21.303386+0000","last_became_peered":"2024-04-19T02:21:21.303386+0000","last_unstale":"2024-04-19T02:22:51.167051+0000","last_undegraded":"2024-04-19T02:22:51.167051+0000","last_fullsized":"2024-04-19T02:22:51.167051+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-19T02:22:51.166776+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-19T02:22:51.166776+0000","last_clean_scrub_stamp":"2024-04-19T02:22:51.166776+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:27.426927+0000","scrub_duration":0.0039107209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28933,"num_write":410,"num_write_kb":42719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"117'55","reported_seq":197,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-19T02:22:07.253769+0000","last_change":"2024-04-19T02:22:07.253769+0000","last_active":"2024-04-19T02:22:07.253769+0000","last_peered":"2024-04-19T02:22:07.253769+0000","last_clean":"2024-04-19T02:22:07.253769+0000","last_became_active":"2024-04-19T02:20:30.532516+0000","last_became_peered":"2024-04-19T02:20:30.532516+0000","last_unstale":"2024-04-19T02:22:07.253769+0000","last_undegraded":"2024-04-19T02:22:07.253769+0000","last_fullsized":"2024-04-19T02:22:07.253769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'55","last_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_deep_scrub":"117'55","last_deep_scrub_stamp":"2024-04-19T02:22:07.253481+0000","last_clean_scrub_stamp":"2024-04-19T02:22:07.253481+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:15.508809+0000","scrub_duration":0.035080496000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2670,"num_read_kb":1397475,"num_write":24504,"num_write_kb":4262455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26637,"ondisk_log_size":26637,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128601393,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":61,"num_read_kb":1475,"num_write":5799,"num_write_kb":129628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":47604055,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66301952,"data_stored":257202786,"data_compressed":22007239,"data_compressed_allocated":33619968,"data_compressed_original":224591872,"omap_allocated":5575,"internal_metadata":0},"log_size":7685,"ondisk_log_size":7685,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16066,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738461,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126648,"kb_used_data":27504,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94245192,"statfs":{"total":96636764160,"available":96507076608,"internally_reserved":0,"allocated":28164096,"data_stored":81662677,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:22:27 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.65900000000000003},"min":{"1min":0.50700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76100000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71299999999999997,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77400000000000002}]}]},{"osd":1,"up_from":78,"seq":335007449126,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66120,"kb_used_data":12352,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94305720,"statfs":{"total":96636764160,"available":96569057280,"internally_reserved":0,"allocated":12648448,"data_stored":91946689,"data_compressed":8727743,"data_compressed_allocated":11485184,"data_compressed_original":91402240,"omap_allocated":7169,"internal_metadata":55043071},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Apr 19 02:22:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.73999999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.71799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139604,"kb_used_data":28172,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94232236,"statfs":{"total":96636764160,"available":96493809664,"internally_reserved":0,"allocated":28848128,"data_stored":86285148,"data_compressed":6818487,"data_compressed_allocated":11358208,"data_compressed_original":69398528,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:22:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:23:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.623,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76900000000000002,"5min":0.81399999999999995,"15min":0.91900000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66700000000000004,"15min":0.69199999999999995},"min":{"1min":0.58199999999999996,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72899999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8033,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":85191116,"data_compressed":6810454,"data_compressed_allocated":11321344,"data_compressed_original":68825088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11509760,"data_stored":90852657,"data_compressed":8719710,"data_compressed_allocated":11448320,"data_compressed_original":90828800,"omap_allocated":5575,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27082752,"data_stored":81159013,"data_compressed":6477075,"data_compressed_allocated":10850304,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:23:34.192 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-19T02:23:34.544 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-19T02:23:34.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:23:34.843 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:23:34.843 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:16:24.477273+0000","modified":"2024-04-19T02:16:26.492157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4198":{"gid":4198,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/684726418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":684726418},{"type":"v1","addr":"172.21.15.73:6803","nonce":684726418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:23:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-19T02:23:34.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:23:35.158 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:23:35.158 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:16:24.477273+0000","modified":"2024-04-19T02:16:26.492157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4198":{"gid":4198,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/684726418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":684726418},{"type":"v1","addr":"172.21.15.73:6803","nonce":684726418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:23:35.158 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-19T02:23:35.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:23:35.470 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-19T02:23:35.470 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":117,"fsid":"30a6d986-f196-4d3c-8512-6c6489722f8f","created":"2024-04-19T02:16:03.364103+0000","modified":"2024-04-19T02:21:21.462529+0000","last_up_change":"2024-04-19T02:20:29.461222+0000","last_in_change":"2024-04-19T02:16:04.286795+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:16:14.248072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:16:18.602050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:16:22.904068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:16:23.465439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16c5fbec-2207-41d1-ae33-893b400fd3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":21424},{"type":"v1","addr":"172.21.15.116:6801","nonce":21424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":21424},{"type":"v1","addr":"172.21.15.116:6803","nonce":21424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":21424},{"type":"v1","addr":"172.21.15.116:6807","nonce":21424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":21424},{"type":"v1","addr":"172.21.15.116:6805","nonce":21424}]},"public_addr":"172.21.15.116:6801/21424","cluster_addr":"172.21.15.116:6803/21424","heartbeat_back_addr":"172.21.15.116:6807/21424","heartbeat_front_addr":"172.21.15.116:6805/21424","state":["exists","up"]},{"osd":1,"uuid":"3211257a-5bd5-4a10-8d5f-c3dae1d504e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":78,"up_thru":116,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1526},{"type":"v1","addr":"172.21.15.136:6801","nonce":1526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1526},{"type":"v1","addr":"172.21.15.136:6803","nonce":1526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1526},{"type":"v1","addr":"172.21.15.136:6807","nonce":1526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1526},{"type":"v1","addr":"172.21.15.136:6805","nonce":1526}]},"public_addr":"172.21.15.136:6801/1526","cluster_addr":"172.21.15.136:6803/1526","heartbeat_back_addr":"172.21.15.136:6807/1526","heartbeat_front_addr":"172.21.15.136:6805/1526","state":["exists","up"]},{"osd":2,"uuid":"1e00b5f3-ecbe-4e61-8016-6ad7a0ec0e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":21523},{"type":"v1","addr":"172.21.15.169:6801","nonce":21523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":21523},{"type":"v1","addr":"172.21.15.169:6803","nonce":21523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":21523},{"type":"v1","addr":"172.21.15.169:6807","nonce":21523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":21523},{"type":"v1","addr":"172.21.15.169:6805","nonce":21523}]},"public_addr":"172.21.15.169:6801/21523","cluster_addr":"172.21.15.169:6803/21523","heartbeat_back_addr":"172.21.15.169:6807/21523","heartbeat_front_addr":"172.21.15.169:6805/21523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.639275+0000","dead_epoch":30},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:16:09.581003+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1","osds":[2,0]},{"pgid":"4.3a","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:23:35.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-19T02:23:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-19T02:23:35.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-19T02:23:35.863 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-04-19T02:23:36.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-19T02:23:37.822 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-04-19T02:23:37.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-19T02:23:38.833 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-04-19T02:23:38.855 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-19T02:23:38.856 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-19T02:23:38.856 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:38.870 INFO:tasks.ceph.mds.a:Stopped 2024-04-19T02:23:38.870 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-19T02:23:38.871 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-19T02:23:38.871 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:38.956 INFO:tasks.ceph.osd.0:Stopped 2024-04-19T02:23:38.957 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-19T02:23:38.958 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:39.023 INFO:tasks.ceph.osd.1:Stopped 2024-04-19T02:23:39.023 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-19T02:23:39.024 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:39.118 INFO:tasks.ceph.osd.2:Stopped 2024-04-19T02:23:39.118 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-19T02:23:39.118 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-19T02:23:39.118 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:39.149 INFO:tasks.ceph.mgr.x:Stopped 2024-04-19T02:23:39.149 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-19T02:23:39.150 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:39.227 INFO:tasks.ceph.mgr.y:Stopped 2024-04-19T02:23:39.227 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-19T02:23:39.227 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-19T02:23:39.228 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:39.283 INFO:tasks.ceph.mon.a:Stopped 2024-04-19T02:23:39.283 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-19T02:23:39.283 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:39.347 INFO:tasks.ceph.mon.b:Stopped 2024-04-19T02:23:39.348 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-19T02:23:39.348 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:23:39.415 INFO:tasks.ceph.mon.c:Stopped 2024-04-19T02:23:39.416 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-19T02:23:39.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-19T02:23:39.475 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi116.front.sepia.ceph.com 2024-04-19T02:23:39.476 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-19T02:23:39.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:23:39.645 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-19T02:23:39.804 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-19T02:23:39.804 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-19T02:23:39.979 INFO:tasks.ceph:Archiving mon data... 2024-04-19T02:23:39.980 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/data/mon.a.tgz 2024-04-19T02:23:39.980 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-19T02:23:39.986 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.W9VL8gdY0t 2024-04-19T02:23:39.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.W9VL8gdY0t 2024-04-19T02:23:40.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.W9VL8gdY0t 2024-04-19T02:23:40.201 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.W9VL8gdY0t is 446KB 2024-04-19T02:23:40.262 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.W9VL8gdY0t 2024-04-19T02:23:40.267 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/data/mon.b.tgz 2024-04-19T02:23:40.268 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-19T02:23:40.317 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.14uwiAhsj5 2024-04-19T02:23:40.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.14uwiAhsj5 2024-04-19T02:23:40.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.14uwiAhsj5 2024-04-19T02:23:40.569 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.14uwiAhsj5 is 610KB 2024-04-19T02:23:40.630 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.14uwiAhsj5 2024-04-19T02:23:40.636 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/data/mon.c.tgz 2024-04-19T02:23:40.636 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-19T02:23:40.684 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.OVVXv0FOM2 2024-04-19T02:23:40.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.OVVXv0FOM2 2024-04-19T02:23:40.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.OVVXv0FOM2 2024-04-19T02:23:40.940 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.OVVXv0FOM2 is 610KB 2024-04-19T02:23:41.004 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.OVVXv0FOM2 2024-04-19T02:23:41.010 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-19T02:23:41.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:23:41.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:23:41.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:23:41.059 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:23:41.141 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-19T02:23:41.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:23:41.144 DEBUG:teuthology.orchestra.run.smithi116:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:23:41.147 DEBUG:teuthology.orchestra.run.smithi136:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:23:41.149 DEBUG:teuthology.orchestra.run.smithi169:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:23:41.171 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:23:41.173 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:23:41.186 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:23:41.240 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:23:41.245 INFO:tasks.ceph:Archiving crash dumps... 2024-04-19T02:23:41.247 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi073/crash 2024-04-19T02:23:41.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:23:41.262 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi116/crash 2024-04-19T02:23:41.263 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:23:41.276 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi136/crash 2024-04-19T02:23:41.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:23:41.307 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi169/crash 2024-04-19T02:23:41.308 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:23:41.320 INFO:tasks.ceph:Compressing logs... 2024-04-19T02:23:41.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:41.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:41.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:41.354 DEBUG:teuthology.orchestra.run.smithi169:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:47.639 INFO:tasks.ceph:Archiving logs... 2024-04-19T02:23:47.639 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi073/log 2024-04-19T02:23:47.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:47.990 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi116/log 2024-04-19T02:23:47.991 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:48.566 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi136/log 2024-04-19T02:23:48.567 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:48.696 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi169/log 2024-04-19T02:23:48.697 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:49.329 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-19T02:23:49.340 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-19T02:23:49.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:49.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:49.345 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:49.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:49.468 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-19T02:23:49.478 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-19T02:23:49.478 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:49.480 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:49.483 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:49.485 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:49.489 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:23:49.489 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-19T02:23:49.490 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 67.205.162.81 3 u 24 64 377 0.089 -1.766 0.863 2024-04-19T02:23:49.490 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 63.231.80.2 3 u 26 64 377 0.086 +0.187 0.780 2024-04-19T02:23:49.490 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 32 64 377 0.071 -1.474 0.655 2024-04-19T02:23:49.490 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-19T02:23:49.494 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:23:49.494 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-04-19T02:23:49.494 INFO:teuthology.orchestra.run.smithi116.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.073 -1.673 0.411 2024-04-19T02:23:49.494 INFO:teuthology.orchestra.run.smithi116.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 377 0.073 +0.377 0.427 2024-04-19T02:23:49.494 INFO:teuthology.orchestra.run.smithi116.stdout:*hv03.front.sepi 74.6.168.72 3 u 26 64 377 0.085 -0.573 0.724 2024-04-19T02:23:49.494 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-19T02:23:49.498 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:23:49.499 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-04-19T02:23:49.499 INFO:teuthology.orchestra.run.smithi169.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.095 -3.742 1.847 2024-04-19T02:23:49.499 INFO:teuthology.orchestra.run.smithi169.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.086 -2.391 2.472 2024-04-19T02:23:49.499 INFO:teuthology.orchestra.run.smithi169.stdout:*hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.087 -2.994 1.846 2024-04-19T02:23:49.499 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-19T02:23:49.518 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:23:49.518 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2024-04-19T02:23:49.518 INFO:teuthology.orchestra.run.smithi136.stdout: hv01.front.sepi 67.205.162.81 3 u 14 64 1 0.154 -2.110 0.000 2024-04-19T02:23:49.518 INFO:teuthology.orchestra.run.smithi136.stdout: hv02.front.sepi .STEP. 16 u 462 64 0 0.000 +0.000 0.000 2024-04-19T02:23:49.518 INFO:teuthology.orchestra.run.smithi136.stdout: hv03.front.sepi 74.6.168.72 3 u 13 64 1 0.102 -1.397 0.000 2024-04-19T02:23:49.518 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .STEP. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T02:23:49.519 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-19T02:23:49.531 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-19T02:23:49.531 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-19T02:23:49.563 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-19T02:23:49.606 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-19T02:23:49.648 INFO:teuthology.task.internal:Duration was 1061.348210 seconds 2024-04-19T02:23:49.648 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-19T02:23:49.689 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-19T02:23:49.689 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:49.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:49.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:49.696 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:49.734 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-19T02:23:49.735 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-04-19T02:23:49.735 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:49.780 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-04-19T02:23:49.781 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:49.790 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-04-19T02:23:49.791 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:49.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-04-19T02:23:49.801 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:49.811 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-19T02:23:49.812 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:49.829 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:49.836 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:49.846 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:49.960 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-19T02:23:49.960 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:49.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:49.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:49.968 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:50.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-19T02:23:50.074 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-19T02:23:50.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:50.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:50.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:50.116 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:50.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-19T02:23:50.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-04-19T02:23:50.157 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-04-19T02:23:50.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.182 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-04-19T02:23:50.183 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-04-19T02:23:50.207 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:50.212 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:50.223 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:50.252 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:50.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:50.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-19T02:23:50.268 INFO:teuthology.task.internal:Transferring archived files... 2024-04-19T02:23:50.268 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi073 2024-04-19T02:23:50.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:50.290 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi116 2024-04-19T02:23:50.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:50.314 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi136 2024-04-19T02:23:50.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:50.335 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662849/remote/smithi169 2024-04-19T02:23:50.336 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:50.357 INFO:teuthology.task.internal:Removing archive directory... 2024-04-19T02:23:50.357 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:50.360 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:50.362 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:50.377 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:50.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-19T02:23:50.417 INFO:teuthology.task.internal:Not uploading archives. 2024-04-19T02:23:50.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-19T02:23:50.450 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-19T02:23:50.450 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:50.453 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:50.455 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:50.456 INFO:teuthology.orchestra.run.smithi073.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:50.457 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:50.459 INFO:teuthology.orchestra.run.smithi116.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:50.461 INFO:teuthology.orchestra.run.smithi136.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:50.465 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-19T02:23:50.492 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-19T02:23:50.578 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1061.3482100963593 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-19T02:23:50.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T02:23:50.648 INFO:teuthology.run:pass